0 Replies Latest reply on Sep 28, 2002 10:15 PM by Sudhi

    High Speed Extraction and Loading in JBoss

    Sudhi Newbie

      I was wondering if there is something that could be done to extraction of bulk rows from the database.
      Here is a quick recap.

      I have datasources like SAP, Oracle, Sybase Siebel, flat files etc.,

      I shall use the JDBC impl from the vendors in case of DAtabase and JCA Impl. for all others.
      I am using JCA from JBoss.
      When I extract from database, I set a prefetch buffer to extract 1000 rows or (whatever is scalable and fast to extract). But here I still have to iterate through large number of ResultSet.
      I was wondering if we can set the rowsize and directly read data (Inputstream) which can be transfered in a temprovary buffer or something.
      Basically JCA or JDBC for High speed extraction and Loading. Sicne this is just reading data and mostly Batch transfers, Is there a way, I can disable Transactions (Local and XA). I really need speed and nothing else. I do not want to be really in transactions, since I dont have to rollback or commit in a source database.
      Any inputs or help ot suggestions would be appreciated.
      This is probably a chance, if we could come out with a special request to optimize JDBC/JCA for high speed Extraction and Loading. (Reading and Writing large resultsets as a stream (chunkof data) ).
      With respect to SAP, Siebel etc., I am not really concerned right now...