Home Page for the TeradataForum
 

Archives of the TeradataForum

Message Posted: Mon, 29 Mar 2004 @ 15:35:34 GMT


     
  <Prev Next>   <<First <Prev Next> Last>>  


Subj:   Re: Teradata Peformance issues when loading data to Teradata using ETL tools like Informatica or Data Stage
 
From:   HARALAA

Can you specify what versions of Informatica and the Oracle ODBC drivers are you using? There are at least two types of DataDirect drivers and the Wire protocol is implementing the equivalent of direct (or bulk) Oracle load and is really very fast. Teradata ODBC does not have anything similar and is inserting one row at the time. In my tests Teradata ODBC 3.02 ends up at best with a insert rate of a few hundred records/sec (Infa Power Center 6.1) but normally is only 30-60 recs/sec. For better performance you can still use Infa and the same transformations that you have mapped; however, configure a loader connections (MLoad, FastLoad or even Warehouse Builder in Infa 7.0) that you can feed either from landed flat files (slower) or via pipe connection (much faster). For example with Infa 6.1 and Fastload via pipe we are getting 12-13K rows/sec. Of course the fact that the current versions of TD utilities don't support load to tables with identity columns (we are on v2r5) does not help much for making the combination of Teradata and Infa better :-(


Rgds,

Dr. Alex Haralampiev, M.Eng, CNA, OCP, TCP
Database Architect
Nationwide Financial



     
  <Prev Next>   <<First <Prev Next> Last>>  
 
 
 
 
 
 
 
 
  
  Top Home Privacy Feedback  
 
 
Copyright for the TeradataForum (TDATA-L), Manta BlueSky    
Copyright 2016 - All Rights Reserved    
Last Modified: 15 Jun 2023