|
|
Archives of the TeradataForum
Message Posted: Mon, 29 Mar 2004 @ 15:35:34 GMT
Subj: | | Re: Teradata Peformance issues when loading data to Teradata using ETL tools like Informatica or Data Stage |
|
From: | | HARALAA |
Can you specify what versions of Informatica and the Oracle ODBC drivers are you using? There are at least two types of DataDirect drivers and
the Wire protocol is implementing the equivalent of direct (or bulk) Oracle load and is really very fast. Teradata ODBC does not have anything
similar and is inserting one row at the time. In my tests Teradata ODBC 3.02 ends up at best with a insert rate of a few hundred records/sec (Infa
Power Center 6.1) but normally is only 30-60 recs/sec. For better performance you can still use Infa and the same transformations that you have
mapped; however, configure a loader connections (MLoad, FastLoad or even Warehouse Builder in Infa 7.0) that you can feed either from landed flat
files (slower) or via pipe connection (much faster). For example with Infa 6.1 and Fastload via pipe we are getting 12-13K rows/sec. Of course the
fact that the current versions of TD utilities don't support load to tables with identity columns (we are on v2r5) does not help much for making
the combination of Teradata and Infa better :-(
Rgds,
Dr. Alex Haralampiev, M.Eng, CNA, OCP, TCP
Database Architect
Nationwide Financial
| |