Home Page for the TeradataForum

Archives of the TeradataForum

Message Posted: Wed, 08 Aug 2007 @ 22:40:18 GMT

  <Prev Next>   <<First <Prev Next> Last>>  

Subj:   Re: Fastload + INS / SEL or MultiLoad
From:   Ureta, Cesar

Hi Anomy,

I try to use only Teradata Load tools for my ETL work for a number of reasons:

- Fastest possible load times.

- Log files are very important for determining the cause for an error.

- I try to stay away from stored procedures (try to find out what went wrong with a 500 line stored procedure, got me?).

- I think upsert is a must have.

- I prefer dealing with error tables than rejecting a whole load because of two dodgy rows.

- Don't want/like lengthy rollbacks or huge transient journals.

So most of my ETL looks like:

- FastLoad -> FastExport -> Named Pipe -> Multiload

- MultiLoad -> FastExport -> Named Pipe ->MultiLoad

- Combinations of BTEQ's and Tpumps

I do this because there is software that takes care of:

- Handling tool error recovery (it's not that hard one you get the hang of it).

- Converting error tables into readable format.

- All the tools use a NOTIFY routine. This allows making the whole process automated.

If you are starting from scratch there is a lot of work ahead of you (either approach you choose).


Cesar Ureta

  <Prev Next>   <<First <Prev Next> Last>>  
  Top Home Privacy Feedback  
Copyright for the TeradataForum (TDATA-L), Manta BlueSky    
Copyright 2016 - All Rights Reserved    
Last Modified: 28 Jun 2020