Archives of the TeradataForum
Message Posted: Tue, 14 Jun 2005 @ 14:41:34 GMT
Subj: | | Re: Moving huge data from UDB to Teradata |
|
From: | | Anomy Anom |
<-- Anonymously Posted: Tuesday, June 14, 2005 10:43 -->
| better to use OLE Load utility or Fastload | |
The OLE Load utility is a tool to simplify the setup of the load job (for example, it generates the scripts) that uses the OLE DB access
module. You still need a load utility like FastLoad to perform the load. An advantage over the FTP approach is that you don't need an
intermediate landing area for the data and the extract from UDB and load to Teradata can be done in parallel. If you need to do some transforms,
consider doing them in Teradata after the load so that you can use the power of the parallel nature inherent in your Teradata system in the
transformation process. There does not appear to be any limit to the volume of the data that can be handled by the OLE DB access module.
We've had good performance using this product, but if it does not meet your performance demands, you might consider dividing up the source data
into smaller jobs that could be run in parallel (ideally the Fastloads could be run on multiple load servers each with dedicated network
connections). Let us know what you end up doing and how it works out.
|