Archives of the TeradataForum
Message Posted: Tue, 07 Jun 2005 @ 14:09:24 GMT
| Subj: | | Re: Moving huge data from UDB to Teradata |
| |
| From: | | Victor Sokovin |
| | Our company is in the process of moving a huge amount of data (8-9TB) from a UDB server to Teradata. We are analyzing different approaches
to complete this. A couple of options are to use an ETL tool to pull datafrom the source and load directly to the target. Other is to FTP data
from the source and then load. | |
It's like comparing, say, mango and potatoes. If the job can be done by mere FTP why bother about the ETL tool? Such a tool would be of help if
you need to apply complex transformations to the data before loading it into the target DB, especially if you have to regularly repeat the
operation.
| | Is there anyone who has prior experience with such a situation ?. Any advice ?. Would it be a better option to load using the ETL
tool as opposed to FTPing the data ?. Any pitfalls ?. | |
No pitfalls really. The data my get corrupted, whether you use FTP or a fancy tool so it might make sense to calculate the checksums before and
after the transfer.
| | What sort of performance shoudl we expect using both these methods ?. | |
Not sure about the performance. It will depend on you hard- and software, network capacity etc.
| | Is it better to use OLE Load utility or Fastload ?. | |
I never use the former so I cannot really compare but I would say with the volumes you mentioned I would rather stick with utilities like
FastLoad, MultiLoad and TPump.
Regards,
Victor
| 
