Archives of the TeradataForum
Message Posted: Thu, 17 Dec 2009 @ 21:59:58 GMT
Subj: | | Re: Retrieve large dataset from Teradata |
|
From: | | Dempsey, Mike |
The Teradata .Net Data Provider seems to be quite fast in my tests. (Version 13.01)
Don't use a DataSet - use a sequential DataReader instead. This is the fastest way to retreive data in a .Net application.
FastExport will create a file on your system which you can then read and load to the other database.
If you use .Net provider directly from within your app however you may be able to use some kind of queue to avoid that I/O. (However if you are
talking very large volumns the load side of the queue may not be able to keep up with the Teradata extract. A DataReader is many times faster than
any Insert method so you would require many threads reading the queue that is created by that single read thread.)
Mike Dempsey
Teradata Client Tools
|