Archives of the TeradataForum

Message Posted: Mon, 07 Feb 2005 @ 14:18:55 GMT

	<Prev	Next>		<<First	<Prev	Next>	Last>>

We have implemented a Windows scheduling solution called Data Warehouse Toolkit (DWT) which allows for the scheduling of time based loading streams (ie: 8:00AM every day) event based streams (When an event has been triggered) and FTP based streams (When a new file is available on a remote server).

DWT uses SQL server to hold all the stream step details and audit information as the data is loaded into Teradata. DWT can also use SQL Server DTS for pre-Processing of data (Limited usage)

There is a web interface to track the progress of the streams.

The DWT also provides for Metadata definition on all objects in the Teradata Warehouses.

The system has taken some time to complete but works well with Informix, SQL Server, Access, XML and GCOS datasources. The ETL developer UI and the scheduler are both written in Microsoft Access. Extensive use of Pass through and OLEDB streams made it perform very good.

We originally started with using SQL Server DTS streams but were unable to manage the FastLoad, MultiLoad steps properly, error tracking was difficult.

Having written our own we have the advantage of adding new features as needed. Next update will be an ability to call a Crystal Report from within the DWT stream.

John HR Schuster
Senior Consultant

	<Prev	Next>		<<First	<Prev	Next>	Last>>