 |
 |
Archives of the TeradataForum
Message Posted: Thu, 03 Feb 2005 @ 09:21:56 GMT
| Subj: | | Re: Is Real-Time Data Loading Real? |
| |
| From: | | Victor Sokovin |
| | We have MQ Series to deliver messages to the warehouse with an expected rate of 20,000 per day... We are also looking into the Enterprise
Services Bus to load data directly into the warehouse from all types of systems from old to new. | |
We are doing similar volumes of messages with our real-time *operational* systems, not the DWH. The messages are in XML format. The load
into the databases (multi-vendor environment) is done by the so called continuous flow graphs developed in Ab Initio. I guess it is similar to the
ESB solution you mentioned but I am not sure what all this new marketing terminology means these days.
My impression is that this way of loading data is still in the pioneering phase, with all the fun and ramifications of it. However, from what I
see I am quite confident that the solution is going to be scalable, fast and reliable. Once you have a few working interfaces, development of new
once should be fast because the building blocks are recyclable.
The approach does require good teams in all related areas and a good communication between them. It is real-time, so problems, if any, must be
solved quickly, at least with the operational systems.
Regards,
Victor
| |
