Home Page for the TeradataForum

Archives of the TeradataForum

Message Posted: Thu, 03 Feb 2005 @ 09:21:56 GMT

  <Prev Next>   <<First <Prev Next> Last>>  

Subj:   Re: Is Real-Time Data Loading Real?
From:   Victor Sokovin

  We have MQ Series to deliver messages to the warehouse with an expected rate of 20,000 per day... We are also looking into the Enterprise Services Bus to load data directly into the warehouse from all types of systems from old to new.  

We are doing similar volumes of messages with our real-time *operational* systems, not the DWH. The messages are in XML format. The load into the databases (multi-vendor environment) is done by the so called continuous flow graphs developed in Ab Initio. I guess it is similar to the ESB solution you mentioned but I am not sure what all this new marketing terminology means these days.

My impression is that this way of loading data is still in the pioneering phase, with all the fun and ramifications of it. However, from what I see I am quite confident that the solution is going to be scalable, fast and reliable. Once you have a few working interfaces, development of new once should be fast because the building blocks are recyclable.

The approach does require good teams in all related areas and a good communication between them. It is real-time, so problems, if any, must be solved quickly, at least with the operational systems.



  <Prev Next>   <<First <Prev Next> Last>>  
  Top Home Privacy Feedback  
Copyright for the TeradataForum (TDATA-L), Manta BlueSky    
Copyright 2016 - All Rights Reserved    
Last Modified: 15 Jun 2023