Archives of the TeradataForum

Message Posted: Thu, 03 Feb 2005 @ 13:25:57 GMT


	<Prev	Next>		<<First	<Prev	Next>	Last>>

Subj:		Re: Is Real-Time Data Loading Real?

From:		Coffing Christopher L

Vokes, Timothy J Wrote:

"What version of Teradata are you running, and what gen of hardware and number of nodes are you working with?"

We have a 36-node (8)5255 and (24)5350 combined system running V2R5.0.3.20

We are looking at the 5400 series systems in the near future.

David Wellman wrote:

"How 'real-time' is 'real-time' ? seconds, minutes ? "

Dave... Like all customers, "real-time" means it gets into the warehouse before it gets into the OLTP system. We keep telling people that time machines are for entertainment only...

The expectation is that we will subscribe to the Enterprise Services Bus (ESB) for incoming and outgoing data requirements. Some of our customers are requesting up to the second data feeds into the warehouse. I am challenging this request and attempting to educate our culture on the different value propositions between a database and a data warehouse. I am getting closer.

From: McCall, Glenn David

"How many tables need to be loaded from a single record?"

"Do you need to process them in any way (eg match up with other records, handle variant records etc)?"

"What format will the records be in (eg. XML, binary, text, CSV etc, so forth and so on)?"

"What other workload will be occurring during the load times (i.e. will the "Big T" be swamped with a gazillion DSS analysts writing complex multi-join queries? Worse, will these queries be running against the tables being loaded?)"

Glenn... I believe the initial request is to load 152 tables. How many from a single records??? Hmmm. I do not know.

As far as processing the data, I am sure there will be form of transformation but I do not know how complex just yet. They always come to me after the decisions have been made to ask how we can support the effort.

The format will be XML...

There will be all sorts of activity going on in the warehouse. Batch loads for sure... Users for sure and maybe even backups... Why not, we are doing everything else in the world... Teradata and do anything right???

Thanks for the replies...

Chris Coffing
Air Force Knowledge Services (AFKS)
Lead DBA Operations & Support
Teradata Certified Master


	<Prev	Next>		<<First	<Prev	Next>	Last>>

Attachments

Library

Quick Reference