Home Page for the TeradataForum
 
https:

Archives of the TeradataForum

Message Posted: Wed, 10 Aug 2016 @ 19:30:56 GMT


     
  <Prev Next>   <<First <Prev Next> Last>>  


Subj:   Re: ODBC throughput from Teradata to Microstrategy
 
From:   Johannes Vink

Hi Dave Ward (and others),

The EnableReadAhead option is indeed enabled (by default) and also explicitly enabled. Disabling EnableReadAhead resulted in 10%-20% slower throughput.

In the meantime we've installed Microstrategy 10.4 on Windows Server 2012 64 bit and are using the Windows Teradata odbc drivers 64 bit (shipped with the TTU 15.10.05 bundle). Througput for odbc was exactly the same: roughly 9.4 MB/s. Very very dissapointing that a different OS, newer reporting tool version and higher TTU version did not result in better performance.

Microstrategy 10.4 also supports TPT Fast export out of the box. We are still testing it, but we cannot get it higher then 12 MB/s, even with big datasets (20 million rows, 15 GB of flat file data). I hope that this is not normal for fast export...

Also on the new setup the traceroute between TD and the Windows server was checked: 1 hop, 1ms.

Tested is:

- Raised the blocksize to the maximum of 1048472 bytes (default was 64330). This increased the throughput from 10 MB/s to 12 MB/s). In-between values not yet tested.

- Tested multiple instances, but only the first instance is used and that 1 instance is tranferring the data to the reporting server. Maybe multiple instances will transfer faster, but as I understand the TPT logic a bit around instances you cannot force the usage of multiple instances

- 1 to 4 sessions did increase throughput somewhat, but 36 sessions did not (we've got only 72 amps on our 2700 2-node box)

- With encryption enabled the total throughput increased. Probably mainly due to the decryption effort on the reporting server. TPT log still shows 12 MB/s.

So with other words: every component has been upgraded, changed and or tested. Except the network. And an scp showed that 65 MB/s is possible. But still I see only one option left and that is our infrastructure people.


Met vriendelijke groeten,

Johannes Vink



     
  <Prev Next>   <<First <Prev Next> Last>>  
 
 
 
 
 
 
 
 
  
  Top Home Privacy Feedback  
 
 
Copyright for the TeradataForum (TDATA-L), Manta BlueSky    
Copyright 2016 - All Rights Reserved    
Last Modified: 24 Jul 2020