Archives of the TeradataForum
Message Posted: Fri, 03 Dec 2004 @ 09:44:49 GMT
| Subj: || || Re: Bad Characters |
| From: || || Victor Sokovin |
| ||I have some bad characters (Hex value 'A0') in my data. These characters look like spaces (hex value '20'), however, they aren't and they
are causing 2 values (which look identical) to hash differently.|| |
| ||My question is as follows: Why is Hex Value 'A0' allowed in a field defined as 'Character Set Latin'? Is their a way to prevent this
stuff from getting loaded via SQL?|| |
These characters might come from the Unicode data, if Unicode is involved somewhere in your data flow chain. The manual I happen to have
here at the moment suggests that the "A0" to "AC" range for the first byte of Unicode is reserved for future use (undefined area). The range is
between two areas called CJK Ideographs and Hangul Syllables.
If it is the Unicode to Latin conversion causing the problem, you probably know where to start zooming in at.