Hive reads file incorrectly -
i have created external hive table pipe delimiters. columns of type strings. 1 of values in file paragraph of text. cannot understand why hive terminates text , puts in next column when there isn't pipe there. there lots of consecutive whitespaces in paragraph. problem when hive tries read file. example text is:
'...sata hooper size \= 6000...'.
hive puts part till sata in columna , next part in columnb. repeats think whenver whitespaces long. clue why , how work around problem? if there lots of consecutive whitespaces, hive thinks string has ended?
i once had similar problem becaus of invisible character.
1.download data local.
2.either should have pipe delimiter or have new line character there .
to confirm that,open file in vi , check (invisible) characters.
Comments
Post a Comment