java - How to decompress lzo_deflate file? -
i used lzo compress reduce output. tried this: hadoop-lzo project of kevin weil , used lzocodec
class job:
textoutputformat.setoutputcompressorclass(job, lzocodec.class);
now compression works fine.
my problem compression result .lzo_deflate
file can't decompress.
lzop utility doesn't seem support type of file.
lzopcodec
supposed give .lzo
file, did not work, it's in th same package lzocodec
(org.apache.hadoop.io.compress
) may refer compatibility issue, since used old api (0.19) make compression works.
answers question suggest python solutions, need in java.
i'm using hadoop 1.1.2 , java 6.
.lzo_deflate
means lzo stream without usual header , trailer. need wrap raw .lzo_deflate
stream header , trailer expected lzop. or @ least header, , ignore errors missing trailer. you'll need @ header , trailer documentation.
the "deflate" in name odd choice, refers gzip analogy, raw compressed data format without gzip header , trailer called deflate.
Comments
Post a Comment