java - How to decompress lzo_deflate file? -
i used lzo compress reduce output. tried this: hadoop-lzo project of kevin weil , used lzocodec class job:
textoutputformat.setoutputcompressorclass(job, lzocodec.class); now compression works fine.
my problem compression result .lzo_deflate file can't decompress.
lzop utility doesn't seem support type of file.
lzopcodec supposed give .lzo file, did not work, it's in th same package lzocodec (org.apache.hadoop.io.compress) may refer compatibility issue, since used old api (0.19) make compression works.
answers question suggest python solutions, need in java.
i'm using hadoop 1.1.2 , java 6.
.lzo_deflate means lzo stream without usual header , trailer. need wrap raw .lzo_deflate stream header , trailer expected lzop. or @ least header, , ignore errors missing trailer. you'll need @ header , trailer documentation.
the "deflate" in name odd choice, refers gzip analogy, raw compressed data format without gzip header , trailer called deflate.
Comments
Post a Comment