[BBLISA] Compression Algorithms

[Edward Ned Harvey]

I decided to benchmark some compression algorithms on our actual data.
Results are attached.

 

Summary:

.         LZO is the fastest.

.         7-zip (p7zip) produces the best compression ratio.  (Overall, it's
the most impressive.)  Doesn't seem possible to use it as an in-line filter.

.         gzip --fast is the most widely available.  Its speed is same order
of magnitude with LZO, and its compression is same order of magnitude as
7-zip, but it's unquestionably beat by those others, in their natural
habitat.  So for general purpose, gzip --fast is the most likely to be used
in general.

.         bzip2 is soundly destroyed by 7-zip, if only 7-zip is made
available as an in-line filter.  Presently, in-line filtering is the only
reason to ever use bzip2 instead of 7-zip.

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://www.bblisa.org/pipermail/bblisa/attachments/20100629/92bb33ab/attachment.htm 
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: compression benchmarks.txt
Url: http://www.bblisa.org/pipermail/bblisa/attachments/20100629/92bb33ab/attachment.txt