News: 0001480321

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

LZ4 v1.10 Introduces Multi-Threading Support For Major Compression Speedups

([Free Software] 5 Hours Ago LZ4 Multi-Threading)


Yann Collet released LZ4 v1.10 today as a major update to this extremely fast compression algorithm. Most significant with LZ4 1.10 is adding multi-threaded compression support for much faster performance with today's modern multi-core processors.

LZ4 1.10 has been dubbed the "multi-cores edition" with this version adding multi-threading support to help speed-up compression now that modern I/O storage with NVMe is so much faster there's a real need to make compressing data even faster.

Benchmarks by Yann Collet show LZ4 1.10 with multi-threading being 5.4~8.0x faster with various data and across Intel / AMD / Apple processors on Windows / macOS / Linux. LZ4 compression with multi-threading on any modern CPUs should now be much, much faster than prior versions. LZ4 decompression can also be ~60%+ faster with overlapping decompression but not as important as the compression speed-ups.

LZ4 1.10 also promotes its dictionary compression from being "experimental" to a fully supported feature. There's also a new "Level 2" compression mode for LZ4, build system improvements, various CLI fixes, and a variety of other optimizations and code improvements.

Downloads and more details on this big LZ4 v1.10 update via [1]GitHub . I'll have out some new [2]LZ4 benchmarks soon across different processors in looking at the multi-threaded compression performance gains.



[1] https://github.com/lz4/lz4/releases/tag/v1.10.0

[2] https://openbenchmarking.org/test/pts/compress-lz4#results



scottishduck

Anux

skeevy420

Anux

skeevy420

bearoso

Anux

skeevy420

Mitch

Humor in the Court:
Q. Mrs. Jones, is your appearance this morning pursuant to a deposition
notice which I sent to your attorney?
A. No. This is how I dress when I go to work.