7 ms·
Yes, bzip3 compresses that 1GB text file into 170 MB while zstd needs 213 MB (SI units, from my own tests with the "enwik9" file of the GP's page, and the lates
by idoubtit 9d ago
Yes, bzip3 compresses that 1GB text file into 170 MB while zstd needs 213 MB (SI units, from my own tests with the "enwik9" file of the GP's page, and the latest releases of both programs, same commands). But the decompression (memory and speed) is a different story.
On my desktop, decompressing with zstd requires 128 MB and 1 s, while bzip3 uses 3.2 GB and 90 s.
Without `-b 511`, bzip3's ratio decreases and decompression requires about the same memory as zstd. But the decompression is still two orders of magnitude slower.
- abrookewood 9d agoThis should get more attention - those decompression requirements are a massive impost.
- account42 9d agoBzip2 has also always be a pig on decompression so I was fearing that this was the catch here as well. Might still be useful as an archival compression format even if it will be less useful for distribution.
- ahknight 7d agoFeels like it's the opposite of what it should be. It's fine to impose the world on the compression side, but decompression should be optimized for low-end devices. This is where deflate and zstd get it.