The only viable compression library, for internal use, is Zstandard https://python-zstandard.readthedocs.io/en/latest/ https://python-zstandard.readthedocs.io/

The only viable compression library, for internal use, is Zstandard https://python-zstandard.readthedocs.io/en/latest/ https://python-zstandard.readthedocs.io/en/latest/ https://engineering.fb.com/2016/08/31/core-data/smaller-and-faster-data-compression-with-zstandard/ https://engineering.fb.com/2016/08/31/core-data/smaller-and-... The compression ratio and decompression speed just blow everything else away.