Haskell Conduit implementing the official LZ4 frame streaming format.
Rationale and comparison to non-
There exist two
- the block format, limited to compressing data < 2 GB
- the frame format, suitable for streaming arbitrarily sized data
** This is what the
lz4command line utility uses
This library implements the frame format.
Some existing Haskell libraries implement only the block format, and are thus not suitable to compress data > 2 GB in a way.
(Of course they could chunk the output in some arbitrary way, but that wouldn’t be compatible with the
lz4 command line utility.)
The libraries that belong to this category at time of writing are: