lz4-frame-conduit

Conduit implementing the official LZ4 frame streaming format

https://github.com/nh2/lz4-frame-conduit#readme

Version on this page:0.1.0.0
LTS Haskell 22.17:0.1.0.1
Stackage Nightly 2023-12-26:0.1.0.1
Latest on Hackage:0.1.0.1

See all snapshots lz4-frame-conduit appears in

MIT licensed by Niklas Hambüchen
Maintained by [email protected]
This version can be pinned in stack with:lz4-frame-conduit-0.1.0.0@sha256:0248cfb62faf2f03a4e1f91d78105c5d434b6b2bd9f57198d31a2d6179b73336,2989

Module documentation for 0.1.0.0

Used by 1 package in nightly-2020-08-31(full list with versions):
lz4-frame-conduit

lz4-frame-conduit

Haskell Conduit implementing the official LZ4 frame streaming format.

Rationale and comparison to non-lz4-compatible libraries

There exist two lz4 formats:

  1. the block format, limited to compressing data < 2 GB
  2. the frame format, suitable for streaming arbitrarily sized data ** This is what the lz4 command line utility uses

This library implements the frame format.

Some existing Haskell libraries implement only the block format, and are thus not suitable to compress data > 2 GB in a way. (Of course they could chunk the output in some arbitrary way, but that wouldn’t be compatible with the lz4 command line utility.) The libraries that belong to this category at time of writing are: