hw-json-simd

SIMD-based JSON semi-indexer

https://github.com/haskell-works/hw-json-simd#readme

Version on this page:0.1.0.2
LTS Haskell 23.19:0.1.1.2@rev:1
Stackage Nightly 2025-04-30:0.1.1.2@rev:1
Latest on Hackage:0.1.1.2@rev:1

See all snapshots hw-json-simd appears in

BSD-3-Clause licensed by John Ky
Maintained by [email protected]
This version can be pinned in stack with:hw-json-simd-0.1.0.2@sha256:c9dcfd7a6a1cdc45857dd298189a4364c56df8e620d63fe2ed588b02c920e52d,4250

Module documentation for 0.1.0.2

Used by 2 packages in nightly-2019-08-07(full list with versions):
hw-json, hw-json-simd

hw-json-simd

This library/tool will generate semi-indexes on JSON files as per the paper: Semi-Indexing Semi-Structured Data in Tiny Space.

The command line tool

For a given JSON file, hw-json-simd will generate two semi-index files, which both together can be loaded into a single in-memory semi-index.

The semi-index files can be generated using two methods, which will be called standard and simple, which correspond to sections 4 and 5 of the Semi-Indexing Semi-Structured Data in Tiny Space paper respectively.

Navigation of the JSON text using the standard index is suppored by the hw-json project for more information. There is currently no support for navigation of the JSON text using the simple index.

Using on the command line

cat test.json | pv -t -e -b -a | time hw-json-simd create-index \
  -i /dev/stdin
  --output-ib-file test.json.ib.idx
  --output-bp-file test.json.bp.idx
  --method standard

cat test.json | pv -t -e -b -a | time hw-json-simd create-index \
  -i /dev/stdin
  --output-ib-file test.json.ib.idx
  --output-bp-file test.json.bp.idx
  --method simple

Installation

From hackage

cabal new-install hw-json-simd

Changes

Changelog for hw-json-simd

Unreleased changes