curl-runnings

A framework for declaratively writing curl based API tests

https://github.com/aviaviavi/curl-runnings#readme

Version on this page:0.6.0
LTS Haskell 21.25:0.17.0
Stackage Nightly 2023-06-21:0.17.0
Latest on Hackage:0.17.0

See all snapshots curl-runnings appears in

MIT licensed by Avi Press
Maintained by [email protected]
This version can be pinned in stack with:curl-runnings-0.6.0@sha256:fe2fcf1c04dfd20a93f955e2c6451843a0298700c2cc11acedac843eca74c6f2,2326

curl-runnings

Build Status

Feel the rhythm! Feel the rhyme! Get on up, it’s testing time! curl-runnings!

curl-runnings is a framework for writing declarative, curl based tests for your APIs. Write your tests quickly and correctly with a straight-forward specification in yaml or json that can encode simple but powerful matchers against responses.

Alternatively, you can use the curl-runnings library to write your tests in Haskell (though a haskell setup is absolutely not required to use this tool).

Why?

When writing curl based smoke/integration tests for APIs using bash and curl is very convenient, but quickly becomes hard to maintain. Writing matchers for json output quickly becomes unweildy and error prone. Writing these sorts of tests in a more traditional programming language is fine, but certainly more time consuming to write than some simple curl requests. curl-runnings aims to make it very easy to write tests that just hit some endpoints and verify the output looks sane.

Now you can write your tests just as data in a yaml or json file, and curl-runnings will take care of the rest!

While yaml/json is the current way to write curl-runnings tests, this project is being built in a way that should lend itself well to an embedded domain specific language, which is a future goal for the project. curl-runnings specs in Dhall is also being developed and may fufill the same needs.

Installing

There are few options to install:

  • download the releases from the github releases page
  • install the binary with stack or cabal
  • build from source with stack

Writing a test specification

Write your tests specs in a yaml or json file. See /examples to get started. A test spec is a top level array of test cases, each item represents a single curl and set of assertions about the response.

Running

Once you’ve written a spec, simply run it with:

bash $ curl-runnings -f path/to/your/spec.yaml

If all your tests pass, curl-runnings will cleanly exit with a 0 code. A code of 1 will be returned if any tests failed.

For more info:

bash $ curl-runnings --help

Contributing

Curl-runnings is totally usable now but is also being actively developed. Contributions in any form are welcome and encouraged. Don’t be shy! :D

Roadmap

  • [x] Json specifications for tests
  • [x] Yaml specifications for tests
  • [ ] Dhall specifications for tests
  • [ ] More specification features
    • [x] Reference values from previous json responses in matchers
    • [x] Environment variable interpolation
    • [ ] Call out to arbitrary shell commands in and between test cases
    • [ ] Timeouts
    • [ ] Support for non-json content type
    • [ ] Retry logic
  • [ ] A DSL for writing test specs