amqp-utils

Generic Haskell AMQP tools

Version on this page:0.4.4.0
LTS Haskell 22.14:0.6.4.0
Stackage Nightly 2023-12-26:0.6.4.0
Latest on Hackage:0.6.4.0

See all snapshots amqp-utils appears in

GPL-3.0-only licensed by Frank Doepper
Maintained by [email protected]
This version can be pinned in stack with:amqp-utils-0.4.4.0@sha256:064a15b05da66406032ed8d0c32cf989de3a42549ff3105604c3d192045c5fa2,4382

Module documentation for 0.4.4.0

There are no documented modules for this package.

haskell-amqp-utils

generic Haskell AMQP commandline tools for use with RabbitMQ

Repository access

Overview

The package contains 4 binaries for commandline use.

  • konsum, a generic consumer
  • agitprop, a generic publisher
  • arbeite, an rpc server
  • plane, an rpc client

konsum

usage

konsum [options]

Options:
  -r BINDINGKEY  --bindingkey=BINDINGKEY          AMQP binding key (default: #)
  -X[EXE]        --execute[=EXE]                  Callback Script File (implies -t) (-X without arg: /usr/lib/haskell-amqp-utils/callback)
  -a ARG         --args=ARG                       additional argument for -X callback
  -t[DIR]        --tempdir[=DIR], --target[=DIR]  tempdir (default: no file creation, -t without arg: /tmp)
  -f INT         --prefetch=INT                   Prefetch count. (0=unlimited, 1=off, default: 1)
  -A             --ack                            Toggle ack messages (default: True)
  -R             --requeuenack                    Toggle requeue when rejected (default: True)
  -l INT         --charlimit=INT                  limit number of shown body chars (default: unlimited)
  -q QUEUENAME   --queue=QUEUENAME                Ignore Exchange and bind to existing Queue
  -i             --simple                         call callback with one arg (filename) only
  -j             --cleanup                        Toggle remove tempfile after script call. Default False, but default True if --simple (-i)
  -Q TEMPQNAME   --qname=TEMPQNAME                Name for temporary exclusive Queue
  -x EXCHANGE    --exchange=EXCHANGE              AMQP Exchange (default: "")
  -o SERVER      --server=SERVER                  AMQP Server (default: localhost)
  -y VHOST       --vhost=VHOST                    AMQP Virtual Host (default: /)
  -p PORT        --port=PORT                      Server Port Number (default: 5672)
  -T             --tls                            Toggle TLS (default: False)
  -c CERTFILE    --cert=CERTFILE                  TLS Client Certificate File
  -k KEYFILE     --key=KEYFILE                    TLS Client Private Key File
  -U USERNAME    --user=USERNAME                  Username for Auth
  -P PASSWORD    --pass=PASSWORD                  Password for Auth
  -s INT         --heartbeats=INT                 heartbeat interval (0=disable, default: set by server)
  -n NAME        --name=NAME                      connection name, will be shown in RabbitMQ web interface
  -w SECONDS     --connect_timeout=SECONDS        timeout for establishing initial connection (default: 60)

examples

connect to localhost with default credentials and attach to a new temp queue on the default exchange (which will usually fail because attaching a queue to the default exchange is not allowed):

konsum

Connect to a host with TLS on a custom port, authenticating with SSL client certificate. On every received message a callback is spawned. The message will be ACKed when the callback exits successfully. First 500 bytes of the message body are printed to stderr. Header infos are always printed to stderr:

konsum -o amqp.example.com -p 5673 -T -k amqp-key.pem -c amqp-crt.pem -y vhost -x exchange -X./callback.sh -a -c -a callback.config.sh -f 2 -r routing.key.# -l 500

Authenticate with user and pass. Attach to an existing queue. Generate a file for every message:

konsum -o amqp.example.com -U user -P pass -q queue -t

Provide a custom CA cert for proving the server’s identity via enviroment:

$ env SYSTEM_CERTIFICATE_PATH=/etc/amqp/cacert.crt konsum -T -y vhost -x exchange

Stop with ^C

agitprop

usage

agitprop [options]

Options:
  -r ROUTINGKEY    --routingkey=ROUTINGKEY            AMQP routing key
  -f INPUTFILE     --inputfile=INPUTFILE              Message input file (default: -)
  -l               --linemode                         Toggle line-by-line mode (default: False)
  -C               --confirm                          Toggle confirms (default: False)
                   --msgid=ID                         Message ID
                   --type=TYPE                        Message Type
                   --userid=USERID                    Message User-ID
                   --appid=APPID                      Message App-ID
                   --clusterid=CLUSTERID              Message Cluster-ID
                   --contenttype=CONTENTTYPE          Message Content-Type
                   --contentencoding=CONTENTENCODING  Message Content-Encoding
                   --replyto=REPLYTO                  Message Reply-To
                   --prio=PRIO                        Message Priority
                   --corrid=CORRID                    Message CorrelationID
                   --exp=EXP                          Message Expiration
  -h HEADER=VALUE  --header=HEADER=VALUE              Message Headers
  -F HEADERNAME    --fnheader=HEADERNAME              Put filename into this header
  -S SUFFIX        --suffix=SUFFIX                    Allowed file suffixes in hotfolder mode
  -m               --magic                            Toggle setting content-type and -encoding from file contents (default: False)
  -e               --persistent                       Set persistent delivery
  -E               --nonpersistent                    Set nonpersistent delivery
  -x EXCHANGE      --exchange=EXCHANGE                AMQP Exchange (default: "")
  -o SERVER        --server=SERVER                    AMQP Server (default: localhost)
  -y VHOST         --vhost=VHOST                      AMQP Virtual Host (default: /)
  -p PORT          --port=PORT                        Server Port Number (default: 5672)
  -T               --tls                              Toggle TLS (default: False)
  -c CERTFILE      --cert=CERTFILE                    TLS Client Certificate File
  -k KEYFILE       --key=KEYFILE                      TLS Client Private Key File
  -U USERNAME      --user=USERNAME                    Username for Auth
  -P PASSWORD      --pass=PASSWORD                    Password for Auth
  -s INT           --heartbeats=INT                   heartbeat interval (0=disable, default: set by server)
  -n NAME          --name=NAME                        connection name, will be shown in RabbitMQ web interface
  -w SECONDS       --connect_timeout=SECONDS          timeout for establishing initial connection (default: 60)

If INPUTFILE is a file, the file is sent as a message and the program exits. If INPUTFILE is a directory, the directory is watched via inotify and every file, which is written and closed or moved in gets sent, optionally only files which match one or several SUFFIXes. Optionally the file name is written into a message header named HEADERNAME. Optionally Content-Type and Content-Encoding headers are set via magic retrieved from file contents.

Line-by-line mode sends one message per INPUTFILE line.

examples

Send a message containing a file and put the filename into a fileName message header:

agitprop -x amq.topic -r test -F fileName -f agitprop.hs

plane

usage

plane [options]

Options:
  -f INPUTFILE     --inputfile=INPUTFILE      Message input file (default: -)
  -O OUTPUTFILE    --outputfile=OUTPUTFILE    Message output file (default: -)
  -t SECONDS       --rpc_timeout=SECONDS      How long to wait for reply (default: 5.0)
                   --corrid=CORRID            Message CorrelationID
                   --exp=EXP                  Message Expiration
  -h HEADER=VALUE  --header=HEADER=VALUE      Message Headers
  -l INT           --charlimit=INT            limit number of shown body chars (default: unlimited)
  -Q TEMPQNAME     --qname=TEMPQNAME          Name for temporary exclusive Queue
  -x EXCHANGE      --exchange=EXCHANGE        AMQP Exchange (default: "")
  -o SERVER        --server=SERVER            AMQP Server (default: localhost)
  -y VHOST         --vhost=VHOST              AMQP Virtual Host (default: /)
  -p PORT          --port=PORT                Server Port Number (default: 5672)
  -T               --tls                      Toggle TLS (default: False)
  -c CERTFILE      --cert=CERTFILE            TLS Client Certificate File
  -k KEYFILE       --key=KEYFILE              TLS Client Private Key File
  -U USERNAME      --user=USERNAME            Username for Auth
  -P PASSWORD      --pass=PASSWORD            Password for Auth
  -s INT           --heartbeats=INT           heartbeat interval (0=disable, default: set by server)
  -n NAME          --name=NAME                connection name, will be shown in RabbitMQ web interface
  -w SECONDS       --connect_timeout=SECONDS  timeout for establishing initial connection (default: 60)

examples

send “ls” to a remote worker and get the result:

echo ls | plane -o amqp.example.com -T -k amqp.pem -c amqp.pem -y myexchange -Q rpctest

arbeite

usage

arbeite [options]

Options:
  -X[EXE]       --execute[=EXE]                  Callback Script File (implies -t) (-X without arg: /usr/lib/haskell-amqp-utils/callback)
  -a ARG        --args=ARG                       additional argument for -X callback
  -t[DIR]       --tempdir[=DIR], --target[=DIR]  tempdir (default: no file creation, -t without arg: /tmp)
  -A            --ack                            Toggle ack messages (default: True)
  -R            --requeuenack                    Toggle requeue when rejected (default: True)
  -l INT        --charlimit=INT                  limit number of shown body chars (default: unlimited)
  -q QUEUENAME  --queue=QUEUENAME                Ignore Exchange and bind to existing Queue
  -i            --simple                         call callback with one arg (filename) only
  -j            --cleanup                        Toggle remove tempfile after script call. Default False, but default True if --simple (-i)
  -Q TEMPQNAME  --qname=TEMPQNAME                Name for temporary exclusive Queue
  -x EXCHANGE   --exchange=EXCHANGE              AMQP Exchange (default: "")
  -o SERVER     --server=SERVER                  AMQP Server (default: localhost)
  -y VHOST      --vhost=VHOST                    AMQP Virtual Host (default: /)
  -p PORT       --port=PORT                      Server Port Number (default: 5672)
  -T            --tls                            Toggle TLS (default: False)
  -c CERTFILE   --cert=CERTFILE                  TLS Client Certificate File
  -k KEYFILE    --key=KEYFILE                    TLS Client Private Key File
  -U USERNAME   --user=USERNAME                  Username for Auth
  -P PASSWORD   --pass=PASSWORD                  Password for Auth
  -s INT        --heartbeats=INT                 heartbeat interval (0=disable, default: set by server)
  -n NAME       --name=NAME                      connection name, will be shown in RabbitMQ web interface
  -w SECONDS    --connect_timeout=SECONDS        timeout for establishing initial connection (default: 60)

examples

provide shell access to a remote user. Very insecure! :-)

arbeite -o amqp.example.com -T -k amqp.pem -c amqp.pem -y myexchange -Q rpctest -i -Xsh

Changes

Revision history for haskell-amqp-utils

0.4.4.0 – 2020-02-18

  • push callback options into environment variables

0.4.3.0 – 2020-02-10

  • specify -R YES option for callback in case of a redelivered message

0.4.2.0 – 2019-12-19

  • introduce –cleanup (-j) to remove temp file
  • change temp file name from konsum-* to amqp-utils-*
  • handle all numeric types in amqp headers same
  • update to amqp-0.19
  • use utf8-string for header string values

0.4.1.0 – 2019-12-09

  • printparam -> Flexprint
  • introduce –simple / -i
  • review data types
  • reformat with hindent
  • update doc

0.4.0.1 – 2019-12-04

  • fix exit codes

0.4.0.0 – 2019-11-11

  • agitprop: show exchange arg
  • agitprop does not need -q or -Q
  • allow RPC with dedicated exchange
  • add missing hFlush
  • stdin / stdout handling without using /dev/
  • cleanup plane answer file handling
  • duplicate plane body to outfile and stderr

0.3.7.1 – 2019-09-10

  • connect timeout

0.3.6.0 – 2019-02-15

  • bug-fix: avoid deadlock in arbeite
  • plane: add –header option
  • rpc: log to stderr, result to stdout

0.3.4.0 – 2018-07-21

  • bug fix: re-add exception handler
  • plane + arbeite: rpc client + server

0.3.3.1 – 2018-07-10

  • fix debian builds
  • konsum options ack and requeuenack
  • fix hotfolder mode
  • enable parallel build
  • tls, hinotify, lts-12.0 compat

0.3.2.0 – 2018-07-04

  • agitprop, a publisher
  • optional publisher confirms
  • hotfolder mode, file magic
  • several options

0.3.0.2 – 2018-04-24

  • use ciphersuite_default

0.3.0.1 – 2018-03-04

  • don’t let the thread sleep too long

0.3.0.0 – 2017-11-21

  • add nix with amqp_0_18_1
  • multiple bindings per queue
  • remove cool smart special options

0.2.2.0 – 2017-11-20

  • option -Q (set queue name for temporary exclusive queue)

0.2.1.5 – 2017-09-25

  • travis
  • debian
  • repair debian jessie
  • callback: pass-through timestamp, ignore non-existing sha
  • reduce load
  • amqp 0.17, use coName

0.2.1.4 – 2017-06-01

  • First version. Released on an unsuspecting world.