polysemy
Higher-order, low-boilerplate free monads.
https://github.com/polysemy-research/polysemy#readme
| LTS Haskell 24.16: | 1.9.2.0@rev:5 |
| Stackage Nightly 2025-10-24: | 1.9.2.0@rev:5 |
| Latest on Hackage: | 1.9.2.0@rev:5 |
polysemy-1.9.2.0@sha256:ea86eaea1bcc425071b87c4a9d5dc071ee603a2901bd4e71b72fcfda4e1c9bd2,4863Module documentation for 1.9.2.0
- Polysemy
- Polysemy.Async
- Polysemy.AtomicState
- Polysemy.Bundle
- Polysemy.Embed
- Polysemy.Error
- Polysemy.Fail
- Polysemy.Final
- Polysemy.Fixpoint
- Polysemy.IO
- Polysemy.Input
- Polysemy.Internal
- Polysemy.Internal.Bundle
- Polysemy.Internal.Combinators
- Polysemy.Internal.CustomErrors
- Polysemy.Internal.Fixpoint
- Polysemy.Internal.Index
- Polysemy.Internal.Kind
- Polysemy.Internal.NonDet
- Polysemy.Internal.Scoped
- Polysemy.Internal.Sing
- Polysemy.Internal.Strategy
- Polysemy.Internal.TH
- Polysemy.Internal.Tactics
- Polysemy.Internal.Union
- Polysemy.Internal.Writer
- Polysemy.Membership
- Polysemy.NonDet
- Polysemy.Opaque
- Polysemy.Output
- Polysemy.Reader
- Polysemy.Resource
- Polysemy.Scoped
- Polysemy.State
- Polysemy.Tagged
- Polysemy.Trace
- Polysemy.Writer
polysemy
Overview
polysemy is a library for writing high-power, low-boilerplate domain specific
languages. It allows you to separate your business logic from your
implementation details. And in doing so, polysemy lets you turn your
implementation code into reusable library code.
It’s like mtl but composes better, requires less boilerplate, and avoids the
O(n^2) instances problem.
It’s like freer-simple but more powerful.
It’s like fused-effects but with an order of magnitude less boilerplate.
Additionally, unlike mtl, polysemy has no functional dependencies, so you
can use multiple copies of the same effect. This alleviates the need for ~~ugly
hacks~~ band-aids like
classy lenses,
the
ReaderT pattern
and nicely solves the
trouble with typed errors.
Concerned about type inference? polysemy comes with its companion
polysemy-plugin,
which helps it perform just as well as mtl‘s! Add polysemy-plugin to your
package.yaml or .cabal file’s dependencies section to use. Then turn it on with a pragma in your source files:
{-# OPTIONS_GHC -fplugin=Polysemy.Plugin #-}
Or by adding -fplugin=Polysemy.Plugin to your package.yaml/.cabal file ghc-options section.
Features
- Effects are higher-order, meaning it’s trivial to write
bracketandlocalas first-class effects. - Effects are low-boilerplate, meaning you can create new effects in a single-digit number of lines. New interpreters are nothing but functions and pattern matching.
Tutorials and Resources
- Raghu Kaippully wrote a beginner friendly tutorial.
- Sandy Maguire, the author, wrote a post about Porting to Polysemy from transformers/MTL-style monads.
- Paweł Szulc gave a great talk on how to start thinking about polysemy.
- Sandy Maguire gave a talk on some of the performance implementation
- He has also written some blog posts on other implementation details.
Examples
Make sure you read the Necessary Language Extensions before trying these yourself!
Teletype effect:
{-# LANGUAGE TemplateHaskell, LambdaCase, BlockArguments, GADTs
, FlexibleContexts, TypeOperators, DataKinds, PolyKinds, ScopedTypeVariables #-}
import Polysemy
import Polysemy.Input
import Polysemy.Output
data Teletype m a where
ReadTTY :: Teletype m String
WriteTTY :: String -> Teletype m ()
makeSem ''Teletype
teletypeToIO :: Member (Embed IO) r => Sem (Teletype ': r) a -> Sem r a
teletypeToIO = interpret \case
ReadTTY -> embed getLine
WriteTTY msg -> embed $ putStrLn msg
runTeletypePure :: [String] -> Sem (Teletype ': r) a -> Sem r ([String], a)
runTeletypePure i
-- For each WriteTTY in our program, consume an output by appending it to the
-- list in a ([String], a)
= runOutputMonoid pure
-- Treat each element of our list of strings as a line of input
. runInputList i
-- Reinterpret our effect in terms of Input and Output
. reinterpret2 \case
ReadTTY -> maybe "" id <$> input
WriteTTY msg -> output msg
echo :: Member Teletype r => Sem r ()
echo = do
i <- readTTY
case i of
"" -> pure ()
_ -> writeTTY i >> echo
-- Let's pretend
echoPure :: [String] -> Sem '[] ([String], ())
echoPure = flip runTeletypePure echo
pureOutput :: [String] -> [String]
pureOutput = fst . run . echoPure
-- echo forever
main :: IO ()
main = runM . teletypeToIO $ echo
Resource effect:
{-# LANGUAGE TemplateHaskell, LambdaCase, BlockArguments, GADTs
, FlexibleContexts, TypeOperators, DataKinds, PolyKinds
, TypeApplications #-}
import Polysemy
import Polysemy.Input
import Polysemy.Output
import Polysemy.Error
import Polysemy.Resource
-- Using Teletype effect from above
data CustomException = ThisException | ThatException deriving Show
program :: Members '[Resource, Teletype, Error CustomException] r => Sem r ()
program = catch @CustomException work \e -> writeTTY $ "Caught " ++ show e
where
work = bracket (readTTY) (const $ writeTTY "exiting bracket") \input -> do
writeTTY "entering bracket"
case input of
"explode" -> throw ThisException
"weird stuff" -> writeTTY input *> throw ThatException
_ -> writeTTY input *> writeTTY "no exceptions"
main :: IO (Either CustomException ())
main
= runFinal
. embedToFinal @IO
. resourceToIOFinal
. errorToIOFinal @CustomException
. teletypeToIO
$ program
Easy.
Friendly Error Messages
Free monad libraries aren’t well known for their ease-of-use. But following in
the shoes of freer-simple, polysemy takes a serious stance on providing
helpful error messages.
For example, the library exposes both the interpret and interpretH
combinators. If you use the wrong one, the library’s got your back:
runResource
:: forall r a
. Sem (Resource ': r) a
-> Sem r a
runResource = interpret $ \case
...
makes the helpful suggestion:
• 'Resource' is higher-order, but 'interpret' can help only
with first-order effects.
Fix:
use 'interpretH' instead.
• In the expression:
interpret
$ \case
Necessary Language Extensions
You’re going to want to stick all of this into your package.yaml file.
ghc-options: -O2 -flate-specialise -fspecialise-aggressively
default-extensions:
- DataKinds
- FlexibleContexts
- GADTs
- LambdaCase
- PolyKinds
- RankNTypes
- ScopedTypeVariables
- TypeApplications
- TypeOperators
- TypeFamilies
Building with Nix
The project provides a basic nix config for building in development.
It is defined as a flake with backwards compatibility stubs in default.nix and shell.nix.
To build the main library or plugin:
nix-build -A polysemy
nix-build -A polysemy-plugin
Flake version:
nix build
nix build '.#polysemy-plugin'
To inspect a dependency:
nix repl
> p = import ./.
> p.unagi-chan
To run a shell command with all dependencies in the environment:
nix-shell --pure
nix-shell --pure --run 'cabal v2-haddock polysemy'
nix-shell --pure --run ghcid
Flake version:
nix develop -i # just enter a shell
nix develop -i -c cabal v2-haddock polysemy
nix develop -i -c haskell-language-server-wrapper # start HLS for your IDE
What about performance? (TL;DR)
Previous versions of this README mentioned the library being
zero-cost, as in having no visible effect on performance. While this was
the original motivation and main factor in implementation of this library, it
turned out that
optimizations we depend on,
while showing amazing results in small benchmarks, don’t work in
bigger, multi-module programs,
what greatly limits their usefulness.
What’s more interesting though is that
this isn’t a polysemy-specific problem - basically all popular effects
libraries ended up being bitten by variation of this problem in one way or
another, resulting in
visible drop in performance
compared to equivalent code without use of effect systems.
Why did nobody notice this?
One factor may be that while GHC’s optimizer is very, very good in general in optimizing all sorts of abstraction, it’s relatively complex and hard to predict - authors of libraries may have not deemed location of code relevant, even though it had big effect at the end. The other is that maybe it doesn’t matter as much as we like to tell ourselves. Many of these effects libraries are used in production and they’re doing just fine, because maximum performance usually matters in small, controlled areas of code, that often don’t use features of effect systems at all.
What can we do about this?
Luckily, the same person that uncovered this problems proposed a
solution -
set of primops that will allow interpretation of effects at runtime, with
minimal overhead. It’s not zero-cost as we hoped for with polysemy at
first, but it should have negligible effect on performance in real life and
compared to current solutions, it should be much more predictable and even
resolve some problems with behaviour of
specific effects.
You can try out experimental library that uses proposed features
here.
When it comes to polysemy, once GHC proposal lands, we will consider the option of
switching to an implementation based on it. This will probably require some
breaking changes, but should resolve performance issues and maybe even make
implementation of higher-order effects easier.
If you’re interested in more details, see
Alexis King’s
talk about the problem,
Sandy Maguire’s
followup about how it relates to polysemy and
GHC proposal that
adds features needed for new type of implementation.
TL;DR
Basically all current effects libraries (including polysemy and
even mtl) got performance wrong - but, there’s ongoing work on extending
GHC with features that will allow for creation of effects implementation with
stable and strong performance. It’s what polysemy may choose at some point,
but it will probably require few breaking changes.
Acknowledgements, citations, and related work
The following is a non-exhaustive list of people and works that have had a
significant impact, directly or indirectly, on polysemy’s design and
implementation:
- Oleg Kiselyov, Amr Sabry, and Cameron Swords — Extensible Effects: An alternative to monad transfomers
- Oleg Kiselyov and Hiromi Ishii — Freer Monads, More Extensible Effects
- Nicolas Wu, Tom Schrijvers, and Ralf Hinze — Effect Handlers in Scope
- Nicolas Wu and Tom Schrijvers — Fusion for Free: Efficient Algebraic Effect Handlers
- Andy Gill and other contributors —
mtl - Rob Rix, Patrick Thomson, and other contributors —
fused-effects - Alexis King and other contributors —
freer-simple
Changes
Changelog for polysemy
Unreleased
1.9.1.0 (2023-04-09)
Other Changes
- Support GHC 9.6
Breaking Changes
Other Changes
1.9.0.0 (2022-12-28)
Breaking Changes
- Slightly modified the signatures of the various
Scopedinterpreters.
Other Changes
- Added
runScopedNew, a simple but powerfulScopedinterpreter.runScopedNewcan be considered a sneak-peek of the future ofScoped, which will eventually receive a major API rework to make it both simpler and more expressive. - Fixed a bug in various
Scopedinterpreters where ascopedusage of an effect always relied on the nearest enclosing use ofscopedfrom the sameScopedeffect, rather than thescopedwhich handles the effect. - Added
Polysemy.Opaque, a module for theOpaqueeffect newtype, meant as a tool to wrap polymorphic effect variables so they don’t jam up resolution ofMemberconstraints. - Expose the type alias
Scoped_for a scoped effect without callsite parameters.
1.8.0.0 (2022-12-22)
Breaking Changes
- Removed
Polysemy.View - Removed
Polysemy.Law - Removed
(@)and(@@)fromPolysemy - Removed
withLowerToIOfromPolysemy. UsewithWeavingToFinalinstead. - Removed
asyncToIOandlowerAsyncfromPolysemy.Async. UseasyncToIOFinalinstead. - Removed
lowerEmbeddedfromPolysemy.IO. UseembedToMonadIOinstead. - Removed
lowerErrorfromPolysemy.Error. UseerrorToIOFinalinstead. - Removed
resourceToIOandlowerResourcefromPolysemy.Resource. UseresourceToIOFinalinstead. - Removed
runFixpointandrunFixpointMfromPolysemy.Fixpoint. UsefixpointToFinalinstead. - Changed semantics of
errorToIOFinalso that it no longer catches errors from other handlers of the same type. - The semantics of
runScopedhas been changed so that the provided interpreter is now used only once per use ofscoped, instead of each individual action.
Other Changes
- Exposed
sendfromPolysemy. - Dramatically improved build performance of projects when compiling with
-O2. - Removed the debug
dump-coreflag. - Introduced the new meta-effect
Scoped, which allows running an interpreter locally whose implementation is deferred to a later stage. - Fixed a bug in various
Scopedinterpreters where any explicit recursive interpretation of higher-order computations that the handler may perform are ignored by the interpreter, and the original handler was reused instead.
1.7.1.0 (2021-11-23)
Other Changes
- Support GHC 9.2.1
1.7.0.0 (2021-11-16)
Breaking Changes
- Added interpreters for
AtomicStatethat run in terms ofState. - Removed
MemberWithError - Removed
DefiningModule
Other Changes
- The internal
ElemOfproof is now implemented as an unsafe integer, significantly cutting down on generated core. - Polysemy no longer emits custom type errors for ambiguous effect actions.
These have long been rendered moot by
polysemy-plugin, and the cases that they still exist are usually overeager (and wrong.) - As a result, the core produced by
polysemyis significantly smaller. Programs should see a reduction of ~20% in terms and types, and ~60% in coercions.
1.6.0.0 (2021-07-12)
Breaking Changes
- Deprecate
traceToIOand replace it withtraceToStdoutandtraceToStderr - Support GHC 9.0.1
Other Changes
- Added the combinator
insertAt, which allows adding effects at a specified index into the effect stack - Added
SemigroupandMonoidforSem
1.5.0.0 (2021-03-30)
Breaking Changes
- Dropped support for GHC 8.4
Other Changes
- Added
InterpretersForas a shorthand for interpreters consuming multiple effects - Added
runTSimpleandbindTSimple, which are simplified variants ofrunTandbindT
1.4.0.0 (2020-10-31)
Breaking Changes
- Added
Polysemy.Async.cancelto allow cancellingAsyncaction (possible name collision) (#321, thanks to @aidangilmore)
Other Changes
- Added
Polysemy.Input.inputsto mirrorPolysemy.Reader.asks(#327, thanks to @expipiplus1) - Added
Polysemy.Resource.bracket_(#335, thanks to @expipiplus1) - Support GHC 8.10.x (#337, #382)
- Restrict the existentially quantified monad in a
WeavingtoSem r(#333, thanks to @A1kmm) - Added
raise2Underandraise3Under(#369) - Added
RaiseandSubsume(#370) - Fixed memory leaks in
Applicative (Sem r)methods (#372, thanks to @goertzenator) - Smaller suggestions and fixes (thanks to @jeremyschlatter, @galagora and @felixonmars)
1.3.0.0 (2020-02-14)
Breaking Changes
- The semantics for
runNonDetwhen<|>is used inside a higher-order action of another effect has been reverted to that of 1.1.0.0 and earlier. (See issue #246) - Type parameters for
outputToTracehave been rearranged (thanks to @juanpaucar)
Other Changes
- Added
Bundleeffect, for bundling multiple effects into a single one. - Added
Taggedeffect, for annotating and disambiguating identical effects. - Added
Vieweffect, anInput-like effect for caching an expensive computation. - Added
fromException/ViaandfromExceptionSem/Via - Added
note - Added
catchJust,tryandtryJust(thanks to @bolt12) - Using
listenwithrunWriterTVarorwriterToIOwill no longer delay writing until thelistencompletes. - Added
runStateSTRefandstateToST(thanks to @incertia) - Added
execStateandexecLazyState(thanks to @tjweir) - Added
Polysemy.Law, which offers machinery for creating laws for effects. - Added
Polysemy.Membershipfor retrieving and making use of effect membership proofs.
1.2.3.0 (2019-10-29)
- Polysemy now works on GHC 8.8.1 (thanks to @googleson78 and @sevanspowell)
- Exported
MemberWithErrorfromPolysemy - Added
rewriteandtransforminterpretation combinators
1.2.2.0 (2019-10-22)
- Fixed a bug in
resourceToIOandresourceToIOFinalthat prevented the finalizers from being called inBracketOnErrorwhen the computation failed due to aSemfailure - Added
atomicGets(thanks to @googleson78) - Added
sequenceConcurrentlytoPolysemy.Async(thanks to @spacekitteh)
1.2.1.0 (2019-09-15)
- Added
InterpreterFor(thanks to @bolt12) - Bumped bounds for first-class-families
1.2.0.0 (2019-09-04)
Breaking Changes
- All
lower-interpreters have been deprecated, in favor of corresponding-Finalinterpreters. runFixpointandrunFixpointMhave been deprecated in favor offixpointToFinal.- The semantics for
runNonDetwhen<|>is used inside a higher-order action of another effect has been changed. - Type variables for certain internal functions,
failToEmbed, andatomicState'have been rearranged.
Other changes
- Added
Finaleffect, an effect for embedding higher-order actions in the final monad of the effect stack. Any interpreter should use this instead of requiring to be provided an explicit lowering function to the final monad. - Added
Strategyenvironment for use together withFinal - Added
asyncToIOFinal, a better alternative oflowerAsync - Added
errorToIOFinal, a better alternative oflowerError - Added
fixpointToFinal, a better alternative ofrunFixpointandrunFixpointM - Added
resourceToIOFinal, a better alternative oflowerResource - Added
outputToIOMonoidandoutputToIOMonoidAssocR - Added
stateToIO - Added
atomicStateToIO - Added
runWriterTVar,writerToIOFinal, andwriterToIOAssocRFinal - Added
writerToEndoWriter - Added
subsumeoperation - Exposed
raiseUnder/2/3inPolysemy
1.1.0.0 (2019-08-15)
Breaking Changes
MonadFailis now implemented in terms ofFail, instead ofNonDet(thanks to @KingoftheHomeless)LastMemberhas been removed.withLowerToIOand all interpreters that make use of it now only requiresMember (Embed IO) r(thanks to @KingoftheHomeless)StateandWriternow have better strictness semantics
Other Changes
- Added
AtomicStateeffect (thanks to @KingoftheHomeless) - Added
Faileffect (thanks to @KingoftheHomeless) - Added
runOutputSem(thanks to @cnr) - Added
modify', a strict variant ofmodify(thanks to @KingoftheHomeless) - Added right-associative variants of
runOutputMonoidandrunWriter(thanks to @KingoftheHomeless) - Added
runOutputMonoidIORefandrunOutputMonoidTVar(thanks to @KingoftheHomeless) - Improved
Fixpointso it won’t always diverge (thanks to @KingoftheHomeless) makeSemwill now complain ifDataKindsisn’t enabled (thanks to @pepegar)
1.0.0.0 (2019-07-24)
Breaking Changes
- Renamed
LifttoEmbed(thanks to @googleson78) - Renamed
runAsyncInIOtolowerAsync - Renamed
runAsynctoasyncToIO - Renamed
runBatchOutputtorunOutputBatched - Renamed
runConstInputtorunInputConst - Renamed
runEmbedtorunEmbedded(thanks to @googleson78) - Renamed
runEmbeddedtolowerEmbedded - Renamed
runErrorAsAnothertomapError - Renamed
runErrorInIOtolowerError - Renamed
runFoldMapOutputtorunOutputMonoid - Renamed
runIOtoembedToMonadIO - Renamed
runIgnoringOutputtoignoreOutput - Renamed
runIgnoringTracetoignoreTrace - Renamed
runInputAsReadertoinputToReader - Renamed
runListInputtorunInputList - Renamed
runMonadicInputtorunInputSem - Renamed
runOutputAsListtorunOutputList - Renamed
runOutputAsTracetooutputToTrace - Renamed
runOutputAsWritertooutputToWriter - Renamed
runResourceBasetoresourceToIO - Renamed
runResourceInIOtolowerResource - Renamed
runStateInIOReftorunStateIORef - Renamed
runTraceAsListtorunTraceList - Renamed
runTraceAsOutputtotraceToOutput - Renamed
runTraceIOtotraceToIO - Renamed
sendMtoembed(thanks to @googleson78) - The
NonDeteffect is now higher-order (thanks to @KingoftheHomeless)
Other Changes
- Added
evalStateandevalLazyState - Added
runNonDetMaybe(thanks to @KingoftheHomeless) - Added
nonDetToError(thanks to @KingoftheHomeless) - Haddock documentation for smart constructors generated via
makeSemwill no longer have weird variable names (thanks to @TheMatten)
0.7.0.0 (2019-07-08)
Breaking Changes
- Added a
Passconstructor toWriter(thanks to @KingoftheHomeless) - Fixed a bug in
runWriterwhere the MTL semantics wouldn’t be respected (thanks to @KingoftheHomeless) - Removed the
Censorconstructor ofWriter(thanks to @KingoftheHomeless) - Renamed
YotoWeaving - Changed the visible type applications for
asks,gets,runEmbedded,fromEitherMandrunErrorAsAnother
Other Changes
- Fixed haddock generation
0.6.0.0 (2019-07-04)
Breaking Changes
- Changed the type of
runBatchOutputto be more useful (thanks to @Infinisil)
Other Changes
- THE ERROR MESSAGES ARE SO MUCH BETTER :party: :party: :party:
- Added
runEmbeddedtoPolysemy.IO - Added
runOutputAsListtoPolysemy.Output(thanks to @googleson78) - Asymptotically improved the performance of
runTraceAsList(thanks to @googleson78)
0.5.1.0 (2019-06-28)
- New combinators for
Polysemy.Error:fromEitherandfromEitherM
0.5.0.1 (2019-06-27)
- Fixed a bug where
interceptandinterceptHwouldn’t correctly handle higher-order effects
0.5.0.0 (2019-06-26)
Breaking Changes
- Removed the internal
Effectmachinery
New Effects and Interpretations
- New effect;
Async, for describing asynchronous computations - New interpretation for
Resource:runResourceBase, which can lowerResourceeffects without giving a lowering natural transformation - New interpretation for
Trace:runTraceAsList - New combinator:
withLowerToIO, which is capable of transformingIO-invariant functions as effects.
Other Changes
- Lots of hard work on the package and CI infrastructure to make it green on GHC 8.4.4 (thanks to @jkachmar)
- Changed the order of the types for
runMonadicInputto be more helpful (thanks to @tempname11) - Improved the error machinery to be more selective about when it runs
- Factored out the TH into a common library for third-party consumers
0.4.0.0 (2019-06-12)
Breaking Changes
- Renamed
runResourcetorunResourceInIO
Other Changes
- Added
runResource, which runs aResourcepurely - Added
onException,finallyandbracketOnErrortoResource - Added a new function,
runResourcewhich performs bracketing for pure code
0.3.0.1 (2019-06-09)
- Fixed a type error in the benchmark caused by deprecation of
Semantic
0.3.0.0 (2019-06-01)
Breaking Changes
- Removed all deprecated names
- Moved
Randomeffect topolysemy-zoo
Other Changes
makeSemcan now be used to create term-level operators (thanks to @TheMatten)
0.2.2.0 (2019-05-30)
- Added
getInspectorTto theTacticalfunctions, which allows polysemy code to be run in external callbacks - A complete rewrite of
Polysemy.Internal.TH.Effect(thanks to @TheMatten) - Fixed a bug in the TH generation of effects where the splices could contain usages of effects that were ambiguous
0.2.1.0 (2019-05-27)
- Fixed a bug in the
Alternativeinstance forSem, where it would choose the last success instead of the first - Added
MonadPlusandMonadFailinstances forSem
0.2.0.0 (2019-05-23)
Breaking Changes
- Lower precedence of
.@and.@@to 8, from 9
Other Changes
- Fixed a serious bug in
interpretHand friends, where higher-order effects would always be run with the current interpreter. - Users need no longer require
inlineRecursiveCalls— thepolysemy-plugin-0.2.0.0will do it automatically when compiling with-O - Deprecated
inlineRecursiveCalls; slated for removal in the next version
0.1.2.1 (2019-05-18)
- Give explicit package bounds for dependencies
- Haddock improvements
- Remove
Typeablemachinery fromPolysemy.Internal.Union(thanks to @googleson78)
0.1.2.0 (2019-04-26)
runInputAsReader,runTraceAsOutputandrunOutputAsWriterhave more generalized types- Added
runStateInIO - Added
runOutputAsTrace - Added
Members(thanks to @TheMatten)
0.1.1.0 (2019-04-14)
- Added
runIOinterpretation (thanks to @adamConnerSax) - Minor documentation fixes
0.1.0.0 (2019-04-11)
- Initial release