[Paper Review] A Framework for Higher-Order Effects & Handlers

Birthe van den Berg, Tom Schrijvers|arXiv (Cornell University)|Feb 2, 2023

Logic, programming, and type systems4 citations

TL;DR

This paper proposes a generic framework for higher-order effects and handlers in functional programming, generalizing algebraic effects and handlers via a higher-order free monad with effect signatures. It enables modular specification of complex effects like scoped, parallel, latent, writer, and bracketing effects, with formal correctness proven for all instances, including novel ones.

ABSTRACT

Algebraic effects & handlers are a modular approach for modeling side-effects in functional programming. Their syntax is defined in terms of a signature of effectful operations, encoded as a functor, that are plugged into the free monad; their denotational semantics is defined by fold-style handlers that only interpret their part of the syntax and forward the rest. However, not all effects are algebraic: some need to access an internal computation. For example, scoped effects distinguish between a computation in scope and out of scope; parallel effects parallellize over a computation, latent effects defer a computation. Separate definitions have been proposed for these higher-order effects and their corresponding handlers, often leading to expedient and complex monad definitions. In this work we propose a generic framework for higher-order effects, generalizing algebraic effects & handlers: a generic free monad with higher-order effect signatures and a corresponding interpreter. Specializing this higher-order syntax leads to various definitions of previously defined (scoped, parallel, latent) and novel (writer, bracketing) effects. Furthermore, we formally show our framework theoretically correct, also putting different effect instances on formal footing; a significant contribution for parallel, latent, writer and bracketing effects.

Motivation & Objective

• To address the limitations of algebraic effects and handlers in modeling higher-order effects that depend on internal computation state.
• To unify and generalize existing ad-hoc definitions of higher-order effects such as scoped, parallel, and latent effects.
• To provide a formal, generic framework for higher-order effect signatures and handlers using a higher-order free monad.
• To formally verify correctness of the framework and its instances, including novel effects like writer and bracketing.
• To offer a principled foundation for implementing and reasoning about higher-order effects in functional languages.

Proposed method

• Define a higher-order effect signature as a functor over a free monad, extending the standard algebraic effect model.
• Introduce a generic higher-order free monad that supports effect operations with internal computation dependencies.
• Design handlers that interpret higher-order effects by pattern-matching on effect operations and forwarding the rest via fold-style recursion.
• Use a datatypes à la carte-style encoding to modularly combine effect signatures and support extensibility.
• Formalize the semantics using a denotational model based on foldable handlers and prove full abstraction and correctness.
• Specialize the framework to derive known effects (scoped, parallel, latent) and new ones (writer, bracketing) with formal semantics.

Experimental results

Research questions

• RQ1 How can higher-order effects that depend on internal computation be uniformly modeled and composed?
• RQ2 Can a generic framework unify existing higher-order effect definitions under a single formalism?
• RQ3 What is the formal semantics of higher-order effects and handlers, and how can correctness be established?
• RQ4 Can novel higher-order effects like writer and bracketing be naturally expressed and verified within the framework?
• RQ5 How does the framework support modularity, extensibility, and separation of concerns in effect handling?

Key findings

• The framework successfully generalizes algebraic effects and handlers to support higher-order effects with internal computation dependencies.
• The framework enables the modular and formal specification of both known higher-order effects (scoped, parallel, latent) and novel ones (writer, bracketing).
• Formal correctness is established for all effect instances, including significant contributions for parallel, latent, writer, and bracketing effects.
• The framework supports a clean separation between effect definition and interpretation via fold-style handlers.
• The use of a higher-order free monad allows for extensible and composable effect systems with principled semantics.
• The approach provides a unified foundation for reasoning about higher-order effects, improving modularity and maintainability.