[Paper Review] learn2learn: A Library for Meta-Learning Research

Sébastien M. R. Arnold, Praateek Mahajan+3 more|arXiv (Cornell University)|Aug 27, 2020

Domain Adaptation and Few-Shot LearningComputer Science21 references37 citations

TL;DR

learn2learn is a Python library that provides low-level differentiable optimization routines, domain/prototype tooling, and standardized benchmarks to improve prototyping and reproducibility in meta-learning research across few-shot learning, meta-reinforcement learning, and meta-optimization.

ABSTRACT

Added New vision example: MAML++. (@Theo Morales) Add tutorial: "Demystifying Task Transforms", (Varad Pimpalkhute) Add <code>l2l.nn.MetaModule</code> and <code>l2l.nn.ParameterTransform</code> for parameter-efficient finetuning. Add <code>l2l.nn.freeze</code>and <code>l2l.nn.unfreeze</code>. Add Adapters and LoRA examples. Add TasksetSampler, compatible with PyTorch's Dataloaders. Changed Documentation: uses <code>mkdocstrings</code> instead of <code>pydoc-markdown</code>. Remove <code>text/news_topic_classification.py</code> example. Rename TaskDataset to Taskset. Fixed MAML Toy example. (@Theo Morales) Example for <code>detach_module</code>. (Nimish Sanghi) Loading duplicate FGVC Aircraft images. Move vision datasets to Zenodo. (mini-ImageNet, tiered-ImageNet, FC100, CIFAR-FS, CUB200) mini-ImageNet targets are now ints (not np.float64). Swap family for variants in FGVCAircraft, as in MetaDataset.

Motivation & Objective

• Identify prototyping and reproducibility challenges in modern meta-learning research.
• Introduce a unified, extensible library to streamline implementation across meta-learning paradigms.
• Provide low- and high-level interfaces that promote standardized benchmarks and reproducible experiments.

Proposed method

• Provide differentiable optimization primitives tightly integrated with PyTorch to enable differentiable meta-learning updates.
• Offer TaskDataset and TaskTransform interfaces to rapidly prototype new data/task regimes for few-shot learning.
• Deliver high-level algorithm implementations (e.g., Meta-SGD, Meta-Curvature, Meta-KFO) built on low-level routines with reproducible benchmarks.
• Develop a standardized benchmarks API for few-shot and meta-reinforcement learning, including vision datasets and MetaWorld-like environments.
• Ensure compatibility with PyTorch modules and optional Cython speedups for data handling.
• Publish open-source, MIT-licensed software with documentation, tutorials, and community-oriented resources.

Experimental results

Research questions

• RQ1 How can meta-learning research be streamlined to reduce prototyping errors and increase reproducibility?
• RQ2 Can a unified library provide reliable, comparable implementations across few-shot learning, meta-reinforcement learning, and meta-optimization?
• RQ3 To what extent do standardized benchmarks and ready-made implementations facilitate fair comparisons of meta-learning methods?

Key findings

• learn2learn provides low-level routines for differentiable optimization that ease implementation of meta-learning algorithms.
• It supplies TaskDataset and TaskTransform abstractions to rapidly create and iterate on new domains and tasks.
• High-level implementations (e.g., Meta-SGD, Meta-Curvature, Meta-KFO) are wrapped with standardized benchmarks to reproduce published experiments.
• The library includes standardized benchmarks and meta-reinforcement learning environments to improve reproducibility across studies.
• learn2learn emphasizes compatibility with PyTorch, extensibility, and open-source availability to foster community adoption.