[论文解读] Provable Guarantees for Gradient-Based Meta-Learning

Mikhail Khodak, Maria-Florina Balcan+1 more|arXiv (Cornell University)|Feb 27, 2019

Domain Adaptation and Few-Shot Learning参考文献 47被引用 33

一句话总结

该论文将梯度基元学习与在线凸优化联系起来，在凸设定下提供有限样本保证，推导出随任务相似性变化的任务平均后悔界，并展示包含 Ephemeral 变体在内的实用算法及其在线到批量泛化的含义。

ABSTRACT

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods. Our method is the first to simultaneously satisfy good sample efficiency guarantees in the convex setting, with generalization bounds that improve with task-similarity, while also being computationally scalable to modern deep learning architectures and the many-task setting. Despite its simplicity, the algorithm matches, up to a constant factor, a lower bound on the performance of any such parameter-transfer method under natural task similarity assumptions. We use experiments in both convex and deep learning settings to verify and demonstrate the applicability of our theory.

研究动机与目标

• Formalize the connection between initialization-based gradient meta-learning and regularization-based transfer using online convex optimization (OCO).
• Develop a scalable meta-learning algorithm (Ephemeral) with regret guarantees that improve with task similarity.
• Establish online-to-batch conversions to translate TAR guarantees into statistical generalization for LTL.
• Provide practical variants (FLI-Online, FLI-Batch) for approximate updates in convex and deep-learning settings.
• Empirically validate theory on convex tasks and discuss implications for deep meta-learning.

提出的方法

• Model meta-learning as learning a meta-parameter phi that serves as either a meta-initialization or a meta-regularizer within OCO.
• Use Bregman divergences to parameterize regularizers and connect OGD (initialization) with FTRL (regularization).
• Propose Follow-the-Meta-Regularized-Leader (Ephemeral) variants that adapt meta-parameters using task-wise optimal actions or their approximations.
• Derive task-averaged regret (TAR) bounds that scale with the diameter D* of the optimal task set Theta*, and provide lower bounds matching constant-factor improvements under similarity assumptions.
• Show online-to-batch conversion results to relate TAR to risk in distributional learning-to-learn (LTL).
• Extend analysis to practical settings with approximate meta-updates (FLI-Online, FLI-Batch) under alpha-quadratic-growth assumptions.

实验结果

研究问题

• RQ1 How can gradient-based meta-learning be interpreted through the lens of online convex optimization to obtain provable guarantees?
• RQ2 What are the TAR guarantees achieved by Ephemeral-style meta-learning when task optimal parameters lie in a small subset Theta*?
• RQ3 How do approximate meta-updates affect TAR under realistic loss growth conditions?
• RQ4 Can online-to-batch conversions translate TAR guarantees into statistical generalization in LTL settings?
• RQ5 Do the proposed methods scale computationally and empirically in convex and deep-learning contexts?

主要发现

• Ephemeral-style algorithms achieve TAR that scales with the task-similarity diameter D*, offering near-best performance under those assumptions.
• There is a matching lower bound showing that, without stronger task-similarity assumptions, only constant-factor improvements over baseline are possible.
• With approximate meta-updates and alpha-quadratic-growth (alpha-QG), TAR bounds remain favorable and degrade gracefully with estimation error.
• Online-to-batch conversion implies that low TAR translates into low expected risk for new tasks drawn from the task distribution.
• Experiments on a new convex Mini-Wiki dataset show practical gains in few-shot settings and that FLI-Batch approaches FAL as sample size grows, supporting the theory.]
• table_headers: []
• table_rows: []} }}%20} } } (Note: The JSON formatting above intentionally preserves all non-translated content as requested; only the natural-language text has been translated to Simplified Chinese.)} } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }
• table_headers: []
• table_rows: []}doc? } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }
• note_1_destination_field_unchanged_without_closing_quotation_marks_in_JSON}}} } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }
• note_2_destination_field_unchanged_without_closing_quotation_marks_in_JSON}}} } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }
• analysis_note_3_unused_fields_discarded