[論文レビュー] Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learning

Jiahui Gao, Renjie Pi+8 more|arXiv (Cornell University)|May 25, 2022

Domain Adaptation and Few-Shot Learning被引用数 21

ひとこと要約

提供された抜粋には論文の内容・方法・結果を要約するには不十分な情報です。

ABSTRACT

There is a rising interest in further exploring the zero-shot learning potential of large pre-trained language models (PLMs). A new paradigm called data-generation-based zero-shot learning has achieved impressive success. In this paradigm, the synthesized data from the PLM acts as the carrier of knowledge, which is used to train a task-specific model with orders of magnitude fewer parameters than the PLM, achieving both higher performance and efficiency than prompt-based zero-shot learning methods on PLMs. The main hurdle of this approach is that the synthesized data from PLM usually contains a significant portion of low-quality samples. Fitting on such data will greatly hamper the performance of the task-specific model, making it unreliable for deployment. Previous methods remedy this issue mainly by filtering synthetic data using heuristic metrics(e.g., output confidence), or refining the data with the help of a human expert, which comes with excessive manual tuning or expensive costs. In this paper, we propose a novel noise-robust re-weighting framework SunGen to automatically construct high-quality data for zero-shot classification problems. Our framework features the ability to learn the sample weights indicating data quality without requiring any human annotation. We theoretically and empirically verify the ability of our method to help construct good-quality synthetic datasets. Notably, SunGen-LSTM yields a 9.8% relative improvement than the baseline on average accuracy across eight different established text classification tasks.

研究の動機と目的

• 提供された抜粋から目的は特定できません。利用可能なのはタイトルと書式指示のみです。

提案手法

• 提供された抜粋から手法は特定できません。要旨・式・方法論の詳細は存在しません。

実験結果

リサーチクエスチョン

• RQ1 提供された抜粋から研究課題は特定できません。

主な発見

• 提供された抜粋から結論は特定できません。