[论文解读] The advent and fall of a vocabulary learning bias from communicative efficiency

David Carrera-Casado, Ramon Ferrer‐i‐Cancho|arXiv (Cornell University)|May 24, 2021

Speech and dialogue systems参考文献 90被引用 8

一句话总结

本文提出了一种广义的信息论模型，通过最小化交际成本来解释词汇学习偏见（即儿童倾向于为未标记意义赋予新词）的出现与消退。该模型结合了齐夫的意义-频率定律，并表明当词汇多样性（µk）或交际效率（λ）达到特定阈值时，该偏见会减弱或消失，从而为词汇学习行为在发展过程中的转变以及多语者现象提供了原则性解释。

ABSTRACT

Biosemiosis is a process of choice-making between simultaneously alternative options. It is well-known that, when sufficiently young children encounter a new word, they tend to interpret it as pointing to a meaning that does not have a word yet in their lexicon rather than to a meaning that already has a word attached. In previous research, the strategy was shown to be optimal from an information theoretic standpoint. In that framework, interpretation is hypothesized to be driven by the minimization of a cost function: the option of least communication cost is chosen. However, the information theoretic model employed in that research neither explains the weakening of that vocabulary learning bias in older children or polylinguals nor reproduces Zipf's meaning-frequency law, namely the non-linear relationship between the number of meanings of a word and its frequency. Here we consider a generalization of the model that is channeled to reproduce that law. The analysis of the new model reveals regions of the phase space where the bias disappears consistently with the weakening or loss of the bias in older children or polylinguals. The model is abstract enough to support future research on other levels of life that are relevant to biosemiotics. In the deep learning era, the model is a transparent low-dimensional tool for future experimental research and illustrates the predictive power of a theoretical framework originally designed to shed light on the origins of Zipf's rank-frequency law.

研究动机与目标

• 解释为何互斥性偏见（即更倾向于为未标记意义赋予新词）在年长儿童和多语者中会减弱。
• 将信息论框架扩展至重现真实世界语言数据所表现出的齐夫意义-频率定律。
• 提供一个透明且低维的模型，基于交际效率预测词汇学习偏见何时出现或消失。
• 将生物符号学原理与信息论相结合，以建模生物与人工系统中学习过程的符号选择。

提出的方法

• 将词-意义关联形式化为二分图，将形式与意义建模为相连的节点。
• 引入基于信息论的成本函数，通过最大化互信息和最小化意外度来最小化交际成本。
• 通过引入参数λ（交际效率）和µk（词汇多样性）对先前模型进行泛化，使模型能够重现齐夫的意义-频率定律。
• 使用数值模拟与相空间分析，探索词汇学习偏见具有优势或完全缺失的区域。
• 将模型应用于预测策略a（为未标记意义分配新词）在何种条件下最优或被舍弃。
• 通过已知的发展规律与语言学定律（包括简缩律和门泽拉特定律）验证预测结果。

实验结果

研究问题

• RQ1 在何种条件下，词汇学习偏见（即更倾向于为未标记意义赋予新词）会在年长儿童或多语者中消失？
• RQ2 如何通过信息论模型重现齐夫的意义-频率定律，该定律将词汇频率与词汇的多义性数量相关联？
• RQ3 词汇多样性（µk）与交际效率（λ）在互斥性偏见的出现或抑制中起何种作用？
• RQ4 一个透明且低维的模型能否预测词汇学习偏见在发展过程中或跨多语现象中的减弱？
• RQ5 该模型对偏见消退的预测与儿童语言习得及成人词汇学习的实证数据是否一致？

主要发现

• 通过将信息论框架泛化并引入参数λ与µk，该模型成功重现了齐夫的意义-频率定律。
• 相空间中存在偏见始终缺失的区域，对应于高µk或低λ的条件，与偏见在发展过程中减弱的现象一致。
• 对于具有相似n和α的儿童，当λ较低且µk较大，或λ较高且µk足够低时，模型预测偏见将消失。
• 模拟热图中稳定的红色水平条带表明，存在一个µk的取值范围，使偏见持续具有优势，暗示在个体学习者中可观测到偏见的窗口期。
• 模型预测，当词汇多样性增加或交际效率降低时，偏见将减弱或消失，为观察到的发展性转变提供了机制性解释。
• 该框架提出了可检验的预测：在儿童或成人控制实验中改变µk，应能调节互斥性偏见的强度，从而证实模型的核心假设。