[论文解读] The Generation-Recognition Asymmetry: Six Dimensions of a Fundamental Divide in Formal Language Theory

Romain Peyrichou|arXiv (Cornell University)|Mar 10, 2026

Natural Language Processing Techniques被引用 0

一句话总结

论文将生成、识别和推理视为六维不对称性，分析语法如何生成字符串与如何解析字符串之间在复杂性、歧义、方向性、信息、语法归纳与时序等维度上的差异。

ABSTRACT

Every formal grammar defines a language and can in principle be used in three ways: to generate strings (production), to recognize them (parsing), or -- given only examples -- to infer the grammar itself (grammar induction). Generation and recognition are extensionally equivalent -- they characterize the same set -- but operationally asymmetric in multiple independent ways. Inference is a qualitatively harder problem: it does not have access to a known grammar. Despite the centrality of this triad to compiler design, natural language processing, and formal language theory, no survey has treated it as a unified, multidimensional phenomenon. We identify six dimensions along which generation and recognition diverge: computational complexity, ambiguity, directionality, information availability, grammar inference, and temporality. We show that the common characterization "generation is easy, parsing is hard" is misleading: unconstrained generation is trivial, but generation under constraints can be NP-hard. The real asymmetry is that parsing is always constrained (the input is given) while generation need not be. Two of these dimensions -- directionality and temporality -- have not previously been identified as dimensions of the generation-recognition asymmetry. We connect the temporal dimension to the surprisal framework of Hale (2001) and Levy (2008), arguing that surprisal formalizes the temporal asymmetry between a generator (surprisal = 0) and a parser that predicts under uncertainty (surprisal > 0). We review bidirectional systems in NLP and observe that bidirectionality has been available for fifty years yet has not transferred to most domain-specific applications. We conclude with a discussion of large language models, which architecturally unify generation and recognition while operationally preserving the asymmetry.

研究动机与目标

• 识别生成与识别在六个独立维度上存在差异的表现
• 将推理（语法归纳）作为第三轴以加深不对称性
• 通过强调结构约束挑战“生成容易而解析困难”的简单观点
• 将惊奇熵理论与不对称性的时序维度联系起来
• 调查双向系统并解释其向领域特定文法的有限迁移
• 回应反对意见并讨论对大型语言模型的意义

提出的方法

• 在形式文法中定义生成、识别和推理，并阐明它们在扩展意义上等价但在操作上存在不对称
• 建立六维不对称性（D1–D6），给出正式论证与运行示例
• 综合香农信息理论、乔姆斯基层级与莫里斯的符号学框架以支撑分析
• 在不同领域调查分析性、生成性与双向系统以说明方向性与不对称
• 给出复杂性热图以对比不同文法类与任务类型下的生成与识别
• 讨论自然语言处理系统中的双向性并评估为何领域特定应用对双向文法的采用有限

实验结果

研究问题

• RQ1 哪些六个维度刻画了形式文法中生成与识别的操作性差异
• RQ2 推理（文法归纳）如何扩展并加深生成-识别不对称性
• RQ3 信息理论、句法复杂性与符号学如何揭示跨领域的不对称性
• RQ4 在何种条件下双向文法可以缓解不对称性，为何在各领域的采用不均衡
• RQ5 这六个维度对大型语言模型及其生成-识别互动有何影响

主要发现

• 生成并非普遍容易；在特定任务和文法表达能力下，受限生成也可能与解析同样困难
• 识别复杂性随文法表达能力增强而增加，取决于任务与文法类型可达线性到不可判定的多种复杂性等级
• 方向性、时序性以及新识别出的两个维度（D3与D6）塑造不对称性，并与解析策略及惊奇熵理论相关
• 双向文法系统存在（如GF、DCG、KAMP），但因可宣称性要求与计算成本而在领域上受限
• 推理（文法归纳）代表最难的轴，极少与生成或识别在单一系统中结合，显示出一个根本性的第三维
• 大型语言模型在架构上似乎统一了生成与识别，但保留了操作性不对称