[论文解读] Outlearning Extortioners by Fair-minded Unbending Strategies

Xingru Chen, Feng Fu|arXiv (Cornell University)|Jan 11, 2022

Evolutionary Game Theory and Cooperation被引用 7

一句话总结

本文识别出公平且坚定的策略——如慷慨的ZD和Win-Stay, Lose-Shift——通过使勒索行为变得无利可图，迫使掠夺性零决定点（ZD）玩家让步。当面对此类策略时，ZD玩家通过提供公平分配来最大化自身收益，而在某些情况下，若收益结构更倾向于相互背叛而非单方面合作，甚至会输给更简单的策略如WSLS。

ABSTRACT

Recent theory shows that extortioners taking advantage of the zero-determinant (ZD) strategy can unilaterally claim an unfair share of the payoffs in the Iterated Prisoner's Dilemma. It is thus suggested that against a fixed extortioner, any adapting co-player should be subdued with full cooperation as their best response. In contrast, recent experiments demonstrate that human players often choose not to accede to extortion out of concern for fairness, actually causing extortioners to suffer more loss than themselves. In light of this, here we reveal fair-minded strategies that are unbending to extortion such that any payoff-maximizing extortioner ultimately will concede in their own interest by offering a fair split in head-to-head matches. We find and characterize multiple general classes of such unbending strategies, including generous zero-determinant strategies and Win-Stay, Lose-Shift as particular examples. When against fixed unbending players, extortioners are forced with consequentially increasing losses whenever intending to demand more unfair share. Our analysis also pivots to the importance of payoff structure in determining the superiority of zero-determinant strategies and in particular their extortion ability. We show that an extortionate ZD player can be even outperformed by, for example, Win-Stay Lose-Shift, if the total payoff of unilateral cooperation is smaller than that of mutual defection. Unbending strategies can be used to outlearn evolutionary extortioners and catalyze the evolution of Tit-for-Tat-like strategies out of ZD players. Our work has implications for promoting fairness and resisting extortion so as to uphold a just and cooperative society.

研究动机与目标

• 研究公平且坚定的策略是否能在重复囚徒困境中抵抗并超越掠夺性零决定点（ZD）玩家。
• 识别出使勒索者收益最大化失效的策略类别，通过使不公平要求自食其果。
• 分析收益结构如何影响ZD策略的主导地位及其勒索能力。
• 探讨坚定策略如何引导适应性合作者的学习动态，使其趋向公平与合作。
• 证明在特定收益条件下，ZD玩家可能被Win-Stay, Lose-Shift等更简单策略所超越。

提出的方法

• 使用Press和Dyson的分析框架，计算ZD与固定坚定策略对局中的期望收益。
• 通过三个参数表征ZD策略：勒索因子χ、归一化因子φ，以及基线收益O ∈ [P, R]，以控制慷慨程度。
• 识别出使勒索者收益与φ无关且随χ单调递减的坚定策略，从而确保勒索失败。
• 采用闭式解推导出坚定策略使ZD玩家在尝试勒索时蒙受损失的条件。
• 分析收益矩阵结构（如T + S < 2P）对ZD与坚定策略相对表现的影响。
• 通过模拟与分析建模表明，坚定策略可催化ZD玩家中出现类似Tit-for-Tat的合作行为。

实验结果

研究问题

• RQ1 固定且坚定的策略是否可通过使勒索无利可图，迫使掠夺性ZD玩家让步？
• RQ2 在何种条件下，坚定策略会使ZD玩家的表现劣于公平替代策略如Win-Stay, Lose-Shift？
• RQ3 收益矩阵结构（如T + S < 2P）如何影响ZD策略的主导地位及其勒索能力？
• RQ4 坚定策略是否能引导适应性合作者的学习动态，使其趋向公平与合作？
• RQ5 哪些一般策略类别对勒索具有鲁棒性，并确保收益与ZD参数（如φ）无关？

主要发现

• 掠夺性ZD玩家仅在向坚定合作者提供公平分配时才能获得最大收益，使勒索行为自食其果。
• 当收益矩阵满足T + S < 2P时，ZD玩家的表现劣于Win-Stay, Lose-Shift，即使WSLS并非ZD策略。
• 慷慨ZD策略与Win-Stay, Lose-Shift被识别为坚定策略的具体实例，使勒索无效。
• 坚定策略对ZD归一化参数φ的收益独立性，确保勒索尝试无法带来更高收益。
• 坚定策略可通过使不公平要求无利可图，催化ZD玩家中进化出类似Tit-for-Tat的合作行为。
• 在一对一对决中，勒索者因试图从坚定玩家处索取不公平份额而遭受的损失随其尝试次数增加而加剧。