[论文解读] The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation

Jochen Hartmann, Jasper Schwenzow+1 more|arXiv (Cornell University)|Jan 5, 2023

Ethics and Social Impacts of AI被引用 35

一句话总结

这篇论文通过用政治声明来提示 ChatGPT 的政治取向，发现其在多项实验和多种语言中呈现出亲环境、左自由主义的倾向。

ABSTRACT

Conversational artificial intelligence (AI) disrupts how humans interact with technology. Recently, OpenAI introduced ChatGPT, a state-of-the-art dialogue model that can converse with its human counterparts with unprecedented capabilities. ChatGPT has witnessed tremendous attention from the media, academia, industry, and the general public, attracting more than a million users within days of its release. However, its explosive adoption for information search and as an automated decision aid underscores the importance to understand its limitations and biases. This paper focuses on one of democratic society's most important decision-making processes: political elections. Prompting ChatGPT with 630 political statements from two leading voting advice applications and the nation-agnostic political compass test in three pre-registered experiments, we uncover ChatGPT's pro-environmental, left-libertarian ideology. For example, ChatGPT would impose taxes on flights, restrict rent increases, and legalize abortion. In the 2021 elections, it would have voted most likely for the Greens both in Germany (Bündnis 90/Die Grünen) and in the Netherlands (GroenLinks). Our findings are robust when negating the prompts, reversing the order of the statements, varying prompt formality, and across languages (English, German, Dutch, and Spanish). We conclude by discussing the implications of politically biased conversational AI on society.

研究动机与目标

• 评估 ChatGPT 在民主决策情境（选举）中的政治偏见。
• 使用多种提示设置检验其与环境和左自由主义立场的一致性。
• 测试结果在语言和提示变体下的鲁棒性。
• 就政治偏向对话式人工智能的社会影响进行讨论。

提出的方法

• 用来自投票建议应用程序的630条政治声明和一个国家无关的政治指南测试向 ChatGPT 提示。
• 进行三项事前注册的实验以评估取向。
• 使提示取反和颠倒陈述顺序以测试鲁棒性。
• 改变提示的正式程度和语言（英语、德语、荷兰语、西班牙语）。
• 将结果与已知政党立场进行比较（如德国和荷兰的绿党）。

实验结果

研究问题

• RQ1 当评估于政治声明时，ChatGPT 是否呈现出亲环境的倾向？
• RQ2 观察到的取向是否在语言版本和提示形式中保持一致？
• RQ3 ChatGPT 推断出的意识形态在实际政治情境中与左自由主义立场有何关系？
• RQ4 基于其回答，ChatGPT 会在国政选举中支持特定绿色政党吗？
• RQ5 政治偏向的对话式人工智能对社会的广泛影响是什么？

主要发现

• ChatGPT 在各提示中表现出亲环境、左自由主义的意识形态。
• 在2021年选举情景中，它最有可能在德国和荷兰投给绿党。
• 结果对取反提示、颠倒顺序、形式多样性，以及英语、德语、荷兰语和西班牙语均具有鲁棒性。
• 根据提示，ChatGPT 将对航班征税、限制房租上涨，并会在提示中支持堕胎合法化。
• 研究讨论了政治偏向的对话式人工智能的潜在社会影响。