[论文解读] Relational Norms for Human-AI Cooperation

Brian D. Earp, Sebastian Porsdam Mann+60 more|ArXiv.org|Feb 17, 2025

Ethics and Social Impacts of AI被引用 6

一句话总结

本文认为人类关系规范应指导社交 AI 的设计与互动，分析 AI 在实现或无法实现关系特定功能以及伦理含义方面的可能性。

ABSTRACT

How we should design and interact with social artificial intelligence depends on the socio-relational role the AI is meant to emulate or occupy. In human society, relationships such as teacher-student, parent-child, neighbors, siblings, or employer-employee are governed by specific norms that prescribe or proscribe cooperative functions including hierarchy, care, transaction, and mating. These norms shape our judgments of what is appropriate for each partner. For example, workplace norms may allow a boss to give orders to an employee, but not vice versa, reflecting hierarchical and transactional expectations. As AI agents and chatbots powered by large language models are increasingly designed to serve roles analogous to human positions - such as assistant, mental health provider, tutor, or romantic partner - it is imperative to examine whether and how human relational norms should extend to human-AI interactions. Our analysis explores how differences between AI systems and humans, such as the absence of conscious experience and immunity to fatigue, may affect an AI's capacity to fulfill relationship-specific functions and adhere to corresponding norms. This analysis, which is a collaborative effort by philosophers, psychologists, relationship scientists, ethicists, legal experts, and AI researchers, carries important implications for AI systems design, user behavior, and regulation. While we accept that AI systems can offer significant benefits such as increased availability and consistency in certain socio-relational roles, they also risk fostering unhealthy dependencies or unrealistic expectations that could spill over into human-human relationships. We propose that understanding and thoughtfully shaping (or implementing) suitable human-AI relational norms will be crucial for ensuring that human-AI interactions are ethical, trustworthy, and favorable to human well-being.

研究动机与目标

• 研究社会 AI 应如何模仿或承担由等级、关怀和交易等规范所支配的人类关系角色。
• 评估 AI 与人类之间的差异（无意识、抗疲劳能力）对规范遵循的影响。
• 识别 AI 承担关系特定角色的潜在收益与风险。
• 概述将 AI 行为与人类关系期望保持一致的设计与监管含义。

提出的方法

• 比较人类关系规范（例如师生、雇主–雇员）与 AI 系统的能力与局限。
• 分析 AI 缺乏主观意识与抗疲劳性对实现关系特定功能的影响。
• 讨论人类–AI 互动中的伦理、信任与福祉方面的考虑。
• 提出在 AI 设计与监管中周到地塑形或实施关系规范的方法。

实验结果

研究问题

• RQ1 人类关系中的哪些规范标准应扩展到人类–AI 交互？
• RQ2 AI 与人类的差异如何影响 AI 实现关系特定角色的能力？
• RQ3 AI 担任社会角色的伦理、信任与福祉影响是什么？
• RQ4 哪些设计与监管策略可以实现适合 AI 的关系规范？

主要发现

• AI 可以带来如增加可用性和在社会关系角色中的一致性等好处。
• 存在 AI 可能在人类–AI 互动中培养不健康的依赖或不现实的期望的风险。
• 理解并塑造适合的人类–AI 关系规范对于道德和可信的互动至关重要。
• 关系规范可以影响用户在助手、导师或照护者等角色中的行为和对 AI 的认知。