[论文解读] Operationalizing the Blueprint for an AI Bill of Rights: Recommendations for Practitioners, Researchers, and Policy Makers

Alex Oesterling, Usha Bhalla+2 more|arXiv (Cornell University)|Jul 11, 2024

Ethics and Social Impacts of AI被引用 4

一句话总结

本文提供了一份实用且基于研究的指南，旨在将美国《人工智能权利法案蓝图》的原则——如安全性、公平性、透明度和人工监督——转化为从业者、研究人员和政策制定者可操作的策略。该文将前沿研究成果整合为易于理解的建议，同时指出了监管理想与现实实施之间存在的关键权衡与研究空白。

ABSTRACT

As Artificial Intelligence (AI) tools are increasingly employed in diverse real-world applications, there has been significant interest in regulating these tools. To this end, several regulatory frameworks have been introduced by different countries worldwide. For example, the European Union recently passed the AI Act, the White House issued an Executive Order on safe, secure, and trustworthy AI, and the White House Office of Science and Technology Policy issued the Blueprint for an AI Bill of Rights (AI BoR). Many of these frameworks emphasize the need for auditing and improving the trustworthiness of AI tools, underscoring the importance of safety, privacy, explainability, fairness, and human fallback options. Although these regulatory frameworks highlight the necessity of enforcement, practitioners often lack detailed guidance on implementing them. Furthermore, the extensive research on operationalizing each of these aspects is frequently buried in technical papers that are difficult for practitioners to parse. In this write-up, we address this shortcoming by providing an accessible overview of existing literature related to operationalizing regulatory principles. We provide easy-to-understand summaries of state-of-the-art literature and highlight various gaps that exist between regulatory guidelines and existing AI research, including the trade-offs that emerge during operationalization. We hope that this work not only serves as a starting point for practitioners interested in learning more about operationalizing the regulatory guidelines outlined in the Blueprint for an AI BoR but also provides researchers with a list of critical open problems and gaps between regulations and state-of-the-art AI research. Finally, we note that this is a working paper and we invite feedback in line with the purpose of this document as described in the introduction.

研究动机与目标

• 弥合监管框架（如人工智能权利法案）与从业者实际实施之间的差距。
• 将关于人工智能可信性的复杂技术研究转化为非专家从业者可理解且可操作的指导。
• 识别原则之间（例如隐私与可解释性）的关键研究空白与权衡，以指导未来研究。
• 倡导对人工智能系统性能进行标准化、持续性的报告，涵盖公平性、隐私、鲁棒性等维度。
• 通过透明、可审计的人工智能系统文档，支持用户和利益相关者做出知情决策。

提出的方法

• 系统性地将《人工智能权利法案蓝图》中的每一项原则与公平性、隐私性、可解释性和鲁棒性等领域的现有前沿研究相对应。
• 以非技术语言总结诸如事后解释方法、公平性约束和差分隐私技术等技术方法。
• 提出一种基于现有工具（如Model Cards、Datasheets和SMACTR）的标准化报告框架，以实现系统文档的一致性。
• 通过实证和理论分析，突出原则之间的权衡，例如提高可解释性可能损害数据隐私或公平性。
• 建议实施持续监控与全生命周期报告，以确保长期合规性与问责制。
• 鼓励研究人员、政策制定者与从业者之间的协作，使研究成果与监管需求保持一致。

实验结果

研究问题

• RQ1 尽管现有研究技术复杂，从业者如何才能在现实的人工智能系统中有效实施人工智能权利法案的原则？
• RQ2 人工智能系统中公平性、隐私性、透明度和鲁棒性之间的关键技术权衡是什么？这些权衡又该如何管理？
• RQ3 标准化报告框架在提升人工智能系统间的信任、可比性和问责制方面有何作用？
• RQ4 现有研究方法在支持监管合规方面存在哪些不足？关键的研究空白在哪里？
• RQ5 如何在不削弱用户对自动化系统信任的前提下，有意义地整合人工监督与备用机制？

主要发现

• 人工智能权利法案中的监管原则与实际实施之间存在显著脱节，主要源于底层研究的技术复杂性。
• 实施公平性通常需要权衡，例如增加模型复杂度，或在强制可解释性时意外依赖敏感属性。
• 可解释性与数据隐私经常冲突，因为详细解释可能被用于成员身份推断攻击或数据重建攻击。
• “被遗忘的权利”可能使过往的解释失效，并损害算法救济能力，尤其是在数据删除后重新训练模型的情况下。
• 人类备用机制可能因用户对解释的过度信任而被削弱，从而降低用户请求人工复核的意愿。
• 标准化报告框架（如Model Cards和SMACTR）可提升透明度并促进人工智能系统间的公平比较，但其广泛应用需依赖监管强制执行。