[论文解读] Navigating the Complexity of Generative AI Adoption in Software Engineering

Daniel Russo|arXiv (Cornell University)|Jul 12, 2023

Big Data and Business Intelligence被引用 18

一句话总结

本论文采用收敛混合方法设计来建模生成式 AI/LLMs 在软件工程中的采用，揭示工作流兼容性在早期阶段主要驱动采用，而有用性和社会因素的作用较小。

ABSTRACT

In this paper, the adoption patterns of Generative Artificial Intelligence (AI) tools within software engineering are investigated. Influencing factors at the individual, technological, and societal levels are analyzed using a mixed-methods approach for an extensive comprehension of AI adoption. An initial structured interview was conducted with 100 software engineers, employing the Technology Acceptance Model (TAM), the Diffusion of Innovations theory (DOI), and the Social Cognitive Theory (SCT) as guiding theories. A theoretical model named the Human-AI Collaboration and Adaptation Framework (HACAF) was deduced using the Gioia Methodology, characterizing AI adoption in software engineering. This model's validity was subsequently tested through Partial Least Squares - Structural Equation Modeling (PLS-SEM), using data collected from 183 software professionals. The results indicate that the adoption of AI tools in these early integration stages is primarily driven by their compatibility with existing development workflows. This finding counters the traditional theories of technology acceptance. Contrary to expectations, the influence of perceived usefulness, social aspects, and personal innovativeness on adoption appeared to be less significant. This paper yields significant insights for the design of future AI tools and supplies a structure for devising effective strategies for organizational implementation.

研究动机与目标

• 调查影响软件工程中生成式 AI 工具采用的因素。
• 结合既有理论（TAM、DOI、SCT）整合个体、技术和社会视角。
• 开发并验证一个关于软件工程中人机协作与适应的理论模型（HACAF）。
• 为软件团队中有效的 AI 工具实现提供设计与组织方面的指南。

提出的方法

• 应用收敛混合方法，结合定量调查与定性分析。
• 以技术接受模型（TAM）、创新扩散理论（DOI）和社会认知理论（SCT）为基础。
• 采用 Gioia 方法论从定性数据中进行理论归纳，并使用 PLS-SEM 进行模型验证。
• 从100名软件工程师（调查）和183名软件工程师（PLS-SEM 验证）收集数据。
• 进行主题分析与迭代编码，以推导一阶概念、二阶主题和聚合维度。

实验结果

研究问题

• RQ1 影响软件工程中生成式 AI 工具采用的因素有哪些？

主要发现

• 采用主要由 AI 工具与现有开发工作流的兼容性驱动。
• 感知有用性、社会因素和个人创新性在这个早期采用阶段的影响较弱。
• 开发并验证了一个理论模型——人机协作与适应框架（HACAF）。
• 这些发现为软件工程中 AI 工具设计和组织实施策略提供了指导。