[论文解读] The Machine Learning Canvas: Empirical Findings on Why Strategy Matters More Than AI Code Generation

Martin Prause|arXiv (Cornell University)|Jan 5, 2026

Ethics and Social Impacts of AI被引用 0

一句话总结

论文提出了机器学习画布，并显示战略因素——战略、流程、生态系统和支持——推动ML项目成功，且组织支持影响战略及后续工作流与基础设施；AI代码生成加速编码但不能保证成功。

ABSTRACT

Despite the growing popularity of AI coding assistants, over 80% of machine learning (ML) projects fail to deliver real business value. This study creates and tests a Machine Learning Canvas, a practical framework that combines business strategy, software engineering, and data science in order to determine the factors that lead to the success of ML projects. We surveyed 150 data scientists and analyzed their responses using statistical modeling. We identified four key success factors: Strategy (clear goals and planning), Process (how work gets done), Ecosystem (tools and infrastructure), and Support (organizational backing and resources). Our results show that these factors are interconnected - each one affects the next. For instance, strong organizational support results in a clearer strategy (β= 0.432, p < 0.001), which improves work processes (β= 0.428, p < 0.001) and builds better infrastructure (β= 0.547, p < 0.001). Together, these elements determine whether a project succeeds. The surprising finding? Although AI assistants make coding faster, they don't guarantee project success. AI assists with the "how" of coding but cannot replace the "why" and "what" of strategic thinking.

研究动机与目标

• 需要一个将商业战略与ML交付连接起来的综合框架以提升动力。
• 开发并测试机器学习画布作为一个实用框架。
• 量化战略因素与项目成功之间的关系。
• 展示AI编码助手加速编码但不保证商业价值。

提出的方法

• 对150名数据科学家的调查。
• 统计建模以分析因素与项目成功之间的关系。
• 在标准化系数和p值的基础上估计路径关系。

实验结果

研究问题

• RQ1 战略、流程、生态系统和支持是否独立及共同影响ML项目成功？
• RQ2 这些因素如何交互影响成功结果？
• RQ3 组织背书是否能够塑造战略及下游流程与基础设施？
• RQ4 AI编码助手在实现项目成功中的作用？

主要发现

• 组织支持对战略有强烈影响（β = 0.432，p < 0.001）。
• 战略对流程有积极影响（β = 0.428，p < 0.001）。
• 战略也改善生态系统/基础设施（β = 0.547，p < 0.001）。
• 四个因素相互关联，共同决定项目成功。
• AI助手加速编码但不能替代用于成功的战略决策。