[Paper Review] Artificial Intelligence Index Report 2024

Nestor Maslej, Loredana Fattorini+12 more|arXiv (Cornell University)|May 29, 2024

Artificial Intelligence in Healthcare and Education158 citations

TL;DR

The 2024 AI Index report is the most comprehensive edition to date, expanding coverage to technical AI advances, public perception, geopolitics, and new data on training costs and the impact on science and medicine.

ABSTRACT

The 2024 Index is our most comprehensive to date and arrives at an important moment when AI's influence on society has never been more pronounced. This year, we have broadened our scope to more extensively cover essential trends such as technical advancements in AI, public perceptions of the technology, and the geopolitical dynamics surrounding its development. Featuring more original data than ever before, this edition introduces new estimates on AI training costs, detailed analyses of the responsible AI landscape, and an entirely new chapter dedicated to AI's impact on science and medicine. The AI Index report tracks, collates, distills, and visualizes data related to artificial intelligence (AI). Our mission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The AI Index is recognized globally as one of the most credible and authoritative sources for data and insights on artificial intelligence. Previous editions have been cited in major newspapers, including the The New York Times, Bloomberg, and The Guardian, have amassed hundreds of academic citations, and been referenced by high-level policymakers in the United States, the United Kingdom, and the European Union, among other places. This year's edition surpasses all previous ones in size, scale, and scope, reflecting the growing significance that AI is coming to hold in all of our lives.

Motivation & Objective

• Broaden the scope to cover technical AI advancements, public perceptions, and geopolitical dynamics surrounding AI development.
• Provide more original data and analyses to inform policymakers, researchers, and the public.
• Introduce new chapters and metrics, including AI training cost estimates and responsible AI landscape.
• Highlight AI's impact on science and medicine through a dedicated new chapter.

Proposed method

• Aggregate and visualize diverse data sources related to AI to ensure unbiased, rigorously vetted insights.
• Present new estimates on AI training costs.
• Analyze the responsible AI landscape and governance considerations.
• Offer narrative and data-driven synthesis to illuminate AI's societal effects.
• Publish comprehensive, scalable insights intended for policymakers, researchers, journalists, and the public.

Experimental results

Research questions

• RQ1 What are the key technical, social, and geopolitical trends shaping AI in 2024?
• RQ2 How do public perceptions of AI align with technical progress and policy actions?
• RQ3 What are the costs associated with AI training and how do they evolve?
• RQ4 What is the state of responsible AI practices and governance across sectors?
• RQ5 What is AI's impact on science and medicine, and how is it transforming these fields?

Key findings

• The 2024 edition is the largest in size, scale, and scope to date.
• New estimates on AI training costs are introduced.
• The report expands coverage to public perceptions and geopolitical dynamics.
• A dedicated chapter analyzes AI's impact on science and medicine.
• The AI Index continues to be a core, credible data source for policymakers and researchers.