[Paper Review] Artificial Intelligence Index Report 2023

Nestor Maslej, Loredana Fattorini+12 more|arXiv (Cornell University)|Oct 5, 2023

Economic and Technological Innovation188 citations

TL;DR

A comprehensive, data-driven overview of AI developments in 2023, introducing new chapters on public opinion, model performance, legislation trends, and environmental impact of AI systems.

ABSTRACT

Welcome to the sixth edition of the AI Index Report. This year, the report introduces more original data than any previous edition, including a new chapter on AI public opinion, a more thorough technical performance chapter, original analysis about large language and multimodal models, detailed trends in global AI legislation records, a study of the environmental impact of AI systems, and more. The AI Index Report tracks, collates, distills, and visualizes data related to artificial intelligence. Our mission is to provide unbiased, rigorously vetted, broadly sourced data in order for policymakers, researchers, executives, journalists, and the general public to develop a more thorough and nuanced understanding of the complex field of AI. The report aims to be the world's most credible and authoritative source for data and insights about AI.

Motivation & Objective

• Provide unbiased, rigorously vetted data on AI for policymakers, researchers, and the public.
• Track and visualize global AI developments across technical performance, models, legislation, and societal impact.
• Introduce new chapters on AI public opinion, large language and multimodal models, and environmental footprint.
• Synthesize data from diverse sources to offer a nuanced view of AI's trajectory.
• Enhance accessibility of AI insights to inform decision-making and accountability.

Proposed method

• Compile and harmonize original datasets related to AI performance, policy, and public opinion.
• Develop new analyses and visualizations for higher transparency and accessibility of AI data.

Experimental results

Research questions

• RQ1 What are the latest trends in AI performance and capabilities, including large language and multimodal models?
• RQ2 How do public opinion and policy environments shape and respond to AI development?
• RQ3 What is the environmental impact of AI systems and how is it evolving?
• RQ4 What do global AI legislation records indicate about governance and regulation trajectories?
• RQ5 How can data be presented to support informed decision-making by diverse stakeholders?

Key findings

• Introduces more original data than previous editions, including new chapters on public opinion, performance, and environmental impact.
• Provides analyses of large language and multimodal models and their implications.
• Offers detailed trends in global AI legislation and governance.
• Examines the environmental footprint of AI systems.
• Aims to deliver a credible, authoritative data source for multiple audiences.