[Paper Review] Developing and Deploying Industry Standards for Artificial Intelligence in Education (AIED): Challenges, Strategies, and Future Directions

Richard M. Tong, Haoyang Li+2 more|arXiv (Cornell University)|Mar 13, 2024

Online Learning and Analytics4 citations

TL;DR

This paper proposes a multi-tiered framework for developing and deploying industry standards in Artificial Intelligence in Education (AIED), addressing interoperability, scalability, and ethical governance through stakeholder collaboration, iterative development, and alignment with global standards like IEEE and ISO. The key contribution is a strategic roadmap for creating equitable, trustworthy, and globally adoptable AIED systems.

ABSTRACT

The adoption of Artificial Intelligence in Education (AIED) holds the promise of revolutionizing educational practices by offering personalized learning experiences, automating administrative and pedagogical tasks, and reducing the cost of content creation. However, the lack of standardized practices in the development and deployment of AIED solutions has led to fragmented ecosystems, which presents challenges in interoperability, scalability, and ethical governance. This article aims to address the critical need to develop and implement industry standards in AIED, offering a comprehensive analysis of the current landscape, challenges, and strategic approaches to overcome these obstacles. We begin by examining the various applications of AIED in various educational settings and identify key areas lacking in standardization, including system interoperability, ontology mapping, data integration, evaluation, and ethical governance. Then, we propose a multi-tiered framework for establishing robust industry standards for AIED. In addition, we discuss methodologies for the iterative development and deployment of standards, incorporating feedback loops from real-world applications to refine and adapt standards over time. The paper also highlights the role of emerging technologies and pedagogical theories in shaping future standards for AIED. Finally, we outline a strategic roadmap for stakeholders to implement these standards, fostering a cohesive and ethical AIED ecosystem. By establishing comprehensive industry standards, such as those by IEEE Artificial Intelligence Standards Committee (AISC) and International Organization for Standardization (ISO), we can accelerate and scale AIED solutions to improve educational outcomes, ensuring that technological advances align with the principles of inclusivity, fairness, and educational excellence.

Motivation & Objective

• Address the fragmented landscape of AIED due to lack of standardized practices in system interoperability, data integration, and ethical governance.
• Overcome challenges in scaling AIED solutions across diverse educational contexts and socioeconomic environments.
• Establish a collaborative framework involving educational institutions, technology providers, regulators, and learners to ensure equitable and effective AIED deployment.
• Develop a systematic, iterative methodology for creating and updating AIED standards based on real-world feedback and technological evolution.
• Align emerging AIED standards with global regulatory frameworks such as the EU AI Act and ISO/IEC JTC 1/SC 42 to ensure legal compliance and technical robustness.

Proposed method

• Propose a multi-tiered framework that leverages existing standards (e.g., IEEE Learning Technology Standards, IEEE AISC), builds AIED-specific standards, and extends them for emerging technologies like GenAI and LLMs.
• Integrate stakeholder engagement across educational institutions, technology developers, regulators, and learners to co-create standards with diverse perspectives.
• Implement iterative development cycles with pilot deployments to test and refine standards in real-world educational settings.
• Establish feedback loops from field applications to continuously improve and adapt standards over time.
• Align AIED standards with international regulatory frameworks such as the EU AI Act and ISO/IEC JTC 1/SC 42 for global consistency and compliance.
• Advocate for policy and regulatory support through incentives, funding, and accountability mechanisms to drive adoption and enforcement of AIED standards.

Experimental results

Research questions

• RQ1 How can a multi-tiered framework be designed to standardize AIED systems across interoperability, data integration, and ethical governance?
• RQ2 What role do existing standards from IEEE and ISO play in accelerating the development of AIED-specific standards?
• RQ3 How can stakeholder collaboration among educators, technologists, and regulators ensure equitable and inclusive AIED deployment?
• RQ4 In what ways can iterative development and feedback mechanisms improve the long-term relevance and effectiveness of AIED standards?
• RQ5 How can AIED standards be aligned with evolving regulatory frameworks such as the EU AI Act and ISO/IEC JTC 1/SC 42?

Key findings

• The lack of standardized practices in AIED leads to fragmented ecosystems that hinder interoperability, scalability, and ethical governance across educational platforms.
• A multi-tiered framework—leveraging, building, and extending standards—provides a scalable and inclusive approach to AIED standardization.
• Collaboration among educational institutions, technology providers, and regulatory bodies is essential to ensure AIED systems are accessible and equitable across diverse learner populations.
• Iterative development with real-world pilot implementations enables continuous improvement and adaptation of AIED standards to evolving technological and pedagogical needs.
• Alignment with the EU AI Act and ISO/IEC JTC 1/SC 42 ensures that AIED standards meet global regulatory and technical requirements for risk management, transparency, and data governance.
• A strategic roadmap for coalition-building, needs assessment, and policy advocacy provides a clear, actionable path for stakeholders to implement and enforce AIED standards at scale.