[Paper Review] Generative AI in Higher Education: Seeing ChatGPT Through Universities' Policies, Resources, and Guidelines

Hui Wang, Anh Kim Dang+2 more|arXiv (Cornell University)|Dec 8, 2023

Artificial Intelligence in Healthcare and Education4 citations

TL;DR

This study analyzes policies and guidelines from top U.S. universities on generative AI, particularly ChatGPT, revealing a widespread cautious yet open institutional approach. It identifies key concerns around ethics, accuracy, and data privacy, and provides four pedagogical implications for educators and two policy recommendations for institutions to effectively integrate GenAI in higher education.

ABSTRACT

The advancements in Generative Artificial Intelligence (GenAI) provide opportunities to enrich educational experiences, but also raise concerns about academic integrity. Many educators have expressed anxiety and hesitation in integrating GenAI in their teaching practices, and are in needs of recommendations and guidance from their institutions that can support them to incorporate GenAI in their classrooms effectively. In order to respond to higher educators' needs, this study aims to explore how universities and educators respond and adapt to the development of GenAI in their academic contexts by analyzing academic policies and guidelines established by top-ranked U.S. universities regarding the use of GenAI, especially ChatGPT. Data sources include academic policies, statements, guidelines, and relevant resources provided by the top 100 universities in the U.S. Results show that the majority of these universities adopt an open but cautious approach towards GenAI. Primary concerns lie in ethical usage, accuracy, and data privacy. Most universities actively respond and provide diverse types of resources, such as syllabus templates, workshops, shared articles, and one-on-one consultations focusing on a range of topics: general technical introduction, ethical concerns, pedagogical applications, preventive strategies, data privacy, limitations, and detective tools. The findings provide four practical pedagogical implications for educators in teaching practices: accept its presence, align its use with learning objectives, evolve curriculum to prevent misuse, and adopt multifaceted evaluation strategies rather than relying on AI detectors. Two recommendations are suggested for educators in policy making: establish discipline-specific policies and guidelines, and manage sensitive information carefully.

Motivation & Objective

• To understand how top-ranked U.S. universities are responding to the rise of generative AI, especially ChatGPT, in academic settings.
• To identify institutional policies, guidelines, and support resources related to GenAI use in higher education.
• To examine the primary concerns universities have regarding ethical use, accuracy, and data privacy in GenAI.
• To derive practical pedagogical implications for educators integrating GenAI into teaching and assessment.
• To provide actionable recommendations for institutions on developing discipline-specific GenAI policies and managing sensitive data.

Proposed method

• Systematic analysis of academic policies, statements, guidelines, and institutional resources from the top 100 U.S. universities.
• Thematic coding of institutional documents to identify recurring concerns, support mechanisms, and policy stances toward GenAI.
• Categorization of available resources into types such as syllabus templates, workshops, shared articles, and one-on-one consultations.
• Identification of recurring themes in institutional guidance, including technical introduction, ethical considerations, pedagogical applications, and detection tools.
• Synthesis of findings into pedagogical implications and policy recommendations based on institutional responses.
• Use of qualitative content analysis to extract actionable insights from institutional documentation without primary data collection from educators or students.

Experimental results

Research questions

• RQ1 How do top U.S. universities currently define and regulate the use of generative AI, particularly ChatGPT, in academic settings?
• RQ2 What types of institutional resources and support mechanisms do universities provide to educators for integrating GenAI into teaching?
• RQ3 What are the primary concerns expressed by universities regarding the use of GenAI in higher education?
• RQ4 What pedagogical strategies do institutions recommend for aligning GenAI use with learning objectives?
• RQ5 What policy-level recommendations emerge from institutional responses to GenAI integration?

Key findings

• The majority of top U.S. universities adopt an open but cautious stance toward generative AI, balancing innovation with risk mitigation.
• Primary institutional concerns center on ethical usage, factual accuracy, and data privacy in AI-generated content.
• Most universities provide diverse support resources, including syllabus templates, workshops, shared articles, and one-on-one consultations.
• Institutional resources cover a broad range of topics: technical basics, ethical considerations, pedagogical integration, misuse prevention, data privacy, limitations of GenAI, and detection tools.
• Four key pedagogical implications are derived: accept GenAI’s presence, align its use with learning objectives, evolve curricula to prevent misuse, and use multifaceted evaluation strategies beyond AI detectors.
• Two policy recommendations are proposed: develop discipline-specific GenAI guidelines and implement strict controls for handling sensitive information.