[論文レビュー] Is ChatGPT Massively Used by Students Nowadays? A Survey on the Use of Large Language Models such as ChatGPT in Educational Settings

Jérémie Sublime, Ilaria Renna|arXiv (Cornell University)|Dec 23, 2024

Artificial Intelligence in Healthcare and Education被引用数 8

ひとこと要約

tldr: フランスとイタリアの13–25歳の395名の学生を対象に、ChatGPTのようなLLMsが教育でどの程度使用されているかを定量化し、人口統計的パターンを探り、AIリテラシーと教育法への含意を論じる。

ABSTRACT

The rapid adoption of Generative AI (GenAI) based on Large Language Models (LLMs) such as ChatGPT has recently and profoundly impacted education, offering transformative opportunities while raising significant concerns. In this study we present the results of a survey that investigates how 395 students aged 13 to 25 years old in France and Italy integrate LLMs into their educational routines. Key findings include the widespread use of these tools across all age groups and disciplines, with older students and male students demonstrating higher usage frequencies, particularly in scientific contexts. The results also show gender disparities, raising concerns about an emerging AI literacy and technological gender gap. Additionally, while most students utilise LLMs constructively, the lack of systematic proofreading and critical evaluation among younger users suggests potential risks to cognitive skills development, including critical thinking and foundational knowledge. The survey results underscore the need for educational institutions to adapt their curricula to integrate AI tools effectively, promoting ethical use, critical thinking, and awareness of AI limitations and environmental costs. This paper provides actionable recommendations for fostering equitable and effective cohabitation of LLMs and education while addressing emerging challenges.

研究の動機と目的

• Quantify how common ChatGPT/LLMs are used for academic purposes across student age groups.
• Identify patterns in usage by age, gender, and disciplinary context.
• Assess students' ability to critically evaluate LLM outputs and awareness of limitations.
• Highlight potential AI literacy gaps and implications for educational policy and curriculum design.

提案手法

• Design and administer a supervised Google Forms survey in France and Italy during class time (May 2024–Oct 2024).
• Include questions on demographics, use of ChatGPT for humanities and science topics, device usage, and non-academic use; ensure GDPR compliance and parental consent for minors.
• Analyze responses with descriptive statistics, chi-squared tests for associations, confidence intervals, and residuals to identify over-/under-represented category combinations.
• Treat responses as contingent on exclusions (e.g., non-users in sub-studies) to ensure robust subgroup analyses.

Figure 1: ChatGPT use by age range based on answers to question item number 3.

実験結果

リサーチクエスチョン

• RQ1 How common is the use of LLMs for academic purposes among students aged 13–25?
• RQ2 Are there systematic differences in LLM usage by age group, gender, or academic discipline?
• RQ3 What challenges or opportunities do these usage patterns imply for education and AI literacy?

主な発見

• Nearly 70% of youngest respondents (13–16) reported using ChatGPT at least once in an educational context.
• Among all age groups, ChatGPT usage was widespread, with 71% contributing to the chi-squared value for age-related usage differences and a p-value below 10^-7.
• The study sample consisted of 395 respondents, with 211 male, 174 female, 9 other, and 1 missing gender; 344 reported using ChatGPT, while 51 had never used it.
• Respondents across age groups showed varying engagement levels, and the analysis notes higher usage frequencies among older students and males, particularly in scientific contexts.
• The authors discuss a potential AI literacy gap and concerns about cognitive skill development due to unsystematic proofreading and critical evaluation—especially among younger users.
• Results support recommendations for integrating AI tools into curricula with emphasis on ethical use, critical thinking, and awareness of AI limitations.]
• table_headers:[]
• table_rows:[]} } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } } }}ERCIAL**

Figure 2: ChatGPT use frequency by age range based on answers to question items 4.1 and 5.1, excluding non-users.