[論文レビュー] Enhancing Programming Education with ChatGPT: A Case Study on Student Perceptions and Interactions in a Python Course

Boxaun Ma, Li Chen+1 more|arXiv (Cornell University)|Mar 20, 2024

Online Learning and Analytics被引用数 5

ひとこと要約

この研究は、八週間のPythonコースにおける1年生の大学生がChatGPTをどのように使用するかを調査し、アンケートと学生–ChatGPTの対話を分析して、認識された利益・相互作用・制限を評価する。

ABSTRACT

The integration of ChatGPT as a supportive tool in education, notably in programming courses, addresses the unique challenges of programming education by providing assistance with debugging, code generation, and explanations. Despite existing research validating ChatGPT's effectiveness, its application in university-level programming education and a detailed understanding of student interactions and perspectives remain limited. This paper explores ChatGPT's impact on learning in a Python programming course tailored for first-year students over eight weeks. By analyzing responses from surveys, open-ended questions, and student-ChatGPT dialog data, we aim to provide a comprehensive view of ChatGPT's utility and identify both its advantages and limitations as perceived by students. Our study uncovers a generally positive reception toward ChatGPT and offers insights into its role in enhancing the programming education experience. These findings contribute to the broader discourse on AI's potential in education, suggesting paths for future research and application.

研究の動機と目的

• Examine how first-year university students utilize ChatGPT in an eight-week Python programming course.
• Characterize student perceptions of ChatGPT’s role, benefits, and drawbacks in programming education.
• Analyze dialogue data between students and ChatGPT to understand interaction patterns across learning activities.

提案手法

• Mixed-methods design combining pre- and post-questionnaires with open-ended questions.
• Collection and thematic analysis of student–ChatGPT dialogue data.
• Log-based analysis of activity over the course timeline and categorization of question types.

実験結果

リサーチクエスチョン

• RQ1 How do students perceive the usefulness of ChatGPT for learning Python programming?
• RQ2 What are the perceived benefits and limitations of using ChatGPT in a university programming course?
• RQ3 How do students interact with ChatGPT across different course activities (exercises, concept mastery, problem-solving)?

主な発見

• Post-course data show overwhelmingly positive views of ChatGPT as a learning tool for programming.
• Students frequently used ChatGPT for debugging, explanations, and code examples, with conceptual questions forming a significant portion of interactions.
• Dialogue analysis reveals patterns aligned with curriculum milestones, with spikes in use during topics like conditionals and loops.
• Qualitative feedback highlights rapid responses, error identification, and tailored explanations as key benefits.
• Drawbacks include concerns about dependency, potential incorrect answers, and misalignment with course scope.
• Suggestions for improvement include step-by-step hints, interactive questioning, integration with development environments, and access to multiple correct solutions.