[Paper Review] Reflection in Game-Based Learning: A Survey of Programming Games

Jennifer Villareale, Colan F. Biemer+2 more|arXiv (Cornell University)|Jun 18, 2020

Educational Games and Gamification29 references4 citations

TL;DR

This paper analyzes 12 programming games to identify how reflection is currently supported in educational game design, revealing that most reflection features are post-gameplay, accuracy-focused, and lack personalization. It proposes three open research directions: integrating reflection as a gameplay loop, enabling cross-level reflection through global process visualization, and supporting diverse reflective behaviors through adaptive, individualized mechanisms.

ABSTRACT

Reflection is a critical aspect of the learning process. However, educational games tend to focus on supporting learning concepts rather than supporting reflection. While reflection occurs in educational games, the educational game design and research community can benefit from more knowledge of how to facilitate player reflection through game design. In this paper, we examine educational programming games and analyze how reflection is currently supported. We find that current approaches prioritize accuracy over the individual learning process and often only support reflection post-gameplay. Our analysis identifies common reflective features, and we develop a set of open areas for future work. We discuss these promising directions towards engaging the community in developing more mechanics for reflection in educational games.

Motivation & Objective

• To investigate how reflection is currently supported in educational programming games.
• To identify common reflective design features and patterns in existing programming games.
• To uncover limitations in current reflection support, particularly its post-gameplay focus and lack of personalization.
• To propose open research areas for designing more effective, process-oriented reflection mechanisms in educational games.
• To support the game design community with actionable insights for integrating reflection into gameplay loops.

Proposed method

• Conducted a close reading analysis of 12 educational programming games using a dual theoretical framework: Schön’s reflection-in-action and reflection-on-action, and Lin et al.’s four reflective design features.
• Mapped reflective features to timing (during vs. after gameplay) and type (e.g., process display, prompts, social discourse) using the analytical framework from Zhu et al. (2019).
• Identified recurring patterns in reflection design, including confinement to local level content and lack of cross-level or personalized reflection support.
• Proposed three open research directions based on observed design gaps: integrating reflection as a gameplay loop, enabling global process visualization across levels, and supporting multiple forms of reflection for diverse learners.
• Suggested design mechanisms such as in-game process prompts, real-time solution editing during visualization, and social discourse features to promote process-focused reflection.
• Advocated for user studies to explore individual differences in reflection and to validate adaptive reflection support in game design.

Experimental results

Research questions

• RQ1 How is reflection currently supported in educational programming games, and what types of reflective features are present?
• RQ2 When do reflective features occur—during gameplay or after?
• RQ3 To what extent do current games support reflection on the learning process versus solution accuracy?
• RQ4 How do reflective features vary across players, and what design strategies can accommodate individual differences in reflection?
• RQ5 What design patterns can support cross-level reflection and promote awareness of evolving problem-solving strategies?

Key findings

• Most reflection features in the analyzed programming games are post-gameplay and focused on correctness, reinforcing accuracy over process understanding.
• Only a few games support reflection-in-action, with limited use of real-time process displays or in-game prompts during gameplay.
• No game examined provided a global, cross-level view of player strategies, limiting reflection on long-term learning behaviors and patterns.
• All reflection features were static and consistent across players, failing to adapt to individual differences in reflective thinking.
• The absence of social discourse features in most games limits opportunities for collaborative, process-oriented reflection and diverse problem-solving perspectives.
• The study identifies three underexplored design directions: integrating reflection as a gameplay loop, enabling cross-level process visualization, and supporting multiple forms of reflection for individual learners.