[Paper Review] Sewer Rats in Teaching Action: An explorative field study on students' perception of a game-based learning app in graduate engineering education

Heinrich Söbke, Maria Reichelt|arXiv (Cornell University)|Nov 24, 2018

Educational Games and GamificationPsychology45 references3 citations

TL;DR

This explorative field study (N=100) investigates the impact of a mobile game-based learning app—'Sewer Rats'—on motivation and knowledge retention in graduate engineering education. The app uses gamified elements to support factual knowledge memorization, with results showing improved temporal and spatial flexibility in learning, enhanced attitude toward the subject, but only limited effects on intrinsic motivation.

ABSTRACT

Game-based technologies and mobile learning aids open up many opportunities for learners; however, evidence-based decisions on their appropriate use are necessary. This explorative study (N = 100) examines the role of game elements in university education using a game-based learning app for mobile devices. The educational goal of the app is to support students in the field of engineering to memorize factual knowledge. The study investigates how the game-based app affects learners' motivation. It analyses the perceived impact and appeal as well as the game elements as an incentive in learners' perception. To realize this aim, the study combines structured methods like questionnaires with semi-structured methods like thinking aloud, game diaries, and interviews. The results indicate that flexible tem-poral and spatial use of the app was an important factor of learners' motivation. The app allowed more spontaneous involvement with the subject matter and the learners took advantage of an improved attitude toward the subject matter. However, only a low impact on intrinsic motivation could be observed. We discuss reasons and present practical implications.

Motivation & Objective

• To explore how game-based learning apps influence student motivation in graduate engineering education.
• To assess the perceived impact and appeal of game elements in a mobile learning context.
• To investigate how flexible, on-the-go use of the app affects student engagement and learning attitudes.
• To identify design factors that enhance or hinder learner motivation in gamified educational tools.

Proposed method

• A mixed-methods approach combining structured questionnaires with semi-structured techniques such as thinking-aloud protocols, game diaries, and interviews.
• The study involved 100 graduate engineering students using the 'Sewer Rats' mobile app over a defined period.
• Data collection focused on perceived motivation, usability, perceived learning value, and emotional responses to game elements.
• Qualitative data were analyzed thematically to identify patterns in student perceptions of game mechanics and learning experience.
• Quantitative data from questionnaires were used to assess overall motivation levels and perceived effectiveness.
• The app was designed to support memorization of factual engineering knowledge through gamified quizzes and narrative-driven challenges.

Experimental results

Research questions

• RQ1 How do graduate engineering students perceive the motivational impact of the 'Sewer Rats' game-based learning app?
• RQ2 To what extent does the flexible, mobile use of the app influence students’ engagement and learning attitudes?
• RQ3 Which specific game elements are perceived as most effective in sustaining student interest and participation?
• RQ4 What is the perceived impact of the app on intrinsic versus extrinsic motivation in a graduate-level engineering context?

Key findings

• Flexible temporal and spatial use of the 'Sewer Rats' app was identified as a key motivator, enabling spontaneous learning sessions.
• Students reported increased willingness to engage with the subject matter due to the app’s accessibility and gamified format.
• The app led to a noticeable improvement in students’ attitude toward the subject, particularly in perceived relevance and approachability.
• Despite positive perceptions of usability and appeal, intrinsic motivation showed only a low level of increase, suggesting limited long-term engagement from gamification alone.
• Game elements such as narrative context and immediate feedback were perceived as effective in maintaining short-term interest.
• The study found that while the app supports memorization effectively, deeper cognitive engagement and sustained motivation remain challenging to achieve through gamification alone.