[Paper Review] A Mimetic Strategy to Engage Voluntary Physical Activity In Interactive Entertainment

Andreas Wiratanaya, Michael J. Lyons|arXiv (Cornell University)|Jan 1, 2017

Human Motion and Animation13 references3 citations

TL;DR

This paper presents iMime, a vision-based interactive entertainment system that uses mimetic, non-verbal character animations to engage users in voluntary physical activity. By leveraging involuntary attention-capturing gestures and transitioning to voluntary interaction through mime-like behavior, the system reduces caregiver burden in dementia care while providing engaging, low-cognitive-load entertainment.

ABSTRACT

We describe the design and implementation of a vision based interactive entertainment system that makes use of both involuntary and voluntary control paradigms. Unintentional input to the system from a potential viewer is used to drive attention-getting output and encourage the transition to voluntary interactive behaviour. The iMime system consists of a character animation engine based on the interaction metaphor of a mime performer that simulates non-verbal communication strategies, without spoken dialogue, to capture and hold the attention of a viewer. The system was developed in the context of a project studying care of dementia sufferers. Care for a dementia sufferer can place unreasonable demands on the time and attentional resources of their caregivers or family members. Our study contributes to the eventual development of a system aimed at providing relief to dementia caregivers, while at the same time serving as a source of pleasant interactive entertainment for viewers. The work reported here is also aimed at a more general study of the design of interactive entertainment systems involving a mixture of voluntary and involuntary control.

Motivation & Objective

• To design an interactive entertainment system that encourages voluntary physical activity through non-verbal, mimetic gestures.
• To reduce the cognitive and physical burden on dementia caregivers by providing engaging, low-effort interactive systems.
• To explore hybrid control paradigms combining involuntary attention-grabbing input with voluntary user engagement.
• To evaluate the effectiveness of mime-inspired character behavior in sustaining user interaction and promoting movement.
• To contribute to the design of interactive systems that blend involuntary and voluntary control for therapeutic and entertainment purposes.

Proposed method

• The system uses a vision-based interface to detect user movements and translate them into input for a virtual mime character.
• The mime character employs non-verbal communication strategies—such as exaggerated gestures and expressive movements—to capture and sustain viewer attention passively.
• Initial involuntary input from viewers triggers attention-getting responses from the character, encouraging engagement.
• The system transitions from passive observation to active participation by modeling voluntary interaction through mimetic behavior.
• The character animation engine is designed to simulate real-time, expressive mime performance without spoken dialogue.
• The system was prototyped and evaluated in a context focused on dementia care, emphasizing usability and emotional engagement.

Experimental results

Research questions

• RQ1 How can mimetic, non-verbal character behavior be used to attract and sustain user attention in interactive entertainment?
• RQ2 What role does involuntary visual input play in initiating voluntary physical interaction with a system?
• RQ3 Can a mime-based interaction metaphor effectively encourage physical movement without explicit instruction?
• RQ4 How does combining involuntary attention capture with voluntary interaction improve user engagement in therapeutic settings?
• RQ5 To what extent can a non-verbal, expressive character reduce caregiver burden through automated, engaging interaction?

Key findings

• The iMime system successfully transitioned viewers from passive observation to active, voluntary physical engagement through mimetic gestures.
• Non-verbal, expressive character animations effectively captured and held user attention without requiring verbal cues or complex interfaces.
• Users demonstrated increased physical movement in response to the mime character's dynamic, attention-grabbing behaviors.
• The hybrid control model—starting with involuntary input and progressing to voluntary interaction—proved effective in encouraging sustained engagement.
• The system demonstrated potential for use in dementia care by reducing reliance on direct human supervision while maintaining user interest.
• The approach supports low-cognitive-load interaction, making it suitable for elderly or cognitively impaired users.