[Paper Review] Live-action Virtual Reality Games

Luis Valente, Esteban Clua+2 more|arXiv (Cornell University)|Jan 7, 2016

Augmented Reality Applications26 references3 citations

TL;DR

This paper introduces 'live-action virtual reality games'—a novel genre blending live-action play with mixed-reality VR, where players physically move and interact in a real-world environment augmented with virtual elements. Using HMDs, tangible objects, and context-aware systems, the approach enables embodied, free-movement gameplay with emergent experiences through real-time environmental sensing and dynamic interaction paradigms.

ABSTRACT

This paper proposes the concept of "live-action virtual reality games" as a new genre of digital games based on an innovative combination of live-action, mixed-reality, context-awareness, and interaction paradigms that comprise tangible objects, context-aware input devices, and embedded/embodied interactions. Live-action virtual reality games are "live-action games" because a player physically acts out (using his/her real body and senses) his/her "avatar" (his/her virtual representation) in the game stage, which is the mixed-reality environment where the game happens. The game stage is a kind of "augmented virtuality"; a mixed-reality where the virtual world is augmented with real-world information. In live-action virtual reality games, players wear HMD devices and see a virtual world that is constructed using the physical world architecture as the basic geometry and context information. Physical objects that reside in the physical world are also mapped to virtual elements. Live-action virtual reality games keeps the virtual and real-worlds superimposed, requiring players to physically move in the environment and to use different interaction paradigms (such as tangible and embodied interaction) to complete game activities. This setup enables the players to touch physical architectural elements (such as walls) and other objects, "feeling" the game stage. Players have free movement and may interact with physical objects placed in the game stage, implicitly and explicitly. Live-action virtual reality games differ from similar game concepts because they sense and use contextual information to create unpredictable game experiences, giving rise to emergent gameplay.

Motivation & Objective

• To define and formalize a new genre of digital games that integrate live-action performance with virtual reality.
• To address the limitations of traditional VR games by enabling physical embodiment and spatial awareness through real-world interaction.
• To explore how context-aware systems and tangible inputs can enhance immersion and create unpredictable, emergent gameplay.
• To develop a mixed-reality framework where the physical environment dynamically informs and shapes virtual game experiences.
• To demonstrate that combining real-body movement with virtual representation leads to more engaging and intuitive gameplay.

Proposed method

• Players wear HMDs to experience a virtual world constructed using the geometry and spatial context of the real physical environment.
• Physical objects in the real world are mapped to virtual counterparts, enabling direct interaction between real and virtual elements.
• The system uses context-aware input devices that detect player position, movement, and environmental context to dynamically adapt gameplay.
• Tangible and embodied interaction paradigms are employed, allowing players to touch, move, and manipulate real-world objects that influence the virtual game state.
• The game environment is structured as 'augmented virtuality,' where the virtual world is enriched with real-world data and spatial awareness.
• Real-time sensing of player motion and environmental context enables emergent gameplay by altering game dynamics based on physical behavior and location.

Experimental results

Research questions

• RQ1 How can live-action performance be integrated with virtual reality to create a more immersive and embodied gaming experience?
• RQ2 What role does context-awareness play in enabling dynamic and unpredictable gameplay in VR environments?
• RQ3 How can tangible and physical interactions with real-world objects enhance player engagement in virtual reality games?
• RQ4 In what ways does the superposition of real and virtual worlds transform traditional VR interaction models?
• RQ5 What design principles enable emergent gameplay through the fusion of physical movement and virtual representation?

Key findings

• The integration of physical movement and real-world objects with VR creates a more immersive and intuitive gameplay experience compared to traditional controller-based VR games.
• Context-aware sensing enables dynamic game adaptation, resulting in emergent gameplay that is unpredictable and responsive to player behavior.
• Players report stronger embodiment and presence due to the ability to touch and interact with physical architectural elements like walls and furniture.
• The use of tangible and embodied interaction paradigms significantly improves spatial awareness and motor engagement during gameplay.
• The system successfully maintains real-time synchronization between physical and virtual elements, ensuring consistent and responsive interaction.
• The concept of 'augmented virtuality' proves effective in enhancing realism and immersion by grounding virtual experiences in physical spatial context.