[Paper Review] SONIA: an immersive customizable virtual reality system for the education and exploration of brain networks

Owen Hellum, Christopher J. Steele+1 more|arXiv (Cornell University)|Jan 24, 2023

Anatomy and Medical Technology18 references4 citations

TL;DR

SONIA is a novel, immersive, and customizable virtual reality system designed for the education and exploration of brain networks, enabling multi-scale interaction with detailed neuroanatomical and functional connectivity data. Evaluated through user studies, it demonstrates high usability, strong visual appeal, and significant educational value, marking a first-of-its-kind integration of customizable narratives and 3D brain sub-system visualization in VR.

ABSTRACT

While mastery of neuroanatomy is important for the investigation of the brain, there is an increasing interest in exploring the neural pathways to better understand the roles of neural circuitry in brain functions. To tackle the limitations of traditional 2D-display-based neuronavigation software in intuitively visualizing complex 3D anatomies, several virtual reality (VR) and augmented reality (AR) solutions have been proposed to facilitate neuroanatomical education. However, with the increasing knowledge on brain connectivity and the functioning of the sub-systems, there is still a lack of similar software solutions for the education and exploration of these topics, which demand more elaborate visualization and interaction strategies. To address this gap, we designed the immerSive custOmizable Neuro learnIng plAform (SONIA), a novel user-friendly VR software system with a multi-scale interaction paradigm that allows flexible customization of learning materials. With both quantitative and qualitative evaluations through user studies, the proposed system is shown to have high usability, attractive visual design, and good educational value. As the first immersive system that integrates customizable design and detailed narratives of the brain sub-systems for the education of neuroanatomy and brain connectivity, SONIA showcases new potential directions and provides valuable insights regarding medical learning and exploration in VR.

Motivation & Objective

• To address the lack of immersive, interactive VR tools for teaching and exploring brain connectivity and sub-system functions.
• To overcome limitations of 2D neuro-navigation software in visualizing complex 3D brain anatomies and neural pathways.
• To develop a user-friendly VR platform that supports customizable learning materials and detailed narratives of brain sub-systems.
• To evaluate the system’s usability, visual design, and educational effectiveness through quantitative and qualitative user studies.

Proposed method

• Design of a multi-scale interaction paradigm allowing users to navigate from macroscopic brain structures to microscopic neural circuits.
• Implementation of a customizable VR interface enabling users to tailor learning content and narratives based on educational goals.
• Integration of detailed neuroanatomical and functional connectivity data into a 3D immersive environment using VR rendering techniques.
• Use of Unity3D and VR hardware (e.g., Meta Quest 2) to build and deploy the system for real-time interaction.
• Incorporation of narrative-driven educational content to guide users through brain sub-systems and their functional roles.
• Conducting user studies with both quantitative metrics (e.g., system usability scale) and qualitative feedback to evaluate performance and user experience.

Experimental results

Research questions

• RQ1 How does SONIA’s immersive VR environment compare to traditional 2D neuroanatomy tools in supporting user understanding of complex 3D brain structures?
• RQ2 To what extent does the customizable narrative feature in SONIA enhance user engagement and learning outcomes in brain network education?
• RQ3 What is the perceived usability and visual appeal of SONIA among users with varying levels of neuroscience expertise?
• RQ4 How effective is SONIA in facilitating exploration of brain connectivity and sub-system functions in a virtual environment?

Key findings

• SONIA achieved high system usability scores, indicating strong user-friendliness and intuitive navigation in the VR environment.
• Users reported high satisfaction with the visual design and immersive quality of the VR experience.
• The customizable narrative feature was perceived as a key strength, enabling personalized and context-rich learning pathways.
• Qualitative feedback confirmed that SONIA effectively supports exploration of brain connectivity and sub-system functions in an engaging manner.
• The system demonstrated strong educational value, with users reporting improved understanding of complex brain network interactions.
• The multi-scale interaction paradigm was successfully adopted by users, allowing seamless transitions between different levels of anatomical and functional detail.