[论文解读] Immersive Virtual Worlds: Multi-sensory Virtual Environments for Health and Safety Training

Glyn Lawson, Emily Shaw+4 more|arXiv (Cornell University)|Jan 1, 2019

Virtual Reality Applications and Impacts参考文献 75被引用 4

一句话总结

本研究开发了一种低成本、多感官虚拟环境（MS-VE），利用Unity和Arduino控制的执行器整合视觉、听觉、嗅觉及热反馈，以增强健康与安全培训中的真实感。结果显示，与标准VR相比，MS-VE能提升行为有效性与学员参与度，但其在现实行为迁移方面的有效性尚未得到证实。

ABSTRACT

Virtual environments (VEs) offer potential benefits to health and safety training: exposure to dangerous (virtual) environments; the opportunity for experiential learning; and a high level of control over the training, in that aspects can be repeated or reviewed based on the trainee's performance. However, VEs are typically presented as audiovisual (AV) systems, whereas engagement of other senses could increase the immersion in the virtual experience. Moreover, other senses play a key role in certain health and safety contexts, for example the feel of heat and smell in a fire or smell in a fuel leak. A multisensory (MS) VE was developed, which provided simulated heat and smell in accordance with events in a virtual world. As users approached a virtual fire, they felt heat from three 2 kW heaters and smelled smoke from a scent diffuser. Behaviours in the MS VE demonstrated higher validity than those in a comparable AV VE, which ratings and verbatim responses indicated was down to a greater belief that participants were in a real fire. However, a study of the effectiveness of the MS VE as a training tool demonstrated that it did not offer benefits over AV as measured by a written knowledge test and subjective ratings of engagement, attitude towards health and safety and desire to repeat. However, the study found further evidence for the use of AV VEs in health and safety training, particularly as the subjective ratings were generally better than for PowerPoint based training. Despite the lack of evidence for MS simulation on traditional measures of training, the different attitudes and experiences of users suggest that it may have value as a system for changing trainees' attitudes towards their personal safety and awareness. This view was supported by feedback from industrial partners.

研究动机与目标

• 调查多感官虚拟环境（MS-VE）是否能提升健康与安全培训中的真实感与参与度。
• 评估MS-VE在应急模拟场景中相较于音视频（AV）虚拟环境的行为有效性。
• 评估MS-VE相较于传统PowerPoint培训在提升培训效果方面的有效性。
• 开发一种安全、低成本的技术解决方案，利用现成组件将加热与气味功能集成到VR模拟中。
• 探索使用扫描技术（如Google Tango）创建精确真实建筑复制品以用于培训模拟的可行性。

提出的方法

• 基于Unity开发虚拟环境，使用Arduino控制的加热器和香氛扩散器提供热觉与嗅觉刺激。
• 设计一种基于鳍片的热屏蔽系统，根据角色移动调节并定位热反馈。
• 开展两项实验研究：一项关于行为有效性（MS-VE vs. AV-VE），另一项关于培训有效性（MS-VE vs. PowerPoint）。
• 制定VR原型中安全使用香氛的协议，以应对化学暴露风险。
• 探索使用Google Tango进行真实工作场所的3D扫描，以创建精确的虚拟培训环境。
• 应用可用性研究与迭代式VE开发，以优化用户交互与感官反馈时机。

实验结果

研究问题

• RQ1 在应急模拟中，与仅具音视频反馈的VR相比，虚拟环境中加入多感官反馈（热觉与嗅觉）是否能提升用户的行为有效性？
• RQ2 相较于传统的PowerPoint教学，多感官VR培训在多大程度上提升了学员的参与度、对健康与安全的态度以及重复参与培训的意愿？
• RQ3 在使用3D扫描技术（如Google Tango）创建可用于VR培训模拟的真实建筑复制品时，面临哪些技术与实际挑战？
• RQ4 能否利用Arduino、加热器和香氛扩散器等现成组件，开发一种低成本、安全且可扩展的MS-VE系统？
• RQ5 多感官VR是否具有比标准VR更准确预测真实应急场景下人类行为的潜力？

主要发现

• 与音视频VR相比，多感官VR显著提升了行为有效性，参与者报告更强的沉浸感，并减少了对预设行为预期的依赖。
• MS-VE中的参与者报告了更高的参与度和更积极的健康与安全培训态度，且更愿意重复参与培训，优于基于PowerPoint的教学方式。
• 研究确定，为实现有效的热反馈，需在用户周围对称布置至少三台2 kW的加热器。
• 成功制定了VR中安全使用香氛的协议，解决了训练过程中化学物质失控暴露的担忧。
• 尽管使用Google Tango进行3D扫描在技术上可行，但图像质量与数据处理复杂性限制了其在真实工作场所复刻中的实用性。
• 与完整VR开发相比，实施多感官元素（加热与气味）的成本与工作量相对较低，使MS-VE在大型组织中聚焦、高影响力的培训场景中具备可行性。