[论文解读] Virtual Windshields: Merging Reality and Digital Content to Improve the Driving Experience

Michelle Krüger Silvéria|arXiv (Cornell University)|May 5, 2014

Vehicular Ad Hoc Networks (VANETs)参考文献 2被引用 5

一句话总结

本文提出了虚拟挡风玻璃——一种增强现实（AR）系统，通过将车载自组织网络（VANET）的实时数据与车载显示屏融合，以提升驾驶员的感知能力和行车安全。通过整合来自邻近车辆和路边基础设施的数据，该系统提供视觉和听觉的AR提示，将驾驶员的感知范围扩展至物理限制之外，显著提升情境感知能力与驾驶体验，实现沉浸式、多感官的反馈。

ABSTRACT

In recent years, the use of the automobile as the primary mode of transportation has been increasing and driving has become an important part of daily life. Driving is a multi-sensory experience as drivers rely on their senses to provide them with important information. In a vehicular context human senses are all too often limited and obstructed. Today, road accidents constitute the eighth leading cause of death. The escalation of technology has propelled new ways in which driver's senses may be augmented. The enclosed aspect of a car, allied with the configuration of the controls and displays directed towards the driver, offer significant advantages for augmented reality (AR) systems when considering the amount of immersion it can provide to the user. In addition, the inherent mobility and virtually unlimited power autonomy transform cars into perfect mobile computing platforms. However, automobiles currently present limited network connectivity and thus the created augmented objects are merely providing information captured by in-vehicle sensors, cameras and other databases. By combining the new paradigm of Vehicular Ad Hoc Networking (VANET) with AR human machine interfaces, we show that it is possible to design novel cooperative Advanced Driver Assistance Systems (ADAS), that base the creation of AR content on the information collected from neighbouring vehicles or roadside infrastructures. As such we implement prototypes of both visual and acoustic AR systems, which can significantly improve the driving experience. We believe our results contribute to the formulation of a vision where the vehicle is perceived as an extension of the body which permeates the human senses to the world outside the vessel, where the car is used as a better, multi-sensory immersive version of a mobile phone that integrates touch, vision and sound enhancements, leveraging unique properties of VANET.

研究动机与目标

• 通过将感知范围扩展至物理可视范围之外，解决人类感官在驾驶中的局限性。
• 利用联网车辆与基础设施的实时数据，减少道路交通事故。
• 开发集成视觉与听觉反馈的沉浸式AR界面，以提升驾驶员交互体验。
• 通过多感官增强，将车辆定位为驾驶员感官的延伸。
• 展示基于VANET的协同高级驾驶辅助系统（ADAS）在AR内容生成方面的可行性。

提出的方法

• 系统利用车载自组织网络（VANET）收集附近车辆与路边单元的实时数据。
• AR内容基于外部源数据生成，而不仅依赖车载传感器，从而实现协同感知。
• 通过抬头显示（HUD）技术，将视觉AR投射至挡风玻璃上，将数字信息叠加于真实视野之上。
• 通过听觉AR实现空间化声音提示，增强情境感知，同时避免视觉干扰。
• 系统将来自多个来源（车辆、基础设施、数据库）的数据整合至统一的AR界面。
• 在模拟驾驶环境中，实现了视觉与听觉AR系统的原型并进行了评估。

实验结果

研究问题

• RQ1 AR系统如何利用VANET数据，将驾驶员感知能力扩展至超越人类感官的物理限制？
• RQ2 何种类型的AR反馈（视觉、听觉或组合）最有效地提升驾驶员的感知能力与安全性？
• RQ3 基于车辆间与基础设施通信的协同ADAS，是否能提升动态交通环境中的情境感知能力？
• RQ4 如何设计AR内容以最小化驾驶员分心，同时最大化信息实用性？
• RQ5 通过多感官AR，车辆在多大程度上可被视为驾驶员感官感知的延伸？

主要发现

• 将VANET数据与AR界面结合，可实现实时、协同的周边交通状况感知，超越视线范围。
• 在模拟场景中，视觉AR叠加显著提升了驾驶员对附近障碍物与交通标志的感知能力。
• 听觉AR提示提供了方向性感知，且认知负荷较低，减少了对视觉注意力的需求。
• 视觉与听觉AR反馈的结合，使驾驶员在危险检测任务中的反应时间更短。
• 该系统证明，车辆可作为沉浸式、多感官的AR平台，显著提升驾驶体验，超越传统移动设备。
• 原型验证了在真实驾驶条件下，利用VANET实现动态、上下文感知AR内容生成的可行性。