[Paper Review] AutoDRIVE Simulator: A Simulator for Scaled Autonomous Vehicle Research and Education

Tanmay Vilas Samak, Chinmay Vilas Samak+1 more|arXiv (Cornell University)|Mar 18, 2021

Autonomous Vehicle Technology and Safety5 references23 citations

TL;DR

AutoDRIVE Simulator is a high-fidelity, Unity-based simulation platform for scaled autonomous vehicles, enabling realistic physics, photorealistic rendering, and integration with ROS and custom C++/Python APIs. It supports modular environment design, sensor simulation, and bidirectional communication for autonomous driving research and education, accelerating algorithm development and deployment on real-world scaled platforms.

ABSTRACT

AutoDRIVE is envisioned to be an integrated research and education platform for scaled autonomous vehicles and related applications. This work is a stepping-stone towards achieving the greater goal of realizing such a platform. Particularly, this work introduces the AutoDRIVE Simulator, a high-fidelity simulator for scaled autonomous vehicles. The proposed simulation ecosystem is developed atop the Unity game engine, and exploits its features in order to simulate realistic system dynamics and render photorealistic graphics. It comprises of a scaled vehicle model equipped with a comprehensive sensor suite for redundant perception, a set of actuators for constrained motion control and a fully functional lighting system for illumination and signaling. It also provides a modular environment development kit, which comprises of various environment modules that aid in reconfigurable construction of the scene. Additionally, the simulator features a communication bridge in order to extend an interface to the autonomous driving software stack developed independently by the users. This work describes some of the prominent components of this simulation system along with some key features that it has to offer in order to accelerate education and research aimed at autonomous driving.

Motivation & Objective

• To address the lack of integrated, scalable simulation tools tailored specifically for small-scale autonomous vehicles in research and education.
• To bridge the sim-to-real gap by providing a high-fidelity simulation environment that closely mirrors real-world dynamics and sensor data for scaled platforms.
• To enable rapid prototyping and testing of autonomous driving algorithms through a modular, extensible simulation ecosystem.
• To support both ROS-based and direct scripting-based development for flexibility in algorithm implementation.
• To provide an accessible, cross-platform simulation framework for students and researchers with limited hardware resources.

Proposed method

• Built on the Unity game engine using NVIDIA’s PhysX for realistic physics simulation and Unity’s Post-Processing Stack for photorealistic graphics rendering.
• Designed a 1:14 scale vehicle model with accurate dynamics, full lighting system, and a comprehensive sensor suite including LiDAR, cameras, IMU, and encoders.
• Implemented a modular environment development kit with reusable scene components and pre-configured maps for flexible scene construction.
• Developed a communication bridge for bidirectional data exchange between the simulator and external autonomy software stacks via ROS, C++, and Python APIs.
• Integrated a customizable GUI with a menu panel for connection settings and a HUD for real-time vehicle state monitoring (e.g., speed, throttle, LIDAR, IMU, camera feeds).
• Enabled hardware input via keyboard and mouse for manual control, with dedicated keys for lighting, indicators, and driving modes.

Experimental results

Research questions

• RQ1 How can a high-fidelity simulation environment for scaled autonomous vehicles be architected to support both research and educational use?
• RQ2 To what extent can a Unity-based simulator replicate real-world sensor data and vehicle dynamics for scaled platforms?
• RQ3 How effective is the integration of ROS, C++, and Python APIs in enabling flexible and efficient algorithm development and testing?
• RQ4 Can a modular environment development kit significantly reduce the time and effort required to build and reconfigure simulation scenes?
• RQ5 How does the communication bridge enable seamless interaction between autonomous driving software stacks and the simulator?

Key findings

• The AutoDRIVE Simulator successfully provides a high-fidelity, cross-platform simulation environment for scaled autonomous vehicles using Unity’s physics and graphics rendering capabilities.
• The simulator supports realistic system dynamics through NVIDIA’s PhysX engine and photorealistic visuals via Unity’s Post-Processing Stack, enhancing simulation fidelity.
• The integration of a ROS-compatible communication bridge enables seamless data exchange for sensor data and control commands, supporting both ROS-based and direct scripting workflows.
• The modular environment development kit allows for reconfigurable scene construction, significantly improving scene creation efficiency and flexibility.
• The GUI includes a comprehensive HUD displaying real-time vehicle state, sensor data, and control inputs, enabling effective monitoring and debugging during simulation.
• The simulator supports both manual and autonomous driving modes, with hardware input mapping for real-time control, enhancing usability for educational and prototyping purposes.