[Paper Review] Designing Automated Vehicle and Traffic Systems towards Meaningful Human Control

Simeon C. Calvert, Stig Ole Johnsen+1 more|arXiv (Cornell University)|Mar 9, 2023

Safety Systems Engineering in Autonomy4 citations

TL;DR

This paper proposes an Integrated System Proximity framework and Operational Process Design approach to embed Meaningful Human Control (MHC) in Connected Automated Vehicles (CAVs), enabling vehicle designers and governments to systematically ensure human oversight. By integrating implicit proximal and explicit distal updating mechanisms, the framework enhances system safety and accountability, demonstrated through three real-world cases, and calls for MHC to be formally embedded in regulations and design processes.

ABSTRACT

Ensuring operational control over automated vehicles is not trivial and failing to do so severely endangers the lives of road users. An integrated approach is necessary to ensure that all agents play their part including drivers, occupants, vehicle designers and governments. While progress is being made, a comprehensive approach to the problem is being ignored, which can be solved in the main through considering Meaningful Human Control (MHC). In this research, an Integrated System Proximity framework and Operational Process Design approach to assist the development of Connected Automated Vehicles (CAV) under the consideration of MHC are introduced. These offer a greater understanding and basis for vehicle and traffic system design by vehicle designers and governments as two important influencing stakeholders. The framework includes an extension to a system approach, which also considers ways that MHC can be improved through updating: either implicit proximal updating or explicit distal updating. The process and importance are demonstrated in three recent cases from practice. Finally, a call for action is made to government and regulatory authorities, as well as the automotive industry, to ensure that MHC processes are explicitly included in policy, regulations, and design processes to ensure future ad-vancement of CAVs in a responsible, safe and humanly agreeable fashion.

Motivation & Objective

• To address the critical challenge of maintaining operational control in automated vehicle systems to prevent endangerment of road users.
• To develop a comprehensive, integrated approach that includes vehicle designers, occupants, and governments in ensuring human oversight.
• To operationalize Meaningful Human Control (MHC) through structured system and process design frameworks.
• To demonstrate the practical applicability of the framework using real-world CAV cases.
• To advocate for regulatory and industry adoption of MHC as a mandatory component in CAV development and policy.

Proposed method

• Development of the Integrated System Proximity framework to model human-agent interactions across vehicle and traffic systems.
• Incorporation of two updating mechanisms: implicit proximal updating (real-time, localized control) and explicit distal updating (deliberate, policy-level oversight).
• Application of an Operational Process Design approach to structure human control across system lifecycle stages.
• Use of three recent CAV cases to illustrate how the framework supports MHC in practice.
• Integration of stakeholder roles—designers, regulators, and users—into a unified control architecture.
• Alignment of system design with regulatory and ethical standards through MHC as a core principle.

Experimental results

Research questions

• RQ1 How can Meaningful Human Control (MHC) be systematically embedded in the design of Connected Automated Vehicles (CAVs)?
• RQ2 What structural and procedural mechanisms enable effective human oversight in automated vehicle and traffic systems?
• RQ3 How do proximal (implicit) and distal (explicit) updating mechanisms contribute to maintaining MHC?
• RQ4 In what ways can vehicle designers and governments collaboratively ensure MHC in CAV development?
• RQ5 What practical examples demonstrate the feasibility and value of MHC integration in real-world CAV deployments?

Key findings

• The Integrated System Proximity framework provides a structured method for embedding MHC in CAV and traffic system design.
• The combination of implicit proximal and explicit distal updating enhances both real-time responsiveness and long-term accountability.
• Three real-world CAV cases demonstrate the practical viability of the framework in diverse operational contexts.
• The framework supports a holistic, stakeholder-inclusive approach to system design that prioritizes safety and human agency.
• Regulatory and industry adoption of MHC as a formal requirement is essential for responsible CAV advancement.
• The study establishes a foundation for policy integration, urging inclusion of MHC in future standards and design processes.