[Paper Review] Cyber-virtual systems: Simulation, validation & visualization

Jan Olaf Blech, Maria Spichkova+2 more|arXiv (Cornell University)|Apr 28, 2014

Simulation Techniques and ApplicationsDecision Sciences39 references12 citations

TL;DR

This paper introduces cyber-virtual systems—hybrid environments combining physical industrial components with software-simulated counterparts—for enhanced simulation, validation, and visualization in industrial automation. By integrating the VITELab global visualization infrastructure with formal spatial behavioral types (BT), the approach enables remote collaboration, automated spatio-temporal reasoning, and early validation of system behavior before physical deployment.

ABSTRACT

We describe our ongoing work and view on simulation, validation and visualization of cyber-physical systems in industrial automation during development, operation and maintenance. System models may represent an existing physical part - for example an existing robot installation - and a software simulated part - for example a possible future extension. We call such systems cyber-virtual systems. In this paper, we present the existing VITELab infrastructure for visualization tasks in industrial automation. The new methodology for simulation and validation motivated in this paper integrates this infrastructure. We are targeting scenarios, where industrial sites which may be in remote locations are modeled and visualized from different sites anywhere in the world. Complementing the visualization work, here, we are also concentrating on software modeling challenges related to cyber-virtual systems and simulation, testing, validation and verification techniques for them. Software models of industrial sites require behavioural models of the components of the industrial sites such as models for tools, robots, workpieces and other machinery as well as communication and sensor facilities. Furthermore, collaboration between sites is an important goal of our work.

Motivation & Objective

• Address the high cost and complexity of physical deployment and integration of industrial automation systems, especially in remote or inaccessible sites such as mines and oil rigs.
• Enable remote collaboration among developers, operators, and maintenance personnel across global sites through advanced visualization and simulation.
• Develop formal, semantically rich software models for industrial components that capture spatio-temporal behavior for reliable simulation and verification.
• Integrate visualization, formal modeling, and automated reasoning to support early validation of system behavior, including collision detection and sensor range analysis.
• Establish a type system based on spatial behavioral types (BT) to ensure compatibility, reusability, and correct interplay between components during system design and evolution.

Proposed method

• Leverage the VITELab infrastructure, particularly the Global Operations Visualization (GOV) Lab, to provide high-resolution, multi-screen remote visualization of industrial automation facilities.
• Model industrial components (robots, tools, conveyors, sensors) using semi-formal, human-readable specifications grounded in human factor analysis for clarity and maintainability.
• Define Spatial Behavioral Types (BT) as a formal type system to abstract, compose, and reason about the spatio-temporal behavior of physical and virtual entities.
• Apply formal verification techniques by translating BT specifications into SMT/SAT problems using the BeSpaceD tool and solving them with the z3 SMT solver.
• Integrate simulation, visualization, and validation into a unified pipeline where BT-based models support automated reasoning for collision avoidance, sensor coverage, and component compatibility.
• Use hardware-in-the-loop (HIL) principles as a foundation, extending them to simulate interactions between physical robots and virtual counterparts in real time.

Experimental results

Research questions

• RQ1 How can remote industrial automation facilities be effectively visualized and collaboratively monitored across global sites using shared virtual environments?
• RQ2 What formal modeling approach enables accurate, readable, and reusable specification of spatio-temporal behavior for industrial components like robots and sensors?
• RQ3 How can a type system for spatial behavioral types (BT) ensure compatibility, reusability, and correct interplay between components during system design and upgrades?
• RQ4 In what ways can automated reasoning over BT models improve validation of safety-critical properties such as collision avoidance and sensor coverage?
• RQ5 How can the integration of visualization, simulation, and formal verification reduce development costs and risks in industrial automation system deployment?

Key findings

• The VITELab infrastructure successfully enables large-scale, remote, multi-site visualization of industrial automation systems using high-resolution multi-screen displays.
• Spatial Behavioral Types (BT) provide a formal, extensible framework for modeling the spatio-temporal behavior of industrial components, supporting abstraction, conformance, and refinement.
• Automated compatibility checking of BT ensures that components meet required behavioral and spatial constraints, enabling safe component substitution and reuse.
• The integration of BT with the BeSpaceD toolchain allows automated verification of spatio-temporal properties by encoding them as SMT problems and solving them with z3.
• Simulation and visualization based on BT models enable early detection of potential issues such as collisions and sensor blind spots before physical deployment.
• The methodology reduces development and integration costs by allowing virtual testing of system configurations, component replacements, and operational scenarios in a safe, scalable environment.