[Paper Review] ArrayTac: A tactile display for simultaneous rendering of shape, stiffness and friction

Tianhai Liang, Shiyi Guo+4 more|arXiv (Cornell University)|Mar 14, 2026

Tactile and Sensory Interactions0 citations

TL;DR

ArrayTac is a piezoelectric 4x4 tactile actuator array that can render shape, stiffness, and friction simultaneously with closed-loop control, enabling high-fidelity haptics and remote tele palpation. It supports end-to-end pipelines for vision-to-touch and long-distance tactile perception.

ABSTRACT

Human-computer interaction in the visual and auditory domains has achieved considerable maturity, yet machine-to-human tactile feedback remains underdeveloped. Existing tactile displays struggle to simultaneously render multiple tactile dimensions, such as shape, stiffness, and friction, which limits the realism of haptic simulation. Here, we present ArrayTac, a piezoelectric-driven tactile display capable of simultaneously rendering shape, stiffness, and friction to reproduce realistic haptic signals. The system comprises a 4x4 array of 16 actuator units, each employing a three-stage micro-lever mechanism to amplify the micrometer-scale displacement of the piezoelectric element, with Hall sensor-based closed-loop control at the end effector to enhance response speed and precision. We further implement two end-to-end pipelines: 1) a vision-to-touch framework that converts visual inputs into tactile signals using multimodal foundation models, and 2) a real-time tele-palpation system operating over distances of several thousand kilometers. In user studies, first-time participants accurately identify object shapes and physical properties with high success rates. In a tele-palpation experiment over 1,000km, untrained volunteers correctly identified both the number and type of tumors in a breast phantom with 100% accuracy and precisely localized their positions. The system pioneers a new pathway for high-fidelity haptic feedback by introducing the unprecedented capability to simultaneously render an object's shape, stiffness, and friction, delivering a holistic tactile experience that was previously unattainable.

Motivation & Objective

• Motivate and demonstrate tactile displays capable of simultaneous rendering of multiple tactile modalities (shape, stiffness, friction).
• Develop a high-resolution, closed-loop tactile display with real-time feedback and scalable control.
• Showcase end-to-end pipelines (Tac-Anything and Tele-Touch) for perception from images and remote palpation tasks.
• Enable intuitive shape recognition and accurate perception of stiffness and friction through psychophysical validation.

Proposed method

• 32-actuator 4x4 array driven by a custom high-performance drive circuit.
• Three-stage micro-lever mechanism amplifies 40 μm piezo displacement to up to 5 mm.
• Hall sensor-based end-effector closed-loop feedback for each actuator unit.
• Zero-gravity sliding platform with rotary encoders for extended workspace and active exploration.
• A stiffness control algorithm using nonlinear (quadratic) feedforward penalty to emulate soft material behavior.
• Real-time tactile rendering pipeline with hand tracking and tactile display integration.

Experimental results

Research questions

• RQ1 Can a single tactile display render shape, stiffness, and friction simultaneously with high fidelity?
• RQ2 How does closed-loop control impact shape rendering accuracy and bandwidth?
• RQ3 Are users capable of zero-shot shape identification and discrimination across multiple stiffness and friction levels?
• RQ4 Can tactile semantics inferred from images be rendered onto the array to support vision-to-touch tasks?
• RQ5 Is remote palpation feasible with high accuracy over long distances using Tele-Touch?

Key findings

• The device achieves a stable refresh rate over 500 Hz for real-time rendering.
• Each actuator unit amplifies 40 μm to up to 5 mm displacement with Hall-sensor closed-loop control.
• Shape rendering supports zero-shot shape identification with high accuracy among naive users (median scores near 5 for simple shapes).
• Five perceptually distinct stiffness levels are renderable and discriminable (pairwise accuracy >86% for adjacent levels, >74% absolute identification).
• Friction is rendered via vibrotactile cues with five levels, achieving 100% accuracy in pairwise discrimination and >87% absolute identification.
• Tac-Anything enables tactile semantics extraction from RGB images, enabling scene sketching with IoU 0.45±0.15 and high placement accuracy; Tele-Touch demonstrates remote palpation with localization errors around 0.3–0.4 cm and high tumor discrimination accuracy.
• In a cross-city breast tumor palpation over 1000 km, 11 naive volunteers achieved 100% diagnostic accuracy in identifying tumor type with latency below 0.1 s for control and sensing.