[Paper Review] GelSight Svelte Hand: A Three-finger, Two-DoF, Tactile-rich, Low-cost Robot Hand for Dexterous Manipulation

Jialiang Zhao, Edward H. Adelson|arXiv (Cornell University)|Sep 19, 2023

Advanced Sensor and Energy Harvesting MaterialsEngineering3 citations

TL;DR

GelSight Svelte Hand is a low-cost, three-fingered robotic hand with only two degrees of freedom, enabling precision, intermediate, and power grasps using two off-the-shelf servo motors. It achieves rich, full-finger tactile sensing via three low-cost cameras embedded in semi-rigid, silicone-skinned fingers, providing high-resolution contact feedback across large surfaces—offering a mechanically simple, cost-effective solution for dexterous manipulation with tactile awareness.

ABSTRACT

This paper presents GelSight Svelte Hand, a novel 3-finger 2-DoF tactile robotic hand that is capable of performing precision grasps, power grasps, and intermediate grasps. Rich tactile signals are obtained from one camera on each finger, with an extended sensing area similar to the full length of a human finger. Each finger of GelSight Svelte Hand is supported by a semi-rigid endoskeleton and covered with soft silicone materials, which provide both rigidity and compliance. We describe the design, fabrication, functionalities, and tactile sensing capability of GelSight Svelte Hand in this paper. More information is available on our website: \url{https://gelsight-svelte.alanz.info}.

Motivation & Objective

• To design a low-cost, mechanically simple robotic hand that enables multiple grasping modes without increasing degrees of freedom or complexity.
• To provide rich, high-resolution tactile feedback over large contact areas across all fingers, not just fingertips.
• To achieve dexterous manipulation with minimal actuation—using only two servo motors for three fingers—by leveraging a 15° motor offset and a flipper-like finger arrangement.
• To demonstrate practical utility in real-world tasks requiring precision, strength, and tactile feedback, such as LEGO brick handling and tool grasping.
• To create a scalable, manufacturable design that balances compliance, rigidity, and tactile sensing for broader adoption in robotics research and applications.

Proposed method

• The hand uses three GelSight Svelte tactile fingers, each with a semi-rigid endoskeleton and soft silicone skin, to combine structural rigidity with compliant contact.
• Each finger integrates a single camera with curved mirrors to enable full-length tactile sensing over an elongated, curved surface, maximizing sensing area with minimal hardware.
• Two servo motors drive the hand: one controls Finger 1 (thumb-like) with a 3:1 gear ratio, and the other drives Finger 2 and 3 together as a flipper, with a 15° angular offset between motors to enable multiple grasping modes.
• Grasping modes are executed via a three-step controller sequence: open Finger 1, position the flipper (Finger 2 & 3) to a target angle for the desired grasp, then close Finger 1 under torque control.
• Tactile signals are captured in real time using the camera-based sensing system, with optical simulation ensuring full-coverage of the sensing skin within the camera’s field of view.
• The design minimizes cost and complexity by using off-the-shelf components and avoiding complex wiring or sensor arrays, while maintaining high tactile resolution across the entire finger surface.

Experimental results

Research questions

• RQ1 Can a 2-DoF robotic hand achieve multiple human-like grasping modes—precision, intermediate, and power—without increasing actuation complexity?
• RQ2 Can full-finger tactile sensing with high spatial resolution be achieved using only three low-cost cameras and a compact optical design?
• RQ3 How can mechanical compliance and structural rigidity be balanced in a soft, tactile robotic hand using a semi-rigid endoskeleton and silicone skin?
• RQ4 To what extent can rich tactile feedback from large contact areas improve manipulation performance in real-world tasks like object holding and twisting?
• RQ5 Is it feasible to create a low-cost, scalable, and manufacturable robotic hand that supports dexterous manipulation with minimal hardware and control overhead?

Key findings

• The GelSight Svelte Hand successfully performs three distinct grasping modes—pinch, lateral, and three-finger opposition—using only two servo motors and a 15° motor offset.
• The hand achieves full-finger tactile sensing with a single camera per finger, covering the entire length of each finger via curved mirrors, enabling high-resolution contact feedback.
• In the pinch grasp mode, the maximum opening between Finger 1 and Finger 2 tips is 63 mm, sufficient for handling small, precise objects like LEGO bricks.
• For lateral grasping, the maximum opening between the middle of Finger 1 and the side of Finger 3 reaches 80 mm, enabling stable handling of tools like screwdrivers.
• The three-finger opposition grasp achieves a maximum opening of 72 mm and delivers a normal fingertip force of 2.5 N and a tangential force of up to 6.3 N at Finger 1, demonstrating high strength and stability.
• Tactile images collected during object holding tasks reveal detailed texture and contact distribution, confirming the system’s ability to provide rich, spatially resolved feedback for manipulation state estimation.