[논문 리뷰] See, Learn, Assist: Safe and Self-Paced Robotic Rehabilitation via Video-Based Learning from Demonstration

Ali Alabbas, Camillo Murgia외 2명|arXiv (Cornell University)|2026. 03. 15.

Stroke Rehabilitation and Recovery인용 수 0

한 줄 요약

비디오 기반 의도 학습 프레임워크는 치료사 시연을 몸 중심의 6-DoF Cartesian Dynamic Movement Primitives로 인코딩하여 cobot-지원 재활을 passive, active-assisted, active-resistive 모드에서 안전하고 적응적으로 구동하며, 실시간 안전은 GMR 기반 힘 모니터링과 가역적 궤도로 제공한다.

ABSTRACT

In this paper, we propose a novel framework that allows therapists to teach robot-assisted rehabilitation exercises remotely via RGB-D video. Our system encodes demonstrations as 6-DoF body-centric trajectories using Cartesian Dynamic Movement Primitives (DMPs), ensuring accurate posture-independent spatial generalization across diverse patient anatomies. Crucially, we execute these trajectories through a decoupled hybrid control architecture that constructs a spatially compliant virtual tunnel, paired with an effort-based temporal dilation mechanism. This architecture is applied to three distinct rehabilitation modalities: Passive, Active-Assisted, and Active-Resistive, by dynamically linking the exercise's execution phase to the patient's tangential force contribution. To guarantee safety, a Gaussian Mixture Regression (GMR) model is learned on-the-fly from the patient's own limb. This allows the detection of abnormal interaction forces and, if necessary, reverses the trajectory to prevent injury. Experimental validation demonstrates the system's precision, achieving an average trajectory reproduction error of 3.7cm and a range of motion (ROM) error of 5.5 degrees. Furthermore, dynamic interaction trials confirm that the controller successfully enforces effort-based progression while maintaining strict spatial path adherence against human disturbances.

연구 동기 및 목표

• 원격으로 치료사가 RGB-D 비디오로 로봇 보조 재활 운동을 가르치도록 enable한다.
• 몸 중심의 궤도 인코딩을 통해 다양한 환자 해부학에서 자세 독립적 공간 일반화를 달성한다.
• 공간 경로를 준수하면서 실행 속도를 환자 노력에 맞춰 적응하는 다중 모드 하이브리드 제어 프레임워크를 제공한다.
• Gaussian Mixture Regression를 이용한 실시간 안전 메커니즘으로 비정상 상호작용 힘을 탐지하고 궤적을 가역적으로 멈춘다.

제안 방법

• Perception module uses YOLOv8-pose and Mediapipe Hand to extract 3D 6-DoF poses from RGB-D, constructing a body-centric frame anchored at the shoulder.
• Learning module encodes 6-DoF trajectories with Cartesian Dynamic Movement Primitives for scalable, posture-invariant motion.
• Execution module implements a decoupled spatial tunnel with an effort-based temporal dilation to couple progression to tangential patient effort.
• A Gaussian Mixture Regression model is learned on-the-fly from the patient’s limb to form a dynamic safety corridor and trigger trajectory reversals when forces exceed safe bounds.

실험 결과

연구 질문

• RQ1 Can therapist demonstrations captured in RGB-D be encoded into body-centric 6-DoF Cartesian DMPs that generalize across different patient anatomies?
• RQ2 Does the decoupled spatial-temporal control with an effort-based dilation ensure safe, self-paced execution across Passive, Active-Assisted, and Active-Resistive rehabilitation modes?
• RQ3 Can a patient-specific GMR model effectively detect abnormal interaction forces and safely reverses trajectories to prevent injury?

주요 결과

운동	재현 오차 (cm)
팔꿈치 굽힘–신전	1.8
어깨 내회전–외회전	4.5
어깨 외전–내전	4.9

• Average trajectory reproduction error of 3.7 cm across exercises and subjects.
• ROM error around 5.5 degrees on validated movements.
• Virtual tunnel with orthogonal admittance maintains spatial adherence under significant orthogonal forces (max spatial deviation 3.7 cm in baseline test).
• Force-based dilation enables Passive, Active-Assisted, and Active-Resistive modalities with self-paced progression.
• GMR-based safety corridor triggers smooth trajectory reversals within ~0.3 s of force violations, ensuring safe operation.