触覚駆動型モーター適応によるヒューマノイドの力強いsim-to-realマニピュレーション
TMA: Sim-to-Real Forceful Humanoid Manipulation via Tactile-Driven Motor Adaptation
触覚フィードバックを活用して実世界の接触・相互作用の不確実性に適応する方策を学習し、丸いドアノブ開けをベンチマークに、シミュレーションのみで訓練したヒューマノイドがゼロショットで実機の力強い多指操作を実現した。
著者: Yiting Chen, Kelin Yu, Sarthak Kaingade, Bryan Trinh, Kaiyu Hang, Roberto Martin-martin, Nima Fazeli, X. Alice Wu
分類: cs.RO
原文アブストラクト
Recent humanoid loco-manipulation in articulated environments has largely focused on geometry-dominant interactions, where success is primarily determined by geometric alignment and motion execution. In contrast, forceful multi-finger manipulation requires the robot to adapt to real-world uncertainties in contact and interaction dynamics. We present Tactile-Driven Motor Adaptation (TMA) and an integrated whole-body system for zero-shot sim-to-real forceful humanoid manipulation, and study round-doorknob opening as a challenging benchmark requiring stable multi-finger frictional grasping, sufficient torque generation without slip, force-regulated pushing, and whole-body stability. TMA structures policy learning around interactions observable through tactile feedback, uses cone geometry as an inductive bias for multi-finger contact representation, and adapts motor behavior online from tactile history. An upper-body manipulation policy is trained alongside a pretrained general locomotion controller to coordinate dexterous interaction and whole-body stabilization. Trained entirely in simulation, TMA transfers zero-shot to a Unitree G1 humanoid with BrainCo Revo2 multi-fingered hands and substantially outperforms standard Rapid Motor Adaptation (RMA) and reactive tactile policy baselines across four commercial round doorknobs in the real world.
関連論文
- TactileLab: せん断感覚を効率的にシミュレートする触覚シミュレーションによるSim-to-Real巧緻マニピュレーション触覚/sim2real
- TactSpace: 触覚のシミュレーションから実世界への転移のための物理強化共有潜在空間の学習触覚/sim2real
- HydroShear: 触覚シミュレーションから実機への強化学習のためのハイドロエラスティックせん断シミュレーション触覚/sim2real
- 触覚シミュレータを実写類似・ゼロショット性能で拡張するSightGAN触覚/sim2real
- Tactile Gym 2.0:低コスト高解像度触覚センサを比較するためのSim-to-Real深層強化学習触覚/sim2real
- 深層テクスチャ生成ネットワークによる触覚Sim2Realギャップの削減触覚/sim2real
