Workhorse: 人間のデータから頑健な全身ヒューマノイドの移動操作を学習
Workhorse: Learning Robust Whole-Body Humanoid Loco-Manipulation from Human Data
人間の実演データから、視覚プランナーと強化学習トラッカーを組み合わせて、ヒューマノイドロボットの全身移動操作を学習する手法を提案。実機で箱の仕分けやキャッチなどのタスクを実現。
著者: Songbo Hu, Qiayuan Liao, Yufeng Chi, Kevin Zakka, Yakun Sophia Shao, Pieter Abbeel, Koushil Sreenath
分類: cs.RO, cs.LG
原文アブストラクト
Humanoid robots still struggle to plan contact-rich whole-body manipulation from egocentric RGB and proprioception. Workhorse learns such manipulation from robot-free human demonstrations. A visual planner predicts five-link targets: the poses of the torso, both wrists, and both feet. A reinforcement-learning whole-body tracker follows them on the robot. Both policies train separately on the same recorded human poses, without retargeting. We augment the training data of each policy to imitate the errors that the other makes at deployment. On a real Unitree G1, Workhorse sorts boxes with its hands and a kick, catches a thrown box, and topples and climbs a suitcase. During box sorting, we show recoveries after a person pushes the robot or takes the box away. In a simulated copy of the demonstration room, the system completes box sorting in 77% of episodes, and in 64% under 40 N.s pushes. With both policies retrained from the same demonstrations, a simulated second humanoid completes box sorting in 83% of episodes without pushes.