キモード・ポリシー:ヒューマノイドの移動操作のための運動学的アクションモデル学習
Kimodo-Policy: Learning Kinematic Action Models for Humanoid Loco-Manipulation
全身運動の生成モデルを土台にした運動学的アクションモデルを提案し、視覚条件付けと階層制御でヒューマノイドの移動しながらの操作を実現した論文。
著者: Yunheng Wang, Jiaxi Zhang, Wei Lu, Yuetong Fang, Taowen Wang, Yixiao Feng, Shuning Zhang, Junzhe Xu, Yichi Wang, Zizhao Yuan, Kailun Huang, Lusong Li, Mingqian Zhou, Zecui Zeng, Renjing Xu
分類: cs.RO, cs.AI, cs.CV
原文アブストラクト
Humanoid loco-manipulation requires continuous coordination of high-dimensional whole-body motion to realize task objectives. While vision-language-action models and world action models transfer semantic and visual-dynamics priors to robot control, these priors do not necessarily capture the structure of robot motion. We introduce Kinematic Action Models (KAMs), a paradigm that treats whole-body motion as a direct pretraining target and uses a pretrained motion generator as the primary action-generation backbone. KAMs ground learned temporal and cross-body coordination priors through task conditioning, visual observations, and execution feedback. We present Kimodo-Policy as an initial instantiation, combining a frozen Kimodo text-to-motion backbone with lightweight ControlNet-based visual conditioning. A root-body-hand hierarchy coordinates locomotion and manipulation, while motion-history conditioning and repeated action-chunk prediction bridge motion synthesis and closed-loop control. Following large-scale loco-manipulation pretraining, the policy achieves the highest overall success among compared policies on multi-task HumanoidArena (72.14%), competitive performance on SIMPLE, and 60% mean success across eight real-world tasks, with 678M parameters (92M trainable). Ablations support the contribution of the pretrained motion backbone. Together, these results provide initial evidence for motion generation as a complementary foundation for humanoid action learning.
関連論文
- SUGARv2: 合成インタラクション参照から多様な視覚ヒューマノイド移動操作スキルを学習ヒューマノイド/移動操作
- 行動条件付き潜在予測によるヒューマノイドの移動操作の協調ヒューマノイド/移動操作
- 力で操るヒューマノイドの移動操作フレームワークCtrl-Fヒューマノイド/移動操作
- MOTIO:実世界接地型ヒューマノイド移動操作のためのエージェント型スキル工学ヒューマノイド/移動操作
- 上半身と下半身を分離したヒューマノイドの移動操作フレームワークDUETヒューマノイド/移動操作
- MotionWAM: 実時間ヒューマノイド移動操作のための基盤ワールドアクションモデルヒューマノイド/移動操作