CopyQuad: 深度モデル不要の単眼側面動画からの四足歩行スキル転移
CopyQuad: Quadrupedal Skill Transfer from a Single Side-View Video Without a Depth Model
側面視の単眼動画から、深度推定を省いてロボットの脚間幅で奥行きを代替し、2Dキーポイント検出と解析的リターゲティングで四足歩行スキルを実機にゼロショット転移する手法を提案。
著者: Mohamad H. Danesh, Raina Hu, Mengxue Xu, Hsiu-Chin Lin
分類: cs.RO, cs.LG
原文アブストラクト
Video-to-robot pipelines for quadrupedal imitation insert a learned lifting stage, either a monocular depth model or a per-clip 3D reconstruction, to recover the one axis a side-view camera cannot see. We present CopyQuad, which omits that stage and pins the missing axis to the robot's own stance width instead. The setting is side-view footage of sagittally dominated motion, where limb motion is almost entirely in the image plane. A frozen 2D keypoint detector and a fixed analytic retargeting then turn a single uncalibrated clip into a robot reference whose foot targets are reachable by construction, so no per-clip trajectory optimization is needed. One phase-indexed reward structure, whose only per-behavior freedom is three scalars from a shared sweep, learns a dog walk, a horse walk, a horse trot and two non-periodic gestures, all deployed zero-shot on hardware. We then measure what omitting the axis costs. In a training-free rigidity test, a video depth model varies the distance between the animal's hips by $40$ to $107\%$ of its own mean and a single-image metric model by $22$ to $58\%$, though that distance cannot move. Motion capture puts the true lateral paw travel of a dog walk at $4.5$ cm peak to peak, a mean deviation near $1.4$ cm against the $3.5$ cm of lateral foot error our policies already leave, so the discarded axis sits below the pipeline's resolution. Depth repaired to feasibility never beats the constant, and the unrepaired estimates put the robot on the ground.
関連論文
- RoboSimStudio:ロボットマニピュレーションタスクの迅速なReal2Simのための対話型ツールキットsim2real
- TRACE: ヒューマノイドの全身制御における効率的な転移学習フレームワークsim2real
- 動的な人間動作生成による全身移動支援ロボットポリシーの学習sim2real
- ピクセルから実行可能な物理へ:身体行動に基づく世界モデルによる四足歩行ロボットの行動結果予測sim2real
- Code2Worlds-2: 物理的に妥当な身体性世界シミュレーションのためのエージェントハーネスsim2real
- YUBI-Real2Sim: 3DGSシーン検証による信頼性の高い方策評価sim2real