部分的な視覚観測による全身空中把持と持ち上げ
Whole-Body Aerial Grasping and Lifting via Partial Visual Observations
強化学習の教師-生徒フレームワークを用いて、部分的な視覚情報から飛行・アーム・グリッパを統合制御し、空中での把持と持ち上げを実現した研究。
著者: Jiaye Jin, Rui Jin, Xinhang Xu, Haotian Jin, Ruiyang Liu, Yi Wang, Jiayan Zhao, Kun Cao, Lihua Xie
分類: cs.RO
原文アブストラクト
Aerial grasp-and-lift tasks require whole-body coordination across approach, acquisition, and lifting under partial target observations. Early approach failures can limit exposure to later task stages during training, while changing visibility complicates alignment and closure timing during execution. We present a recurrent teacher-student framework that learns a single policy in simulation to jointly command flight, arm motion, and gripper closure without an explicit task-phase input. A privileged teacher learns through reinforcement learning with a critical-state curriculum that exposes acquisition and lifting states before connecting them to normal approach trajectories. Its behavior is distilled into a recurrent visual student that replaces privileged target states with dual-view point clouds and proprioception, integrating observation history for closed-loop control. A dedicated closure objective supervises closure timing from sustained model-defined readiness sequences. Training and primary evaluation use a simulated acquisition-and-payload model with condition-triggered latching, virtual attachment, and wrench-based payload loading for short-distance lifting. Across 8,996 completed simulation episodes under this model, the frozen student achieves full-task success rates of 99.97%, 97.14%, and 95.84% under nominal, physics/control-randomized, and additional camera-randomized conditions, respectively. The nominal latch-count-weighted mean of per-seed 90th-percentile alignment errors at acquisition is 8.12 mm.
関連論文
- 局所全身VLA行動からシーン規模の空中マニピュレーションへ空中マニピュレーション
- 可動コンプライアントアンカーによるケーブル吊り下げ空中マニピュレーションの受動剛性成形空中マニピュレーション
- 空中グリッパー:勾配ベースのリアルタイム逆ゲーム予測・計画フレームワーク空中マニピュレーション
- QuadHand:MRC-SDFを用いた全身運動計画によるコンパクトなクアッドロータ空中マニピュレータ空中マニピュレーション
- オンボード知覚・方策学習・全身制御による屋外空中マニピュレーション空中マニピュレーション
- テザー吊り下げ型空中放射線センシングペイロードの視覚ベース制御空中マニピュレーション