海中の身体知:マルチタスク水中マニピュレーションのための模倣学習
Embodied at Sea: Imitation Learning for Multi-Task Underwater Manipulation
水中でのマニピュレーションに向けて1616エピソードのデータを収集し、14種類の汎用VLAモデルを訓練・評価した。プール実験では最高93.3%の成功率を達成し、海洋考古学の現場でもACT方策がSmolVLAを大きく上回った。
著者: Greta Perez-Haiek, Luca Macesanu, Kevin Angers, Mohammed Imam, Timothy Gambin, Christopher Clark
分類: cs.RO, cs.LG
原文アブストラクト
Behavior Cloning has demonstrated promising generalization capabilities for robotic manipulation in terrestrial environments. However, marine visual distortions and dynamic currents create a severe domain shift that remains a key bottleneck in adapting generalist architectures to underwater field manipulation. To address this, 1616 episodes of underwater manipulation data were collected in calm and turbulent waters and were used to train 14 generalist Vision-Language-Action (VLA) models (DynamicVLA) with varying proprioception observation configurations. Across three tasks on 1260 gradable on-hardware rollouts in a pool, 10 models outperformed the baseline, with the highest-performing model achieving a 93.3% overall success rate, including partial successes. Results are also introduced from a case study evaluating the performance of a single-task Action Chunking Transformer (ACT) and a generalist VLA (SmolVLA) policy for two tasks in marine archaeology and conservation: grasping and mooring. Experiments are performed on an ROV on and around the WWII wreck Coralita X127 and at Manoel Island Marina, Malta. Across 748 collected episodes and 508 gradable on-hardware rollouts, the ACT policy substantially outperformed SmolVLA (47.9% vs. 7.9% pooled success rate), earning a 66.7% success rate on the most successful task at the marine archaeological site. To enable further contributions to embodied intelligence in marine field robotics, the BLUEMBODIED KIT used to collect data, train models, and deploy policies on the ROV has been open sourced.
関連論文
- WasserMan: 水中マニピュレーション方策学習のためのベンチマーク水中マニピュレーション
- ULOHA: 水中両腕ロボット学習プラットフォーム水中マニピュレーション
- 水中ビークル・マニピュレータシステムの安全な衝突対処のための切替型非線形モデル予測制御戦略水中マニピュレーション
- 水中マニピュレーションのためのヒューリスティック運動記憶を用いた文脈認識行動学習水中マニピュレーション
- 水中マニピュレーションと海底介入タスクのためのVR拡張ロボットシミュレータ水中マニピュレーション
- プロジェクトURSULA:水中マニピュレーションのためのロボットイカの設計水中マニピュレーション