RoboBridge:シミュレーションから実世界への転移のための自己進化型具現化エージェントフレームワーク
RoboBridge: A Self-Evolving Embodied Agent Framework for Sim-to-Real Transfer
シミュレーションと実世界で共有されるタスク知識を手続きとして表現し、対話フィードバックでスキルを自己進化させることで、VLAポリシーを再学習せずにsim-to-real転移を実現するフレームワークを提案。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Chenxi Li, Zhangrui Zhao, Rui Li, Yuan Gao, Kehui Liu, Jiarui Li, Dong Wang, Tong Si, Minting Pan, Wanli Ouyang, Dongzhan Zhou
分類: cs.RO
原文アブストラクト
A key challenge in bringing embodied intelligence into the real world is transferring capabilities from simulation to reality and enabling agents to continually adapt after deployment. End-to-end vision-language-action policies provide strong manipulation capabilities, but their transfer to physical environments typically relies on calibrating simulated visual and dynamical conditions, collecting additional target-domain demonstrations, and optimizing the policy through further training. Tool-using embodied agents offer flexible task orchestration, yet existing systems primarily emphasize task execution and experience reuse within a given environment, with limited support for transferring procedural knowledge and continuously adapting it across simulation and reality. We propose RoboBridge, a framework that treats sim-to-real transfer as the continued adaptation of executable task skills. The agent represents task knowledge as procedures connecting task intent, observations, tool operations, and outcome verification. Interaction feedback is used to generate candidate skill revisions, which are evaluated before being persisted or rejected. A pretrained vision-language-action policy is exposed as a reusable action tool and enhanced with inference-time guidance, enabling fine-grained execution without retraining the underlying policy. RoboBridge grounds transferable skills in task semantics and interaction interfaces shared across simulation and reality. This representation preserves reusable task structure while allowing environment-dependent operations to be selectively revised through real-world execution feedback. We evaluate the framework on LIBERO-PRO and corresponding physical tasks, studying both skill evolution and post-transfer adaptation. Our framework provides a route from one-shot policy deployment to continual procedural learning across environments.
関連論文
- SceneFactory-3D:2D交通シーンを3D物理的反実世界へ持ち上げ、スケーラブルな物理基盤の安全評価を実現sim2real
- Skill2Real:ゼロショットSim-to-Realロボットマニピュレーションのためのエージェント型スキル学習sim2real
- I2CD: 単一画像から凸分解された衝突形状を直接生成sim2real
- 報酬ハッキングを超えて:段階的人型学習パイプラインの4層におけるプロキシ乖離sim2real
- 大規模ロボット学習のためのGPUバッチ5Gシミュレーションによるネットワーク・イン・ザ・ループsim2real
- Awomo-SimDataEngine: エージェント型シミュレーション対応世界生成sim2real