RoboBuilder:実世界の映像フィードバックを組み込んだエージェントによるロボット協調設計
RoboBuilder: Agentic Robot Co-Design with Real-world Video Feedback in the Loop
コーディングエージェントが部品からロボットのハードウェアとプログラムを設計し、シミュレーション通過後に実機で検証するベンチマークを提案。実走映像を見せるとエージェントが再設計し失敗の72%を解消できることを示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Ghadi Nehme, Dahyun Nam, Akshay Govind Srinivasan, Faez Ahmed
分類: cs.AI, cs.CV, cs.RO
原文アブストラクト
Can AI agents design robots that work in the real world? We introduce RoboBuilder, a benchmark in which coding agents co-design a robot's hardware and program from standard parts, motors and a custom 3D-printed part, and every design that passes in simulation is built and tested on a physical course. Simulation alone is not enough: under public part data, none of 15 initial passing designs crossed the real course, so an agent learns the simulator from measurements it requests and videos of real runs. Across four frontier coding agents, ten obstacles at three difficulty levels, 16,427 simulations of 12,774 distinct robots and 135 physical robots built in an estimated 240 hours, agents solve nearly all easy obstacles and invent mechanisms our search baselines do not reach, but falter at harder levels, when one robot must cross every obstacle, and in the real world, where 66% of simulated passes hold across all levels. Closing the loop helps: shown a video of its real failure, an agent redesigns the robot, sometimes correcting its simulator, and removes 72% of level-1 and level-2 failures. RoboBuilder measures progress toward agents that engineer real machines. Project Page: https://ghadinehme.com/robobuilder.github.io/
