コーディングエージェントがロボットアームを操る時代の安全リスク評価ベンチマーク
When Coding Agents Get Arms: Safety Risks Across the Digital-Physical Boundary
コーディングエージェントがゼロショットで実機ロボットアームを制御できるようになったことを受け、能力悪用や間接プロンプトインジェクションが物理世界に波及するリスクを体系的に評価する初のベンチマークArmedAgentを提案した。
著者: Yiming Sun, Mi Zhang
分類: cs.RO, cs.CR, cs.MM
原文アブストラクト
Advances in spatial understanding have enabled frontier models to power coding agents that control a real robot arm zero-shot and end-to-end, without task-specific demonstrations or retraining. This brings two new safety challenges. First, the extensive knowledge of frontier models lets these agents perform tasks that earlier VLA and WAM paradigms could not, opening the door to new forms of capability misuse. Second, coding agents can access digital resources such as web pages and emails. Threats in these resources, such as indirect prompt injection, can carry over into the physical world when the agent controls a robot. We therefore introduce ArmedAgent, the first systematic benchmark to evaluate both risks for coding agents performing zero-shot robot control. It covers robustness, malicious use, and indirect injection across 36 tasks in 5 scenarios, evaluated in simulation and validated on a physical robot arm. A distinctive portion of the tasks target harmful behaviors that earlier VLA paradigms could not perform. Testing several frontier models, including GPT-6-Astra, under widely used agent frameworks, we find substantial safety risks in current systems.