ICR-Drive: 言語駆動型自動運転のための指示反事実ロバスト性評価
ICR-Drive: Instruction Counterfactual Robustness for End-to-End Language-Driven Autonomous Driving
言語指示に基づく自動運転モデルが、言い換えや曖昧さ、ノイズ、誤解を招く指示などの変種に対してどれほど頑健かを評価する診断フレームワークを提案した。
著者: Kaiser Hamid, Can Cui, Nade Liang
分類: cs.CL, cs.CV
原文アブストラクト
Recent progress in vision-language-action (VLA) models has enabled language-conditioned driving agents to execute natural-language navigation commands in closed-loop simulation, yet standard evaluations largely assume instructions are precise and well-formed. In deployment, instructions vary in phrasing and specificity, may omit critical qualifiers, and can occasionally include misleading, authority-framed text, leaving instruction-level robustness under-measured. We introduce ICR-Drive, a diagnostic framework for instruction counterfactual robustness in end-to-end language-conditioned autonomous driving. ICR-Drive generates controlled instruction variants spanning four perturbation families: Paraphrase, Ambiguity, Noise, and Misleading, where Misleading variants conflict with the navigation goal and attempt to override intent. We replay identical CARLA routes under matched simulator configurations and seeds to isolate performance changes attributable to instruction language. Robustness is quantified using standard CARLA Leaderboard metrics and per-family performance degradation relative to the baseline instruction. Experiments on LMDrive and BEVDriver show that minor instruction changes can induce substantial performance drops and distinct failure modes, revealing a reliability gap for deploying embodied foundation models in safety-critical driving.