日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
世界モデルarXiv:2609.32322

すべての誤差が重要ではない:意思決定に関連する予測誤差が計画品質を予測する

Not All Errors Matter: Decision-Relevant Prediction Error Predicts Planning Quality

シェア:XThreadsFacebookLINEはてブBluesky

世界モデルの予測誤差全体ではなく、意思決定に影響する状態次元の誤差(DRPE)が計画性能を強く予測することを示し、タスク依存性や想像の深さによる影響を明らかにした。

著者: Linhao Wang, Yiyan Fan, Dongjin Huang

分類: cs.LG

原文アブストラクト

World models are typically trained and evaluated by prediction error, assuming that more accurate predictions lead to better decisions. We show that this assumption can fail because models with similar total error can differ substantially in planning performance when their errors occur on different state dimensions. We introduce Decision-Relevant Prediction Error (DRPE), which measures prediction error on the state dimensions that affect decisions. We also develop an iso-error evaluation protocol that varies error allocation while keeping total error fixed. In a factored gridworld with known state relevance and a standardized planner, we evaluate 55 controlled and learned models across different error levels and allocations. Total prediction error is weakly related to planning success (Spearman $ρ=-0.25$), whereas DRPE is strongly predictive ($ρ=-0.84$; $-0.98$ within the controlled family). Models with only a 1\% difference in total error can differ by 60 percentage points in planning success (97\% vs 37\%). The relevant error also depends on the task, with model rankings reversing across tasks at the same total error. Deeper imagination further amplifies decision-relevant errors, while learned models exhibit systematic bias on rare but decision-critical events. We formalize sufficient conditions under which DRPE correctly ranks models and total prediction error cannot.

関連論文

PR本紙発行元 EmplifAI