日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
ワールドモデルarXiv:2608.21582v1

部屋を読む:リカレントワールドモデルの状態における暗黙の混乱エンコーディング

Reading the Room: Implicit Confusion Encoding in Recurrent World Model States

シェア:XThreadsFacebookLINEはてブBluesky

RSSMベースのワールドモデル(DreamerV3など)の隠れ状態が、予測誤差だけでなく自身の「混乱」も追跡していることを発見し、線形プローブで検出可能であることを示した。

著者: Donald Aadithiyan

分類: cs.LG

原文アブストラクト

World models built on the RSSM architecture, such as DreamerV3, keep a recurrent hidden state $h_t$ trained only to reduce prediction error. We show this state also tracks its own confusion, hiding in plain sight: nearly orthogonal to $h_t$'s directions of greatest variance, invisible to any variance-based method. It is functionally distinct from ensemble disagreement, which flags new inputs, and reconstruction error, which flags bad predictions right now. On a test holding prediction error fixed while confusion varies, a linear probe on $h_t$ finds the signal (AUROC 0.72, 5 runs), while an ensemble baseline scores below chance. A discounted count of recent high-error steps explains 80% of the probe's output ($R^2=0.80$). We confirm the signal is causally used, not merely present, by editing $h_t$ directly and watching behaviour change, including a check using real values from other trajectories instead of synthetic edits. Its geometry and closed form generalize across three control tasks; the decisive dissociation test itself holds cleanly on only one, and its practical use, deciding when to check reality instead of trusting imagination, generalizes to only two of the three tasks.

関連論文