ワールドモデルにおける予測の経路空間定式化:単一の行動から予測・計画・不可逆性へ
A Path-Space Formulation of Prediction in World Models: From a Single Action to Prediction, Planning, and Irreversibility
AIワールドモデルの予測を、将来の軌跡上の確率測度として定式化し、予測・計画・不確実性を単一の作用汎関数の操作として統一的に扱う。学習された注意の非対称性がデータの不可逆性と関連し、不可逆性が予測の計算資源となることを示した。
著者: Gunn Kim
分類: cs.LG, cond-mat.stat-mech
原文アブストラクト
We propose a path-space formulation of prediction in AI world models. Rather than sequences of one-step conditional distributions, we argue that a world model implicitly defines a probability measure over future trajectories. In the local regime where latent dynamics admit an effective Markovian description, this path measure takes the Onsager-Machlup form. Within this framework, prediction (most probable trajectory), planning (constrained optimization), and uncertainty (fluctuations) emerge as operations on a single action functional. We decompose the latent dynamics into reversible and irreversible components and introduce operational measures of entropy production from model rollouts. In controlled small-scale attention-based models, we find that attention asymmetry is acquired during training in proportion to the irreversibility of the data. Symmetrizing the learned attention suppresses entropy production and selectively degrades long-horizon prediction of irreversible dynamics while preserving relaxational prediction. These results suggest that irreversibility may serve as a computational resource for predictive world models. More generally, the fundamental predictive object is a distribution over future paths rather than states.