ツイン・ロールアウト:対話型ビデオ世界モデルにおけるノイズ結合型反事実分岐
Twin Rollouts: Noise-Coupled Counterfactual Branching in Interactive Video World Models
この論文は、ビデオ世界モデルが生成した軌道に対して、行動を変えた場合の反事実的な生成を研究し、ノイズ結合による正確な反事実生成と検証可能な評価指標を提案している。
著者: Yu Ma, Hongli Shi, Xinran Xu
分類: cs.LG
原文アブストラクト
Interactive video world models generate rollouts autoregressively under an action stream, yet they are trained and evaluated almost exclusively on factual prediction. We study counterfactual generation inside the rollout: given a trajectory the model has itself generated, what would have happened had the actions differed from step t* onward? We formalize noise-coupled twin rollouts --- a factual and a counterfactual branch sharing the generated prefix and the future exogenous noise sequence, diverging only in the action stream at an intervention point. Because the factual branch is self-generated, its exogenous noise is known exactly: the abduction step of Pearl's counterfactual procedure is exact by construction, sidestepping the approximate-inversion problem faced by editing-based pipelines. Noise coupling further turns the minimal-change principle into a per-sample verifiable property: we define a spatiotemporal locality metric that penalizes divergence outside the causal descendants of the intervention, computable against simulator ground truth without a learned judge. Forking the simulator state at t* yields ground-truth counterfactual re-renders, which we use as verifiable rewards for post-training. This note establishes the formal framework, metric definitions, and positioning; experiments are forthcoming.