ハミルトニアンビデオ力学モデルにおける時間的一般化の実現
Unlocking Temporal Generalization in Hamiltonian Video Dynamics Models
固定ステップで訓練された世界モデルの時間解像度の一般化問題を、ハミルトニアン生成ネットワークの連続時間エネルギー関数に基づいて解決し、訓練外の時間ステップでも安定した予測を実現する手法を提案した。
著者: Eli Laird, Corey Clark
分類: cs.LG
原文アブストラクト
World models are typically trained to predict discrete-time physical dynamics with a fixed step size baked into the model weights, preventing prediction at variable temporal resolutions. This matters for hierarchical planning, sim-to-real transfer, and scientific or game-engine applications that must query the same dynamics at multiple timescales. Hamiltonian Generative Networks (HGN) offer a principled path forward, grounding predictions in a continuous-time energy function that is, in principle, independent of the observation frame rate. In practice, however, their temporal generalization breaks down in non-conservative settings. We show that in externally forced, dissipative environments, HGN rollouts at step sizes beyond the training regime fail due to distinct failure modes, including latent magnitude growth driven by an unconstrained action-force map, and global truncation error accumulation from an under-resolved integrator. We identify a targeted fix for each mechanism and demonstrate stable dynamics prediction at temporal resolutions well outside the training distribution. In a detailed analysis, we recommend several strategies for enabling temporal generalization in continuous-time video generation.