日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
世界モデルarXiv:2606.12979v1

EPM-JEPA:JEPA系世界モデルにおけるオペレータ側経験変調

EPM-JEPA: Operator-Side Experience Modulation in JEPA-Family World Models

シェア:XThreadsFacebookLINEはてブBluesky

JEPA系世界モデルで、テスト時の分布シフトに対応するため、経験表現を予測器の重みにLoRAで注入する方式(EPM-JEPA)を提案し、既存の隠れ状態への注入方式(EI-JEPA)と比較。結果は統計的に差がないという帰無結果だったが、重み変調の有効性を示唆する観察も得た。

著者: Vedant Pandya

分類: cs.LG

原文アブストラクト

JEPA-family world models use a static predictor whose weights do not adapt when test-time dynamics diverge from training. We compare two mechanisms for incorporating accumulated experience into a JEPA predictor under distribution shift: operand-side injection, where a compressed experience representation is added as a residual to the predictor's hidden state (EI-JEPA), and operator-side modulation, where the same representation generates low-rank weight deltas via LoRA applied to the predictor's weights (EPM-JEPA). On a pre-registered comparison (Moving MNIST, gravity shift), EPM-JEPA (D_shift^{n=50} = 0.7848 +/- 0.0078, three seeds) differs from EI-JEPA (0.8238) by delta = 4.74% - Outcome C: a null result - by our stated criterion, a valid outcome. As a secondary, non-pre-registered observation, EPM-JEPA improves 1.90% over a no-memory baseline (0.8000), consistently across seeds, while EI-JEPA underperforms the baseline, indicating the benefit is specific to weight-level modulation. Our primary contribution is a mechanism analysis: the D_shift^{n=50} trajectory reflects three independent dynamical processes - buffer cycling, EMA target drift, and an intrinsic LoRA settling transient of +0.021 - rather than convergence to equilibrium. These findings motivate PEM-JEPA, a physics-grounded successor addressing this dynamical-peak limitation.

関連論文