日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
世界モデルarXiv:2610.23968

IMPULSE:まず押して、V-JEPA 2特徴空間で予測する

IMPULSE: Push First, Then Predict in V-JEPA 2 Feature Space

シェア:XThreadsFacebookLINEはてブBluesky

物体を数回押した観測から物理特性をベイズ的に記憶し、V-JEPA 2の凍結特徴空間での将来予測に反映させる手法を提案。姿勢情報を活用する軽量ヘッドにより予測誤差を約12〜16%改善した。

著者: Tingan Jin

分類: cs.CV, cs.LG, cs.RO

原文アブストラクト

Latent world models such as V-JEPA 2 forecast in the feature space of a video encoder, but one look at an object does not reveal how hard it is to rotate, how much it bounces or how much it slides. People find out by trying: a few pokes reveal how an object responds. IMPULSE, named after the impulse response it infers, gives a predictor in frozen V-JEPA 2 feature space the same ability. A Bayesian contact memory summarizes three short calibration pushes, a predicted object pose carries it into the predictor, and a lightweight random-Fourier pose head lets the predictor use the pose. On 512 fresh objects, in a pre-specified held-out confirmation with models sealed before the data existed, the memory lowers the 1-second feature-forecast error by 11.6-12.8% relative to the same predictor without experience, for all 8 training seeds, with a 95% seed-and-object interval excluding zero. The gain also holds for 128 objects with out-of-range physics (11.7-14.0%), and the full extension beats a plain predictor by 15.5-16.6%. An information-ladder argument, exact for ideal predictors, shows that physics reaches the features only through motion, so we measure how much the pathway lets pose help. On fresh objects, the Fourier head roughly triples the gain of a perfect memory over plain pose tokens (2.8-3.2x). Raw push measurements fed through the same pathway give a similar gain, so the Bayesian summary is not required; it condenses the trials into eight interpretable numbers. The gain is absent at contact onset and grows afterwards.

関連論文

PR本紙発行元 EmplifAI