レジスタを介した行動生成:世界行動モデルにおける空間外れ値の再編成
Acting Through Registers
世界行動モデルの表現に現れる高ノルムな空間外れ値に着目し、学習可能な非空間レジスタを導入して行動条件付けに用いるRegisterWAMを提案。観測フローマッチング損失と組み合わせることで外れ値を抑制し、LIBERO-PlusやRoboTwin 2.0で高い成功率を達成した。
著者: Yiwei Zhang, Yantai Yang, Jin Gao, Jin Lou, Andong Chen, Yufei Liu, Boyang Xing, Yuchen Zhu, Weiming Hu, Zhipeng Zhang
分類: cs.RO
原文アブストラクト
World Action Models (WAMs) use generative visual representations to condition robot actions, yet how these representations organize action-relevant information remains poorly understood. We identify persistent high-norm spatial outliers in WAM representations and find that their action relevance persists even after normalization and K/V projection attenuate their extreme magnitude. Motivated by this observation, we introduce RegisterWAM, which adds learnable non-spatial registers to the world model and uses them directly for action conditioning. Registers alone do not fully eliminate spatial outliers; pairing them with observation flow-matching (FM) loss supervision suppresses spatial outliers while concentrating high-norm responses in registers. Beyond this reorganization, observation FM loss supervision also improves action learning without registers, motivating an additional noised-observation FM objective that learns current-scene recovery from corrupted inputs. The resulting model achieves 81.64\% success on LIBERO-Plus without additional embodied pretraining data or foundation models, reaches 93.0\% average success on RoboTwin 2.0, and improves real-world manipulation performance.