G²WAM: 効率的で幾何学的に基盤を持つ画像ゴールナビゲーションのためのワールドアクションモデル
G$^2$WAM: World Action Models for Efficient and Geometry Grounded Image-Goal Navigation
シーン座標定位で空間手がかりを学習し、潜在空間で将来状態と行動を同時予測するワールドアクションモデルにより、3D再構成なしで画像ゴールナビゲーションを効率化した研究。
著者: Ke Gui, Chenghao Shi, Ziyue Wang, Longwen Chen, Xieyuanli Chen, Huimin Lu
分類: cs.AI, cs.RO
原文アブストラクト
World models capture environment dynamics and support counterfactual reasoning for planning. In image-goal navigation, where the target often lies beyond the current field of view, the agent must not only model environmental dynamics but also maintain a persistent spatial memory of the scene. Existing approaches either introduce spatial context by fine-tuning pretrained models on the target task, which underexploits their spatial priors, or rely on external 3D reconstruction, which is computationally expensive for real-world deployment. In this paper, we propose the Geometry Grounded World Action Model (G$^2$WAM) for image-goal navigation. G$^2$WAM encodes spatial cues through a learned scene-coordinate localization module that anchors the current, goal, and history frames in a common reference frame, yielding a stable and consistent spatial context that enables efficient navigation without explicit 3D reconstruction. Following the world-action-model paradigm, G$^2$WAM jointly predicts future states and actions, eliminating the need for costly cross-entropy method (CEM) style planning. In addition, G$^2$WAM operates entirely in latent space, avoiding the computational burden of pixel-level reconstruction and substantially reducing inference cost. Across four trajectory prediction benchmarks, G$^2$WAM reduces average ATE and RPE by 40.1% and 35.2%, respectively. In closed-loop navigation experiments, it improves the success rate from 54.0% to 63.0% and the success weighted by path length (SPL) from 36.4% to 59.2%, while maintaining high efficiency.
関連論文
- 有界外乱下における複数障害物間の安全な一輪車ナビゲーション:学習拡張型CLF-CBFアプローチナビゲーション
- DR-VLA: 一人称視点のWeb動画からドメイン不変なシーン表現を介して人間らしい四足歩行ナビゲーションを学習ナビゲーション
- I2O2I-Nav: 屋内-屋外-屋内の長距離ナビゲーションのためのベンチマークとモジュラーエージェントナビゲーション
- LynxScenes: 屋外車輪脚ロボットの知覚・ナビゲーション・想像・再構成のための大規模実世界ベンチマークナビゲーション
- 行動自己蒸留による汎用ナビゲーション方策の学習ナビゲーション
- ATOM: 抽象遷移とオプションのモデル化による経験情報を活用した階層ナビゲーションナビゲーション