GG-Nav: 目標指向型グラウンディング連鎖推論でナビゲーション基盤モデルの推論を引き出す
GG-Nav: Goal-oriented Grounding Chain-of-Thought Elicits Reasoning in Navigation Foundation Models
ストリーミング観測を活用し目標を正確に特定する構造化Chain-of-Thoughtを教師あり微調整で学習させるナビゲーション手法を提案し、複数ベンチマークで成功率を向上させた。
著者: Shaohao Zhu, Wensi Huang, Siqi Zhang, Yuqiang Yang, Meng Wei, Chenyang Wan, Tianle Liu, Tai Wang, Jinming Xu
分類: cs.RO, cs.AI
原文アブストラクト
Emerging strong Vision-Language Models (VLMs) have advanced navigation foundation models. However, these models still have unsatisfactory performance on goal-oriented navigation settings. In this paper, we first conduct a motivating study revealing that the key issue lies in the insufficient utilization of streaming observations and imprecise target localization. To tackle these challenges, we propose GG-Nav, a simple yet effective navigation framework that learns a structured chain-of-thought (CoT) mechanism via supervised fine-tuning to explicitly localize goal-relevant instances, accumulate grounding evidence, and support more reliable decision-making. Specifically, the structured CoT is designed with two key stages: (i) Observation-to-Evidence, which reasons over all intermediate frames between adjacent decision steps to retain useful goal-related evidence; and (ii) Evidence-to-Decision, which integrates the current observation with accumulated evidence to ground the target and support the generation of navigation actions or clarification questions. Extensive experiments show that GG-Nav outperforms the state-of-the-art methods in terms of success rates on the HM3D ObjectNav, VL-LN, and CoIN benchmarks by 3.1%, 16.6%, and 5.3%, respectively. Ablation studies further show that accumulating evidence from intermediate observations reduces evidence-missing failures by 11.6%, while explicit grounding reduces stopping errors by 49.4%. We also deploy GG-Nav on a Unitree Go2 robot, demonstrating its zero-shot generalization capability in unseen real-world environments.
関連論文
- 有界外乱下における複数障害物間の安全な一輪車ナビゲーション:学習拡張型CLF-CBFアプローチナビゲーション
- DR-VLA: 一人称視点のWeb動画からドメイン不変なシーン表現を介して人間らしい四足歩行ナビゲーションを学習ナビゲーション
- I2O2I-Nav: 屋内-屋外-屋内の長距離ナビゲーションのためのベンチマークとモジュラーエージェントナビゲーション
- LynxScenes: 屋外車輪脚ロボットの知覚・ナビゲーション・想像・再構成のための大規模実世界ベンチマークナビゲーション
- GLST: オンライン連鎖目標ナビゲーションのためのグローバル・ローカル時空間記憶分解フレームワークナビゲーション
- CoSMO: オープンワールド安全ロボットナビゲーションのための共形セマンティックマッピングナビゲーション