不確実性に応じて推論を切り替える物体探索ナビゲーション
CovNav: Conformal Prediction-Guided Adaptive Inference for Object Goal Navigation
Conformal Predictionを用いてLLMの高速推論と熟考推論を適応的に切り替え、物体目標ナビゲーションの成功率と効率を両立させた学習不要のフレームワーク。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Pengying Wu, Zhejia Wen, Kang Ding, Kangjie Zhou, Chunxuan Jiao, Wei Pan, Xiangli Nie, Chang Liu
分類: cs.RO, cs.AI, cs.CL, cs.CV
原文アブストラクト
In object goal navigation (ObjectNav), an embodied agent must find a target object (e.g., "find a bed") in a previously unseen environment, relying on spatial commonsense such as object co-occurrence. Large Language Models (LLMs) encode this commonsense, but deploying them on robots exposes a trade-off between reasoning quality and efficiency: cloud-based models incur latency and privacy risks, whereas small on-device LLMs are fast but prone to hallucinated spatial judgments. Hybrid reasoning LLMs offer both a fast non-thinking mode and a slow thinking mode, which raises a key question for embodied agents: when is slow thinking worth its cost? We propose CovNav, a training-free framework that answers this question with Conformal Prediction (CP), turning dual-process (System 1 / System 2) inference into an uncertainty-aware decision. Much like recent decision models such as Jev, CovNav casts each spatial query as a structured binary decision rather than free-form generation: a local LLM in fast mode judges whether the target is likely near an observed object, CP converts its token probabilities into a prediction set, and only ambiguous queries are escalated to slow chain-of-thought reasoning. The object-pair formulation keeps calibration tractable and supports open-set objects through off-the-shelf detectors. Experiments on Gibson and HM3D show that CovNav surpasses the strongest zero-shot baseline by 0.8 and 1.7 percentage points in success rate on HM3D v1 and v2, while invoking slow reasoning for only 12.4% of queries and retaining most of the gain of always-on thinking at a fraction of its latency. Real-robot experiments on a TurtleBot 4 further validate the approach. CovNav shows how calibrated uncertainty can decide when an embodied agent should think slowly, offering a principled form of adaptive test-time reasoning for LLM-based robots.
関連論文
- F2A-ObjectNav: 物体目標ナビゲーションのための適応型エージェントアーキテクチャ物体目標ナビゲーション
- FOM-Nav: フロンティア物体マップによる物体目標ナビゲーション物体目標ナビゲーション
- EfficientNav: ナビゲーションマップのキャッシュと検索によるオンデバイス物体目標ナビゲーション物体目標ナビゲーション
- 物体目標ナビゲーションのための強化学習手法で重要な要素は何か?実証研究と統合フレームワーク物体目標ナビゲーション
- LLMの事前知識をフローモデルに蒸留し物体目標ナビゲーションの想像力を汎化物体目標ナビゲーション
- 不確実性を考慮した能動的知覚によるオープンボキャブラリ物体目標ナビゲーション物体目標ナビゲーション