日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
物体目標ナビゲーションarXiv:2610.27677

不確実性に応じて推論を切り替える物体探索ナビゲーション

CovNav: Conformal Prediction-Guided Adaptive Inference for Object Goal Navigation

シェア:XThreadsFacebookLINEはてブBluesky

Conformal Predictionを用いてLLMの高速推論と熟考推論を適応的に切り替え、物体目標ナビゲーションの成功率と効率を両立させた学習不要のフレームワーク。

詳しい要約

1. どんなもの?

- ObjectNav(未見環境で目標物体を探すembodied agentタスク)向けの、training-freeな推論フレームワーク - 対象はLLMのdual-process推論(System 1の高速モード/System 2のslow thinking)の使い分け - Conformal Prediction (CP)で不確実性を推定し、曖昧なクエリのみslow chain-of-thoughtへescalateする - 空間クエリを自由生成ではなく構造化binary decisionとして扱う - Gibson/HM3DおよびTurtleBot 4実機で評価

2. 先行研究と比べてどこがすごい?

- LLMの空間commonsense利用における推論品質と効率のトレードオフ(cloudは遅延・プライバシー、小型on-deviceはhallucination)に対処 - 常時thinkingと異なり、CPで不確実なクエリのみslow reasoningへ回す適応的test-time reasoningを実現 - 最強のzero-shot baselineに対しHM3D v1/v2で成功率+0.8/+1.7ポイント - slow reasoningは全クエリの12.4%のみで、always-on thinkingの利得の大部分を低latencyで保持 - Jevのようなdecision modelと同様にbinary decision化する点を踏襲しつつCPで較正する点が特徴

3. 技術・手法の肝は?

- 各空間クエリを『目標が観測物体の近くにありそうか』というstructured binary decisionに変換 - local LLMのfast modeで判定し、そのtoken probabilitiesをCPがprediction setへ変換 - prediction setが曖昧なクエリのみslow chain-of-thought reasoningへescalate - object-pair定式化によりcalibrationを扱いやすくする - off-the-shelf detectorsによりopen-set objectsに対応

4. どうやって有効だと検証した?

- GibsonとHM3Dで実験し、zero-shot baselineと成功率を比較 - HM3D v1/v2で最強zero-shot baselineを+0.8/+1.7ポイント上回る - slow reasoning呼び出し率12.4%とlatencyの削減を報告 - always-on thinkingの利得の大部分を保持することを確認 - TurtleBot 4でのreal-robot experimentsで追加検証

5. 議論はある?

- slow thinkingをいつ使うべきかという問いに対し、calibrated uncertaintyで決める枠組みを提示 - LLM-based robotのためのprincipleあるadaptive test-time reasoningの一形態と位置づけ - 具体的な限界・失敗事例・CPのcalibration前提の議論は要旨からは不明 - latencyやprivacyに関する定量的比較の詳細は要旨からは不明

6. 次に読むべき論文は?

- Jev(要旨で言及されたdecision model) - Conformal Prediction(CP)を用いたLLM推論の不確実性推定・adaptive inference関連研究 - dual-process / System 1・System 2推論やslow chain-of-thoughtのtest-time compute制御研究 - ObjectNavのzero-shot baselineおよびLLM-based navigation手法 - Gibson, HM3Dを用いたembodied navigationベンチマーク研究

※ AIが要旨から生成した要約です。正確性は原文をご確認ください。

著者: Pengying Wu, Zhejia Wen, Kang Ding, Kangjie Zhou, Chunxuan Jiao, Wei Pan, Xiangli Nie, Chang Liu

分類: cs.RO, cs.AI, cs.CL, cs.CV

原文アブストラクト

In object goal navigation (ObjectNav), an embodied agent must find a target object (e.g., "find a bed") in a previously unseen environment, relying on spatial commonsense such as object co-occurrence. Large Language Models (LLMs) encode this commonsense, but deploying them on robots exposes a trade-off between reasoning quality and efficiency: cloud-based models incur latency and privacy risks, whereas small on-device LLMs are fast but prone to hallucinated spatial judgments. Hybrid reasoning LLMs offer both a fast non-thinking mode and a slow thinking mode, which raises a key question for embodied agents: when is slow thinking worth its cost? We propose CovNav, a training-free framework that answers this question with Conformal Prediction (CP), turning dual-process (System 1 / System 2) inference into an uncertainty-aware decision. Much like recent decision models such as Jev, CovNav casts each spatial query as a structured binary decision rather than free-form generation: a local LLM in fast mode judges whether the target is likely near an observed object, CP converts its token probabilities into a prediction set, and only ambiguous queries are escalated to slow chain-of-thought reasoning. The object-pair formulation keeps calibration tractable and supports open-set objects through off-the-shelf detectors. Experiments on Gibson and HM3D show that CovNav surpasses the strongest zero-shot baseline by 0.8 and 1.7 percentage points in success rate on HM3D v1 and v2, while invoking slow reasoning for only 12.4% of queries and retaining most of the gain of always-on thinking at a fraction of its latency. Real-robot experiments on a TurtleBot 4 further validate the approach. CovNav shows how calibrated uncertainty can decide when an embodied agent should think slowly, offering a principled form of adaptive test-time reasoning for LLM-based robots.

関連論文

PR本紙発行元 EmplifAI