OptiSight：意味推論と幾何制御を橋渡しする身体化ナビゲーション
OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation
視覚言語モデルによる意味推論と視覚サーボによる幾何制御を組み合わせたハイブリッドな屋内ナビゲーション手法を提案。AI Habitatでのゼロショット実験で有効性を確認。
著者: Alperen Avan, Jordi Sanchez-Riera
分類: cs.RO, cs.CV
原文アブストラクト
Autonomous indoor navigation requires both semantic understanding and precise geometric control. We propose OptiSight, a hybrid framework that combines Vision-Language Model reasoning with deterministic visual servoing through a finite-state Chain-of-Thought architecture. Grounded-SAM localizes open-vocabulary targets, while camera projection geometry converts visual observations into navigation commands without requiring dense mapping. The VLM is queried only at key decision points, reducing computational overhead while geometric control handles continuous navigation. Experiments in AI Habitat demonstrate reliable zero-shot navigation across diverse indoor scenarios, including obstacle avoidance and semantic ambiguity, while operating within an 8~GB VRAM budget. The source code is available at https://github.com/avanalperen/OptiSight-Python-Multimodal-CoT-for-Visual-Reasoning.