大規模言語モデルによるニューロシンボリック制御:言語指示に基づく空間タスク
Neuro-Symbolic Control with Large Language Models for Language-Guided Spatial Tasks
LLMに記号的なタスク解釈を任せ、連続空間の動作は軽量ニューラルコントローラが担うモジュール型ニューロシンボリック枠組みを提案し、言語指示付き平面マニピュレーションで成功率と効率を大幅に改善した。
著者: Momina Liaqat Ali, Muhammad Abid, Muhammad Saqlain, Jose M. Merigo
分類: cs.RO
原文アブストラクト
Although large language models (LLMs) have recently become effective tools for language-conditioned control in embodied systems, instability, slow convergence, and hallucinated actions continue to limit their direct application to continuous control. A modular neuro-symbolic control framework that clearly distinguishes between low-level motion execution and high-level semantic reasoning is proposed in this work. While a lightweight neural delta controller performs bounded, incremental actions in continuous space, a locally deployed LLM interprets symbolic tasks. We assess the suggested method in a planar manipulation setting with spatial relations between objects specified by language. Numerous tasks and local language models, such as Mistral, Phi, and LLaMA-3.2, are used in extensive experiments to compare LLM-only control, neural-only control, and the suggested LLM+DL framework. In comparison to LLM-only baselines, the results show that the neuro-symbolic integration consistently increases both success rate and efficiency, achieving average step reductions exceeding 70% and speedups of up to 8.83x while remaining robust to language model quality. The suggested framework enhances interpretability, stability, and generalization without any need of reinforcement learning or costly rollouts by controlling the LLM to symbolic outputs and allocating uninterpreted execution to a neural controller trained on artificial geometric data. These outputs show empirically that neuro-symbolic decomposition offers a scalable and principled way to integrate language understanding with ongoing control, this approach promotes the creation of dependable and effective language-guided embodied systems.