経路計画arXiv:2411.17912
LLMは実世界で経路計画できるか？
Can LLMs plan paths in the real world?
3つのLLMを6つの実世界経路計画シナリオで評価し、いずれも多数の誤りを犯し信頼できないことを示した。
著者: Wanyi Chen, Meng-Wen Su, Nafisa Mehjabin, Mary L. Cummings
分類: cs.AI, cs.RO
原文アブストラクト
As large language models (LLMs) increasingly integrate into vehicle navigation systems, understanding their path-planning capability is crucial. We tested three LLMs through six real-world path-planning scenarios in various settings and with various difficulties. Our experiments showed that all LLMs made numerous errors in all scenarios, revealing that they are unreliable path planners. We suggest that future work focus on implementing mechanisms for reality checks, enhancing model transparency, and developing smaller models.