観察・共有・予測:身体性マルチエージェント協調におけるパートナー情報の disentangle
Observe, Share, or Predict? Disentangling Partner Information in Embodied Multi-Agent Collaboration
LLMベースの身体性エージェントが、対話なしで協調する際に、相手の状態観察・物体知識交換・次行動予測がタスク結果と調整にどう影響するかを、HabitatベースのPARTNRベンチマークで検証した。
著者: Adrián Szlatincsán, Filippo Ziliotto, Bruno Lepri, Luciano Serafini, Massimiliano Luca, Tommaso Campari
分類: cs.AI, cs.RO
原文アブストラクト
LLMs are used as high-level controllers for embodied agents, but it remains unclear whether they support collaborative reasoning, such as anticipating a collaborator's actions in real-time teamwork without dialogue. We ask if observing the partner's state, exchanging object knowledge, and predicting the partner's next action, shape task outcomes and coordination when agents can share percepts but never intentions, plans, or task-level messages, and whether the two agents occupy symmetric roles. Using the Habitat-based PARTNR benchmark, we introduce a Decoupled Partial Observability regime that enforces strictly individual perception, and we augment decentralized zero-shot ReAct planners with Other Agent's State (OAS) observation, object Knowledge Exchange (KE) between co-located agents, and Other Agent's Next Action (OANA) prediction, evaluated on the full 2 x 2 x 2 grid with four planners on 1,000 validation tasks. OAS observation improves task quality, reducing extraneous effort for every planner, whereas KE primarily improves execution efficiency, cutting simulation steps by up to 25% with little change in success. The two are largely redundant for strong planners but complementary for the weakest, for which KE without the OAS is the worst configuration. OANA prediction lowers the success rate in 15 of 16 model x context pairs while raising explicit partner mentions to 55-100%, and its accuracy gains lie mainly in the coarse action type, partly because agents recognize the action the partner is already performing. The robot retrieves objects sooner and completes its tasks earlier than the simulated human. Shared context reduces total task time by shortening the remaining duration that the human works alone. Also, coordination benefits arise from responding to shared context, especially the OAS, rather than explicit anticipation, yielding shallow, planner-dependent partner modeling.
関連論文
- 残差デノイジングによるサンプル効率の良いオンデマンド多エージェント協調マルチエージェント協調
- SyncPlan: 明示的同期と適応的修正による長期的LLM協調マルチエージェント協調
- MECoBench: 具現化環境におけるマルチモーダルエージェント協調の体系的研究マルチエージェント協調
- LLawCo: 協調の法則を学習して具現化マルチエージェント行動をモデル化するマルチエージェント協調
- CoEnv: 構成環境による身体化マルチエージェント協調の推進マルチエージェント協調
- 安全で解釈可能なマルチモーダル経路計画によるマルチエージェント協調マルチエージェント協調