マルチヘッドアテンションによる協調戦略を用いた効率的なマルチロボット探索
Efficient Multi-robot Exploration via Multi-head Attention-based Cooperation Strategy
連続空間での分散型マルチロボット探索のため、マルチヘッドアテンション機構と計算幾何学に基づく環境記述・報酬設計を組み合わせ、状態空間を削減しつつ協調戦略を自動学習する手法を提案した。
著者: Shuqi Liu, Zhaoxia Wu
分類: cs.AI, cs.RO
原文アブストラクト
The goal of coordinated multi-robot exploration tasks is to employ a team of autonomous robots to explore an unknown environment as quickly as possible. Compared with human-designed methods, which began with heuristic and rule-based approaches, learning-based methods enable individual robots to learn sophisticated and hard-to-design cooperation strategies through deep reinforcement learning technologies. However, in decentralized multi-robot exploration tasks, learning-based algorithms are still far from being universally applicable to the continuous space due to the difficulties associated with area calculation and reward function designing; moreover, existing learning-based methods encounter problems when attempting to balance the historical trajectory issue and target area conflict problem. Furthermore, the scalability of these methods to a large number of agents is poor because of the exponential explosion problem of state space. Accordingly, this paper proposes a novel approach - Multi-head Attention-based Multi-robot Exploration in Continuous Space (MAMECS) - aimed at reducing the state space and automatically learning the cooperation strategies required for decentralized multi-robot exploration tasks in continuous space. Computational geometry knowledge is applied to describe the environment in continuous space and to design an improved reward function to ensure a superior exploration rate. Moreover, the multi-head attention mechanism employed helps to solve the historical trajectory issue in the decentralized multi-robot exploration task, as well as to reduce the quadratic increase of action space.
