強化学習によるBVLoS経路計画でUAVのセルラー接続性を最大化
Maximizing UAV Cellular Connectivity with Reinforcement Learning for BVLoS Path Planning
見通し外飛行するセルラー接続UAVの経路計画に強化学習を用い、通信リンク品質を報酬として移動距離を抑えつつ接続性を最大化する手法を提案した。
著者: Mehran Behjati, Rosdiadee Nordin, Nor Fadzilah Abdullah
分類: cs.RO, cs.LG
原文アブストラクト
This paper presents a reinforcement learning (RL) based approach for path planning of cellular connected unmanned aerial vehicles (UAVs) operating beyond visual line of sight (BVLoS). The objective is to minimize travel distance while maximizing the quality of cellular link connectivity by considering real world aerial coverage constraints and employing an empirical aerial channel model. The proposed solution employs RL techniques to train an agent, using the quality of communication links between the UAV and base stations (BSs) as the reward function. Simulation results demonstrate the effectiveness of the proposed method in training the agent and generating feasible UAV path plans. The proposed approach addresses the challenges due to limitations in UAV cellular communications, highlighting the need for investigations and considerations in this area. The RL algorithm efficiently identifies optimal paths, ensuring maximum connectivity with ground BSs to ensure safe and reliable BVLoS flight operation. Moreover, the solution can be deployed as an offline path planning module that can be integrated into future ground control systems (GCS) for UAV operations, enhancing their capabilities and safety. The method holds potential for complex long range UAV applications, advancing the technology in the field of cellular connected UAV path planning.