Inicio  /  Drones  /  Vol: 7 Par: 1 (2023)  /  Artículo
ARTÍCULO
TITULO

Multi-UAV Autonomous Path Planning in Reconnaissance Missions Considering Incomplete Information: A Reinforcement Learning Method

Yu Chen    
Qi Dong    
Xiaozhou Shang    
Zhenyu Wu and Jinyu Wang    

Resumen

Unmanned aerial vehicles (UAVs) are important in reconnaissance missions because of their flexibility and convenience. Vitally, UAVs are capable of autonomous navigation, which means they can be used to plan safe paths to target positions in dangerous surroundings. Traditional path-planning algorithms do not perform well when the environmental state is dynamic and partially observable. It is difficult for a UAV to make the correct decision with incomplete information. In this study, we proposed a multi-UAV path planning algorithm based on multi-agent reinforcement learning which entails the adoption of centralized training?decentralized execution architecture to coordinate all the UAVs. Additionally, we introduced a hidden state of the recurrent neural network to utilize the historical observation information. To solve the multi-objective optimization problem, We designed a joint reward function to guide UAVs to learn optimal policies under the multiple constraints. The results demonstrate that by using our method, we were able to solve the problem of incomplete information and low efficiency caused by partial observations and sparse rewards in reinforcement learning, and we realized kdiff multi-UAV cooperative autonomous path planning in unknown environment.

 Artículos similares

       
 
Salvatore Rosario Bassolillo, Egidio D?Amato, Immacolata Notaro, Gennaro Ariante, Giuseppe Del Core and Massimiliano Mattei    
In recent years the use of Unmanned Aerial Vehicles (UAVs) has considerably grown in the civil sectors, due to their high flexibility of use. Currently, two important key points are making them more and more successful in the civil field, namely the decr... ver más
Revista: Drones

 
Enrique Aldao, Luis M. González-deSantos, Humberto Michinel and Higinio González-Jorge    
In this work, a real-time collision avoidance algorithm was presented for autonomous navigation in the presence of fixed and moving obstacles in building environments. The current implementation is designed for autonomous navigation between waypoints of ... ver más
Revista: Drones

 
Mohammad Sadeq Ale Isaac, Marco Andrés Luna, Ahmed Refaat Ragab, Mohammad Mehdi Ale Eshagh Khoeini, Rupal Kalra, Pascual Campoy, Pablo Flores Peña and Martin Molina    
Unmanned aerial vehicles (UAVs) have drawn significant attention from researchers over the last decade due to their wide range of possible uses. Carrying massive payloads concurrent with light UAVs has broadened the aeronautics context, which is feasible... ver más
Revista: Drones

 
Fei Liu, Jiayao Shan, Binyu Xiong and Zheng Fang    
This paper presents a real-time and multi-sensor-based landing area recognition system for UAVs, which aims to enable UAVs to land safely on open and flat terrain and is suitable for comprehensive unmanned autonomous operation. The landing area recogniti... ver más
Revista: Drones

 
Sina Sajjadi, Mehran Mehrandezh and Farrokh Janabi-Sharifi    
In the past two decades, Unmanned Aerial Vehicles (UAVs) have gained attention in applications such as industrial inspection, search and rescue, mapping, and environment monitoring. However, the autonomous navigation capability of UAVs is aggravated in G... ver más
Revista: Drones