Inicio  /  Future Internet  /  Vol: 16 Par: 3 (2024)  /  Artículo
ARTÍCULO
TITULO

UAV Control Method Combining Reptile Meta-Reinforcement Learning and Generative Adversarial Imitation Learning

Shui Jiang    
Yanning Ge    
Xu Yang    
Wencheng Yang and Hui Cui    

Resumen

Reinforcement learning (RL) is pivotal in empowering Unmanned Aerial Vehicles (UAVs) to navigate and make decisions efficiently and intelligently within complex and dynamic surroundings. Despite its significance, RL is hampered by inherent limitations such as low sample efficiency, restricted generalization capabilities, and a heavy reliance on the intricacies of reward function design. These challenges often render single-method RL approaches inadequate, particularly in the context of UAV operations where high costs and safety risks in real-world applications cannot be overlooked. To address these issues, this paper introduces a novel RL framework that synergistically integrates meta-learning and imitation learning. By leveraging the Reptile algorithm from meta-learning and Generative Adversarial Imitation Learning (GAIL), coupled with state normalization techniques for processing state data, this framework significantly enhances the model?s adaptability. It achieves this by identifying and leveraging commonalities across various tasks, allowing for swift adaptation to new challenges without the need for complex reward function designs. To ascertain the efficacy of this integrated approach, we conducted simulation experiments within both two-dimensional environments. The empirical results clearly indicate that our GAIL-enhanced Reptile method surpasses conventional single-method RL algorithms in terms of training efficiency. This evidence underscores the potential of combining meta-learning and imitation learning to surmount the traditional barriers faced by reinforcement learning in UAV trajectory planning and decision-making processes.

 Artículos similares

       
 
Abdulrahman Alharbi, Ivan Petrunin and Dimitrios Panagiotakopoulos    
The accurate estimation of airspace capacity in unmanned traffic management (UTM) operations is critical for a safe, efficient, and equitable allocation of airspace system resources. While conventional approaches for assessing airspace complexity certain... ver más
Revista: Drones

 
Nurul I. Sarkar and Sonia Gul    
Recent advancements in unmanned aerial vehicles (UAVs) have proven UAVs to be an inevitable part of future networking and communications systems. While many researchers have proposed UAV-assisted solutions for improving traditional network performance by... ver más
Revista: Drones

 
Shabeer Ahmad, Jinling Zhang, Adil Khan, Umar Ajaib Khan and Babar Hayat    
Revista: Drones

 
Bo Liu, Shulei Wang, Qinghua Li, Xinyang Zhao, Yunqing Pan and Changhong Wang    
Revista: Drones

 
Jingping Zhou, Yaping Xu, Xiaohe Gu, Tianen Chen, Qian Sun, Sen Zhang and Yuchun Pan    
Revista: Drones