Inicio  /  Future Internet  /  Vol: 16 Par: 3 (2024)  /  Artículo
ARTÍCULO
TITULO

UAV Control Method Combining Reptile Meta-Reinforcement Learning and Generative Adversarial Imitation Learning

Shui Jiang    
Yanning Ge    
Xu Yang    
Wencheng Yang and Hui Cui    

Resumen

Reinforcement learning (RL) is pivotal in empowering Unmanned Aerial Vehicles (UAVs) to navigate and make decisions efficiently and intelligently within complex and dynamic surroundings. Despite its significance, RL is hampered by inherent limitations such as low sample efficiency, restricted generalization capabilities, and a heavy reliance on the intricacies of reward function design. These challenges often render single-method RL approaches inadequate, particularly in the context of UAV operations where high costs and safety risks in real-world applications cannot be overlooked. To address these issues, this paper introduces a novel RL framework that synergistically integrates meta-learning and imitation learning. By leveraging the Reptile algorithm from meta-learning and Generative Adversarial Imitation Learning (GAIL), coupled with state normalization techniques for processing state data, this framework significantly enhances the model?s adaptability. It achieves this by identifying and leveraging commonalities across various tasks, allowing for swift adaptation to new challenges without the need for complex reward function designs. To ascertain the efficacy of this integrated approach, we conducted simulation experiments within both two-dimensional environments. The empirical results clearly indicate that our GAIL-enhanced Reptile method surpasses conventional single-method RL algorithms in terms of training efficiency. This evidence underscores the potential of combining meta-learning and imitation learning to surmount the traditional barriers faced by reinforcement learning in UAV trajectory planning and decision-making processes.

 Artículos similares

       
 
Bo Liu, Shulei Wang, Qinghua Li, Xinyang Zhao, Yunqing Pan and Changhong Wang    
Revista: Drones

 
Jingping Zhou, Yaping Xu, Xiaohe Gu, Tianen Chen, Qian Sun, Sen Zhang and Yuchun Pan    
Revista: Drones

 
Yunhong Yang, Xingzhong Xiong and Yuehao Yan    
With the continuous development of UAV technology and swarm intelligence technology, the UAV formation cooperative mission has attracted wide attention because of its remarkable function and flexibility to complete complex and changeable tasks, such as s... ver más
Revista: Drones

 
Jianjun Chen, Zizhen Chen, Renjie Huang, Haotian You, Xiaowen Han, Tao Yue and Guoqing Zhou    
When employing remote sensing images, it is challenging to classify vegetation species and ground objects due to the abundance of wetland vegetation species and the high fragmentation of ground objects. Remote sensing images are classified primarily acco... ver más
Revista: Drones

 
Yarajarla Nagasree, Chiramdasu Rupa, Ponugumati Akshitha, Gautam Srivastava, Thippa Reddy Gadekallu and Kuruva Lakshmanna    
Privacy preservation of image data has been a top priority for many applications. The rapid growth of technology has increased the possibility of creating fake images using social media as a platform. However, many people, including researchers, rely on ... ver más
Revista: Drones