Inicio  /  Aerospace  /  Vol: 9 Par: 11 (2022)  /  Artículo
ARTÍCULO
TITULO

High-Speed Three-Dimensional Aerial Vehicle Evasion Based on a Multi-Stage Dueling Deep Q-Network

Yefeng Yang    
Tao Huang    
Xinxin Wang    
Chih-Yung Wen and Xianlin Huang    

Resumen

This paper proposes a multi-stage dueling deep Q-network (MS-DDQN) algorithm to address the high-speed aerial vehicle evasion problem. High-speed aerial vehicle pursuit and evasion are an ongoing game attracting significant research attention in the field of autonomous aerial vehicle decision making. However, traditional maneuvering methods are usually not applicable in high-speed scenarios. Independent of the aerial vehicle model, the implemented MS-DDQN-based method searches for an approximate optimal maneuvering policy by iteratively interacting with the environment. Furthermore, the multi-stage learning mechanism was introduced to improve the training data quality. Simulation experiments were conducted to compare the proposed method with several typical evasion maneuvering policies and to reveal the effectiveness and robustness of the proposed MS-DDQN algorithm.

 Artículos similares

       
 
Yuzheng Li, Jintao Du, Yijun Lan, Heng Du and Hui Huang    
Aiming at the problem of valve port erosion caused by contaminated particles, a three-dimensional prediction model of valve orifice erosion was established based on computational fluid dynamics (CFD) and erosion theory, considering the influence of the v... ver más
Revista: Applied Sciences

 
Andrea Aprovitola, Oleksandr Dyblenko, Giuseppe Pezzella and Antonio Viviani    
The recent improvement of technology readiness level in aeronautics and the renewed demand for faster transportation are driving the rebirth of supersonic flight for commercial aviation. However, the design of a future supersonic aircraft is still very c... ver más
Revista: Aerospace

 
Hongmei Jiang, Xu Peng, Wenbo Xie, Shaopeng Lu and Yongmin Gu    
The high-speed Over-Tip-Leakage (OTL) flow has a significant impact on the aerodynamic performance of the High-Pressure Turbine (HPT) passage and generates high thermal load for the blade tip. Different tip sealing and cooling design strategies are appli... ver más
Revista: Aerospace

 
Wei Wang, Xi Wang, Zhengwei Wang, Mabing Ni and Chunan Yang    
The instability of the no-load working condition of the pump turbine directly affects the grid connection of the unit, and will cause vibration and damage to the components of the unit in severe cases. In this paper, a three-dimensional full flow numeric... ver más

 
Mahdi Tabatabaei Malazi, Emir Taha Eren, Jing Luo, Shuo Mi and Galip Temir    
A three-dimensional T-shaped flexible beam deformation was investigated using model experiments and numerical simulations. In the experiment, a beam was placed in a recirculating water channel with a steady uniform flow in the inlet. A high-speed camera ... ver más