Inicio  /  Aerospace  /  Vol: 9 Par: 12 (2022)  /  Artículo
ARTÍCULO
TITULO

Improving Algorithm Conflict Resolution Manoeuvres with Reinforcement Learning

Marta Ribeiro    
Joost Ellerbroek and Jacco Hoekstra    

Resumen

Future high traffic densities with drone operations are expected to exceed the number of aircraft that current air traffic control procedures can control simultaneously. Despite extensive research on geometric CR methods, at higher densities, their performance is hindered by the unpredictable emergent behaviour from surrounding aircraft. In response, research has shifted its attention to creating automated tools capable of generating conflict resolution (CR) actions adapted to the environment and not limited by man-made rules. Several works employing reinforcement learning (RL) methods for conflict resolution have been published recently. Although proving that they have potential, at their current development, the results of the practical implementation of these methods do not reach their expected theoretical performance. Consequently, RL applications cannot yet match the efficacy of geometric CR methods. Nevertheless, these applications can improve the set of rules that geometrical CR methods use to generate a CR manoeuvre. This work employs an RL method responsible for deciding the parameters that a geometric CR method uses to generate the CR manoeuvre for each conflict situation. The results show that this hybrid approach, combining the strengths of geometric CR and RL methods, reduces the total number of losses of minimum separation. Additionally, the large range of different optimal solutions found by the RL method shows that the rules of geometric CR method must be expanded, catering for different conflict geometries.

 Artículos similares

       
 
Shitu Chen, Ling Feng, Xuteng Bao, Zhe Jiang, Bowen Xing and Jingxiang Xu    
Path planning is crucial for unmanned surface vehicles (USVs) to navigate and avoid obstacles efficiently. This study evaluates and contrasts various USV path-planning algorithms, focusing on their effectiveness in dynamic obstacle avoidance, resistance ... ver más

 
Ivan Volaric and Victor Sucic    
One of the frequently used classes of sparse reconstruction algorithms is based on the iterative shrinkage/thresholding procedure, in which the thresholding parameter controls a trade-off between the algorithm?s accuracy and execution time. In order to a... ver más
Revista: Information

 
Piotr Bortnowski, Robert Król, Natalia Suchorab-Matuszewska, Maksymilian Ozdoba and Mateusz Szczerbakowicz    
This study examines the optimization of ore receiving bins in underground copper mines, targeting the reduction of rapid wear and tear on bin components. The investigation identifies the primary wear contributors as the force exerted by the accumulated o... ver más
Revista: Applied Sciences

 
Rui Zhou and Xianghong Xu    
The significant increase in the speed of high-speed trains has made the optimization of pantograph?catenary parameters aimed at improving current collection quality become one of the key issues that urgently need to be addressed. In this paper, a method ... ver más
Revista: Applied Sciences

 
MohammadHossein Reshadi, Wen Li, Wenjie Xu, Precious Omashor, Albert Dinh, Scott Dick, Yuntong She and Michael Lipsett    
Anomaly detection in data streams (and particularly time series) is today a vitally important task. Machine learning algorithms are a common design for achieving this goal. In particular, deep learning has, in the last decade, proven to be substantially ... ver más
Revista: Algorithms