Inicio  /  Aerospace  /  Vol: 8 Par: 1 (2021)  /  Artículo
ARTÍCULO
TITULO

Unmanned Aerial Vehicle Pitch Control Using Deep Reinforcement Learning with Discrete Actions in Wind Tunnel Test

Daichi Wada    
Sergio A. Araujo-Estrada and Shane Windsor    

Resumen

Deep reinforcement learning is a promising method for training a nonlinear attitude controller for fixed-wing unmanned aerial vehicles. Until now, proof-of-concept studies have demonstrated successful attitude control in simulation. However, detailed experimental investigations have not yet been conducted. This study applied deep reinforcement learning for one-degree-of-freedom pitch control in wind tunnel tests with the aim of gaining practical understandings of attitude control application. Three controllers with different discrete action choices, that is, elevator angles, were designed. The controllers with larger action rates exhibited better performance in terms of following angle-of-attack commands. The root mean square errors for tracking angle-of-attack commands decreased from 3.42° to 1.99° as the maximum action rate increased from 10°/s to 50°/s. The comparison between experimental and simulation results showed that the controller with a smaller action rate experienced the friction effect, and the controllers with larger action rates experienced fluctuating behaviors in elevator maneuvers owing to delay. The investigation of the effect of friction and delay on pitch control highlighted the importance of conducting experiments to understand actual control performances, specifically when the controllers were trained with a low-fidelity model.

 Artículos similares

       
 
José Azinheira, Reginaldo Carvalho, Ely Paiva and Rafael Cordeiro    
This paper proposes a new kind of airship actuator configuration for surveillance and environmental monitoring missions. We present the design and application of a six-propeller electrical airship (Noamini) with independent tilting propellers, allowing i... ver más
Revista: Aerospace

 
Hanmin Park, Hyeongseok Kang, Bohyun Hwang, Seonggun Joe and Byungkyu Kim    
This study introduces a fruit harvesting mechanism powered by a single motor, designed for integration with unmanned aerial vehicles (UAVs). The mechanism performs reciprocating motion by converting linear motion into rotational motion. Consequently, the... ver más
Revista: Aerospace

 
Michael Finigian, Peter Apostolos Kavounas, Ian Ho, Conor Cian Smith, Adam Witusik, Andrew Hopwood, Camron Avent, Brandon Ragasa and Brian Roth    
Unmanned aerial vehicles (UAVs) have already proven valuable for intelligence, search, and reconnaissance missions; however, their integration into manned aircraft to augment existing capabilities is still an emerging field. This paper describes the desi... ver más
Revista: Aerospace

 
Seyed Mohammad Hashemi, Ruxandra Mihaela Botez and Georges Ghazi    
Accurate aircraft trajectory prediction is fundamental for enhancing air traffic control systems, ensuring a safe and efficient aviation transportation environment. This research presents a detailed study on the efficacy of the Random Forest (RF) methodo... ver más
Revista: Aerospace

 
Donghyun Kang    
Despite the technological achievements of unmanned aerial vehicles (UAVs) growing in academia and industry, there is a lack of studies on the storage devices in UAVs. However, this is an important aspect because the storage devices in UAVs have a limited... ver más
Revista: Aerospace