Inicio  /  Drones  /  Vol: 6 Par: 9 (2022)  /  Artículo
ARTÍCULO
TITULO

Robust Control Strategy for Quadrotor Drone Using Reference Model-Based Deep Deterministic Policy Gradient

Hongxun Liu    
Satoshi Suzuki    
Wei Wang    
Hao Liu and Qi Wang    

Resumen

Due to the differences between simulations and the real world, the application of reinforcement learning (RL) in drone control encounters problems such as oscillations and instability. This study proposes a control strategy for quadrotor drones using a reference model (RM) based on deep RL. Unlike the conventional studies associated with optimal and adaptive control, this method uses a deep neural network to design a flight controller for quadrotor drones, which can map the drone?s states and target values to control commands directly. The method was developed based on a deep deterministic policy gradient (DDPG) algorithm combined with the deep neural network. The RM was further employed for the actor?critic structure to enhance the robustness and dynamic stability. The RM?DDPG-based flight-control strategy was confirmed to be practicable through a two-fold experiment. First, a quadrotor drone model was constructed based on an actual drone, and the offline policy was trained on it. The performance of the policy was evaluated via simulations while confirming the transition of system states and the output of the controller. The proposed strategy can eliminate oscillations and steady error and can achieve robust results for the target value and external interference.

 Artículos similares

       
 
Mateusz Malarczyk, Mateusz Zychlewicz, Radoslaw Stanislawski and Marcin Kaminski    
In this paper, the problem of the remote control of electric drives with a complex mechanical structure is discussed. Oscillations of state variables and control precision are the main issues found in such applications. The article proposes a smart, IoT-... ver más
Revista: Future Internet

 
Weilin Yang, Tianjing Shen, Tinglong Pan, Guanyang Hu and Dezhi Xu    
In this paper, the consensus control of unmanned surface vehicles (USVs) is investigated by employing a distributed model predictive control approach. A hierarchical control structure is considered during the controller design, where the upper layer dete... ver más
Revista: Drones

 
Pratik Thantharate and Anurag Thantharate    
With the digitization of healthcare, an immense amount of sensitive medical data are generated and shared between various healthcare stakeholders?however, traditional health data management mechanisms present interoperability, security, and privacy chall... ver más

 
Younghan Edwin Jung, M. Myung Jeong, Hwandon Jun and Trevor Smith    
Combined sewer overflow (CSO) is a significant environmental concern and public health risk (e.g., water contamination, eutrophication, and beach closure). The Environmental Protection Agency (EPA) has introduced the National Pollutant Discharge Eliminat... ver más
Revista: Infrastructures

 
Mohammed A. Mohammed, Manel Boujelben and Mohamed Abid    
Recently, the advent of blockchain (BC) has sparked a digital revolution in different fields, such as finance, healthcare, and supply chain. It is used by smart healthcare systems to provide transparency and control for personal medical records. However,... ver más
Revista: Future Internet