Inicio  /  Aerospace  /  Vol: 8 Par: 1 (2021)  /  Artículo
ARTÍCULO
TITULO

Unmanned Aerial Vehicle Pitch Control Using Deep Reinforcement Learning with Discrete Actions in Wind Tunnel Test

Daichi Wada    
Sergio A. Araujo-Estrada and Shane Windsor    

Resumen

Deep reinforcement learning is a promising method for training a nonlinear attitude controller for fixed-wing unmanned aerial vehicles. Until now, proof-of-concept studies have demonstrated successful attitude control in simulation. However, detailed experimental investigations have not yet been conducted. This study applied deep reinforcement learning for one-degree-of-freedom pitch control in wind tunnel tests with the aim of gaining practical understandings of attitude control application. Three controllers with different discrete action choices, that is, elevator angles, were designed. The controllers with larger action rates exhibited better performance in terms of following angle-of-attack commands. The root mean square errors for tracking angle-of-attack commands decreased from 3.42° to 1.99° as the maximum action rate increased from 10°/s to 50°/s. The comparison between experimental and simulation results showed that the controller with a smaller action rate experienced the friction effect, and the controllers with larger action rates experienced fluctuating behaviors in elevator maneuvers owing to delay. The investigation of the effect of friction and delay on pitch control highlighted the importance of conducting experiments to understand actual control performances, specifically when the controllers were trained with a low-fidelity model.

 Artículos similares

       
 
Donghyun Kang    
Despite the technological achievements of unmanned aerial vehicles (UAVs) growing in academia and industry, there is a lack of studies on the storage devices in UAVs. However, this is an important aspect because the storage devices in UAVs have a limited... ver más
Revista: Aerospace

 
Haoyu Cheng, Dan Zhao, Nay Lin Oo, Xiran Liu and Xu Dong    
Ice accretion is inevitable on fix-wing UAVs (unmanned aerial vehicles) when they are applied to surveillance and mapping over colder climates and arctic regions. Subsequent aerodynamic profile changes have caused the current interest in the better predi... ver más
Revista: Aerospace

 
Chenglou Liu, Fangfang Xie and Tingwei Ji    
Formation path planning is a significant cornerstone for unmanned aerial vehicle (UAV) swarm intelligence. Previous methods were not suitable for large-scale UAV formation, which suffered from poor formation maintenance and low planning efficiency. To th... ver más
Revista: Aerospace

 
Ahad Alotaibi, Chris Chatwin and Phil Birch    
In aerial surveillance systems, achieving optimal object detection precision is of paramount importance for effective monitoring and reconnaissance. This article presents a novel approach to enhance object detection accuracy through the integration of De... ver más

 
Bohyeon Hwang, Kideok Do and Sungyeol Chang    
Constant changes occur in coastal areas over different timescales, requiring observation and modeling. Specifically, modeling morphological changes resulting from short-term events, such as storms, is of great importance in coastal management. Parameter ... ver más