ARTÍCULO
TITULO

Three-Dimensional Path Tracking Control of Autonomous Underwater Vehicle Based on Deep Reinforcement Learning

Yushan Sun    
Chenming Zhang    
Guocheng Zhang    
Hao Xu and Xiangrui Ran    

Resumen

In this paper, the three-dimensional (3D) path tracking control of an autonomous underwater vehicle (AUV) under the action of sea currents was researched. A novel reward function was proposed to improve learning ability and a disturbance observer was developed to observe the disturbance caused by currents. Based on existing models, the dynamic and kinematic models of the AUV were established. Deep Deterministic Policy Gradient, a deep reinforcement learning, was employed for designing the path tracking controller. Compared with the backstepping sliding mode controller, the controller proposed in this article showed excellent performance, at least in the particular study developed in this article. The improved reward function and the disturbance observer were also found to work well with improving path tracking performance.

 Artículos similares

       
 
Zeyang Wang, Jun Huang and Mingxu Yi    
Unmanned aerial helicopters (UAHs) have been widely used recently for reconnaissance operations and other risky missions. Meanwhile, the threats to UAHs have been becoming more and more serious, mainly from radar and flights. It is essential for a UAH to... ver más
Revista: Aerospace

 
Tianming Feng, Jin Lei, Yujie Zeng, Xinyan Qin, Yanqi Wang, Dexin Wang and Wenxing Jia    
The Flying?Walking Power Line Inspection Robot (FPLIR) faces challenges in maintaining stability and reliability when operating in harsh transmission line environments with complex conditions. The robot often switches modes frequently to land accurately ... ver más
Revista: Aerospace

 
Jian Li, Weijian Zhang, Yating Hu, Shengliang Fu, Changyi Liao and Weilin Yu    
To improve the obstacle avoidance ability of agricultural unmanned aerial vehicles (UAV) in farmland settings, a three-dimensional space path planning model based on the R5DOS model is proposed in this paper. The direction layer of the R5DOS intersection... ver más
Revista: Applied Sciences

 
Haochen Li, Haibing Chen, Chengpeng Tan, Zaiming Jiang and Xinyi Xu    
Optimal entry flight of hypersonic vehicles requires achieving specific mission objectives under complex nonlinear flight dynamics constraints. The challenge lies in rapid generation of optimal or near-optimal flight trajectories with significant changes... ver más
Revista: Aerospace

 
Shao Xuan Seah and Sutthiphong Srigrarom    
This paper explores the use of deep reinforcement learning in solving the multi-agent aircraft traffic planning (individual paths) and collision avoidance problem for a multiple UAS, such as that for a cargo drone network. Specifically, the Deep Q-Networ... ver más
Revista: Aerospace