Inicio  /  Aerospace  /  Vol: 10 Par: 5 (2023)  /  Artículo
ARTÍCULO
TITULO

Online Trajectory Planning Method for Midcourse Guidance Phase Based on Deep Reinforcement Learning

Wanli Li    
Jiong Li    
Ningbo Li    
Lei Shao and Mingjie Li    

Resumen

Concerned with the problem of interceptor midcourse guidance trajectory online planning satisfying multiple constraints, an online midcourse guidance trajectory planning method based on deep reinforcement learning (DRL) is proposed. The Markov decision process (MDP) corresponding to the background of a trajectory planning problem is designed, and the key reward function is composed of the final reward and the negative step feedback reward, which lays the foundation for the interceptor training trajectory planning method in the interactive data of a simulation environment; at the same time, concerned with the problems of unstable learning and training efficiency, a trajectory planning training strategy combined with course learning (CL) and deep deterministic policy gradient (DDPG) is proposed to realize the progressive progression of trajectory planning learning and training from satisfying simple objectives to complex objectives, and improve the convergence of the algorithm. The simulation results show that our method can not only generate the optimal trajectory with good results, but its trajectory generation speed is also more than 10 times faster than the hp pseudo spectral convex method (PSC), and can also resist the error influence mainly caused by random wind interference, which has certain application value and good research prospects.

 Artículos similares

       
 
Zhe Liu, Jie Yan, Bangcheng Ai, Yonghua Fan, Kai Luo, Guodong Cai and Jiankai Qin    
This paper presents a deep neural network-based online trajectory generation method for the aerodynamic characteristic description and terminal-area energy management of wave-rider aircrafts. First, the flight dynamics equations in the energy domain are ... ver más
Revista: Aerospace

 
Wei Shi, Jinzhu Zhang, Lina Li, Ziliang Li, Yanjie Zhang, Xiaoyan Xiong, Tao Wang and Qingxue Huang    
Aiming at the robotization of the grinding process in the steel bar finishing process, the steel bar grinding robot can achieve the goal of fast, efficient, and accurate online grinding operation, a multi-layer forward propagating deep neural network (DN... ver más
Revista: Applied Sciences

 
Chengxi Wu, Yuewei Dai, Liang Shan and Zhiyu Zhu    
This paper focuses on developing a data-driven trajectory tracking control approach for autonomous underwater vehicles (AUV) under uncertain external disturbance and time-delay. A novel model-free adaptive predictive control (MFAPC) approach based on a f... ver más

 
Xu Huang, Yuan Zhang, Jiarun Liu, Honghao Zhong, Zhaolei Wang and Yue Peng    
A data-driven nonlinear control approach, called error dynamics-based dual heuristic dynamic programming (ED-DHP), is proposed for air vehicle attitude control. To solve the optimal tracking control problem, the augmented system is defined by the derived... ver más
Revista: Applied Sciences

 
Zhe Zheng, Bo Zou, Wenbin Wei and Wen Tian    
The ability to accurately predict flight time of arrival in real time during a flight is critical to the efficiency and reliability of aviation system operations. This paper proposes a data-light and trajectory-based machine learning approach for the onl... ver más
Revista: Aerospace