Inicio  /  Aerospace  /  Vol: 9 Par: 8 (2022)  /  Artículo
ARTÍCULO
TITULO

Using Reinforcement Learning in a Layered Airspace to Improve Layer Change Decision

Marta Ribeiro    
Joost Ellerbroek and Jacco Hoekstra    

Resumen

Current predictions for future operations with drones estimate traffic densities orders of magnitude higher than any observed in manned aviation. Such densities call for further research and innovation, in particular, into conflict detection and resolution without the need for human intervention. The layered airspace concept, where aircraft are separated per vertical layer according to their heading, has been widely researched and proven to increase traffic capacity. However, aircraft traversing between layers do not benefit from this separation and alignment effect. As a result, interactions between climbing/descending and cruising aircraft can lead to a large increase in conflicts and intrusions. This paper looks into ways of reducing the impact of vertical transitions within the environment. We test two reinforcement learning methods: a decision-making module and a control execution module. The former issues a lane change command based on the planned route. The latter performs operational control to coordinate the longitude and vertical movement of the aircraft for a safe merging manoeuvre. The results show that reinforcement learning is capable of optimising an efficient driving policy for layer change manoeuvres, decreasing the number of conflicts and losses of minimum separation compared to manually defined navigation rules.

 Artículos similares

       
 
Ahmet Demir, Bahadir Ok and Talha Sarici    
In this study, the performance of unpaved road sections over soft clay soil geosynthetic-reinforced and stabilized with rock fill layer was evaluated using repeated plate loading tests. A total of 10 field tests were carried out using a circular model ri... ver más
Revista: Applied Sciences

 
Daniel Suarez-Riera, Luca Lavagna, Juan Felipe Carvajal, Jean-Marc Tulliani, Devid Falliano and Luciana Restuccia    
Biochar, the solid sub-product of biomass pyrolysis, is widely considered an effective water retention material thanks to its porous microstructure and high specific surface area. This study investigates the possibility of improving both mechanical and r... ver más
Revista: Applied Sciences

 
Juyao Wei, Zhenggang Lu, Zheng Yin and Zhipeng Jing    
This paper presents a novel data-driven multiagent reinforcement learning (MARL) controller for enhancing the running stability of independently rotating wheels (IRW) and reducing wheel?rail wear. We base our active guidance controller on the multiagent ... ver más
Revista: Applied Sciences

 
Jordi Renau Martínez, Víctor García Peñas, Manuel Ibáñez Arnal, Alberto Giménez Sancho, Eduardo López González, Adelaida García Magariño, Félix Terroba Ramírez, Francisco Javier Moreno Ayerbe and Fernando Sánchez López    
This article presents the design and manufacturing of a hydrogen-powered unmanned aquatic surface vehicle (USV) hull. The design process comprised three stages: (1) defining the requirements for a preliminary geometry, (2) verifying the hydrodynamic hull... ver más

 
Eyad K. Sayhood, Nisreen S. Mohammed, Salam J. Hilo and Salih S. Salih    
This paper presents comprehensive empirical equations to predict the shear strength capacity of reinforced concrete deep beams, with a focus on improving the accuracy of existing codes. Analyzing 198 deep beams imported from 15 existing investigations, t... ver más
Revista: Infrastructures