Inicio  /  Applied Sciences  /  Vol: 13 Par: 6 (2023)  /  Artículo
ARTÍCULO
TITULO

Model-Based Deep Reinforcement Learning with Traffic Inference for Traffic Signal Control

Hao Wang    
Jinan Zhu and Bao Gu    

Resumen

In the modern world, the extremely rapid growth of traffic demand has become a major problem for urban traffic development. Continuous optimization of signal control systems is an important way to relieve traffic pressure in cities. In recent years, with the impressive development of deep reinforcement learning (DRL), some DRL approaches have started to be applied to traffic signal control. Unlike traditional signal control methods, agents trained using DRL approaches continuously receive feedback from the environment to continuously improve the policy. Since current research in the field is more focused on the performance of the agent, data efficiency during training is ignored to some extent. However, in traffic signal control tasks, the cost of trial and error is very expensive. In this paper, we propose a DRL approach based on a traffic inference model. The proposed traffic inference model is based on the future information given based on upstream intersections and data from the environment to continuously learn the changing patterns of the traffic environment in order to make inferences about changes in the traffic environment. In the proposed algorithm, the inference model interacts with the agent instead of the environment. Through comprehensive experiments based on realistic datasets, we demonstrate that our proposed algorithm is superior to other algorithms in terms of its data efficiency and stronger performance.

 Artículos similares

       
 
Yixiong He, Zijun Du, Liwen Huang, Deqing Yu and Xiao Liu    
A maneuvering decision-making model based on time series rolling and feedback compensation methods is proposed to solve the problem of high traffic risk in Chengshantou traffic separation scheme (TSS) waters. Firstly, a digital traffic environment model ... ver más
Revista: Applied Sciences

 
Yikang Rui, Shu Wang, Renfei Wu and Zhe Shen    
Automated truck platooning has become an increasingly popular research subject, and its applicability to highways is considered one of the earliest possible landing scenarios for automated driving. However, there is a lack of research regarding the combi... ver más
Revista: Applied Sciences

 
Jiaming Song, Xiaojuan Wang, Mingshu He and Lei Jin    
In computer networks, Network Intrusion Detection System (NIDS) plays a very important role in identifying intrusion behaviors. NIDS can identify abnormal behaviors by analyzing network traffic. However, the performance of classifier is not very good in ... ver más
Revista: Information

 
Ekaterina Lopukhova, Ansaf Abdulnagimov, Grigory Voronkov, Ruslan Kutluyarov and Elizaveta Grakhova    
In intelligent transportation systems, an important task is to provide a highly efficient communication channel between vehicles and other infrastructure objects that meets energy efficiency requirements and involves low time delays. The paper presents a... ver más
Revista: Information

 
Jing Yang, Hongyu Yang, Zhengyuan Wu and Xiping Wu    
Due to increased air traffic flow, air traffic controllers (ATCs) operate in a state of high load or even overload for long periods of time, which can seriously affect the reliability and efficiency of controllers? commands. Thus, the early identificatio... ver más
Revista: Aerospace