Hierarchical multi-agent system in traffic network signalization with improved genetic algorithm

Tan, Min Keng and Chuo, Helen Sin Ee and Chin, Renee Ka Yin and Yeo, Kiam Beng and Teo, Kenneth Tze Kin (2019) Hierarchical multi-agent system in traffic network signalization with improved genetic algorithm.

[img] Text
Hierarchical multi-agent system in traffic network signalization with improved genetic algorithm.ABSTRACT.pdf

Download (60kB)
[img] Text
Hierarchical multi-agent system in traffic network signalization with improved genetic algorithm.pdf
Restricted to Registered users only

Download (316kB) | Request a copy

Abstract

Instead of using classical offline data-driven optimization technique in traffic network signal control, this work aims to explore the potential of implementing an online data-driven optimization technique. A dynamic modeling technique is proposed using Q-learning (QL) algorithm to online observe and learn the inflow-outflow traffic behaviors and extract the model parameters to update the evaluation model used in the fitness function of genetic algorithm (GA). The proposed GA with dynamic modeling is known as dyna- GA. Dyna-GA is then integrated into a hierarchical-based multi-agent traffic signal control system which consists of two layers. The lower-layer consists of several local agents that have autonomy in controlling their local intersection, whereas the upper-layer consists of one supervisory agent that has jurisdiction on all the local agents. The supervisory agent has the superiority in overwriting the local control decision if conflict occurred. The robustness of the proposed dyna-GA under several traffic scenarios is tested using a simulated arterial traffic network. The simulation results show the proposed dyna-GA has better performances in minimizing travel delay as compared to the classical GA which does not have the dynamic model.

Item Type: Proceedings
Keyword: Traffic signal control , Multi-agent system , Dynamic modeling , Genetic algorithm , Q-learning algorithm
Subjects: T Technology > TE Highway engineering. Roads and pavements > TE1-450 Highway engineering. Roads and pavements > TE210-228.3 Construction details Including foundations, maintenance, equipment
Department: FACULTY > Faculty of Engineering
Depositing User: DG MASNIAH AHMAD -
Date Deposited: 24 Feb 2022 16:51
Last Modified: 24 Feb 2022 16:51
URI: https://eprints.ums.edu.my/id/eprint/31766

Actions (login required)

View Item View Item