Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Kuang, Li | - |
dc.contributor.author | Zheng, Jianbo | - |
dc.contributor.author | Li, Kemu | - |
dc.contributor.author | Gao, Honghao | - |
dc.date.accessioned | 2021-10-14T00:40:35Z | - |
dc.date.available | 2021-10-14T00:40:35Z | - |
dc.date.created | 2021-10-14 | - |
dc.date.issued | 2021-11 | - |
dc.identifier.issn | 1533-5399 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/82369 | - |
dc.description.abstract | Efficient signal control at isolated intersections is vital for relieving congestion, accidents, and environmental pollution caused by increasing numbers of vehicles. However, most of the existing studies not only ignore the constraint of the limited computing resources available at isolated intersections but also the matching degree between the signal timing and the traffic demand, leading to high complexity and reduced learning efficiency. In this article, we propose a traffic signal control method based on reinforcement learning with state reduction. First, a reinforcement learning model is established based on historical traffic flow data, and we propose a dual-objective reward function that can reduce vehicle delay and improve the matching degree between signal time allocation and traffic demand, allowing the agent to learn the optimal signal timing strategy quickly. Second, the state and action spaces of the model are preliminarily reduced by selecting a proper control phase combination; then, the state space is further reduced by eliminating rare or nonexistent states based on the historical traffic flow. Finally, a simplified Q-table is generated and used to optimize the complexity of the control algorithm. The results of simulation experiments show that our proposed control algorithm effectively improves the capacity of isolated intersections while reducing the time and space costs of the signal control algorithm. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | ASSOC COMPUTING MACHINERY | - |
dc.relation.isPartOf | ACM TRANSACTIONS ON INTERNET TECHNOLOGY | - |
dc.title | Intelligent Traffic Signal Control Based on Reinforcement Learning with State Reduction for Smart Cities | - |
dc.type | Article | - |
dc.type.rims | ART | - |
dc.description.journalClass | 1 | - |
dc.identifier.wosid | 000703365700023 | - |
dc.identifier.doi | 10.1145/3418682 | - |
dc.identifier.bibliographicCitation | ACM TRANSACTIONS ON INTERNET TECHNOLOGY, v.21, no.4 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.scopusid | 2-s2.0-85116299324 | - |
dc.citation.title | ACM TRANSACTIONS ON INTERNET TECHNOLOGY | - |
dc.citation.volume | 21 | - |
dc.citation.number | 4 | - |
dc.contributor.affiliatedAuthor | Gao, Honghao | - |
dc.type.docType | Article | - |
dc.subject.keywordAuthor | Traffic signal control | - |
dc.subject.keywordAuthor | Q-learning | - |
dc.subject.keywordPlus | TIME | - |
dc.relation.journalResearchArea | Computer Science | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Information Systems | - |
dc.relation.journalWebOfScienceCategory | Computer Science, Software Engineering | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
1342, Seongnam-daero, Sujeong-gu, Seongnam-si, Gyeonggi-do, Republic of Korea(13120)031-750-5114
COPYRIGHT 2020 Gachon University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.