Deep Q-Network Based Beam Tracking for Mobile Millimeter-wave Communications
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Park, Hyunwoo | - |
dc.contributor.author | Kang, Jeongwan | - |
dc.contributor.author | Lee, Sangwoo | - |
dc.contributor.author | Choi, Jun Won | - |
dc.contributor.author | Kim, Sunwoo | - |
dc.date.accessioned | 2023-10-04T06:53:14Z | - |
dc.date.available | 2023-10-04T06:53:14Z | - |
dc.date.created | 2022-10-06 | - |
dc.date.issued | 2023-02 | - |
dc.identifier.issn | 1536-1276 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/191659 | - |
dc.description.abstract | In this paper, we present a beam tracking algorithm based on the deep Q-network (DQN) for mobile millimeter-wave (mmWave) communications. The proposed algorithm determines the receive beam angle from the received signals without knowing the channel model and dynamics. It uses the received signals of the current and previous time slots to design the state and reward of the DQN. Our goal is to maximize the signal-to-noise ratio by the actions of the designed DQN. A significant computational complexity reduction is achieved since the receiver does not need to run complicated signal processing algorithms once the DQN is properly trained. Therefore a practical implementation of mmWave beam tracking with a very large number of antennas under harsh mobile environments becomes feasible. Through the extensive simulations, we verified the performance of the proposed algorithm and demonstrated robustness to the system uncertainty and low computational complexity in comparison with particle filter and the Q-learning. | - |
dc.language | 영어 | - |
dc.language.iso | en | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Deep Q-Network Based Beam Tracking for Mobile Millimeter-wave Communications | - |
dc.type | Article | - |
dc.contributor.affiliatedAuthor | Choi, Jun Won | - |
dc.contributor.affiliatedAuthor | Kim, Sunwoo | - |
dc.identifier.doi | 10.1109/TWC.2022.3199746 | - |
dc.identifier.scopusid | 2-s2.0-85137899461 | - |
dc.identifier.wosid | 000966738800001 | - |
dc.identifier.bibliographicCitation | IEEE Transactions on Wireless Communications, v.22, no.2, pp.961 - 971 | - |
dc.relation.isPartOf | IEEE Transactions on Wireless Communications | - |
dc.citation.title | IEEE Transactions on Wireless Communications | - |
dc.citation.volume | 22 | - |
dc.citation.number | 2 | - |
dc.citation.startPage | 961 | - |
dc.citation.endPage | 971 | - |
dc.type.rims | ART | - |
dc.type.docType | Article | - |
dc.description.journalClass | 1 | - |
dc.description.isOpenAccess | N | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalResearchArea | Telecommunications | - |
dc.relation.journalWebOfScienceCategory | Engineering, Electrical & Electronic | - |
dc.relation.journalWebOfScienceCategory | Telecommunications | - |
dc.subject.keywordPlus | OPTIMIZATION | - |
dc.subject.keywordPlus | MMWAVE | - |
dc.subject.keywordPlus | DESIGN | - |
dc.subject.keywordPlus | MIMO | - |
dc.subject.keywordAuthor | Millimeter wave communication | - |
dc.subject.keywordAuthor | Symbols | - |
dc.subject.keywordAuthor | Signal processing algorithms | - |
dc.subject.keywordAuthor | Computational modeling | - |
dc.subject.keywordAuthor | Q-learning | - |
dc.subject.keywordAuthor | Heuristic algorithms | - |
dc.subject.keywordAuthor | Bayes methods | - |
dc.subject.keywordAuthor | Beam tracking | - |
dc.subject.keywordAuthor | deep reinforcement learning | - |
dc.subject.keywordAuthor | deep Q-network | - |
dc.subject.keywordAuthor | mmWave communications | - |
dc.subject.keywordAuthor | channel estimation | - |
dc.identifier.url | https://ieeexplore.ieee.org/document/9869437 | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
222, Wangsimni-ro, Seongdong-gu, Seoul, 04763, Korea+82-2-2220-1365
COPYRIGHT © 2021 HANYANG UNIVERSITY.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.