Deep Reinforcement Learning Driven Joint Dynamic TDD and RRC Connection Management Scheme in Massive IoT Networksopen access
- Authors
- Park, Jaeeun; Lee, Joohyung; Kim, Daejin; Choi, Jun Kyun
- Issue Date
- Feb-2024
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Internet of Things; Deep reinforcement learning; time division duplexing; grant-free transmission; radio resource control; deep reinforcement learning
- Citation
- IEEE ACCESS, v.12, pp 34973 - 34992
- Pages
- 20
- Journal Title
- IEEE ACCESS
- Volume
- 12
- Start Page
- 34973
- End Page
- 34992
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/91107
- DOI
- 10.1109/ACCESS.2024.3371169
- ISSN
- 2169-3536
- Abstract
- To support dramatically increasing services from internet of thing (IoT) devices with the sporadic and fluctuated generation of short packet traffic, this paper investigates joint dynamic time division duplexing (TDD) and radio resource control (RRC) connection management in a single-cell massive IoT network. Specifically, under the grant-free transmission incurring packet collision, this study models the factors affecting the time resource utilization (TRU) and energy consumption of IoT devices as a comprehensive system utility and further formulates the problem as a decision-making process aiming for balancing the long-term average TRU and energy consumption. To address the formulated problem, based on the deep reinforcement learning framework, this paper designs an experience-driven joint dynamic TDD and RRC connection management scheme that intelligently i) determines the TDD configuration based on the most recent downlink (DL)/uplink (UL) traffic demands and ii) adjusts the RRC state of each IoT device to control the maximum number of transmitting IoT devices. Finally, trace-driven simulation results demonstrate that the proposed scheme outperforms existing benchmarks, such as Static TDD and Dynamic TDD, in terms of transmission success ratio difference (TSRD) (up to 89% reduction), time resource utilization (TRU) (up to $17\times $ increase), and energy consumption (up to 70% reduction) of IoT devices.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - ETC > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/91107)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.