Multi-Objective Optimization of Energy Saving and Throughput in Heterogeneous Networks Using Deep Reinforcement Learning
- Authors
- Ryu, Kyungho; Kim, Wooseong
- Issue Date
- Dec-2021
- Publisher
- MDPI
- Keywords
- Energy saving; Wireless backhaul mesh, deep reinforcement learning; Wireless heterogeneous network
- Citation
- Sensors, v.21, no.23
- Journal Title
- Sensors
- Volume
- 21
- Number
- 23
- URI
- https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/83121
- DOI
- 10.3390/s21237925
- ISSN
- 1424-8220
- Abstract
- Wireless networking using GHz or THz spectra has encouraged mobile service providers to deploy small cells to improve link quality and cell capacity using mmWave backhaul links. As green networking for less CO2 emission is mandatory to confront global climate change, we need energy efficient network management for such denser small-cell heterogeneous networks (HetNets) that already suffer from observable power consumption. We establish a dual-objective optimization model that minimizes energy consumption by switching off unused small cells while maximizing user throughput, which is a mixed integer linear problem (MILP). Recently, the deep reinforcement learning (DRL) algorithm has been applied to many NP-hard problems of the wireless networking field, such as radio resource allocation, association and power saving, which can induce a nearoptimal solution with fast inference time as an online solution. In this paper, we investigate the feasibility of the DRL algorithm for a dual-objective problem, energy efficient routing and throughput maximization, which has not been explored before. We propose a proximal policy (PPO)-based multi-objective algorithm using the actor-critic model that is realized as an optimistic linear support framework in which the PPO algorithm searches for feasible solutions iteratively. Experimental results show that our algorithm can achieve throughput and energy savings comparable to the CPLEX. © 2021 by the authors. Licensee MDPI, Basel, Switzerland.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - IT융합대학 > 컴퓨터공학과 > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/gachon/handle/2020.sw.gachon/83121)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.