Dynamic pricing and energy management for profit maximization in multiple smart electric vehicle charging stations: A privacy-preserving deep reinforcement learning approach
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Lee, S. | - |
dc.contributor.author | Choi, D.-H. | - |
dc.date.accessioned | 2021-09-29T00:40:39Z | - |
dc.date.available | 2021-09-29T00:40:39Z | - |
dc.date.issued | 2021-12-15 | - |
dc.identifier.issn | 0306-2619 | - |
dc.identifier.issn | 1872-9118 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/49973 | - |
dc.description.abstract | Profit maximization of electric vehicle charging station (EVCS) operation yields an increasing investment for the deployment of EVCSs, thereby increasing the penetration of electric vehicles (EVs) and supporting high-quality charging service to EV users. However, existing model-based approaches for profit maximization of EVCSs may exhibit poor performance owing to the underutilization of massive data and inaccurate modeling of EVCS operation in a dynamic environment. Furthermore, the existing approaches can be vulnerable to adversaries that abuse private EVCS operation data for malicious purposes. To resolve these limitations, we propose a privacy-preserving distributed deep reinforcement learning (DRL) framework that maximizes the profits of multiple smart EVCSs integrated with photovoltaic and energy storage systems under a dynamic pricing strategy. In the proposed framework, DRL agents using the soft actor–critic method determine the schedules of the profitable selling price and charging/discharging energy for EVCSs. To preserve the privacy of EVCS operation data, a federated reinforcement learning method is adopted in which only the local and global neural network models of the DRL agents are exchanged between the DRL agents at the EVCSs and the global agent at the central server without sharing EVCS data. Numerical examples demonstrate the effectiveness of the proposed approach in terms of convergence of the training curve for the DRL agent, adaptive profitable selling price, energy charging and discharging, sensitivity of the selling price factor, and varying weather conditions. © 2021 Elsevier Ltd | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Elsevier Ltd | - |
dc.title | Dynamic pricing and energy management for profit maximization in multiple smart electric vehicle charging stations: A privacy-preserving deep reinforcement learning approach | - |
dc.type | Article | - |
dc.identifier.doi | 10.1016/j.apenergy.2021.117754 | - |
dc.identifier.bibliographicCitation | Applied Energy, v.304 | - |
dc.description.isOpenAccess | N | - |
dc.identifier.wosid | 000701880300003 | - |
dc.identifier.scopusid | 2-s2.0-85114493231 | - |
dc.citation.title | Applied Energy | - |
dc.citation.volume | 304 | - |
dc.type.docType | Article | - |
dc.publisher.location | 영국 | - |
dc.subject.keywordAuthor | Deep reinforcement learning | - |
dc.subject.keywordAuthor | Dynamic pricing | - |
dc.subject.keywordAuthor | Electric vehicle | - |
dc.subject.keywordAuthor | Electric vehicle charging station | - |
dc.subject.keywordAuthor | Federated reinforcement learning | - |
dc.subject.keywordAuthor | Profit maximization | - |
dc.subject.keywordPlus | Charging (batteries) | - |
dc.subject.keywordPlus | Costs | - |
dc.subject.keywordPlus | Deep learning | - |
dc.subject.keywordPlus | Digital storage | - |
dc.subject.keywordPlus | Investments | - |
dc.subject.keywordPlus | Profitability | - |
dc.subject.keywordPlus | Reinforcement learning | - |
dc.subject.keywordPlus | Sales | - |
dc.subject.keywordPlus | Charging station | - |
dc.subject.keywordPlus | Dynamic pricing | - |
dc.subject.keywordPlus | Electric vehicle charging | - |
dc.subject.keywordPlus | Electric vehicle charging station | - |
dc.subject.keywordPlus | Federated reinforcement learning | - |
dc.subject.keywordPlus | Privacy preserving | - |
dc.subject.keywordPlus | Profit maximization | - |
dc.subject.keywordPlus | Reinforcement learning agent | - |
dc.subject.keywordPlus | Selling prices | - |
dc.subject.keywordPlus | Station operations | - |
dc.subject.keywordPlus | Electric vehicles | - |
dc.subject.keywordPlus | climate conditions | - |
dc.subject.keywordPlus | electric vehicle | - |
dc.subject.keywordPlus | energy management | - |
dc.subject.keywordPlus | energy market | - |
dc.subject.keywordPlus | energy storage | - |
dc.subject.keywordPlus | integrated approach | - |
dc.subject.keywordPlus | learning | - |
dc.subject.keywordPlus | strategic approach | - |
dc.relation.journalResearchArea | Energy & Fuels | - |
dc.relation.journalResearchArea | Engineering | - |
dc.relation.journalWebOfScienceCategory | Energy & Fuels | - |
dc.relation.journalWebOfScienceCategory | Engineering, Chemical | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.