A Speedy Reinforcement Learning-Based Energy Management Strategy for Fuel Cell Hybrid Vehicles Considering Fuel Cell System Lifetime
- Authors
- Li, Wei; Ye, Jiaye; Cui, Yunduan; Kim, Namwook; Cha, Suk Won; Zheng, Chunhua
- Issue Date
- May-2022
- Publisher
- 한국정밀공학회
- Keywords
- Energy management strategy; Fuel cell hybrid vehicle; Lifetime enhancement; Pre-initialization; Speedy reinforcement learning
- Citation
- International Journal of Precision Engineering and Manufacturing-Green Technology, v.9, no.3, pp 859 - 872
- Pages
- 14
- Indexed
- SCIE
SCOPUS
KCI
- Journal Title
- International Journal of Precision Engineering and Manufacturing-Green Technology
- Volume
- 9
- Number
- 3
- Start Page
- 859
- End Page
- 872
- URI
- https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/112905
- DOI
- 10.1007/s40684-021-00379-8
- ISSN
- 2288-6206
2198-0810
- Abstract
- A speedy reinforcement learning (RL)-based energy management strategy (EMS) is proposed for fuel cell hybrid vehicles (FCHVs) in this research, which approaches near-optimal results with a fast convergence rate based on a pre-initialization framework and meanwhile possesses the ability to extend the fuel cell system (FCS) lifetime. In the pre-initialization framework, well-designed power distribution-related rules are used to pre-initialize the Q-table of the RL algorithm to expedite its optimization process. Driving cycles are modeled as Markov processes and the FCS power difference between adjacent moments is used to evaluate the impact on the FCS lifetime in this research. The proposed RL-based EMS is trained on three driving cycles and validated on another driving cycle. Simulation results demonstrate that the average fuel consumption difference between the proposed EMS and the EMS based on dynamic programming is 5.59% on the training driving cycles and the validation driving cycle. Additionally, the power fluctuation on the FCS is reduced by at least 13% using the proposed EMS compared to the conventional RL-based EMS which does not consider the FCS lifetime. This is significantly beneficial for improving the FCS lifetime. Furthermore, compared to the conventional RL-based EMS, the convergence speed of the proposed EMS is increased by 69% with the pre-initialization framework, which presents the potential for real-time applications. © 2021, Korean Society for Precision Engineering.
- Files in This Item
-
Go to Link
- Appears in
Collections - COLLEGE OF ENGINEERING SCIENCES > DEPARTMENT OF MECHANICAL ENGINEERING > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/112905)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.