Online Data-Driven Energy Management of a Hybrid Electric Vehicle Using Model-Based Q-Learningopen access
- Authors
- Lee, Heeyun; Kang, Changbeom; Park, Yeong-Il; Kim, Namwook; Cha, Suk Won
- Issue Date
- May-2020
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Hybrid electric vehicle; optimal control; power management; Q-learning; reinforcement learning
- Citation
- IEEE ACCESS, v.8, pp 84444 - 84454
- Pages
- 11
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE ACCESS
- Volume
- 8
- Start Page
- 84444
- End Page
- 84454
- URI
- https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/1883
- DOI
- 10.1109/ACCESS.2020.2992062
- ISSN
- 2169-3536
2169-3536
- Abstract
- The energy management strategy of a hybrid electric vehicle directly determines the fuel economy of the vehicle. As a supervisory control strategy to divide the required power into its multiple power sources, engines and batteries, many studies have been conducting using rule-based and optimization-based approaches for energy management strategy so far. Recently, studies using various machine learning techniques have been conducted. In this paper, a novel control framework implementing Model-based Q-learning is developed for the optimal control problem of hybrid electric vehicles. As an online energy management strategy, a new approach could learn the characteristics of a current given driving environment and adaptively change the control policy through learning. Especially, for the proposed algorithm, the internal powertrain environment and external driving environment are separated so they can be learned via the reinforcement learning framework, which results in a simpler and more intuitive control strategy that can be explained using the vehicle state approximation model. The proposed algorithm is tested and verified through simulations, and the simulation results present near optimal solution. The simulation results are compared with conventional rule-based strategies and optimal control solutions acquired from Dynamic Programming.
- Files in This Item
-
- Appears in
Collections - COLLEGE OF ENGINEERING SCIENCES > DEPARTMENT OF MECHANICAL ENGINEERING > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/erica/handle/2021.sw.erica/1883)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.