A real-time energy management strategy for off-road hybrid electric vehicles based on the expected SARSA

To improve the power performance and fuel economy and reduce the online computation time of hybrid electric vehicles (HEVs) in off-road driving environments, a real-time energy management strategy based on the expected state-action-reward-state’-action’ (SARSA) algorithm is proposed. This strategy a...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the Institution of Mechanical Engineers. Part D, Journal of automobile engineering Journal of automobile engineering, 2023-02, Vol.237 (2-3), p.362-380
Main Authors: Bo, Lin, Han, Lijin, Xiang, Changle, Liu, Hui, Ma, Tian
Format: Article
Language:English
Subjects:
Algorithms
Benchmarks
Control theory
Dynamic programming
Electric power demand
Electric vehicles
Energy distribution
Energy efficiency
Energy management
Fuel consumption
Fuel economy
Hybrid electric vehicles
Machine learning
Optimal control
Real time
Transition probabilities
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:To improve the power performance and fuel economy and reduce the online computation time of hybrid electric vehicles (HEVs) in off-road driving environments, a real-time energy management strategy based on the expected state-action-reward-state’-action’ (SARSA) algorithm is proposed. This strategy achieves the control effect through coordinated control of the engine generator set (EGS) and the energy distribution between the battery and the EGS. The driving environment is expressed as a transition probability matrix (TPM) of the electric power demand, and the optimal control problem of energy management is solved offline by the expected SARSA algorithm to obtain the control laws. Then, the Kullback-Leibler (KL) divergence rate is used as the evaluation index of the switching control strategy, and these control laws are used online to realize real-time control. Control strategies based on traditional reinforcement learning (RL), stochastic dynamic programming (SDP), and dynamic programming (DP) are considered benchmark strategies to verify the effectiveness of the proposed energy management strategy based on the expected SARSA. The fuel economy is improved by a maximum of 13.2%, and the elapsed time is reduced by more than 99.8% compared with the values achieved with the benchmark algorithms. These results show that the proposed strategy has flexible adaptability to complex and changeable off-road conditions without prior knowledge of the whole driving cycle.
ISSN:0954-4070
2041-2991
DOI:10.1177/09544070221079173