8,890 research outputs found
Human-like Energy Management Based on Deep Reinforcement Learning and Historical Driving Experiences
Development of hybrid electric vehicles depends on an advanced and efficient
energy management strategy (EMS). With online and real-time requirements in
mind, this article presents a human-like energy management framework for hybrid
electric vehicles according to deep reinforcement learning methods and
collected historical driving data. The hybrid powertrain studied has a
series-parallel topology, and its control-oriented modeling is founded first.
Then, the distinctive deep reinforcement learning (DRL) algorithm, named deep
deterministic policy gradient (DDPG), is introduced. To enhance the derived
power split controls in the DRL framework, the global optimal control
trajectories obtained from dynamic programming (DP) are regarded as expert
knowledge to train the DDPG model. This operation guarantees the optimality of
the proposed control architecture. Moreover, the collected historical driving
data based on experienced drivers are employed to replace the DP-based
controls, and thus construct the human-like EMSs. Finally, different categories
of experiments are executed to estimate the optimality and adaptability of the
proposed human-like EMS. Improvements in fuel economy and convergence rate
indicate the effectiveness of the constructed control structure.Comment: 8 pages, 10 figure
On-Line Building Energy Optimization Using Deep Reinforcement Learning
Unprecedented high volumes of data are becoming available with the growth of the advanced metering infrastructure. These are expected to benefit planning and operation of the future power systems and to help customers transition from a passive to an active role. In this paper, we explore for the first time in the smart grid context the benefits of using deep reinforcement learning, a hybrid type of methods that combines reinforcement learning with deep learning, to perform on-line optimization of schedules for building energy management systems. The learning procedure was explored using two methods, Deep Q-learning and deep policy gradient, both of which have been extended to perform multiple actions simultaneously. The proposed approach was validated on the large-scale Pecan Street Inc. database. This highly dimensional database includes information about photovoltaic power generation, electric vehicles and buildings appliances. Moreover, these on-line energy scheduling strategies could be used to provide realtime feedback to consumers to encourage more efficient use of electricity
Recommended from our members
Reinforcement Learning for Hybrid and Plug-In Hybrid Electric Vehicle Energy Management: Recent Advances and Prospects
Progress and summary of reinforcement learning on energy management of MPS-EV
The high emission and low energy efficiency caused by internal combustion
engines (ICE) have become unacceptable under environmental regulations and the
energy crisis. As a promising alternative solution, multi-power source electric
vehicles (MPS-EVs) introduce different clean energy systems to improve
powertrain efficiency. The energy management strategy (EMS) is a critical
technology for MPS-EVs to maximize efficiency, fuel economy, and range.
Reinforcement learning (RL) has become an effective methodology for the
development of EMS. RL has received continuous attention and research, but
there is still a lack of systematic analysis of the design elements of RL-based
EMS. To this end, this paper presents an in-depth analysis of the current
research on RL-based EMS (RL-EMS) and summarizes the design elements of
RL-based EMS. This paper first summarizes the previous applications of RL in
EMS from five aspects: algorithm, perception scheme, decision scheme, reward
function, and innovative training method. The contribution of advanced
algorithms to the training effect is shown, the perception and control schemes
in the literature are analyzed in detail, different reward function settings
are classified, and innovative training methods with their roles are
elaborated. Finally, by comparing the development routes of RL and RL-EMS, this
paper identifies the gap between advanced RL solutions and existing RL-EMS.
Finally, this paper suggests potential development directions for implementing
advanced artificial intelligence (AI) solutions in EMS
- …