Predictive Energy Management in Connected Vehicles: Utilizing Route Information Preview for Energy Saving

This dissertation formulates algorithms that use preview information of road terrain and traffic flow for reducing energy use and emissions of modern vehicles with conventional or hybrid powertrains. Energy crisis, long term energy deficit, and more restrictive environmental protection policies require developing more efficient and cleaner vehicle powertrain systems. An alternative to making advanced technology engines or electrifying the vehicle powertrain is utilizing ambient terrain and traffic information in the energy management of vehicles, a topic which has not been emphasized in the past. Today\u27s advances in vehicular telematics and advances in GIS (Geographic Information System), GPS (Global Positioning Systems), ITS (Intelligent Transportation Systems), V2V (Vehicle to Vehicle) communication, and VII (Vehicle Infrastructure Integration ) create more opportunities for predicting a vehicle\u27s trip information with details such as the future road grade, the distance to the destination, speed constraints imposed by the traffic flow, which all can be utilized for better vehicle energy management. Optimal or near optimal decision-making based on this available information requires optimal control methods, whose fundamental theories were well studied in the past but are not directly applicable due to the complexity of real problems and uncertainty in the available preview information. This dissertation proposes the use of optimal control theories and tools including Pontryagin minimum principle, Dynamic Programming (DP) which is a numerical realization of Bellman\u27s principle of optimality, and Model Predictive Control (MPC) in the optimization-based control of hybrid electric vehicles (HEVs), plug-in hybrid electric vehicles (PHEVs), and conventional vehicles based on preview of future route information. The dissertation includes three parts introduced as follows: First, the energy saving benefit in HEV energy management by previewing future terrain information and applying optimal control methods is explored. The potential gain in fuel economy is evaluated, if road grade information is integrated in energy management of hybrid vehicles. Real-world road geometry information is taken into account in power management decisions by using both Dynamic Programming (DP) and a standard Equivalent Consumption Minimization Strategy (ECMS), derived using Pontryagin minimum principle. Secondly, the contribution of different levels of preview to energy management of plug-in hybrid vehicles (PHEVs) is studied. The gains to fuel economy of plug-in hybrid vehicles with availability of velocity and terrain preview and knowledge of distance to the next charging station are investigated. Access to future driving information is classified into full, partial, or no future information and energy management strategies for real-time implementation with partial future preview are proposed. ECMS as well as Dynamic Programming (DP) is systematically utilized to handle the resulting optimal control problems with different levels of preview. We also study the benefit of future traffic flow information preview in improving the fuel economy of conventional vehicles by predictive control methods. According to the time-scale of the preview information and its importance to the driver, the energy optimization problem is decomposed into different levels. In the microscopic level, a model predictive controller as well as a car following model is employed for predictive adaptive cruise control by stochastically forecasting the driving behavior of the lead car. In the macroscopic level, we propose to incorporate the estimated macroscopic future traffic flow information and optimize the cost-to-go by utilizing a two-dimension Dynamic Programming (2D-DP). The algorithm yields the optimal trip velocity as the reference velocity for the driver or a low level controller to follow. Through the study, we show that energy use and emissions can be reduced considerably by using preview route information. The methodologies discussed in this dissertation provide an alternative mean for the automotive industry to develop more efficient and environmentally friendly vehicles by relying mostly on software and information and with minimal hardware investments

Development of predictive energy management strategies for hybrid electric vehicles

2017 Fall.Includes bibliographical references.Studies have shown that obtaining and utilizing information about the future state of vehicles can improve vehicle fuel economy (FE). However, there has been a lack of research into the impact of real-world prediction error on FE improvements, and whether near-term technologies can be utilized to improve FE. This study seeks to research the effect of prediction error on FE. First, a speed prediction method is developed, and trained with real-world driving data gathered only from the subject vehicle (a local data collection method). This speed prediction method informs a predictive powertrain controller to determine the optimal engine operation for various prediction durations. The optimal engine operation is input into a high-fidelity model of the FE of a Toyota Prius. A tradeoff analysis between prediction duration and prediction fidelity was completed to determine what duration of prediction resulted in the largest FE improvement. Results demonstrate that 60-90 second predictions resulted in the highest FE improvement over the baseline, achieving up to a 4.8% FE increase. A second speed prediction method utilizing simulated vehicle-to-vehicle (V2V) communication was developed to understand if incorporating near-term technologies could be utilized to further improve prediction fidelity. This prediction method produced lower variation in speed prediction error, and was able to realize a larger FE improvement over the local prediction method for longer prediction durations, achieving up to 6% FE improvement. This study concludes that speed prediction and prediction-informed optimal vehicle energy management can produce FE improvements with real-world prediction error and drive cycle variability, as up to 85% of the FE benefit of perfect speed prediction was achieved with the proposed prediction methods

Stochastic model predictive control for energy management of power-split plug-in hybrid electric vehicles based on reinforcement learning

In this paper, a stochastic model predictive control (MPC) method based on reinforcement learning is proposed for energy management of plug-in hybrid electric vehicles (PHEVs). Firstly, the power transfer of each component in a power-split PHEV is described in detail. Then an effective and convergent reinforcement learning controller is trained by the Q-learning algorithm according to the driving power distribution under multiple driving cycles. By constructing a multi-step Markov velocity prediction model, the reinforcement learning controller is embedded into the stochastic MPC controller to determine the optimal battery power in predicted time domain. Numerical simulation results verify that the proposed method achieves superior fuel economy that is close to that by stochastic dynamic programming method. In addition, the effective state of charge tracking in terms of different reference trajectories highlight that the proposed method is effective for online application requiring a fast calculation speed

Hybrid and Electric Vehicles Optimal Design and Real-time Control based on Artificial Intelligence

L'abstract è presente nell'allegato / the abstract is in the attachmen

Modelling and control of hybrid electric vehicles (a comprehensive review)

The gradual decline in global oil reserves and presence of ever so stringent emissions rules around the world, have created an urgent need for the production of automobiles with improved fuel economy. HEVs (hybrid electric vehicles) have proved a viable option to guarantying improved fuel economy and reduced emissions.The fuel consumption benefits which can be realised when utilising HEV architecture are dependent on how much braking energy is regenerated, and how well the regenerated energy is utilized. The challenge in developing an HEV control strategy lies in the satisfaction of often conflicting control constraints involving fuel consumption, emissions and driveability without over-depleting the battery state of charge at the end of the defined driving cycle.To this effect, a number of power management strategies have been proposed in literature. This paper presents a comprehensive review of these literatures, focusing primarily on contributions in the aspect of parallel hybrid electric vehicle modelling and control. As part of this treatise, exploitable research gaps are also identified. This paper prides itself as a comprehensive reference for researchers in the field of hybrid electric vehicle development, control and optimization

Analyzing the Improvements of Energy Management Systems for Hybrid Electric Vehicles Using a Systematic Literature Review: How Far Are These Controls from Rule-Based Controls Used in Commercial Vehicles?

Featured Application This work is useful for researchers interested in the study of energy management systems for hybrid electric vehicles. In addition, it is interesting for institutions related to the market of this type of vehicle. The hybridization of vehicles is a viable step toward overcoming the challenge of the reduction of emissions related to road transport all over the world. To take advantage of the emission reduction potential of hybrid electric vehicles (HEVs), the appropriate design of their energy management systems (EMSs) to control the power flow between the engine and the battery is essential. This work presents a systematic literature review (SLR) of the more recent works that developed EMSs for HEVs. The review is carried out subject to the following idea: although the development of novel EMSs that seek the optimum performance of HEVs is booming, in the real world, HEVs continue to rely on well-known rule-based (RB) strategies. The contribution of this work is to present a quantitative comparison of the works selected. Since several studies do not provide results of their models against commercial RB strategies, it is proposed, as another contribution, to complete their results using simulations. From these results, it is concluded that the improvement of the analyzed EMSs ranges roughly between 5% and 10% with regard to commercial RB EMSs; in comparison to the optimum, the analyzed EMSs are nearer to the optimum than commercial RB EMSs

Control of a hybrid electric vehicle with predictive journey estimation

Battery energy management plays a crucial role in fuel economy improvement of charge-sustaining parallel hybrid electric vehicles. Currently available control strategies consider battery state of charge (SOC) and driver’s request through the pedal input in decision-making. This method does not achieve an optimal performance for saving fuel or maintaining appropriate SOC level, especially during the operation in extreme driving conditions or hilly terrain. The objective of this thesis is to develop a control algorithm using forthcoming traffic condition and road elevation, which could be fed from navigation systems. This would enable the controller to predict potential of regenerative charging to capture cost-free energy and intentionally depleting battery energy to assist an engine at high power demand. The starting point for this research is the modelling of a small sport-utility vehicle by the analysis of the vehicles currently available in the market. The result of the analysis is used in order to establish a generic mild hybrid powertrain model, which is subsequently examined to compare the performance of controllers. A baseline is established with a conventional powertrain equipped with a spark ignition direct injection engine and a continuously variable transmission. Hybridisation of this vehicle with an integrated starter alternator and a traditional rule-based control strategy is presented. Parameter optimisation in four standard driving cycles is explained, followed by a detailed energy flow analysis. An additional potential improvement is presented by dynamic programming (DP), which shows a benefit of a predictive control. Based on these results, a predictive control algorithm using fuzzy logic is introduced. The main tools of the controller design are the DP, adaptive-network-based fuzzy inference system with subtractive clustering and design of experiment. Using a quasi-static backward simulation model, the performance of the controller is compared with the result from the instantaneous control and the DP. The focus is fuel saving and SOC control at the end of journeys, especially in aggressive driving conditions and a hilly road. The controller shows a good potential to improve fuel economy and tight SOC control in long journey and hilly terrain. Fuel economy improvement and SOC correction are close to the optimal solution by the DP, especially in long trips on steep road where there is a large gap between the baseline controller and the DP. However, there is little benefit in short trips and flat road. It is caused by the low improvement margin of the mild hybrid powertrain and the limited future journey information. To provide a further step to implementation, a software-in-the-loop simulation model is developed. A fully dynamic model of the powertrain and the control algorithm are implemented in AMESim-Simulink co-simulation environment. This shows small deterioration of the control performance by driver’s pedal action, powertrain dynamics and limited computational precision on the controller performance

Reinforcement learning for power scheduling in a grid-tied pv-battery electric vehicles charging station

Grid-tied renewable energy sources (RES) based electric vehicle (EV) charging stations are an example of a distributed generator behind the meter system (DGBMS) which characterizes most modern power infrastructure. To perform power scheduling in such a DGBMS, stochastic variables such as load profile of the charging station, output profile of the RES and tariff profile of the utility must be considered at every decision step. The stochasticity in this kind of optimization environment makes power scheduling a challenging task that deserves substantial research attention. This dissertation investigates the application of reinforcement learning (RL) techniques in solving the power scheduling problem in a grid-tied PV-powered EV charging station with the incorporation of a battery energy storage system. RL is a reward-motivated optimization technique that was derived from the way animals learn to optimize their behavior in a new environment. Unlike other optimization methods such as numerical and soft computing techniques, RL does not require an accurate model of the optimization environment in order to arrive at an optimal solution. This study developed and evaluated the feasibility of two RL algorithms, namely, an asynchronous Q-learning algorithm and an advantage actor-critic (A2C) algorithm, in performing power scheduling in the EV charging station under static conditions. To assess the performances of the proposed algorithms, the conventional Q-learning and actor-critic algorithm were implemented to compare their global cost convergence and their learning characteristics. First, the power scheduling problem was expressed as a sequential decision-making process. Then an asynchronous Q-learning algorithm was developed to solve it. Further, an advantage actor-critic (A2C) algorithm was developed and was used to solve the power scheduling problem. The two algorithms were tested using a 24-hour load, generation and utility grid tariff profiles under static optimization conditions. The performance of the asynchronous Q-learning algorithm was compared with that of the conventional Q-learning method in terms of the global cost, stability and scalability. Likewise, the A2C was compared with the conventional actor-critic method in terms of stability, scalability and convergence. Simulation results showed that both the developed algorithms (asynchronous Q-learning algorithm and A2C) converged to lower global costs and displayed more stable learning characteristics than their conventional counterparts. This research established that proper restriction of the action-space of a Q-learning algorithm improves its stability and convergence. It was also observed that such a restriction may come with compromise of computational speed and scalability. Of the four algorithms analyzed, the A2C was found to produce a power schedule with the lowest global cost and the best usage of the battery energy storage system

Influence of Architecture Design on the Performance and Fuel Efficiency of Hydraulic Hybrid Transmissions

Hydraulic hybrids are a proven and effective alternative to electric hybrids for increasing the fuel efficiency of on-road vehicles. To further the state-of-the-art this work investigates how architecture design influences the performance, fuel efficiency, and controllability of hydraulic hybrid transmissions. To that end a novel neural network based power management controller was proposed and investigated for conventional hydraulic hybrids. This control scheme trained a neural network to generalize the globally optimal, though non-implementable, state trajectories generated by dynamic programming. Once trained the neural network was used for online prediction of a transmission’s optimal state trajectory during untrained cycles forming the basis of an implementable controller. During hardware-in-the-loop (HIL) testing the proposed control strategy improved fuel efficiency by up to 25.5% when compared with baseline approaches. To further improve performance and fuel efficiency a novel transmission architecture termed a Blended Hydraulic Hybrid was proposed and investigated. This novel architecture improves on existing hydraulic hybrids by partially decoupling power transmission from energy storage while simultaneously providing means to recouple the systems when advantageous. Optimal control studies showed the proposed architecture improved fuel efficiency over both baseline mechanical and conventional hydraulic hybrid transmissions. Effective system level and supervisory control schemes were also proposed for the blended hybrid. In order to investigate the concept’s feasibility a blended hybrid transmission was constructed and successfully tested on a HIL transmission dynamometer. Finally to investigate controllability and driver perception an SUV was retrofitted with a blended hybrid transmission. Successful on-road vehicle testing showcased the potential of this novel hybrid architecture as a viable alternative to more conventional electric hybrids in the transportation sector

Development Schemes of Electric Vehicle Charging Protocols and Implementation of Algorithms for Fast Charging under Dynamic Environments Leading towards Grid-to-Vehicle Integration

This thesis focuses on the development of electric vehicle (EV) charging protocols under a dynamic environment using artificial intelligence (AI), to achieve Vehicle-to-Grid (V2G) integration and promote automobile electrification. The proposed framework comprises three major complementary steps. Firstly, the DC fast charging scheme is developed under different ambient conditions such as temperature and relative humidity. Subsequently, the transient performance of the controller is improved while implementing the proposed DC fast charging scheme. Finally, various novel techno-economic scenarios and case studies are proposed to integrate EVs with the utility grid. The proposed novel scheme is composed of hierarchical stages; In the first stage, an investigation of the temperature or/and relative humidity impact on the charging process is implemented using the constant current-constant voltage (CC-CV) protocol. Where the relative humidity impact on the charging process was not investigated or mentioned in the literature survey. This was followed by the feedforward backpropagation neural network (FFBP-NN) classification algorithm supported by the statistical analysis of an instant charging current sample of only 10 seconds at any ambient condition. Then the FFBP-NN perfectly estimated the EV’s battery terminal voltage, charging current, and charging interval time with an error of 1% at the corresponding temperature and relative humidity. Then, a nonlinear identification model of the lithium-polymer ion battery dynamic behaviour is introduced based on the Hammerstein-Wiener (HW) model with an experimental error of 1.1876%. Compared with the CC-CV fast charging protocol, intelligent novel techniques based on the multistage charging current protocol (MSCC) are proposed using the Cuckoo optimization algorithm (COA). COA is applied to the Hierarchical technique (HT) and the Conditional random technique (CRT). Compared with the CC-CV charging protocol, an improvement in the charging efficiency of 8% and 14.1% was obtained by the HT and the CRT, respectively, in addition to a reduction in energy losses of 7.783% and 10.408% and a reduction in charging interval time of 18.1% and 22.45%, respectively. The stated charging protocols have been implemented throughout a smart charger. The charger comprises a DC-DC buck converter controlled by an artificial neural network predictive controller (NNPC), trained and supported by the long short-term memory neural network (LSTM). The LSTM network model was utilized in the offline forecasting of the PV output power, which was fed to the NNPC as the training data. The NNPC–LSTM controller was compared with the fuzzy logic (FL) and the conventional PID controllers and perfectly ensured that the optimum transient performance with a minimum battery terminal voltage ripple reached 1 mV with a very high-speed response of 1 ms in reaching the predetermined charging current stages. Finally, to alleviate the power demand pressure of the proposed EV charging framework on the utility grid, a novel smart techno-economic operation of an electric vehicle charging station (EVCS) in Egypt controlled by the aggregator is suggested based on a hierarchical model of multiple scenarios. The deterministic charging scheduling of the EVs is the upper stage of the model to balance the generated and consumed power of the station. Mixed-integer linear programming (MILP) is used to solve the first stage, where the EV charging peak demand value is reduced by 3.31% (4.5 kW). The second challenging stage is to maximize the EVCS profit whilst minimizing the EV charging tariff. In this stage, MILP and Markov Decision Process Reinforcement Learning (MDP-RL) resulted in an increase in EVCS revenue by 28.88% and 20.10%, respectively. Furthermore, the grid-to-vehicle (G2V) and vehicle-to-grid (V2G) technologies are applied to the stochastic EV parking across the day, controlled by the aggregator to alleviate the utility grid load demand. The aggregator determined the number of EVs that would participate in the electric power trade and sets the charging/discharging capacity level for each EV. The proposed model minimized the battery degradation cost while maximizing the revenue of the EV owner and minimizing the utility grid load demand based on the genetic algorithm (GA). The implemented procedure reduced the degradation cost by an average of 40.9256%, increased the EV SOC by 27%, and ensured an effective grid stabilization service by shaving the load demand to reach a predetermined grid average power across the day where the grid load demand decreased by 26.5% (371 kW)