Systematic hyperparameter selection in Machine Learning-based engine control to minimize calibration effort

For automotive powertrain control systems, the calibration effort is exploding due to growing system complexity and increasingly strict legal requirements for greenhouse gas and real-world pollutant emissions. These powertrain systems are characterized by their highly dynamic operation, so transient performance is key. Currently applied control methods require tuning of an increasing number of look-up tables and of parameters in the applied models. Especially for transient control this state-of-the-art calibration process is unsystematic and requires a large development effort. Also, embedding models in a controller can set challenging requirements to production control hardware. In this work, we assess the potential of Machine Learning to dramatically reduce the calibration effort in transient air path control development. This is not only done for the existing benchmark controller, but also for a new preview controller. In order to efficiently realize preview, a strategy is proposed where the existing reference signal is shifted in time. These reference signals are then modeled as a function of engine torque demand using a Long Short-Term Memory (LSTM) neural network, which can capture the dynamic input–output relationship. A multi-objective optimization problem is defined to systematically select hyperparameters that optimize the trade-off between model accuracy, system performance, calibration effort and computational requirements. This problem is solved using an exhaustive search approach. The control system performance is validated over a transient driving cycle. For the LSTM-based controllers, the proposed calibration approach achieves a significant reduction of 71% in the control calibration effort compared to the benchmark process. The expert effort and turbocharger experiments used in calibrating transient compensation maps in physics-based feedforward controller are replaced by little simulation time and parametrization effort in ML-based controller, which requires significantly less expert effort and system knowledge compared to benchmark process. The best trade-off between multi-objective cost terms is achieved with one layer and 32 cells LSTM neural network for both non-preview and preview control. For non-preview control, a comparable control system performance is achieved with the LSTM-based controller, while 5% reduction in cumulative NOx emissions and similar fuel consumption is achieved with preview controller

Islanded Wind Energy Management System Based on Neural Networks

Wind power, as the main renewable energy source, is increasingly deployed and connected into electrical networks thanks to the development of wind energy conversion technologies. This dissertation is focusing on research related to wind power system include grid-connected/islanded wind power systems operation and control design, wind power quality, wind power prediction technologies, and its applications in microgrids. The doubly fed induction generator (DFIG) wind turbine is popular in the wind industry and thus has been researched in this Dissertation. In order to investigate reasons of harmonic generation in wind power systems, a DFIG wind turbine is modeled by using general vector representation of voltage, current and magnetic flux in the presence of harmonics. In this Dissertation, a method of short term wind power prediction for a wind power plant is developed by training neural networks in Matlab software based on historical data of wind speed and wind direction. The model proposed is shown to achieve a high accuracy with respect to the measured data. Based on the above research work, a microgrid with high wind energy penetration has been designed and simulated by using Matlab/Simulink. Besides wind energy, this microgrid system is operated with assistance of a diesel generator. A three-layer energy management system (EMS) is designed and applied in this microgrid system, which is to realize microgrid islanded operation under different wind conditions. Simulation results show that the EMS can ensure stable operation of the microgrid under varying wind speed situations

FPGA design methodology for industrial control systems—a review

This paper reviews the state of the art of fieldprogrammable gate array (FPGA) design methodologies with a focus on industrial control system applications. This paper starts with an overview of FPGA technology development, followed by a presentation of design methodologies, development tools and relevant CAD environments, including the use of portable hardware description languages and system level programming/design tools. They enable a holistic functional approach with the major advantage of setting up a unique modeling and evaluation environment for complete industrial electronics systems. Three main design rules are then presented. These are algorithm refinement, modularity, and systematic search for the best compromise between the control performance and the architectural constraints. An overview of contributions and limits of FPGAs is also given, followed by a short survey of FPGA-based intelligent controllers for modern industrial systems. Finally, two complete and timely case studies are presented to illustrate the benefits of an FPGA implementation when using the proposed system modeling and design methodology. These consist of the direct torque control for induction motor drives and the control of a diesel-driven synchronous stand-alone generator with the help of fuzzy logic

Hamiltonian modeling and structure modified control of diesel engine

YesA diesel engine is a typical dynamic system. In this paper, a dynamics method is proposed to establish the Hamiltonian model of the diesel engine, which solves the main difficulty of con-structing a Hamiltonian function under the multi-field coupling condition. Furthermore, the control method of Hamiltonian model structure modification is introduced to study the control of a diesel engine. By means of the principle of energy-shaping and Hamiltonian model structure modification theories, the modified energy function is constructed, which is proved to be a quasi-Lyapunov function of the closed-loop system. Finally, the control laws are derived, and the simulations are carried out. The study reveals the dynamic mechanism of diesel engine operation and control and provides a new way to research the modeling and control of a diesel engine system.This research was funded by the National Natural Science Foundation of China, grant number 51869007

The application of black box models to combustion processes in the internal combustion engine

The internal combustion engine has been under considerable pressure during the last few years. The publics growing sensitivity for emissions and resource wastage have led to increasingly stringent legislation. Engine manufacturers need to invest significant monetary funds and engineering resources in order to meet the designated regulations. In recent years, reductions in emissions and fuel consumption could be achieved with advanced engine technologies such as exhaust gas recirculation (EGR), variable geometry turbines (VGT), variable valve trains (VVT), variable compression ratios (VCR) or extended aftertreatment systems such as diesel particulate filters (DPF) or NOx traps or selective catalytic reduction (SCR) implementations. These approaches are characterised by a highly non-linear behaviour with an increasing demand for close-loop control. In consequence, successful controller design becomes an important part of meeting legislation requirements and acceptable standards. At the same time, the close-loop control requires additional monitoring information and, especially in the field of combustion control, this is a challenging task. Existing sensors in heavy-duty diesel applications for incylinder pressure detection enable the feedback of combustion conditions. However, high maintenance costs and reliability issues currently cancel this method out for mass-production vehicles. Methods of in-cylinder condition reconstruction for real-time applications have been presented over the last few decades. The methodical restrictions of these approaches are proving problematic. Hence, this work presents a method utilising artificial neural networks for the prediction of combustion-related engine parameters. The application of networks for the prediction of parameters such as emission formations of NOx and Particulate Matters will be shown initially. This thesis shows the importance of correct training and validation data choice together with a comprehensive network input set. In addition, an application of an efficient and accurate plant model as a support tool for an engine fuel-path controller is presented together with an efficient test data generation method. From these findings, an artificial neural network structure is developed for the prediction of in-cylinder combustion conditions. In-cylinder pressure and temperature provide valuable information about the combustion efficiency and quality. This work presents a structure that can predict these parameters from other more simple measurable variables within the engine auxiliaries. The structure is tested on data generated from a GT-Power simulation model and with a Caterpillar C6.6 heavy-duty diesel engine

Neuro_Dynamic Programming and Reinforcement Learning for Optimal Energy Management of a Series Hydraulic Hybrid Vehicle Considering Engine Transient Emissions.

Sequential decision problems under uncertainty are encountered in various fields such as optimal control and operations research. In this dissertation, Neuro-Dynamic Programming (NDP) and Reinforcement Learning (RL) are applied to address policy optimization problems with multiple objectives and large design state space. Dynamic Programming (DP) is well suited for determining an optimal solution for constrained nonlinear model based systems. However, DP suffers from curse of dimensionality i.e. computational effort grows exponentially with state space. The new algorithms address this problem and enable practical application of DP to a much broader range of problems. The other contribution is to design fast and computationally efficient transient emission models. The power management problem for a hybrid vehicle can be formulated as an infinite time horizon stochastic sequential decision-making problem. In the past, policy optimization has been applied successfully to design optimal supervisory controller for best fuel economy. Static emissions have been considered too but engine research has shown that transient operation can have significant impact on real-world emissions. Modeling transient emissions results in addition of more states. Therefore, the problem with multiple objectives i.e. minimize fuel consumption and transient particulate and NOX emissions, becomes computationally intractable by DP. This research captures the insight with models and brings it into the supervisory controller design. A self-learning supervisory controller is designed based on the principles of NDP and RL. The controller starts “naïve” i.e. with no knowledge to control the onboard power but learns to do so in an optimal manner after interacting with the system. The controller tries to minimize multiple objectives and continues to evolve until a global solution is achieved. Virtual sensors for predicting real-time transient particulate and NOX emissions are developed using neuro-fuzzy modeling technique, which utilizes a divide-and-conquer strategy. The highly nonlinear engine operating space is partitioned into smaller subspaces and a separate local model is trained to for each subspace. Finally, the supervisory controller along with virtual emission sensors is implemented and evaluated using the Engine-In-the-Loop (EIL) setup. EIL is a unique facility to systematically evaluate control methodologies through concurrent running of real engine and a virtual hybrid powertrain.Ph.D.Mechanical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/89829/1/rajit_1.pd

Design optimisation and real-time energy management control of the electrified off-highway vehicle with artificial intelligence

Targeting zeros-emissions in transportation, future vehicles will be more energy-efficient via powertrain electrification. This PhD research aims to optimise an electrified off-highway vehicle to achieve the maximum energy efficiency by exploring new artificial intelligence algorithms. The modelling study of the vehicle system is firstly performed. Offline design optimisation and online optimum energy management control methodologies have been researched. New optimisation methods are proposed and compared with the benchmark methods. Hardware-in-the-Loop testing of the energy management controller has been carried out for validation of the control methods. This research delivers three original contributions: 1) Chaos-enhance accelerated particle swarm optimisation algorithm for offline design optimisation is proposed for the first time. This can achieve 200% higher reputation-index value compared to the particle swarm optimisation method. 2) Online swarm intelligent programming is developed as a new online optimisation method for model-based predictive control of the vehicle energy-flow. This method can save up to 17% energy over the rule-based strategy. 3) Multi-step reinforcement learning is researched for a new concept of ‘model-free’ predictive energy management with the capability of continuously online optimisation in real-world driving. It can further save at least 9% energy

Mathematical Modelling of Diesel Engine Operational Performance Parameters in Transient Modes

This study presents innovative methods for solving practical challenges that occur during the operation of heavy diesel engines (DEs). The novelty of the method arises from the combined use of an artificial neural network, a single-zone DE combustion mathematical model, and data from real operation conditions. Using the proposed method, DE transient mode energy efficiency has been analysed, and the primary influencing factors have been identified: qcycl and dqcycl/dt. The adequacy of the method has been tested for CAT3512B-HD series engines installed on freight locomotives. The difference between the model results and experimental data has been 3–4%. CAT3512B-HD series DE transient operation studies have shown that at the low-load range of qcycl (up to 36% of nominal), the fuel consumption during transient operation increases by 10% compared to steady state operation. Transient operation efficiency is not influenced by the operation rate (dqcycl/dt) in the analysed -0.016 to 0.016 g/s range. Near the nominal power (qcycl increases up to 0.5 g/cycle), it is necessary to limit the dqcycl/dt range to 0.006 g/s to avoid overexploitation of the fuel by more than 100%. The proposed method has been recommended for practical use in optimizing vehicle operation load cycle structure by adapting the engine control to the concrete operation conditions, as well as for overall efficiency improvement

An intelligent engine condition monitoring system

The main focus of the work reported here is in the design of an intelligent condition monitoring system for diesel engines. Mechanical systems in general and diesel engines in particular can develop faults if operated for any length of time. Condition monitoring is a method by which the performance of a diesel engine can be maintained at a high level, ensuring both continuous availability and design-level efficiency. A key element in a condition monitoring program is to acquire sensor information from the engine, and use this information to assess the condition of the engine, with an emphasis on monitoring causes of engine failure or reduced efficiency. A Ford 70PS 4-stroke diesel engine has been instrumented with a range of sensors and interfaced to a PC in order to facilitate computer controlled data acquisition and data storage. Data was analyzed to evaluate the optimum use of sensors to identify faults and to develop an intelligent algorithm for the engine condition monitoring and fault detection, and in particular faults affecting the combustion process in the engine. In order to investigate the fault-symptom relationships, two synthetic faults were introduced to the engine. Fuel and inlet air shortage were selected as the faults for their direct relationship to the combustion process quality. As a subtask the manually operated hydraulic brake was adapted to allow automatic control to improve its performance. Two modes of controlling were designed for the developed automatic control of the hydraulic brake system. A robust mathematical diesel engine model has been developed which can be used to predict the engine parameters related to the combustion process in the diesel engine, was constructed from the basic relationships of the diesel engine using the minimum number of empirical equations. The system equations of a single cylinder engine were initially developed, from which the multi-cylinder diesel engine model was validated against experimental test data. The model was then tuned to improve the predicted engine parameters for better matching with the available engine type. The final four-cylinder diesel engine model was verified and the results show an accurate match with the experimental results. Neural networks and fuzzification were used to develop and validate the intelligent condition monitoring and fault diagnosis algorithm, in order to satisfy the requirements of on-line operation, i. e. reliability, easily trained, minimum hardware and software requirements. The development process used a number of different neural network architecture and training techniques. To increase the number of the parameters used for the engine condition evaluation, the Multi-Net technique was used to satisfy accurate and fast decision making. Two neural networks are designed to operate in parallel to accommodate the different sampling rate of the key parameters without interference and with reduced data processing time. The two neural networks were trained and validated using part of the measured data set that represents the engine operating range. Another set of data, not utilized within the training stage, has been applied for validation. The results of validation process indicate the successful prediction of the faults using the key measured parameters, as well as a fast data processing algorithm. One of the main outcomes of this study is the development of a new technique to measure cylinder pressure and fuel pressure through the measurement of the strain in the injector body. The main advantage of this technique is that, it does not require any intrusive modification to the engine which might affect the engine actual performance. The developed sensor was tested and used to measure the cylinder and fuel pressure to verify the fuel fault effect on the combustion process quality. Due to high sampling rate required, the developed condition monitoring and fault diagnosis algorithm does not utilize this signal to reduce the required computational resources for practical applications.EThOS - Electronic Theses Online ServiceEgyptian GovernmentGBUnited Kingdo

Data driven techniques for on-board performance estimation and prediction in vehicular applications.

L'abstract è presente nell'allegato / the abstract is in the attachmen