Reinforcement learning-based control design for load frequency control

Energy balance in electric power systems is continuously disrupted by constant demand changes due to customers\u27 switching in and out, or loss of generating units. Load frequency control (LFC) is very essential for interconnected power systems in order to maintain the energy balance which is assessed through the Area Control Error, a signal that is made up of deviations from their nominal values of the system frequency and power area interchanges. Each balancing authority is responsible for its own energy balance in accordance with North American Electric Reliability Corporation (NERC) standards.;This thesis presents a novel approach to the LFC problem. An adaptive intelligent controller, or agent, changes the gains of a proportional-integral (PI) controller based on the operating conditions. The intelligence and decision making is provided by means of a reinforcement learning (RL) algorithms. This approach keeps the simple design of the PI controllers and in the mean time makes them more adaptive and applicable to different disturbances. Moreover, the developed controller can be applied to different systems with various parameters with almost no change in the controller design due to their ability to learn proper settings through interaction with the environment.;Each control authority should comply with NERC control performance standards CPS1 and CPS2. In order to comply with these standards and decrease the control cost, tight control should be prevented. The second approach in this thesis is to design a reinforcement learning based controller that tunes the gains of the PI controller in a way to achieve this goal. Simulations are performed in MATLAB/Simulink to demonstrate performance of all the proposed controllers

A comparative study of the effectiveness of vibration and acoustic emission in diagnosing a defective bearing in a planetry gearbox

Whilst vibration analysis of planetary gearbox faults is relatively well established, the application of Acoustic Emission (AE) to this field is still in its infancy. For planetary-type gearboxes it is more challenging to diagnose bearing faults due to the dynamically changing transmission paths which contribute to masking the vibration signature of interest. The present study is aimed to reduce the effect of background noise whilst extracting the fault feature from AE and vibration signatures. This has been achieved through developing of internal AE sensor for helicopter transmission system. In addition, series of signal processing procedure has been developed to improved detection of incipient damage. Three signal processing techniques including an adaptive filter, spectral kurtosis and envelope analysis, were applied to AE and vibration data acquired from a simplified planetary gearbox test rig with a seeded bearing defect. The results show that AE identified the defect earlier than vibration analysis irrespective of the tortuous transmission pat

Deep convolutional neural network with 2D spectral energy maps for fault diagnosis of gearboxes under variable speed.

For industrial safety, correct classification of gearbox fault conditions is necessary. One of the most crucial tasks in data-driven fault diagnosis is determining the best set of features by analyzing the statistical parameters of the signals. However, under variable speed conditions, these statistical parameters are incapable of uncovering the dynamic characteristics of different fault conditions of gearboxes. Later, several deep learning algorithms are used to improve the performance of the feature selection process, but domain knowledge expertise is still necessary. In this paper, a combination domain knowledge analysis and a deep neural network is proposed. By using the input acoustic emission (AE) signal, a two-dimensional spectrum energy map (2D AE-SEM) is created to form an identical fault pattern for various speed conditions of gearboxes. Then, a deep convolutional neural network (DCNN) is proposed to investigate the detailed structure of the 2D input for final fault classification. This 2D AE-SEM offers a graphical depiction of acoustic emission spectral characteristics. Our proposed system offers vigorous and dynamic classification performance through the proposed DCNN with a high diagnostic fault classification accuracy of 96.37% in all considered scenarios

Planetary bearing defect detection in a commercial helicopter main gearbox with vibration and acoustic emission

The file attached to this record is the author's final peer reviewed version. The Publisher's final version can be found by following the DOI link.Helicopter gearboxes significantly differ from other transmission types and exhibit unique behaviors that reduce the effectiveness of traditional fault diagnostics methods. In addition, due to lack of redundancy, helicopter transmission failure can lead to catastrophic accidents. Bearing faults in helicopter gearboxes are difficult to discriminate due to the low signal to noise ratio (SNR) in the presence of gear vibration. In addition, the vibration response from the planet gear bearings must be transmitted via a time-varying path through the ring gear to externally mounted accelerometers, which cause yet further bearing vibration signal suppression. This research programme has resulted in the successful proof of concept of a broadband wireless transmission sensor that incorporates power scavenging whilst operating within a helicopter gearbox. In addition, this paper investigates the application of signal separation techniques in detection of bearing faults within the epicyclic module of a large helicopter (CS-29) main gearbox using vibration and Acoustic Emissions (AE). It compares their effectiveness for various operating conditions. Three signal processing techniques including an adaptive filter, spectral kurtosis and envelope analysis, were combined for this investigation. In addition, this research discusses the feasibility of using AE for helicopter gearbox monitoring

Detection of sub-surface damage in wind turbine bearings using acoustic emissions and probabilistic modelling

Bearings are the culprit of a large quantity of Wind Turbine (WT) gearbox failures and account for a high percentage of the total of global WT downtime. Damage within rolling element bearings have been shown to initiate beneath the surface which defies detection by conventional vibration monitoring as the geometry of the rolling surface is unaltered. However, once bearing damage reaches the surface, it generates spalling and quickly drives the deterioration of the entire gearbox through the introduction of debris into the oil system. There is a pressing need for performing damage detection before damage reaches the bearing surface. This paper presents a methodology for detecting sub-surface damage using Acoustic Emission (AE) measurements. AE measurements are well known for their sensitivity to incipient damage. However, the background noise and operational variations within a bearing necessitate the use of a principled statistical procedure for damage detection. This is addressed here through the use of probabilistic modelling, more specifically Gaussian mixture models. The methodology is validated using a full-scale rig of a WT bearing. The bearings are seeded with sub-surface and early-stage surface defects in order to provide a comparison of the detectability at each level of a fault progression

Seeded fault detection on helical gears with acoustic emission

Acoustic emission (AE) is one of many technologies for health monitoring and diagnosis of rotating machines such as gearboxes. Although significant research has been undertaken in understanding the potential of AE in monitoring gearboxes this has been solely applied to spur gears. This report presents an experimental investigation that assesses the effectiveness of AE in identifying seeded defects on helical gears; the first known attempt. Additionally vibration analysis has performed to Study the effect of seeded defect on the vibration signature of the meshing gears