Adaptive Online Sequential ELM for Concept Drift Tackling

A machine learning method needs to adapt to over time changes in the environment. Such changes are known as concept drift. In this paper, we propose concept drift tackling method as an enhancement of Online Sequential Extreme Learning Machine (OS-ELM) and Constructive Enhancement OS-ELM (CEOS-ELM) by adding adaptive capability for classification and regression problem. The scheme is named as adaptive OS-ELM (AOS-ELM). It is a single classifier scheme that works well to handle real drift, virtual drift, and hybrid drift. The AOS-ELM also works well for sudden drift and recurrent context change type. The scheme is a simple unified method implemented in simple lines of code. We evaluated AOS-ELM on regression and classification problem by using concept drift public data set (SEA and STAGGER) and other public data sets such as MNIST, USPS, and IDS. Experiments show that our method gives higher kappa value compared to the multiclassifier ELM ensemble. Even though AOS-ELM in practice does not need hidden nodes increase, we address some issues related to the increasing of the hidden nodes such as error condition and rank values. We propose taking the rank of the pseudoinverse matrix as an indicator parameter to detect underfitting condition.Comment: Hindawi Publishing. Computational Intelligence and Neuroscience Volume 2016 (2016), Article ID 8091267, 17 pages Received 29 January 2016, Accepted 17 May 2016. Special Issue on "Advances in Neural Networks and Hybrid-Metaheuristics: Theory, Algorithms, and Novel Engineering Applications". Academic Editor: Stefan Hauf

Efficient Neural Network Implementations on Parallel Embedded Platforms Applied to Real-Time Torque-Vectoring Optimization Using Predictions for Multi-Motor Electric Vehicles

The combination of machine learning and heterogeneous embedded platforms enables new potential for developing sophisticated control concepts which are applicable to the field of vehicle dynamics and ADAS. This interdisciplinary work provides enabler solutions -ultimately implementing fast predictions using neural networks (NNs) on field programmable gate arrays (FPGAs) and graphical processing units (GPUs)- while applying them to a challenging application: Torque Vectoring on a multi-electric-motor vehicle for enhanced vehicle dynamics. The foundation motivating this work is provided by discussing multiple domains of the technological context as well as the constraints related to the automotive field, which contrast with the attractiveness of exploiting the capabilities of new embedded platforms to apply advanced control algorithms for complex control problems. In this particular case we target enhanced vehicle dynamics on a multi-motor electric vehicle benefiting from the greater degrees of freedom and controllability offered by such powertrains. Considering the constraints of the application and the implications of the selected multivariable optimization challenge, we propose a NN to provide batch predictions for real-time optimization. This leads to the major contribution of this work: efficient NN implementations on two intrinsically parallel embedded platforms, a GPU and a FPGA, following an analysis of theoretical and practical implications of their different operating paradigms, in order to efficiently harness their computing potential while gaining insight into their peculiarities. The achieved results exceed the expectations and additionally provide a representative illustration of the strengths and weaknesses of each kind of platform. Consequently, having shown the applicability of the proposed solutions, this work contributes valuable enablers also for further developments following similar fundamental principles.Some of the results presented in this work are related to activities within the 3Ccar project, which has received funding from ECSEL Joint Undertaking under grant agreement No. 662192. This Joint Undertaking received support from the European Union’s Horizon 2020 research and innovation programme and Germany, Austria, Czech Republic, Romania, Belgium, United Kingdom, France, Netherlands, Latvia, Finland, Spain, Italy, Lithuania. This work was also partly supported by the project ENABLES3, which received funding from ECSEL Joint Undertaking under grant agreement No. 692455-2

Viabilidade do aprendizado ativo em máquinas extremas

O aprendizado de máquina requer a indução de modelos preditivos. Frequentemente, há dois problemas relacionados com essa tarefa: o custo de rotulação e o tempo de treinamento. Isso é especialmente verdade na presença massiva de dados e em sistemas interativos ou que requeiram resposta imediata. Parte da solução é o uso de aprendizado ativo, que seleciona exemplos a rotular de acordo com um critério de relevância. O complemento da solução é a adoção de um rápido e robusto algoritmo de aprendizado, como as “máquinas extremas”. Neste artigo, várias estratégias de aprendizado ativo são comparadas experimentalmente em diferentes bases de dados com o intuito de preencher uma notável lacuna nas literaturas de aprendizado ativo e máquinas extremas. Os resultados demonstram a viabilidade da união entre as duas áreas.CAPESCNPqFAPES

New Structural Evolving Algorithms For Fuzzy Systems

Recently, the issue of accuracy and interpretability trade-off has been getting more attention when designing new fuzzy systems. In this thesis, three evolving fuzzy models, namely enhancement of fuzzy term identification (EFTI), structure identification method (SIM) and structural evolving approach (SEA) are proposed to spot the best trade-off between accuracy and interpretability. EFTI, SIM and SEA are designed based on error reducing methods. EFTI is developed to fit with single input single output (SISO) problems (i.e. one dimension), while SIM and SEA are developed to fit with multi input single output (MISO) (medium and high dimension). EFTI begins with a simple fuzzy structure that is composed of two fuzzy terms in the input space. Then EFTI continues evolving by identifying splitting points of the input space that are compatible with the consequent parameters. On the other hand, SIM and SEA start with one fuzzy rule that has no fuzzy term in the input space regardless of the degree level of input dimension. Then they evolve on the basis of either closure or split processes for the selected input attribute of the selected subregion. If the selected attribute has no fuzzy terms, closure is performed, otherwise split is done. The evolving continues until a satisfactory accuracy is fulfilled or maximum number of subregion is reached. A partitioning technique based on the similarity feature and a static partition-selection technique are developed for SIM. While, a partitioning technique based on splitting the selected subregion into two subregions with maximum and minimum average error and a dynamic partition-selection technique are developed for SEA. Furthermore, a pruning technique based on the importance level of the fuzzy rules is proposed to shrink the rule-base of SEA. Compared with SISO models and using three datasets, EFTI produces the lowest RMSE with lowest number of rules. For MISO models and using nine benchmark datasets, SIM achieves the lowest RMSE with the smallest size of rule-base systems. Similarly, for MISO state-of-the-art models and using six benchmark datasets, SEA also produces the lowest RMSE with the smallest size of rule-base systems. In conclusion, the results proved that EFTI, SIM and SEA are able to produce a significant trade-off between accuracy and interpretabilit

Resilience Enhancement Strategies for Modern Power Systems

The frequency of extreme events (e.g., hurricanes, earthquakes, and floods) and man-made attacks (cyber and physical attacks) has increased dramatically in recent years. These events have severely impacted power systems ranging from long outage times to major equipment (e.g., substations, transmission lines, and power plants) destructions. Also, the massive integration of information and communication technology to power systems has evolved the power systems into what is known as cyber-physical power systems (CPPSs). Although advanced technologies in the cyber layer improve the operation and control of power systems, they introduce additional vulnerabilities to power system performance. This has motivated studying power system resilience evaluation and enhancements methods. Power system resilience can be defined as ``The ability of a system to prepare for, absorb, adapt to, and recover from disruptive events''. Assessing resilience enhancement strategies requires further and deeper investigation because of several reasons. First, enhancing the operational and planning resilience is a mathematically involved problem accompanied with many challenges related to modeling and computation methods. The complexities of the problem increases in CPPSs due to the large number and diverse behavior of system components. Second, a few studies have given attention to the stochastic behavior of extreme events and their accompanied impacts on the system resilience level yielding less realistic modeling and higher resilience level. Also, the correlation between both cyber and physical layers within the context of resilience enhancement require leveraging sophisticated modeling approaches which is still under investigation. Besides, the role of distributed energy resources in planning-based and operational-based resilience enhancements require further investigation. This calls for developing enhancement strategies to improve resilience of power grids against extreme events. This dissertation is divided into four parts as follows. Part I: Proactive strategies: utilizing the available system assets to prepare the power system prior to the occurrence of an extreme event to maintain an acceptable resilience level during a severe event. Various system generation and transmission constraints as well as the spatiotemporal behavior of extreme events should be properly modeled for a feasible proactive enhancement plan. In this part, two proactive strategies are proposed against weather-related extreme events and cyber-induced failure events. First, a generation redispatch strategy is formulated to reduce the amount of load curtailments in transmission systems against hurricanes and wildfires. Also, a defensive islanding strategy is studied to isolate vulnerable system components to cyber failures in distribution systems. Part II: Corrective strategies: remedial actions during an extreme event for improved performance. The negative impacts of extreme weather events can be mitigated, reduced, or even eliminated through corrective strategies. However, the high stochastic nature of resilience-based problem induces further complexities in modeling and providing feasible solutions. In this part, reinforcement learning approaches are leveraged to develop a control-based environment for improved resilience. Three corrective strategies are studied including distribution network reconfiguration, allocating and sizing of distributed energy resources, and dispatching reactive shunt compensators. Part III: Restorative strategies: retain the power service to curtailed loads in a fast and efficient means after a diverse event. In this part, a resilience enhancement strategy is formulated based on dispatching distributed generators for minimal load curtailments and improved restorative behavior. Part IV: Uncertainty quantification: Impacts of uncertainties on modeling and solution accuracy. Though there exist several sources of stochasticity in power systems, this part focuses on random behavior of extreme weather events and the associated impacts on system component failures. First, an assessment framework is studied to evaluate the impacts of ice storms on transmission systems and an evaluation method is developed to quantify the hurricane uncertainties for improved resilience. Additionally, the role of unavailable renewable energy resources on improved system resilience during extreme hurricane events is studied. The methodologies and results provided in this dissertation can be useful for system operators, utilities, and regulators towards enhancing resilience of CPPSs against weather-related and cyber-related extreme events. The work presented in this dissertation also provides potential pathways to leverage existing system assets and resources integrated with recent advanced computational technologies to achieve resilient CPPSs