Reservoir of Diverse Adaptive Learners and Stacking Fast Hoeffding Drift Detection Methods for Evolving Data Streams

The last decade has seen a surge of interest in adaptive learning algorithms for data stream classification, with applications ranging from predicting ozone level peaks, learning stock market indicators, to detecting computer security violations. In addition, a number of methods have been developed to detect concept drifts in these streams. Consider a scenario where we have a number of classifiers with diverse learning styles and different drift detectors. Intuitively, the current 'best' (classifier, detector) pair is application dependent and may change as a result of the stream evolution. Our research builds on this observation. We introduce the \mbox{Tornado} framework that implements a reservoir of diverse classifiers, together with a variety of drift detection algorithms. In our framework, all (classifier, detector) pairs proceed, in parallel, to construct models against the evolving data streams. At any point in time, we select the pair which currently yields the best performance. We further incorporate two novel stacking-based drift detection methods, namely the \mbox{FHDDMS} and \mbox{FHDDMS}_{add} approaches. The experimental evaluation confirms that the current 'best' (classifier, detector) pair is not only heavily dependent on the characteristics of the stream, but also that this selection evolves as the stream flows. Further, our \mbox{FHDDMS} variants detect concept drifts accurately in a timely fashion while outperforming the state-of-the-art.Comment: 42 pages, and 14 figure

Automatic tuning of Free Electron Lasers

Existing FEL facilities often suffer from stability issues: so electron orbit, transverse electron optics, electron bunch compression and other parameters have to be readjusted often to account for drifts in performance of various components. The tuning procedures typically employed in operation are often manual and lengthy. We have been developing a combination of model-free and model-based automatic tuning methods to meet the needs of present and upcoming XFEL facilities. Our approach has been implemented at FLASH \cite{flash} to achieve automatic SASE tuning using empirical control of orbit, electron optics and bunch compression. In this paper we describe our approach to empirical tuning, the software which implements it, and the results of using it at FLASH. We also discuss the potential of using machine learning and model-based techniques in tuning methods

Multi-objective optimal design of inerter-based vibration absorbers for earthquake protection of multi-storey building structures

In recent years different inerter - based vibration absorbers (IVAs) emerged for the earthquake protection of building structures coupling viscous and tuned - mass dampers with an inerter device . In the three most popular IVAs the inerter is functioning either as a motion amplifier [tuned - viscous - mass - damper (TVMD) configuration], mass amplifier [tuned - mass - damper - inerter (T MDI) configuration], or mass substitute [tuned - inerter - damper (TID) configuration]. Previous work has shown that through proper tuning , IVAs achieve enhanced earthquake - induced vibration suppression and/or weight reduction compared to conventional dampers/absorbers , but at the expense of increased control forces exerted from the IVA to the host building structure . These potentially large forces are typically not accounted for by current IVA tuning approaches. In this regard, a multi-objective IVA design approach is herein developed to identify the compromise between the competing objectives of (i) suppressing earthquake-induced vibrations in buildings, and (ii) avoiding development of excessive IVA (control) forces, while, simultaneously, assessing the appropriateness of different modeling assumptions for practical design of IVAs for earthquake engineering applications . The potential of the approach to pinpoint Pareto optimal IVA designs against the above objectives is illustrated for different IVA placements along the height of a benchmark 9-storey steel frame structure. Objective (i) is quantified according to current performanc e-based seismic design trends using first-passage reliability criteria associated with the probability of exceeding pre-specified thresholds of storey drifts and/or floor accelerations being the engineering demand parameters (EDPs) of interest . A variant, simpler, formulation is also considered using as performance quantification the sum of EDPs variances in accordance to traditional tuning methods for dynamic vibration absorbers. Objective (ii) is quantified through the variance of the IVA force. It is found that reduction of IVA control force of up to 3 times can be achieved with insignificant deterioration of building performance com pared to the extreme Pareto optimal IVA design targeting maximum vibration suppression , while TID and TMDI a chieve practically the same building performance and significantly outperform the TVMD. Moreover, it is shown that the simpler variant formulation may provide significantly suboptimal reliability performance . Lastly, it is verified that the efficacy of optimal IVA designs for stationary conditions is maintained for non-stationary stochastic excitation model capturing typical evolutionary features of earthquake excitations

Incremental Predictive Process Monitoring: How to Deal with the Variability of Real Environments

A characteristic of existing predictive process monitoring techniques is to first construct a predictive model based on past process executions, and then use it to predict the future of new ongoing cases, without the possibility of updating it with new cases when they complete their execution. This can make predictive process monitoring too rigid to deal with the variability of processes working in real environments that continuously evolve and/or exhibit new variant behaviors over time. As a solution to this problem, we propose the use of algorithms that allow the incremental construction of the predictive model. These incremental learning algorithms update the model whenever new cases become available so that the predictive model evolves over time to fit the current circumstances. The algorithms have been implemented using different case encoding strategies and evaluated on a number of real and synthetic datasets. The results provide a first evidence of the potential of incremental learning strategies for predicting process monitoring in real environments, and of the impact of different case encoding strategies in this setting

Voronoi-Like grid systems for tall buildings

In the context of innovative patterns for tall buildings, Voronoi tessellation is certainly worthy of interest. It is an irregular biomimetic pattern based on the Voronoi diagram, which derives from the direct observation of natural structures. The paper is mainly focused on the application of this nature-inspired typology to load-resisting systems for tall buildings, investigating the potential of non-regular grids on the global mechanical response of the structure. In particular, the study concentrates on the periodic and non-periodic Voronoi tessellation, describing the procedure for generating irregular patterns through parametric modeling and illustrates the homogenization-based approach proposed in the literature for dealing with unconventional patterns. To appreciate the consistency of preliminary design equations, numerical and analytical results are compared. Moreover, since the mechanical response of the building strongly depends on the parameters of the microstructure, the paper focuses on the influence of the grid arrangement on the global lateral stiffness, therefore on the displacement constraint, which is an essential requirement in the design of tall buildings. To this end, five case studies, accounting for different levels of irregularity and relative density, are generated and analyzed through static and modal analysis in the elastic field. In addition, the paper focuses on the mechanical response of a pattern with gradual rarefying density to evaluate its applicability to tall buildings. Displacement based optimizations are carried out to assess the adequate member cross sections that provide the maximum contribution in restraining deflection with the minimum material weight. The results obtained for all the models generated are compared and discussed to outline a final evaluation of the Voronoi structures. In addition to the wind loading scenario, the efficiency of the building model with varying density Voronoi pattern, is tested for seismic ground motion through a response spectrum analysis. The potential applications of Voronoi tessellation for tall buildings is demonstrated for both regions with high wind load conditions and areas of high seismicity

Handling Concept Drift for Predictions in Business Process Mining

Predictive services nowadays play an important role across all business sectors. However, deployed machine learning models are challenged by changing data streams over time which is described as concept drift. Prediction quality of models can be largely influenced by this phenomenon. Therefore, concept drift is usually handled by retraining of the model. However, current research lacks a recommendation which data should be selected for the retraining of the machine learning model. Therefore, we systematically analyze different data selection strategies in this work. Subsequently, we instantiate our findings on a use case in process mining which is strongly affected by concept drift. We can show that we can improve accuracy from 0.5400 to 0.7010 with concept drift handling. Furthermore, we depict the effects of the different data selection strategies

Evolving Ensemble Fuzzy Classifier

The concept of ensemble learning offers a promising avenue in learning from data streams under complex environments because it addresses the bias and variance dilemma better than its single model counterpart and features a reconfigurable structure, which is well suited to the given context. While various extensions of ensemble learning for mining non-stationary data streams can be found in the literature, most of them are crafted under a static base classifier and revisits preceding samples in the sliding window for a retraining step. This feature causes computationally prohibitive complexity and is not flexible enough to cope with rapidly changing environments. Their complexities are often demanding because it involves a large collection of offline classifiers due to the absence of structural complexities reduction mechanisms and lack of an online feature selection mechanism. A novel evolving ensemble classifier, namely Parsimonious Ensemble pENsemble, is proposed in this paper. pENsemble differs from existing architectures in the fact that it is built upon an evolving classifier from data streams, termed Parsimonious Classifier pClass. pENsemble is equipped by an ensemble pruning mechanism, which estimates a localized generalization error of a base classifier. A dynamic online feature selection scenario is integrated into the pENsemble. This method allows for dynamic selection and deselection of input features on the fly. pENsemble adopts a dynamic ensemble structure to output a final classification decision where it features a novel drift detection scenario to grow the ensemble structure. The efficacy of the pENsemble has been numerically demonstrated through rigorous numerical studies with dynamic and evolving data streams where it delivers the most encouraging performance in attaining a tradeoff between accuracy and complexity.Comment: this paper has been published by IEEE Transactions on Fuzzy System