A study of instance-based algorithms for supervised learning tasks : mathematical, empirical, and psychological evaluations

This dissertation introduces a framework for specifying instance-based algorithms that can solve supervised learning tasks. These algorithms input a sequence of instances and yield a partial concept description, which is represented by a set of stored instances and associated information. This description can be used to predict values for subsequently presented instances. The thesis of this framework is that extensional concept descriptions and lazy generalization strategies can support efficient supervised learning behavior.The instance-based learning framework consists of three components. The pre-processor component transforms an instance into a more palatable form for the performance component, which computes the instance's similarity with a set of stored instances and yields a prediction for its target value(s). Therefore, the similarity and prediction functions impose generalizations on the stored instances to inductively derive predictions. The learning component assesses the accuracy of these prediction(s) and updates partial concept descriptions to improve their predictive accuracy.This framework is evaluated in four ways. First, its generality is evaluated by mathematically determining the classes of symbolic concepts and numeric functions that can be closely approximated by IB_1, a simple algorithm specified by this framework. Second, this framework is empirically evaluated for its ability to specify algorithms that improve IB_1's learning efficiency. Significant efficiency improvements are obtained by instance-based algorithms that reduce storage requirements, tolerate noisy data, and learn domain-specific similarity functions respectively. Alternative component definitions for these algorithms are empirically analyzed in a set of five high-level parameter studies. Third, this framework is evaluated for its ability to specify psychologically plausible process models for categorization tasks. Results from subject experiments indicate a positive correlation between a models' ability to utilize attribute correlation information and its ability to explain psychological phenomena. Finally, this framework is evaluated for its ability to explain and relate a dozen prominent instance-based learning systems. The survey shows that this framework requires only slight modifications to fit these highly diverse systems. Relationships with edited nearest neighbor algorithms, case-based reasoners, and artificial neural networks are also described

Iterative Regularization for Learning with Convex Loss Functions

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint or penalization is considered, and generalization is achieved by (early) stopping an empirical iteration. We consider a nonparametric setting, in the framework of reproducing kernel Hilbert spaces, and prove finite sample bounds on the excess risk under general regularity conditions. Our study provides a new class of efficient regularized learning algorithms and gives insights on the interplay between statistics and optimization in machine learning

Explaining Data Patterns using Knowledge from the Web of Data

Knowledge Discovery (KD) is a long-tradition field aiming at developing methodologies to detect hidden patterns and regularities in large datasets, using techniques from a wide range of domains, such as statistics, machine learning, pattern recognition or data visualisation. In most real world contexts, the interpretation and explanation of the discovered patterns is left to human experts, whose work is to use their background knowledge to analyse, refine and make the patterns understandable for the intended purpose. Explaining patterns is therefore an intensive and time-consuming process, where parts of the knowledge can remain unrevealed, especially when the experts lack some of the required background knowledge. In this thesis, we investigate the hypothesis that such interpretation process can be facilitated by introducing background knowledge from the Web of (Linked) Data. In the last decade, many areas started publishing and sharing their domain-specific knowledge in the form of structured data, with the objective of encouraging information sharing, reuse and discovery. With a constantly increasing amount of shared and connected knowledge, we thus assume that the process of explaining patterns can become easier, faster, and more automated. To demonstrate this, we developed Dedalo, a framework that automatically provides explanations to patterns of data using the background knowledge extracted from the Web of Data. We studied the elements required for a piece of information to be considered an explanation, identified the best strategies to automatically find the right piece of information in the Web of Data, and designed a process able to produce explanations to a given pattern using the background knowledge autonomously collected from the Web of Data. The final evaluation of Dedalo involved users within an empirical study based on a real-world scenario. We demonstrated that the explanation process is complex when not being familiar with the domain of usage, but also that this can be considerably simplified when using the Web of Data as a source of background knowledge

Concept drift learning and its application to adaptive information filtering

Tracking the evolution of user interests is a problem instance of concept drift learning. Keeping track of multiple interest categories is a natural phenomenon as well as an interesting tracking problem because interests can emerge and diminish at different time frames. The first part of this dissertation presents a Multiple Three-Descriptor Representation (MTDR) algorithm, a novel algorithm for learning concept drift especially built for tracking the dynamics of multiple target concepts in the information filtering domain. The learning process of the algorithm combines the long-term and short-term interest (concept) models in an attempt to benefit from the strength of both models. The MTDR algorithm improves over existing concept drift learning algorithms in the domain. Being able to track multiple target concepts with a few examples poses an even more important and challenging problem because casual users tend to be reluctant to provide the examples needed, and learning from a few labeled data is generally difficult. The second part presents a computational Framework for Extending Incomplete Labeled Data Stream (FEILDS). The system modularly extends the capability of an existing concept drift learner in dealing with incomplete labeled data stream. It expands the learner's original input stream with relevant unlabeled data; the process generates a new stream with improved learnability. FEILDS employs a concept formation system for organizing its input stream into a concept (cluster) hierarchy. The system uses the concept and cluster hierarchy to identify the instance's concept and unlabeled data relevant to a concept. It also adopts the persistence assumption in temporal reasoning for inferring the relevance of concepts. Empirical evaluation indicates that FEILDS is able to improve the performance of existing learners particularly when learning from a stream with a few labeled data. Lastly, a new concept formation algorithm, one of the key components in the FEILDS architecture, is presented. The main idea is to discover intrinsic hierarchical structures regardless of the class distribution and the shape of the input stream. Experimental evaluation shows that the algorithm is relatively robust to input ordering, consistently producing a hierarchy structure of high quality

Estimation of real traffic radiated emissions from electric vehicles in terms of the driving profile using neural networks

The increment of the use of electric vehicles leads to a worry about measuring its principal source of environmental pollution: electromagnetic emissions. Given the complexity of directly measuring vehicular radiated emissions in real traffic, the main contribution of this PhD thesis is to propose an indirect solution to estimate such type of vehicular emissions. Relating the on-road vehicular radiated emissions with the driving profile is a complicated task. This is because it is not possible to directly measure the vehicular radiated interferences in real traffic due to potential interferences from another electromagnetic wave sources. This thesis presents a microscopic artificial intelligence model based on neural networks to estimate real traffic radiated emissions of electric vehicles in terms of the driving dynamics. Instantaneous values of measured speed and calculated acceleration have been used to characterize the driving profile. Experimental electromagnetic interference tests have been carried out with a Vectrix electric motorcycle as well as Twizy electric cars in semi-anechoic chambers. Both the motorcycle and the car have been subjected to different urban and interurban driving profiles. Time Domain measurement methodology of electromagnetic radiated emissions has been adopted in this work to save the overall measurement time. The relationship between the magnetic radiated emissions of the Twizy and the corresponding speed has been very noticeable. Maximum magnetic field levels have been observed during high speed cruising in extra-urban driving and acceleration in urban environments. A comparative study of the prediction performance between various static and dynamic neural models has been introduced. The Multilayer Perceptron feedforward neural network trained with Extreme Learning Machines has achieved the best estimation results of magnetic radiated disturbances as function of instantaneous speed and acceleration. In this way, on-road magnetic radiated interferences from an electric vehicle equipped with a Global Positioning System can be estimated. This research line will allow quantify the pollutant electromagnetic emissions of electric vehicles and study new policies to preserve the environment

Estimation of real traffic radiated emissions from electric vehicles in terms of the driving profile using neural networks

The increment of the use of electric vehicles leads to a worry about measuring its principal source of environmental pollution: electromagnetic emissions. Given the complexity of directly measuring vehicular radiated emissions in real traffic, the main contribution of this PhD thesis is to propose an indirect solution to estimate such type of vehicular emissions. Relating the on-road vehicular radiated emissions with the driving profile is a complicated task. This is because it is not possible to directly measure the vehicular radiated interferences in real traffic due to potential interferences from another electromagnetic wave sources. This thesis presents a microscopic artificial intelligence model based on neural networks to estimate real traffic radiated emissions of electric vehicles in terms of the driving dynamics. Instantaneous values of measured speed and calculated acceleration have been used to characterize the driving profile. Experimental electromagnetic interference tests have been carried out with a Vectrix electric motorcycle as well as Twizy electric cars in semi-anechoic chambers. Both the motorcycle and the car have been subjected to different urban and interurban driving profiles. Time Domain measurement methodology of electromagnetic radiated emissions has been adopted in this work to save the overall measurement time. The relationship between the magnetic radiated emissions of the Twizy and the corresponding speed has been very noticeable. Maximum magnetic field levels have been observed during high speed cruising in extra-urban driving and acceleration in urban environments. A comparative study of the prediction performance between various static and dynamic neural models has been introduced. The Multilayer Perceptron feedforward neural network trained with Extreme Learning Machines has achieved the best estimation results of magnetic radiated disturbances as function of instantaneous speed and acceleration. In this way, on-road magnetic radiated interferences from an electric vehicle equipped with a Global Positioning System can be estimated. This research line will allow quantify the pollutant electromagnetic emissions of electric vehicles and study new policies to preserve the environment

An adaptable fuzzy-based model for predicting link quality in robot networks.

It is often essential for robots to maintain wireless connectivity with other systems so that commands, sensor data, and other situational information can be exchanged. Unfortunately, maintaining sufficient connection quality between these systems can be problematic. Robot mobility, combined with the attenuation and rapid dynamics associated with radio wave propagation, can cause frequent link quality (LQ) issues such as degraded throughput, temporary disconnects, or even link failure. In order to proactively mitigate such problems, robots must possess the capability, at the application layer, to gauge the quality of their wireless connections. However, many of the existing approaches lack adaptability or the framework necessary to rapidly build and sustain an accurate LQ prediction model. The primary contribution of this dissertation is the introduction of a novel way of blending machine learning with fuzzy logic so that an adaptable, yet intuitive LQ prediction model can be formed. Another significant contribution includes the evaluation of a unique active and incremental learning framework for quickly constructing and maintaining prediction models in robot networks with minimal sampling overhead

POWER QUALITY CONTROL AND COMMON-MODE NOISE MITIGATION FOR INVERTERS IN ELECTRIC VEHICLES

Inverters are widely utilized in electric vehicle (EV) applications as a major voltage/current source for onboard battery chargers (OBC) and motor drive systems. The inverter performance is critical to the efficiency of EV system energy conversion and electronics system electro-magnetic interference (EMI) design. However, for AC systems, the bandwidth requirement is usually low compared with DC systems, and the control impact on the inverter differential-mode (DM) and common-mode (CM) performance are not well investigated. With the wide-band gap (WBG) device era, the switching capability of power electronics devices drastically improved. The DM/CM impact that was brought by the WBG device-based inverter becomes more serious and has not been completely understood. This thesis provides an in-depth analysis of on-board inverter control strategies and the corresponding DM/CM impact on the EV system. The OBC inverter control under vehicle-to-load (V2L) mode will be documented first. A virtual resistance damping method minimizes the nonlinear load harmonics, and a neutral balancing method regulates the unbalanced load impact through the fourth leg. In the motor drive system, a generalized CM voltage analytical model and a current ripple prediction model are built for understanding the system CM and DM stress with respect to different modulation methods, covering both 2-level and 3-level topologies. A novel CM EMI damping modulation scheme is proposed for 6-phase inverter applications. The performance comparison between the proposed methods and the conventional solution is carried out. Each topic is supported by the corresponding hardware platform and experimental validation