Event Detection in Eye-Tracking Data for Use in Applications with Dynamic Stimuli

This doctoral thesis has signal processing of eye-tracking data as its main theme. An eye-tracker is a tool used for estimation of the point where one is looking. Automatic algorithms for classification of different types of eye movements, so called events, form the basis for relating the eye-tracking data to cognitive processes during, e.g., reading a text or watching a movie. The problems with the algorithms available today are that there are few algorithms that can handle detection of events during dynamic stimuli and that there is no standardized procedure for how to evaluate the algorithms. This thesis comprises an introduction and four papers describing methods for detection of the most common types of eye movements in eye-tracking data and strategies for evaluation of such methods. The most common types of eye movements are fixations, saccades, and smooth pursuit movements. In addition to these eye movements, the event post-saccadic oscillations, (PSO), is considered. The eye-tracking data in this thesis are recorded using both high- and low-speed eye-trackers. The first paper presents a method for detection of saccades and PSO. The saccades are detected using the acceleration signal and three specialized criteria based on directional information. In order to detect PSO, the interval after each saccade is modeled and the parameters of the model are used to determine whether PSO are present or not. The algorithm was evaluated by comparing the detection results to manual annotations and to the detection results of the most recent PSO detection algorithm. The results show that the algorithm is in good agreement with annotations, and has better performance than the compared algorithm. In the second paper, a method for separation of fixations and smooth pursuit movements is proposed. In the intervals between the detected saccades/PSO, the algorithm uses different spatial scales of the position signal in order to separate between the two types of eye movements. The algorithm is evaluated by computing five different performance measures, showing both general and detailed aspects of the discrimination performance. The performance of the algorithm is compared to the performance of a velocity and dispersion based algorithm, (I-VDT), to the performance of an algorithm based on principle component analysis, (I-PCA), and to manual annotations by two experts. The results show that the proposed algorithm performs considerably better than the compared algorithms. In the third paper, a method based on eye-tracking signals from both eyes is proposed for improved separation of fixations and smooth pursuit movements. The method utilizes directional clustering of the eye-tracking signals in combination with binary filters taking both temporal and spatial aspects of the eye-tracking signal into account. The performance of the method is evaluated using a novel evaluation strategy based on automatically detected moving objects in the video stimuli. The results show that the use of binocular information for separation of fixations and smooth pursuit movements is advantageous in static stimuli, without impairing the algorithm's ability to detect smooth pursuit movements in video and moving dot stimuli. The three first papers in this thesis are based on eye-tracking signals recorded using a stationary eye-tracker, while the fourth paper uses eye-tracking signals recorded using a mobile eye-tracker. In mobile eye-tracking, the user is allowed to move the head and the body, which affects the recorded data. In the fourth paper, a method for compensation of head movements using an inertial measurement unit, (IMU), combined with an event detector for lower sampling rate data is proposed. The event detection is performed by combining information from the eye-tracking signals with information about objects extracted from the scene video of the mobile eye-tracker. The results show that by introducing head movement compensation and information about detected objects in the scene video in the event detector, improved classification can be achieved. In summary, this thesis proposes an entire methodological framework for robust event detection which performs better than previous methods when analyzing eye-tracking signals recorded during dynamic stimuli, and also provides a methodology for performance evaluation of event detection algorithms

The Application of ANN and ANFIS Prediction Models for Thermal Error Compensation on CNC Machine Tools

Thermal errors can have significant effects on Computer Numerical Control (CNC) machine tool accuracy. The errors come from thermal deformations of the machine elements caused by heat sources within the machine structure or from ambient temperature change. The effect of temperature can be reduced by error avoidance or numerical compensation. The performance of a thermal error compensation system essentially depends upon the accuracy and robustness of the thermal error model and its input measurements. This thesis first reviews different methods of designing thermal error models, before concentrating on employing Artificial Intelligence (AI) methods to design different thermal prediction models. In this research work the Adaptive Neuro-Fuzzy Inference System (ANFIS) is used as the backbone for thermal error modelling. The choice of inputs to the thermal model is a non-trivial decision which is ultimately a compromise between the ability to obtain data that sufficiently correlates with the thermal distortion and the cost of implementation of the necessary feedback sensors. In this thesis, temperature measurement was supplemented by direct distortion measurement at accessible locations. The location of temperature measurement must also provide a representative measurement of the change in temperature that will affect the machine structure. The number of sensors and their locations are not always intuitive and the time required to identify the optimal locations is often prohibitive, resulting in compromise and poor results. In this thesis, a new intelligent system for reducing thermal errors of machine tools using data obtained from thermography data is introduced. Different groups of key temperature points on a machine can be identified from thermal images using a novel schema based on a Grey system theory and Fuzzy C-Means (FCM) clustering method. This novel method simplifies the modelling process, enhances the accuracy of the system and reduces the overall number of inputs to the model, since otherwise a much larger number of thermal sensors would be required to cover the entire structure. An Adaptive Neuro-Fuzzy Inference System with Fuzzy C-Means clustering (ANFIS-FCM) is then employed to design the thermal prediction model. In order to optimise the approach, a parametric study is carried out by changing the number of inputs and number of Membership Functions (MFs) to the ANFIS-FCM model, and comparing the relative robustness of the designs. The proposed approach has been validated on three different machine tools under different operation conditions. Thus the proposed system has been shown to be robust to different internal heat sources, ambient changes and is easily extensible to other CNC machine tools. Finally, the proposed method is shown to compare favourably against alternative approaches such as an Artificial Neural Network (ANN) model and different Grey models

A Novel Dynamic Appliance Clustering Scheme in a Community Home Energy Management System for Improved Stability and Resiliency of Microgrids

Power scheduling of domestic appliances is a vital preference for bridging the gap between demand and generation of electricity in a microgrid. For a stable microgrid, an acceptable mechanism must reduce the peak to average ratio (PAR) of power demand with supplementary benefits for consumers as reduced electricity charges. Recent studies have focused on PAR and cost reduction for a small consumer population. Furthermore, researchers have mainly considered homogeneous consumer loads. This study focuses on residential power scheduling for electricity cost reduction for consumers and load profile PAR curtailment for a relatively large consumer population with non-homogeneous loads. A sample population of 1000 consumers from various classes of society is considered. The proposed dynamic clustered community home energy management system (DCCHEMS) allows the clustering of appliances based on time overlap criteria. Comparatively flatter power demand is attained by utilizing the clustered appliances in conjunction with particle swarm optimization under the influence of user-defined constraints. Modified inclined block rates with real-time electricity pricing strategies are deployed to minimize the electricity costs. DCCHEMS achieved higher efficiency rates in contrast to the traditional non-clustering and static clustering optimization schemes. An improvement of 21% in peak to average ratio, 4% in cost reduction, and 19% in variance to mean ratio is obtained

A New design of fuzzy logic controller optimized By PSO-SCSO applied To SFO-DTC induction motor drive

In this paper, a new strategy for the design of fuzzy logic controllers (FLC) is proposed. This strategy is based on the optimization, by the particle swarm optimization (PSO) Algorithm and by sine-cosine based swarm optimization (SCSO) Algorithm, of the input-output gains and the geometric forms of the triangular membership functions of the proposed FLC. This latter is obtained by the minimizing a cost function based on combining two criterions, the Integral Time Absolute Error (ITAE) and Integral Absolute Error (IAE). A comparison, between the conventional FLC and the proposed FLC is carried out. The PSO-FLC shows a remarkable improvement in the performances of the controlled induction motor

Solving security constrained optimal power flow problems:a hybrid evolutionary approach

A hybrid population-based metaheuristic, Hybrid Canonical Differential Evolutionary Particle Swarm Optimization (hC-DEEPSO), is applied to solve Security Constrained Optimal Power Flow (SCOPF) problems. Despite the inherent difficulties of tackling these real-world problems, they must be solved several times a day taking into account operation and security conditions. A combination of the C-DEEPSO metaheuristic coupled with a multipoint search operator is proposed to better exploit the search space in the vicinity of the best solution found so far by the current population in the first stages of the search process. A simple diversity mechanism is also applied to avoid premature convergence and to escape from local optima. A experimental design is devised to fine-tune the parameters of the proposed algorithm for each instance of the SCOPF problem. The effectiveness of the proposed hC-DEEPSO is tested on the IEEE 57-bus, IEEE 118-bus and IEEE 300-bus standard systems. The numerical results obtained by hC-DEEPSO are compared with other evolutionary methods reported in the literature to prove the potential and capability of the proposed hC-DEEPSO for solving the SCOPF at acceptable economical and technical levels

Immunity-Based Framework for Autonomous Flight in GPS-Challenged Environment

In this research, the artificial immune system (AIS) paradigm is used for the development of a conceptual framework for autonomous flight when vehicle position and velocity are not available from direct sources such as the global navigation satellite systems or external landmarks and systems. The AIS is expected to provide corrections of velocity and position estimations that are only based on the outputs of onboard inertial measurement units (IMU). The AIS comprises sets of artificial memory cells that simulate the function of memory T- and B-cells in the biological immune system of vertebrates. The innate immune system uses information about invading antigens and needed antibodies. This information is encoded and sorted by T- and B-cells. The immune system has an adaptive component that can accelerate and intensify the immune response upon subsequent infection with the same antigen. The artificial memory cells attempt to mimic these characteristics for estimation error compensation and are constructed under normal conditions when all sensor systems function accurately, including those providing vehicle position and velocity information. The artificial memory cells consist of two main components: a collection of instantaneous measurements of relevant vehicle features representing the antigen and a set of instantaneous estimation errors or correction features, representing the antibodies. The antigen characterizes the dynamics of the system and is assumed to be correlated with the required corrections of position and velocity estimation or antibodies. When the navigation source is unavailable, the currently measured vehicle features from the onboard sensors are matched against the AIS antigens and the corresponding corrections are extracted and used to adjust the position and velocity estimation algorithm and provide the corrected estimation as actual measurement feedback to the vehicle’s control system. The proposed framework is implemented and tested through simulation in two versions: with corrections applied to the output or the input of the estimation scheme. For both approaches, the vehicle feature or antigen sets include increments of body axes components of acceleration and angular rate. The correction feature or antibody sets include vehicle position and velocity and vehicle acceleration adjustments, respectively. The impact on the performance of the proposed methodology produced by essential elements such as path generation method, matching algorithm, feature set, and the IMU grade was investigated. The findings demonstrated that in all cases, the proposed methodology could significantly reduce the accumulation of dead reckoning errors and can become a viable solution in situations where direct accurate measurements and other sources of information are not available. The functionality of the proposed methodology and its promising outcomes were successfully illustrated using the West Virginia University unmanned aerial system simulation environment

Energy Management of Prosumer Communities

The penetration of distributed generation, energy storages and smart loads has resulted in the emergence of prosumers: entities capable of adjusting their electricity production and consumption in order to meet environmental goals and to participate profitably in the available electricity markets. Significant untapped potential remains in the exploitation and coordination of small and medium-sized distributed energy resources. However, such resources usually have a primary purpose, which imposes constraints on the exploitation of the resource; for example, the primary purpose of an electric vehicle battery is for driving, so the battery could be used as temporary storage for excess photovoltaic energy only if the vehicle is available for driving when the owner expects it to be. The aggregation of several distributed energy resources is a solution for coping with the unavailability of one resource. Solutions are needed for managing the electricity production and consumption characteristics of diverse distributed energy resources in order to obtain prosumers with more generic capabilities and services for electricity production, storage, and consumption. This collection of articles studies such prosumers and the emergence of prosumer communities. Demand response-capable smart loads, battery storages and photovoltaic generation resources are forecasted and optimized to ensure energy-efficient and, in some cases, profitable operation of the resources

Optimisation, Optimal Control and Nonlinear Dynamics in Electrical Power, Energy Storage and Renewable Energy Systems

The electrical power system is undergoing a revolution enabled by advances in telecommunications, computer hardware and software, measurement, metering systems, IoT, and power electronics. Furthermore, the increasing integration of intermittent renewable energy sources, energy storage devices, and electric vehicles and the drive for energy efficiency have pushed power systems to modernise and adopt new technologies. The resulting smart grid is characterised, in part, by a bi-directional flow of energy and information. The evolution of the power grid, as well as its interconnection with energy storage systems and renewable energy sources, has created new opportunities for optimising not only their techno-economic aspects at the planning stages but also their control and operation. However, new challenges emerge in the optimization of these systems due to their complexity and nonlinear dynamic behaviour as well as the uncertainties involved.This volume is a selection of 20 papers carefully made by the editors from the MDPI topic “Optimisation, Optimal Control and Nonlinear Dynamics in Electrical Power, Energy Storage and Renewable Energy Systems”, which was closed in April 2022. The selected papers address the above challenges and exemplify the significant benefits that optimisation and nonlinear control techniques can bring to modern power and energy systems

A Grey Wolf Optimization-Based Clustering Approach for Energy Efficiency in Wireless Sensor Networks

In the realm of Wireless Sensor Networks, the longevity of a sensor node's battery is pivotal, especially since these nodes are often deployed in locations where battery replacement is not feasible. Heterogeneous networks introduce additional challenges due to varying buffer capacities among nodes, necessitating timely data transmission to prevent loss from buffer overflows. Despite numerous attempts to address these issues, previous solutions have been deficient in significant respects. Our innovative strategy employs Grey Wolf Optimization for Cluster Head selection within heterogeneous networks, aiming to concurrently optimise energy efficiency and buffer capacity. We conducted comprehensive simulations using Network Simulator 2, with results analysed in MATLAB, focusing on metrics such as energy depletion rates, remaining energy, node-to-node distance, node count, packet delivery, and average energy in the cluster head selection process. Our approach was benchmarked against leading protocols like LEACH and PEGASIS, considering five key performance indicators: energy usage, network lifespan, the survival rate of nodes over time, data throughput, and remaining network energy. The simulations demonstrate that our Grey Wolf Optimisation method outperforms conventional protocols, showing a 9% reduction in energy usage, a 12% increase in node longevity, a 9.8% improvement in data packet delivery, and a 12.2% boost in data throughput