Visual Speech Recognition using Histogram of Oriented Displacements

Lip reading is the recognition of spoken words from the visual information of lips. It has been of considerable interest in the Computer Vision and Speech Recognition communities to automate this process using computer algorithms. In this thesis, we have developed a novel method involving describing visual features using fixed length descriptors called Histogram of Oriented Displacements to which we apply Support Vector Machines for recognition of spoken words. Using this method on the CUAVE database we have achieved a recognition rate of 81%

SUPPORT VECTOR MACHINE FOR HIGH THROUGHPUT RODENT SLEEP BEHAVIOR CLASSIFICATION

This thesis examines the application of a Support Vector Machine (SVM) classifier to automatically detect sleep and quiet wake (rest) behavior in mice from pressure signals on their cage floor. Previous work employed Neural Networks (NN) and Linear Discriminant Analysis (LDA) to successfully detect sleep and wake behaviors in mice. Although the LDA was successful in distinguishing between the sleep and wake behaviors, it has several limitations, which include the need to select a threshold and difficulty separating additional behaviors with subtle differences, such as sleep and rest. The SVM has advantages in that it offers greater degrees of freedom than the LDA for working with complex data sets. In addition, the SVM has direct methods to limit overfitting for the training sets (unlike the NN method). This thesis develops an SVM classifier to characterize the linearly non separable sleep and rest behaviors using a variety of features extracted from the power spectrum, autocorrelation function, and generalized spectrum (autocorrelation of complex spectrum). A genetic algorithm (GA) optimizes the SVM parameters and determines a combination of 5 best features. Experimental results from over 9 hours of data scored by human observation indicate 75% classification accuracy for SVM compared to 68% accuracy for LDA

Automated drowsiness detection for improved driving safety

Several approaches were proposed for the detection and prediction of drowsiness. The approaches can be categorized as estimating the fitness of duty, modeling the sleep-wake rhythms, measuring the vehicle based performance and online operator monitoring. Computer vision based online operator monitoring approach has become prominent due to its predictive ability of detecting drowsiness. Previous studies with this approach detect driver drowsiness primarily by making preassumptions about the relevant behavior, focusing on blink rate, eye closure, and yawning. Here we employ machine learning to datamine actual human behavior during drowsiness episodes. Automatic classifiers for 30 facial actions from the Facial Action Coding system were developed using machine learning on a separate database of spontaneous expressions. These facial actions include blinking and yawn motions, as well as a number of other facial movements. In addition, head motion was collected through automatic eye tracking and an accelerometer. These measures were passed to learning-based classifiers such as Adaboost and multinomial ridge regression. The system was able to predict sleep and crash episodes during a driving computer game with 96% accuracy within subjects and above 90% accuracy across subjects. This is the highest prediction rate reported to date for detecting real drowsiness. Moreover, the analysis revealed new information about human behavior during drowsy drivin

Water filtration by using apple and banana peels as activated carbon

Water filter is an important devices for reducing the contaminants in raw water. Activated from charcoal is used to absorb the contaminants. Fruit peels are some of the suitable alternative carbon to substitute the charcoal. Determining the role of fruit peels which were apple and banana peels powder as activated carbon in water filter is the main goal. Drying and blending the peels till they become powder is the way to allow them to absorb the contaminants. Comparing the results for raw water before and after filtering is the observation. After filtering the raw water, the reading for pH was 6.8 which is in normal pH and turbidity reading recorded was 658 NTU. As for the colour, the water becomes more clear compared to the raw water. This study has found that fruit peels such as banana and apple are an effective substitute to charcoal as natural absorbent

Efficient Learning Machines

Computer scienc

Adaptive Cognitive Interaction Systems

Adaptive kognitive Interaktionssysteme beobachten und modellieren den Zustand ihres Benutzers und passen das Systemverhalten entsprechend an. Ein solches System besteht aus drei Komponenten: Dem empirischen kognitiven Modell, dem komputationalen kognitiven Modell und dem adaptiven Interaktionsmanager. Die vorliegende Arbeit enthält zahlreiche Beiträge zur Entwicklung dieser Komponenten sowie zu deren Kombination. Die Ergebnisse werden in zahlreichen Benutzerstudien validiert

Analysis of Parkinson's Disease Gait using Computational Intelligence

Millions of individuals throughout the world are living with Parkinson’s disease (PD), a neurodegenerative condition whose symptoms are difficult to differentiate from those of other disorders. Freezing of gait (FOG) is one of the signs of Parkinson’s disease that have been utilized as the main diagnostic factor. Bradykinesia, tremors, depression, hallucinations, cognitive impairment, and falls are all common symptoms of Parkinson’s disease (PD). This research uses a dataset that captures data on individuals with PD who suffer from freezing of gait. This dataset includes data for medication in both the “On” and “Off” stages (denoting whether patients have taken their medicines or not). The dataset is comprised of four separate experiments, which are referred to as Voluntary Stop, Timed Up and Go (TUG), Simple Motor Task, and Dual Motor and Cognitive Task. Each of these tests has been carried out over a total of three separate attempts (trials) to verify that they are both reliable and accurate. The dataset was used for four significant challenges. The first challenge is to differentiate between people with Parkinson’s disease and healthy volunteers, and the second task is to evaluate effectiveness of medicines on the patients. The third task is to detect episodes of FOG in each individual, and the last task is to predict the FOG episode at the time of occurrence. For the last task, the author proposed. a new framework to make real-time predictions for detecting FOG, in which the results demonstrated the effectiveness of the approach. It is worth mentioning that techniques from many classifiers have been combined in order to reduce the likelihood of being biased toward a single approach. Multilayer Perceptron, K-Nearest Neighbors, random Forest, and Decision Tree Classifier all produced the best results when applied to the first three tasks with an accuracy of more than 90% amongst the classifiers that were investigated

An IVR call performance classification system using computational intelligent techniques

Speech recognition adoption rate within Interactive Voice Response (IVR) systems is on the increase. If implemented correctly, businesses experience an increase of IVR utilization by customers, thus benefiting from reduced operational costs. However, it is essential for businesses to evaluate the productivity, quality and call resolution performance of these self-service applications. This research is concerned with the development of a business analytics for IVR application that could assist contact centers in evaluating these self-service IVR applications. A call classification system for a pay beneficiary IVR application has been developed. The system comprises of field and call performance classification components. ‘Say account’, ‘Say amount’, ‘Select beneficiary’ and ‘Say confirmation’ field classifiers were developed using Multi-Layer Perceptron (MLP) Artificial Neural Network (ANN), Radial Basis Function (RBF) ANN, Fuzzy Inference System (FIS) as well as Support Vector Machine (SVM). Call performance classifiers were also developed using these computational intelligent techniques. Binary and real coded Genetic Algorithm (GA) solutions were used to determine optimal MLP and RBF ANN classifiers. These GA solutions produced accurate MLP and RBF ANN classifiers. In order to increase the accuracy of the call performance RBF ANN classifier, the classification threshold has been optimized. This process increased the classifier accuracy by approximately eight percent. However, the field and call performance MLP ANN classifiers were the most accurate ANN solutions. Polynomial and RBF SVM kernel functions were most suited for field classifications. However, the linear SVM kernel function is most accurate for call performance classification. When compared to the ANN and SVM field classifiers, the FIS field classifiers did not perform well. The FIS call performance classifier did outperform the RBF ANN call performance network. Ensembles of MLP ANN, RBF ANN and SVM field classifiers were developed. Ensembles of FIS, MLP ANN and SVM call performance classifiers were also implemented. All the computational intelligent methods considered were compared in relation to accuracy, sensitivity and specificity performance metrics. MLP classifier solution is most appropriate for ‘Say account’ field classification. Ensemble of field classifiers and MLP classifier solutions performed the best in ‘Say amount’ field classification. Ensemble of field classifiers and SVM classifier solutions are most suited in ‘Select beneficiary’ and ‘Say confirmation’ field classifications. However, the ensemble of call performance classifiers is the preferred classification solution for call performance