An audio-based sports video segmentation and event detection algorithm

In this paper, we present an audio-based event detection algorithm shown to be effective when applied to Soccer video. The main benefit of this approach is the ability to recognise patterns that display high levels of crowd response correlated to key events. The soundtrack from a Soccer sequence is first parameterised using Mel-frequency Cepstral coefficients. It is then segmented into homogenous components using a windowing algorithm with a decision process based on Bayesian model selection. This decision process eliminated the need for defining a heuristic set of rules for segmentation. Each audio segment is then labelled using a series of Hidden Markov model (HMM) classifiers, each a representation of one of 6 predefined semantic content classes found in Soccer video. Exciting events are identified as those segments belonging to a crowd cheering class. Experimentation indicated that the algorithm was more effective for classifying crowd response when compared to traditional model-based segmentation and classification techniques

Discovering Clusters in Motion Time-Series Data

A new approach is proposed for clustering time-series data. The approach can be used to discover groupings of similar object motions that were observed in a video collection. A finite mixture of hidden Markov models (HMMs) is fitted to the motion data using the expectation-maximization (EM) framework. Previous approaches for HMM-based clustering employ a k-means formulation, where each sequence is assigned to only a single HMM. In contrast, the formulation presented in this paper allows each sequence to belong to more than a single HMM with some probability, and the hard decision about the sequence class membership can be deferred until a later time when such a decision is required. Experiments with simulated data demonstrate the benefit of using this EM-based approach when there is more "overlap" in the processes generating the data. Experiments with real data show the promising potential of HMM-based motion clustering in a number of applications.Office of Naval Research (N000140310108, N000140110444); National Science Foundation (IIS-0208876, CAREER Award 0133825

Low-Power Appliance Monitoring Using Factorial Hidden Markov Models

To optimize the energy utilization, intelligent energy management solutions require appliance-specific consumption statistics. One can obtain such information by deploying smart power outlets on every device of interest, however it incurs extra hardware cost and installation complexity. Alternatively, a single sensor can be used to measure total electricity consumption and thereafter disaggregation algorithms can be applied to obtain appliance specific usage information. In such a case, it is quite challenging to discern low-power appliances in the presence of high-power loads. To improve the recognition of low-power appliance states, we propose a solution that makes use of circuit-level power measurements. We examine the use of a specialized variant of Hidden Markov Model (HMM) known as Factorial HMM (FHMM) to recognize appliance specific load patterns from the aggregated power measurements. Further, we demonstrate that feature concatenation can improve the disaggregation performance of the model allowing it to identify device states with an accuracy of 90% for binary and 80% for multi-state appliances. Through experimental evaluations, we show that our solution performs better than the traditional event based approach. In addition, we develop a prototype system that allows real-time monitoring of appliance states

Audio-based event detection for sports video

In this paper, we present an audio-based event detection approach shown to be effective when applied to the Sports broadcast data. The main benefit of this approach is the ability to recognise patterns that indicate high levels of crowd response which can be correlated to key events. By applying Hidden Markov Model-based classifiers, where the predefined content classes are parameterised using Mel-Frequency Cepstral Coefficients, we were able to eliminate the need for defining a heuristic set of rules to determine event detection, thus avoiding a two-class approach shown not to be suitable for this problem. Experimentation indicated that this is an effective method for classifying crowd response in Soccer matches, thus providing a basis for automatic indexing and summarisation