Background Subtraction via Generalized Fused Lasso Foreground Modeling

Background Subtraction (BS) is one of the key steps in video analysis. Many background models have been proposed and achieved promising performance on public data sets. However, due to challenges such as illumination change, dynamic background etc. the resulted foreground segmentation often consists of holes as well as background noise. In this regard, we consider generalized fused lasso regularization to quest for intact structured foregrounds. Together with certain assumptions about the background, such as the low-rank assumption or the sparse-composition assumption (depending on whether pure background frames are provided), we formulate BS as a matrix decomposition problem using regularization terms for both the foreground and background matrices. Moreover, under the proposed formulation, the two generally distinctive background assumptions can be solved in a unified manner. The optimization was carried out via applying the augmented Lagrange multiplier (ALM) method in such a way that a fast parametric-flow algorithm is used for updating the foreground matrix. Experimental results on several popular BS data sets demonstrate the advantage of the proposed model compared to state-of-the-arts

Dynamic tree-structured sparse RPCA via column subset selection for background modeling and foreground detection

Video analysis often begins with background subtraction, which consists of creation of a background model that allows distinguishing foreground pixels. Recent evaluation of background subtraction techniques demonstrated that there are still considerable challenges facing these methods. Processing per-pixel basis from the background is not only time-consuming but also can dramatically affect foreground region detection, if region cohesion and contiguity is not considered in the model. We present a new method in which we regard the image sequence to be made up of the sum of a low-rank background matrix and a dynamic tree-structured sparse matrix, and solve the decomposition using our approximated Robust Principal Component Analysis method extended to handle camera motion. Furthermore, to reduce the curse of dimensionality and scale, we introduce a low-rank background modeling via Column Subset Selection that reduces the order of complexity, decreases computation time, and eliminates the huge storage need for large videos

Robust Event Detection and Retrieval in Surveillance Video

We developed a robust event detection and retrieval system for surveillance video. The proposed system offers vision-based capabilities for the detection and tracking of various objects of interest, and can recognize events such as: 1. a person with certain attributes being present in the scene; 2. two people meeting; 3. people carrying bags; 4. bags being dropped; 5. bags being stolen; 6. bags being exchanged; 7. two people handshaking; 8. one person's pointing gesture. We use an improved adaptive Gaussian mixture model for background modeling and foreground detection; a connected component labeling algorithm is then employed to label the foreground pixels. A Kalman filter approach is used to build models for the entities of interest (people and bags), which is combined with color histograms for tracking. We use shape symmetry analysis and color histograms to detect people carrying bags. Our experiments demonstrate the ability to search for instances of events according to specific attributes in large video sequences

A Study On Information Retrieval Systems

A video is a key component of today's multimedia applications,  including Video Cassette Recording (VCR), Video-on-Demand (VoD), and virtual walkthrough. This happens supplementary with the fast amplification in video skill (Rynson W.H. Lau et al. 2000). Owing to innovation's progress in the  media, computerized TV, and data frameworks, an immense measure of video information is now exhaustively realistic (Walid G. Aref et al. 2003). The startling advancement in computerized video content has made entrée and moves the data in a tremendous video database a muddled and sensible issue (Chih-Wen Su et al. 2005). Therefore, the necessity for creating devices and frameworks that can effectively investigate the most needed video content, has evoked a great deal of interest among analysts. Sports video has been chosen as the prime application in this proposition since it has attracted viewers around the world

A Literature Study On Video Retrieval Approaches

A detailed survey has been carried out to identify the various research articles available in the literature in all the categories of video retrieval and to do the analysis of the major contributions and their advantages, following are the literature used for the assessment of the state-of-art work on video retrieval. Here, a large number of papershave been studied

Evaluación de algoritmos de sustracción de fondo para conteo de personas

La sustracción de fondo es una herramienta útil en el campo de la manipulación y análisis de videos, esta nos ofrece una técnica para separar los objetos en movimiento de los objetos estáticos, es ampliamente usado por herramientas como el Kinect, el conteo de personas, el tracking, entre otras. En este documento se consigna la implementación de tres algoritmos, utilizados en sustracción de fondo para conteo de personas, y una posterior comparación bajo unos parámetros, se utilizara el lenguaje Python con la librería opencv, la lectura del video puede realizarse por medio de archivos o directamente desde la cámara web, a continuación se transforma a escala de grises para facilitar su procesamiento y manipulación, por último, por medio de las técnicas que se introducirán en capítulos posteriores, se aplica la sustracción de fondo y los diferentes tipos de pruebas para determinar las mejores condiciones de trabajo y según unos criterios definidos, comparar los algoritmos entre sí. Las condiciones de operación consisten en tener una cámara estática, una iluminación de poca variabilidad, una resolución mínima de 950x540 píxeles, en los clips utilizados se evitan objetos que puedan influir en el resultado como autos en movimiento, motos, lluvia entre otros. Los algoritmos fueron probados con 10 videos en diferentes condiciones bajo la misma resolución, obteniendo así resultados para la evaluación de desempeño y concluyendo cuál de los 3 se comporta mejor bajo que parámetros. En general el trabajo desarrollado reúne diversas técnicas de procesamiento de video, sustracción de fondo, así como algoritmos propios orientados a un fin específico, pero que pueden ser utilizados para el desarrollo de otros proyectos afines o que incluyan el procesamiento de video.PregradoINGENIERO(A) DE SISTEMA

Compensation of nonlinear distortion in RF amplifiers for mobile communications

Compensation of nonlinear distortion of power amplifiers in mobile communications is an important requirement for improving power consumption performance while maintaining efficiency, since mobile phone became an essential accessory for everyone nowadays. This problem demands a good power amplifier model, in order to develop an effective predistortion system. Current researches are focused on modelling and predistortion of power amplifiers with memory, as well as memoryless ones. Different methods for modelling are used, as the Volterra series, polynomial models, look-up tables, the Hammerstein models, the Wiener models, and artificial intelligence systems. For predistortion feedback, feedforward and digital predistortion techniques are used. Among digital predistortion methods there are artificial intelligence systems, used in this thesis for linearization of power amplifier. This thesis presents developed robust method for modelling power amplifiers without memory effects and gives a comparison of proposed method with least squares method. Also, this research presents two novel techniques based on artificial intelligence systems for modelling and predistortion of highly nonlinear power amplifier with memory. The first approach is based on artificial neural networks, while the second one uses adaptive fuzzy logic systems. Forward and inverse models of power amplifier are created with both proposed methods. Superiority of artificial intelligence systems over partial least squares method is presented. Developed models are employed in a cascade to make a linearized system. Verification of proposed methods is carried out through the signal performance parameters and spectra of measured signal and signal from predistortion system. The feasibility and performances of the proposed digital predistortions are examined by simulations and experiments. The comparison of proposed methods is given to present advantages/disadvantages of both methods. The achieved distortion suppression from 72.2% to 93.6% and spectral regrowth improvement from 11.4 dB to 16.2 dB prove that the proposed methods have great ability to compensate the nonlinear distortion in power amplifier

A framework based on Gaussian mixture models and Kalman filters for the segmentation and tracking of anomalous events in shipboard video

Anomalous indications in monitoring equipment on board U.S. Navy vessels must be handled in a timely manner to prevent catastrophic system failure. The development of sensor data analysis techniques to assist a ship\u27s crew in monitoring machinery and summon required ship-to-shore assistance is of considerable benefit to the Navy. In addition, the Navy has a large interest in the development of distance support technology in its ongoing efforts to reduce manning on ships. In this thesis, algorithms have been developed for the detection of anomalous events that can be identified from the analysis of monochromatic stationary ship surveillance video streams. The specific anomalies that we have focused on are the presence and growth of smoke and fire events inside the frames of the video stream. The algorithm consists of the following steps. First, a foreground segmentation algorithm based on adaptive Gaussian mixture models is employed to detect the presence of motion in a scene. The algorithm is adapted to emphasize gray-level characteristics related to smoke and fire events in the frame. Next, shape discriminant features in the foreground are enhanced using morphological operations. Following this step, the anomalous indication is tracked between frames using Kalman filtering. Finally, gray level shape and motion features corresponding to the anomaly are subjected to principal component analysis and classified using a multilayer perceptron neural network. The algorithm is exercised on 68 video streams that include the presence of anomalous events (such as fire and smoke) and benign/nuisance events (such as humans walking the field of view). Initial results show that the algorithm is successful in detecting anomalies in video streams, and is suitable for application in shipboard environments

Biodiversity beyond species census: assessing organisms' traits and functional attributes using computer vision

César Herrera studied the functions of intertidal crabs in estuarine mudflats in Townsville. He developed a novel workflow and software that use computer vision to monitor crab movement and behaviour. His analytical framework is more effective than traditional sampling techniques, and it will help ecologists to gather more and better ecological information on crabs