Silhouette coverage analysis for multi-modal video surveillance

In order to improve the accuracy in video-based object detection, the proposed multi-modal video surveillance system takes advantage of the different kinds of information represented by visual, thermal and/or depth imaging sensors. The multi-modal object detector of the system can be split up in two consecutive parts: the registration and the coverage analysis. The multi-modal image registration is performed using a three step silhouette-mapping algorithm which detects the rotation, scale and translation between moving objects in the visual, (thermal) infrared and/or depth images. First, moving object silhouettes are extracted to separate the calibration objects, i.e., the foreground, from the static background. Key components are dynamic background subtraction, foreground enhancement and automatic thresholding. Then, 1D contour vectors are generated from the resulting multi-modal silhouettes using silhouette boundary extraction, cartesian to polar transform and radial vector analysis. Next, to retrieve the rotation angle and the scale factor between the multi-sensor image, these contours are mapped on each other using circular cross correlation and contour scaling. Finally, the translation between the images is calculated using maximization of binary correlation. The silhouette coverage analysis also starts with moving object silhouette extraction. Then, it uses the registration information, i.e., rotation angle, scale factor and translation vector, to map the thermal, depth and visual silhouette images on each other. Finally, the coverage of the resulting multi-modal silhouette map is computed and is analyzed over time to reduce false alarms and to improve object detection. Prior experiments on real-world multi-sensor video sequences indicate that automated multi-modal video surveillance is promising. This paper shows that merging information from multi-modal video further increases the detection results

Advanced SAR interferometric analysis to support geomorphological interpretation of slow-moving coastal landslides (Malta, Mediterranean Sea)

An advanced SAR interferometric analysis has been combined with a methodology for the automatic classification of radar reflectors phase histories to interpret slope-failure kinematics and trend of displacements of slow-moving landslides. To accomplish this goal, the large dataset of radar images, acquired in more than 20 years by the two European Space Agency (ESA) missions ERS-1/2 and ENVISAT, was exploited. The analysis was performed over the northern sector of Island of Malta (central Mediterranean Sea), where extensive landslides occur. The study was assisted by field surveys and with the analysis of existing thematic maps and landslide inventories. The outcomes allowed definition of a model capable of describing the geomorphological evolution of slow-moving landslides, providing a key for interpreting such phenomena that, due to their slowness, are usually scarcely investigated

Automatic Characterization of Myocardial Perfusion in Contrast Enhanced MRI

The use of contrast medium in cardiac MRI allows joining the high-resolution anatomical information provided by standard magnetic resonance with functional information obtained by means of the perfusion of contrast agent in myocardial tissues. The current approach to perfusion MRI characterization is the qualitative one, based on visual inspection of images. Moving to quantitative analysis requires extraction of numerical indices of myocardium perfusion by analysis of time/intensity curves related to the area of interest. The main problem in quantitative image sequence analysis is the heart movement, mainly due to patient respiration. We propose an automatic procedure based on image registration, segmentation of the myocardium, and extraction and analysis of time/intensity curves. The procedure requires a minimal user interaction, is robust with respect to the user input, and allows effective characterization of myocardial perfusion. The algorithm was tested on cardiac MR images acquired from voluntaries and in clinical routine

Non-quadratic regularization based image deblurring: automatic parameter selection and feature based evaluation

In computer vision based analysis, a completely automatic inspection of parts on assembly line involves many challanges. Since the parts are moving fast on line it is most probable that the captured frames are motion blurred and noisy images. Therefore accurate extraction of features from the image may not be possible. To overcome this challenge, we consider quadratic and non-quadratic regularization based deblurring. To select the regularization parameter automatically, we propose usage of unbiased predictive risk estimator method. We investigate the quantitative effect of the applied methods on feature extraction performance and demonstrate the effectiveness of the proposed approach with experiments on real data

Video vehicle detection at signalised junctions: a simulation-based study

Many existing advanced methods of traffic signal control depend on information about approaching traffic provided by inductive loop detectors at particular points in the road. But analysis of images from CCTV cameras can in principle provide more comprehensive information about traffic approaching and passing through junctions, and cameras may be easier to install and maintain than loop detectors, and some systems based on video detection have already been in use for some time. Against this background, computer simulation has been used to explore the potential of existing and immediately foreseeable capability in automatic on-line image analysis to extract information relevant to signal control from images provided by cameras mounted in acceptable positions at signal-controlled junctions. Some consequences of extracting relevant information in different ways were investigated in the context of an existing detailed simulation model of vehicular traffic moving through junctions under traffic-responsive signal control, and the development of one basic and one advanced algorithm for traffic-responsive control. The work was confined as a first step to operation of one very simple signalcontrolled junction. Two techniques for extraction of information from images were modelled - a more ambitious technique based on distinguishing most of the individual vehicles visible to the camera, and a more modest technique requiring only that the presence of vehicles in any part of the image be distinguished from the background scene. In the latter case, statistical modelling was used to estimate the number of vehicles corresponding to any single area of the image that represents vehicles rather than background. At the simple modelled junction, each technique of extraction enabled each of the algorithms for traffic-responsive control of the signals to achieve average delays per vehicle appreciably lower than those given by System D control, and possibly competitive with those that MOVA would give, but comparison with MOVA was beyond the scope of the initial study. These results of simulation indicate that image analysis of CCTV pictures should be able to provide sufficient information in practice for traffic-responsive control that is competitive with existing techniques. Ways in which the work could be taken further were discussed with practitioners, but have not yet been progressed

ATREngine: An Orientation-Based Algorithm for Automatic Target Recognition

Automatic Target Recognition (ATR) is a subject involving the use of sensor data to develop an algorithm for identifying targets of significance. It is of particular interest in military applications such as unmanned aerial vehicles and missile tracking systems. This thesis develops an orientation-based classification approach from previous ATR algorithms for 2-D Synthetic Aperture Radar (SAR) images. Prior work in ATR includes Chessa Guilas’ Hausdorff Probabilistic Feature Analysis Approach in 2005 and Daniel Cary’s Optimal Rectangular Fit in 2007. A system incorporating multiple modules performing different tasks is developed to streamline the data processing of previous algorithms. Using images from the publicly available Moving and Stationary Target Acquisition and Recognition (MSTAR) database, target orientation was determined to be the best feature for ATR. A rotationally variant algorithm taking advantage of the combination of target orientation and pixel location for classification is proposed in this thesis. Extensive classification results yielding an overall accuracy of 76.78% are presented to demonstrate algorithm functionality

Automatic microscopic image analysis by moving window local Fourier Transform and Machine Learning

Analysis of microscope images is a tedious work which requires patience and time, usually done manually by the microscopist after data collection. The results obtained in such a way might be biased by the human who performed the analysis. Here we introduce an approach of automatic image analysis, which is based on locally applied Fourier Transform and Machine Learning methods. In this approach, a whole image is scanned by a local moving window with defined size and the 2D Fourier Transform is calculated for each window. Then, all the Local Fourier Transforms are fed into Machine Learning processing. Firstly, a number of components in the data is estimated from Principal Component Analysis (PCA) Scree Plot performed on the data. Secondly, the data are decomposed blindly by Non-Negative Matrix Factorization (NMF) into interpretable spatial maps (loadings) and corresponding Fourier Transforms (factors). As a result, the microscopic image is analyzed and the features on the image are automatically discovered, based on the local changes in Fourier Transform, without human bias. The user selects only a size and movement of the scanning local window which defines the final analysis resolution. This automatic approach was successfully applied to analysis of various microscopic images with and without local periodicity i.e. atomically resolved High Angle Annular Dark Field (HAADF) Scanning Transmission Electron Microscopy (STEM) image of Au nanoisland of fcc and Au hcp phases, Scanning Tunneling Microscopy (STM) image of Au-induced reconstruction on Ge(001) surface, Scanning Electron Microscopy (SEM) image of metallic nanoclusters grown on GaSb surface, and Fluorescence microscopy image of HeLa cell line of cervical cancer. The proposed approach could be used to automatically analyze the local structure of microscopic images within a time of about a minute for a single image on a modern desktop/notebook computer and it is freely available as a Python analysis notebook and Python program for batch processing