Atmospheric Turbulence Mitigation using Complex Wavelet-based Fusion

Restoring a scene distorted by atmospheric turbulence is a challenging problem in video surveillance. The effect, caused by random, spatially varying, perturbations, makes a model-based solution difficult and in most cases, impractical. In this paper, we propose a novel method for mitigating the effects of atmospheric distortion on observed images, particularly airborne turbulence which can severely degrade a region of interest (ROI). In order to extract accurate detail about objects behind the distorting layer, a simple and efficient frame selection method is proposed to select informative ROIs only from good-quality frames. The ROIs in each frame are then registered to further reduce offsets and distortions. We solve the space-varying distortion problem using region-level fusion based on the dual tree complex wavelet transform. Finally, contrast enhancement is applied. We further propose a learning-based metric specifically for image quality assessment in the presence of atmospheric distortion. This is capable of estimating quality in both full-and no-reference scenarios. The proposed method is shown to significantly outperform existing methods, providing enhanced situational awareness in a range of surveillance scenarios. © 1992-2012 IEEE

Terrain Classification from Body-mounted Cameras during Human Locomotion

Abstract—This paper presents a novel algorithm for terrain type classification based on monocular video captured from the viewpoint of human locomotion. A texture-based algorithm is developed to classify the path ahead into multiple groups that can be used to support terrain classification. Gait is taken into account in two ways. Firstly, for key frame selection, when regions with homogeneous texture characteristics are updated, the fre-quency variations of the textured surface are analysed and used to adaptively define filter coefficients. Secondly, it is incorporated in the parameter estimation process where probabilities of path consistency are employed to improve terrain-type estimation. When tested with multiple classes that directly affect mobility a hard surface, a soft surface and an unwalkable area- our proposed method outperforms existing methods by up to 16%, and also provides improved robustness. Index Terms—texture, classification, recursive filter, terrain classification I

Artificial Intelligence in the Creative Industries: A Review

This paper reviews the current state of the art in Artificial Intelligence (AI) technologies and applications in the context of the creative industries. A brief background of AI, and specifically Machine Learning (ML) algorithms, is provided including Convolutional Neural Network (CNNs), Generative Adversarial Networks (GANs), Recurrent Neural Networks (RNNs) and Deep Reinforcement Learning (DRL). We categorise creative applications into five groups related to how AI technologies are used: i) content creation, ii) information analysis, iii) content enhancement and post production workflows, iv) information extraction and enhancement, and v) data compression. We critically examine the successes and limitations of this rapidly advancing technology in each of these areas. We further differentiate between the use of AI as a creative tool and its potential as a creator in its own right. We foresee that, in the near future, machine learning-based AI will be adopted widely as a tool or collaborative assistant for creativity. In contrast, we observe that the successes of machine learning in domains with fewer constraints, where AI is the `creator', remain modest. The potential of AI (or its developers) to win awards for its original creations in competition with human creatives is also limited, based on contemporary technologies. We therefore conclude that, in the context of creative industries, maximum benefit from AI will be derived where its focus is human centric -- where it is designed to augment, rather than replace, human creativity

Computer Vision Sensing Systems for Structural Health Monitoring in Challenging Field Conditions

Computer vision sensing techniques enable easy-to-install and remote non-contact monitoring of structures and have great potentials in field applications. This study will develop/implement novel computer vision techniques for two sensing systems for monitoring different aspects of infrastructures in challenging field conditions. The dissertation is therefore composed of two parts: robust measurement of global multi-point structural displacements, and accurate and robust monitoring of local surface displacements/strains. Computer vision based displacement measurement has become popular in the recent decade. The first part presents InnoVision, a vision sensing system developed to address a number of challenging problems associated with applying vision sensors to the measurement of multi-point structural displacement in field conditions that are rarely comprehensively studied in the literature. The challenging problems include tracking low-contrast natural targets on the structural surface, insufficient resolution for long distance measurement, inevitable camera vibration, and image distortion due to heat haze in hot weather. Several techniques are developed in InnoVision to tackle these challenges. Laboratory and field tests are conducted to evaluate the performance of these techniques. In the second part, another vision sensing system SurfaceVision is developed for accurate and robust monitoring two-dimensional (2D) structural surface displacements/strains. Important structures, such as nuclear power plants, need the continuous inspection of surface conditions. As an alternative to the human inspection, conventional digital-image-correlation (DIC) based methods have been applied to surfaces painted with speckle patterns in a controlled environment. However, it is highly challenging for DIC methods to accurately measure displacement on natural concrete surfaces in outdoor conditions with changing illumination and weather conditions. Additionally, common surface displacement measurement is based on segmenting the surface image into small subsets and tracking each subset individually through template matching, the surface displacement thus obtained has obvious discontinuity and low spatial resolution. Therefore, for applicability in the outdoor environment, SurfaceVision is proposed for accurate and robust monitoring of surface displacements/strains. Advanced computer vision techniques are developed/implemented to enable surface displacement measurement with high continuity, spatial resolution, accuracy, and robustness. An intuitive strain calculation method is also developed for converting surface displacements into surface strains. A numerical simulation is formulated based on four-point bending tests to validate the accuracy and robustness of SurfaceVision in surface displacements. Four-point bending experiments using reinforced concrete specimens are conducted to demonstrate the performance of SurfaceVision under different cases of optical noises and its effectiveness in predicting crack formations