Non-Rigid Registration via Global to Local Transformation

Non-rigid point set and image registration are key problems in plenty of computer vision and pattern recognition tasks. Typically, the non-rigid registration can be formulated as an optimization problem. However, registration accuracy is limited by local optimum. To solve this problem, we propose a method with global to local transformation for non-rigid point sets registration and it also can be used to infrared (IR) and visible (VIS) image registration. Firstly, an objective function based on Gaussian fields is designed to make a problem of non-rigid registration transform into an optimization problem. A global transformation model, which can describe the regular pattern of non-linear deformation between point sets, is then proposed to achieve coarse registration in global scale. Finally, with the results of coarse registration as initial value, a local transformation model is employed to implement fine registration by using local feature. Meanwhile, the optimal global and local transformation models estimated from edge points of IR and VIS image pairs are used to achieve non-rigid image registration. The qualitative and quantitative comparisons demonstrate that the proposed method has good performance under various types of distortions. Moreover, our method can also produce accurate results of IR and VIS image registration

Automated Alignment of Multi-Modal Plant Images Using Integrative Phase Correlation Approach

Modern facilities for high-throughput phenotyping provide plant scientists with a large amount of multi-modal image data. Combination of different image modalities is advantageous for image segmentation, quantitative trait derivation, and assessment of a more accurate and extended plant phenotype. However, visible light (VIS), fluorescence (FLU), and near-infrared (NIR) images taken with different cameras from different view points in different spatial resolutions exhibit not only relative geometrical transformations but also considerable structural differences that hamper a straightforward alignment and combined analysis of multi-modal image data. Conventional techniques of image registration are predominantly tailored to detection of relative geometrical transformations between two otherwise identical images, and become less accurate when applied to partially similar optical scenes. Here, we focus on a relatively new technical problem of FLU/VIS plant image registration. We present a framework for automated alignment of FLU/VIS plant images which is based on extension of the phase correlation (PC) approach − a frequency domain technique for image alignment, which relies on detection of a phase shift between two Fourier-space transforms. Primarily tailored to detection of affine image transformations between two structurally identical images, PC is known to be sensitive to structural image distortions. We investigate effects of image preprocessing and scaling on accuracy of image registration and suggest an integrative algorithmic scheme which allows to overcome shortcomings of conventional single-step PC by application to non-identical multi-modal images. Our experimental tests with FLU/VIS images of different plant species taken on different phenotyping facilities at different developmental stages, including difficult cases such as small plant shoots of non-specific shape and non-uniformly moving leaves, demonstrate improved performance of our extended PC approach within the scope of high-throughput plant phenotyping

Gait Analysis for Early Neurodegenerative Diseases Classification through the Kinematic Theory of Rapid Human Movements

Neurodegenerative diseases are particular diseases whose decline can partially or completely compromise the normal course of life of a human being. In order to increase the quality of patient's life, a timely diagnosis plays a major role. The analysis of neurodegenerative diseases, and their stage, is also carried out by means of gait analysis. Performing early stage neurodegenerative disease assessment is still an open problem. In this paper, the focus is on modeling the human gait movement pattern by using the kinematic theory of rapid human movements and its sigma-lognormal model. The hypothesis is that the kinematic theory of rapid human movements, originally developed to describe handwriting patterns, and used in conjunction with other spatio-temporal features, can discriminate neurodegenerative diseases patterns, especially in early stages, while analyzing human gait with 2D cameras. The thesis empirically demonstrates its effectiveness in describing neurodegenerative patterns, when used in conjunction with state-of-the-art pose estimation and feature extraction techniques. The solution developed achieved 99.1% of accuracy using velocity-based, angle-based and sigma-lognormal features and left walk orientation

Gait Analysis for Early Neurodegenerative Diseases Classification Through the Kinematic Theory of Rapid Human Movements

Neurodegenerative diseases are particular diseases whose decline can partially or completely compromise the normal course of life of a human being. In order to increase the quality of patient's life, a timely diagnosis plays a major role. The analysis of neurodegenerative diseases, and their stage, is also carried out by means of gait analysis. Performing early stage neurodegenerative disease assessment is still an open problem. In this paper, the focus is on modeling the human gait movement pattern by using the kinematic theory of rapid human movements and its sigma-lognormal model. The hypothesis is that the kinematic theory of rapid human movements, originally developed to describe handwriting patterns, and used in conjunction with other spatio-temporal features, can discriminate neurodegenerative diseases patterns, especially in early stages, while analyzing human gait with 2D cameras. The thesis empirically demonstrates its effectiveness in describing neurodegenerative patterns, when used in conjunction with state-of-the-art pose estimation and feature extraction techniques. The solution developed achieved 99.1% of accuracy using velocity-based, angle-based and sigma-lognormal features and left walk orientation

Three-dimensional eddy current pulsed thermography and its applications

Ph. D. Thesis.The measurement and quantification of defects is a challenge for Non-DestructiveTesting and Evaluation (NDT&E). Such challenges include the precise localisation and detection of surface and sub-surface defects, as well as the quantification of such defects. This work first reports a three-dimensional (3D) Eddy Current Pulsed Thermography (ECPT) system via integration with an RGB-D camera. Then, various quantitative measurements and analyses of defects are carried out based on the 3D ECPT system. The ECPT system at Newcastle University has been prooven to be an effective nondestructive testing (NDT) method in surface and sub-surface detection over the past few years. Based on the different numerical or analytical models, it has achieved precise defect detection on the rail tracks, wind turbines, carbon fibre reinforced plastic (CFRP) and so on. The ECPT system has the advantage of fast inspection and a large lift-off range. However, it involves a trade-off between detectable defect size and inspection area compared with other NDT methods. In addition, there are challenges of defect detection in a complex structure. Thus, the quantification of defects gives a higher requirement of the measurement the object geometry information. Furthermore, the analysis of thermal diffusion requires a precise 3D model. For this reason, a 3D ECPT system is proposed that adds each heat pixel with an exact X-Y-Z coordinate. In this work, first, the 3D ECPT system is built. A feature-based automatic calibration of the infrared camera and the RGB-D camera is proposed. Second, the software platform is built. A fast 3D visualization is completed with multi-threading technology and the Point Cloud Library. Lastly, various studies of defect localization, quantification and thermal tomography reconstruction are carried ou

Gaze-Based Human-Robot Interaction by the Brunswick Model

We present a new paradigm for human-robot interaction based on social signal processing, and in particular on the Brunswick model. Originally, the Brunswick model copes with face-to-face dyadic interaction, assuming that the interactants are communicating through a continuous exchange of non verbal social signals, in addition to the spoken messages. Social signals have to be interpreted, thanks to a proper recognition phase that considers visual and audio information. The Brunswick model allows to quantitatively evaluate the quality of the interaction using statistical tools which measure how effective is the recognition phase. In this paper we cast this theory when one of the interactants is a robot; in this case, the recognition phase performed by the robot and the human have to be revised w.r.t. the original model. The model is applied to Berrick, a recent open-source low-cost robotic head platform, where the gazing is the social signal to be considered

Social work with airports passengers

Social work at the airport is in to offer to passengers social services. The main methodological position is that people are under stress, which characterized by a particular set of characteristics in appearance and behavior. In such circumstances passenger attracts in his actions some attention. Only person whom he trusts can help him with the documents or psychologically