Local binary pattern network: a deep learning approach for face recognition

Deep learning is well known as a method to extract hierarchical representations of data. This method has been widely implemented in many fields, including image classification, speech recognition, natural language processing, etc. Over the past decade, deep learning has made a great progress in solving face recognition problems due to its effectiveness. In this thesis a novel deep learning multilayer hierarchy based methodology, named Local Binary Pattern Network (LBPNet), is proposed. Unlike the shallow LBP method, LBPNet performs multi-scale analysis and gains high-level representations from low-level overlapped features in a systematic manner. The LBPNet deep learning network is generated by retaining the topology of Convolutional Neural Network (CNN) and replacing its trainable kernel with the off-the-shelf computer vision descriptor, the LBP descriptor. This enables LBPNet to achieve a high recognition accuracy without requiring costly model learning approach on massive data. LBPNet progressively extracts features from input images from test and training data through multiple processing layers, pairwisely measures the similarity of extracted features in regional level, and then performs the classification based on the aggregated similarity values. Through extensive numerical experiments using the popular benchmarks (i.e., FERET, LFW and YTF), LBPNet has shown the promising results. Its results out-perform (on FERET) or are comparable (on LFW and FERET) to other methods in the same categories, which are single descriptor based unsupervised learning methods on FERET and LFW, and single descriptor based supervise learning methods with image-restricted no outside data settings on LFW and YTF, respectively. --Leaves i-ii.The original print copy of this thesis may be available here: http://wizard.unbc.ca/record=b214095

Study of Computational Image Matching Techniques: Improving Our View of Biomedical Image Data

Image matching techniques are proven to be necessary in various fields of science and engineering, with many new methods and applications introduced over the years. In this PhD thesis, several computational image matching methods are introduced and investigated for improving the analysis of various biomedical image data. These improvements include the use of matching techniques for enhancing visualization of cross-sectional imaging modalities such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), denoising of retinal Optical Coherence Tomography (OCT), and high quality 3D reconstruction of surfaces from Scanning Electron Microscope (SEM) images. This work greatly improves the process of data interpretation of image data with far reaching consequences for basic sciences research. The thesis starts with a general notion of the problem of image matching followed by an overview of the topics covered in the thesis. This is followed by introduction and investigation of several applications of image matching/registration in biomdecial image processing: a) registration-based slice interpolation, b) fast mesh-based deformable image registration and c) use of simultaneous rigid registration and Robust Principal Component Analysis (RPCA) for speckle noise reduction of retinal OCT images. Moving towards a different notion of image matching/correspondence, the problem of view synthesis and 3D reconstruction, with a focus on 3D reconstruction of microscopic samples from 2D images captured by SEM, is considered next. Starting from sparse feature-based matching techniques, an extensive analysis is provided for using several well-known feature detector/descriptor techniques, namely ORB, BRIEF, SURF and SIFT, for the problem of multi-view 3D reconstruction. This chapter contains qualitative and quantitative comparisons in order to reveal the shortcomings of the sparse feature-based techniques. This is followed by introduction of a novel framework using sparse-dense matching/correspondence for high quality 3D reconstruction of SEM images. As will be shown, the proposed framework results in better reconstructions when compared with state-of-the-art sparse-feature based techniques. Even though the proposed framework produces satisfactory results, there is room for improvements. These improvements become more necessary when dealing with higher complexity microscopic samples imaged by SEM as well as in cases with large displacements between corresponding points in micrographs. Therefore, based on the proposed framework, a new approach is proposed for high quality 3D reconstruction of microscopic samples. While in case of having simpler microscopic samples the performance of the two proposed techniques are comparable, the new technique results in more truthful reconstruction of highly complex samples. The thesis is concluded with an overview of the thesis and also pointers regarding future directions of the research using both multi-view and photometric techniques for 3D reconstruction of SEM images

Doctor of Philosophy

dissertationDigital image processing has wide ranging applications in combustion research. The analysis of digital images is used in practically every scale of studying combustion phenomena from the scale of individual atoms to diagnosing and controlling large-scale combustors. Digital image processing is one of the fastest-growing scientific areas in the world today. From being able to reconstruct low-resolution grayscale images from transmitted signals, the capabilities have grown to enabling machines carrying out tasks that would normally require human vision, perception, and reasoning. Certain applications in combustion science benefit greatly from recent advances in image processing. Unfortunately, since the two fields - combustion and image processing research - stand relatively far from each other, the most recent results are often not known well enough in the areas where they may be applied with great benefits. This work aims to improve the accuracy and reliability of certain measurements in combustion science by selecting, adapting, and implementing the appropriate techniques originally developed in the image processing area. A number of specific applications were chosen that cover a wide range of physical scales of combustion phenomena, and specific image processing methodologies were proposed to improve or enable measurements in studying such phenomena. The selected applications include the description and quantification of combustion-derived carbon nanostructure, the three-dimensional optical diagnostics of combusting pulverized-coal particles and the optical flow velocimetry and quantitative radiation imaging of a pilot-scale oxy-coal flame. In the field of the structural analysis of soot, new structural parameters were derived and the extraction and fidelity of existing ones were improved. In the field of pulverized-coal combustion, the developed methodologies allow for studying the detailed mechanisms of particle combustion in three dimensions. At larger scales, the simultaneous measurement of flame velocity, spectral radiation, and pyrometric properties were realized

Physics of Complex Plasmas.

Physics of complex plasmas is a wide and varied field. In the context of this PhD thesis I present the major results from my research on fundamental properties of the plasma sheath, the plasma dust interaction, non-Hamiltonian dynamics, and on non-equilibrium phase transitions, using complex plasmas as a model system. The first chapter provides a short overview of the development of physics of Complex Plasmas. From fundamental plasma physics, properties of dust in plasmas, to the exceptional and unique features of complex plasmas. A summary of twenty years of research topics is also presented. This is followed by three chapters that illustrate publications based on experiments I did during my PhD. These publications, in my opinion, reflect nicely the large diversity of complex plasma research. • The investigation of nonlinear vertical oscillations of a particle in a sheath of an rf discharge was a simultaneous test of (pre-)sheath models and parameters. The nonlinear oscillations were shown to derive from a (strong) nonlinearity of the local sheath potential. They could be described quantitatively applying the theory of anharmonic oscillations, and the first two anharmonic terms in an expansion of the sheath potential were measured. On top of that we provided a simple experimentally, theoretically and mathematically based method that allows for in situ measurement of these coefficients for other experimental conditions. • The vertical pairing of identical particles suspended in the plasma sheath demonstrated some of the unique features that complex plasmas have as an open (non-Hamiltonian) system. Particle interaction becomes non-reciprocal in the presence of streaming ions. The symmetry breaking allows for mode-coupling of in plane and out of plane motion of particles. • Lane formation is a non-equilibrium phase transition. I summarize the main result of my papers on the dynamics of lane formation, i.e., the temporal evolution of lanes. This is followed by an outlook on my future research on non-equilibrium phase transitions, how they relate to our research of systems at the critical point, and how they allow us to test fundamental theories of charging of particles and the shielding of the resulting surface potential. Finally there is an appendix on the scaling index method. A versatile mathematical tool to quantify structural differences / peculiarities in data, that I used to define a suitable order parameter for lane formation

Image Enhancement via Deep Spatial and Temporal Networks

Image enhancement is a classic problem in computer vision and has been studied for decades. It includes various subtasks such as super-resolution, image deblurring, rain removal and denoise. Among these tasks, image deblurring and rain removal have become increasingly active, as they play an important role in many areas such as autonomous driving, video surveillance and mobile applications. In addition, there exists connection between them. For example, blur and rain often degrade images simultaneously, and the performance of their removal rely on the spatial and temporal learning. To help generate sharp images and videos, in this thesis, we propose efficient algorithms based on deep neural networks for solving the problems of image deblurring and rain removal. In the first part of this thesis, we study the problem of image deblurring. Four deep learning based image deblurring methods are proposed. First, for single image deblurring, a new framework is presented which firstly learns how to transfer sharp images to realistic blurry images via a learning-to-blur Generative Adversarial Network (GAN) module, and then trains a learning-to-deblur GAN module to learn how to generate sharp images from blurry versions. In contrast to prior work which solely focuses on learning to deblur, the proposed method learns to realistically synthesize blurring effects using unpaired sharp and blurry images. Second, for video deblurring, spatio-temporal learning and adversarial training methods are used to recover sharp and realistic video frames from input blurry versions. 3D convolutional kernels on the basis of deep residual neural networks are employed to capture better spatio-temporal features, and train the proposed network with both the content loss and adversarial loss to drive the model to generate realistic frames. Third, the problem of extracting sharp image sequences from a single motion-blurred image is tackled. A detail-aware network is presented, which is a cascaded generator to handle the problems of ambiguity, subtle motion and loss of details. Finally, this thesis proposes a level-attention deblurring network, and constructs a new large-scale dataset including images with blur caused by various factors. We use this dataset to evaluate current deep deblurring methods and our proposed method. In the second part of this thesis, we study the problem of image deraining. Three deep learning based image deraining methods are proposed. First, for single image deraining, the problem of joint removal of raindrops and rain streaks is tackled. In contrast to most of prior works which solely focus on the raindrops or rain streaks removal, a dual attention-in-attention model is presented, which removes raindrops and rain streaks simultaneously. Second, for video deraining, a novel end-to-end framework is proposed to obtain the spatial representation, and temporal correlations based on ResNet-based and LSTM-based architectures, respectively. The proposed method can generate multiple deraining frames at a time, which outperforms the state-of-the-art methods in terms of quality and speed. Finally, for stereo image deraining, a deep stereo semantic-aware deraining network is proposed for the first time in computer vision. Different from the previous methods which only learn from pixel-level loss function or monocular information, the proposed network advances image deraining by leveraging semantic information and visual deviation between two views

Deep learning for supernovae detection

In future astronomical sky surveys it will be humanly impossible to classify the tens of thousands of candidate transients detected per night. This thesis explores the potential of using state-of-the-art machine learning algorithms to handle this burden more accurately and quickly than trained astronomers. To this end Deep Learning methods are applied to classify transients using real-world data from the Sloan Digital Sky Survey. Using cutting-edge training techniques several Convolutional Neural networks are trained and hyper-parameters tuned to outperform previous approaches and find that human labelling errors are the primary obstacle to further improvement. The tuning and optimisation of the deep models took in excess of 700 hours on a 4-Titan X GPU cluster

Epileptic Seizures and the EEG

A study of epilepsy from an engineering perspective, this volume begins by summarizing the physiology and the fundamental ideas behind the measurement, analysis and modeling of the epileptic brain. It introduces the EEG and provides an explanation of the type of brain activity likely to register in EEG measurements, offering an overview of how these EEG records are and have been analyzed in the past. The book focuses on the problem of seizure detection and surveys the physiologically based dynamic models of brain activity. Finally, it addresses the fundamental question: can seizures be predicted? Based on the authors' extensive research, the book concludes by exploring a range of future possibilities in seizure prediction

Epileptic Seizures and the EEG

A study of epilepsy from an engineering perspective, this volume begins by summarizing the physiology and the fundamental ideas behind the measurement, analysis and modeling of the epileptic brain. It introduces the EEG and provides an explanation of the type of brain activity likely to register in EEG measurements, offering an overview of how these EEG records are and have been analyzed in the past. The book focuses on the problem of seizure detection and surveys the physiologically based dynamic models of brain activity. Finally, it addresses the fundamental question: can seizures be predicted? Based on the authors' extensive research, the book concludes by exploring a range of future possibilities in seizure prediction

NASA Tech Briefs, October 1995

A special focus in this issue is Data acquisition and analysis. Topics covered include : Electronic Components and Circuits; Electronic Systems; Physical Sciences; Materials; Life Sciences; Mechanics; Machinery; Fabrication Technology; and Mathematics and Information Sciences. Also included in this issue are Laser Tech Briefs and Industry Focus: Motion Control/ Positioning Equipmen