Evaluating Novel Mask-RCNN Architectures for Ear Mask Segmentation

The human ear is generally universal, collectible, distinct, and permanent. Ear-based biometric recognition is a niche and recent approach that is being explored. For any ear-based biometric algorithm to perform well, ear detection and segmentation need to be accurately performed. While significant work has been done in existing literature for bounding boxes, a lack of approaches output a segmentation mask for ears. This paper trains and compares three newer models to the state-of-the-art MaskRCNN (ResNet 101 +FPN) model across four different datasets. The Average Precision (AP) scores reported show that the newer models outperform the state-of-the-art but no one model performs the best over multiple datasets.Comment: Accepted into ICCBS 202

Ear detection with convolutional neural networks

Object detection is still considered a difficult task in the field of computer vision. Specifically, earlobe detection has become a popular application as the interest in human identification using earlobe biometry has increased. So far earlobe detection problem has been solved using a combination of skin detection, edge detection, segmentation by fusion of histogram-based k-means, and template matching algorithms. In this work we present a method of earlobe detection without template matching by using a convolutional neural network, performing image segmentation. With this method, which is invariant to angle at which the photo was taken, earlobe shape, skin color, illumination, occlusions, and earlobe accessories, we were able to accurately detect the area of the image, where an earlobe is present. Moreover, detection time was significantly improved when compared to other methods for solving the same task. We expect our method to be used in Annotated Web Ears Toolbox

Ear detection with convolutional neural networks

Object detection is still considered a difficult task in the field of computer vision. Specifically, earlobe detection has become a popular application as the interest in human identification using earlobe biometry has increased. So far earlobe detection problem has been solved using a combination of skin detection, edge detection, segmentation by fusion of histogram-based k-means, and template matching algorithms. In this work we present a method of earlobe detection without template matching by using a convolutional neural network, performing image segmentation. With this method, which is invariant to angle at which the photo was taken, earlobe shape, skin color, illumination, occlusions, and earlobe accessories, we were able to accurately detect the area of the image, where an earlobe is present. Moreover, detection time was significantly improved when compared to other methods for solving the same task. We expect our method to be used in Annotated Web Ears Toolbox

Biometric Systems

Because of the accelerating progress in biometrics research and the latest nation-state threats to security, this book's publication is not only timely but also much needed. This volume contains seventeen peer-reviewed chapters reporting the state of the art in biometrics research: security issues, signature verification, fingerprint identification, wrist vascular biometrics, ear detection, face detection and identification (including a new survey of face recognition), person re-identification, electrocardiogram (ECT) recognition, and several multi-modal systems. This book will be a valuable resource for graduate students, engineers, and researchers interested in understanding and investigating this important field of study

Large Deformation Diffeomorphic Metric Mapping Provides New Insights into the Link Between Human Ear Morphology and the Head-Related Transfer Functions

The research findings presented in this thesis is composed of four sections. In the first section of this thesis, it is shown how LDDMM can be applied to deforming head and ear shapes in the context of morphoacoustic study. Further, tools are developed to measure differences in 3D shapes using the framework of currents and also to compare and measure the differences between the acoustic responses obtained from BEM simulations for two ear shapes. Finally this section introduces the multi-scale approach for mapping ear shapes using LDDMM. The second section of the thesis estimates a template ear, head and torso shape from the shapes available in the SYMARE database. This part of the thesis explains a new procedure for developing the template ear shape. The template ear and head shapes were are verified by comparing the features in the template shapes to corresponding features in the CIPIC and SYMARE database population. The third section of the thesis examines the quality of the deformations from the template ear shape to target ears in SYMARE from both an acoustic and morphological standpoint. As a result of this investigation, it was identified that ear shapes can be studied more accurately by the use of two physical scales and that scales at which the ear shapes were studied were dependent on the parameters chosen when mapping ears in the LDDMM framework. Finally, this section concludes by noting how shape distances vary with the acoustic distances using the developed tools. In the final part of this thesis, the variations in the morphology of ears are examined using the Kernel Principle Component Analysis (KPCA) and the changes in the corresponding acoustics are studied using the standard principle component analysis (PCA). These examinations involved identifying the number of kernel principle components that are required in order to model ear shapes with an acceptable level of accuracy, both morphologically and acoustically

EQUIPMENT TO ADDRESS INFRASTRUCTURE AND HUMAN RESOURCE CHALLENGES FOR RADIOTHERAPY IN LOW-RESOURCE SETTINGS

Millions of people in low- and middle- income countries (LMICs) are without access to radiation therapy and as rate of population growth in these regions increase and lifestyle factors which are indicative of cancer increase; the cancer burden will only rise. There are a multitude of reasons for lack of access but two themes among them are the lack of access to affordable and reliable teletherapy units and insufficient properly trained staff to deliver high quality care. The purpose of this work was to investigate to two proposed efforts to improve access to radiotherapy in low-resource areas; an upright radiotherapy chair (to facilitate low-cost treatment devices) and a fully automated treatment planning strategy. A fixed-beam patient treatment device would allow for reduced upfront and ongoing cost of teletherapy machines. The enabling technology for such a device is the immobilization chair. A rotating seated patient not only allows for a low-cost fixed treatment machine but also has dosimetric and comfort advantages. We examined the inter- and intra- fraction setup reproducibility, and showed they are less than 3mm, similar to reports for the supine position. The head-and-neck treatment site, one of the most challenging treatment planning, greatly benefits from the use of advanced treatment planning strategies. These strategies, however, require time consuming normal tissue and target contouring and complex plan optimization strategies. An automated treatment planning approach could reduce the additional number of medical physicists (the primary treatment planners) in LMICs by up to half. We used in-house algorithms including mutli-atlas contouring and quality assurance checks, combined with tools in the Eclipse Treatment Planning System®, to automate every step of the treatment planning process for head-and-neck cancers. Requiring only the patient CT scan, patient details including dose and fractionation, and contours of the gross tumor volume, high quality treatment plans can be created in less than 40 minutes

Reconstruction of three-dimensional facial geometric features related to fetal alcohol syndrome using adult surrogates

Fetal alcohol syndrome (FAS) is a condition caused by prenatal alcohol exposure. The diagnosis of FAS is based on the presence of central nervous system impairments, evidence of growth abnormalities and abnormal facial features. Direct anthropometry has traditionally been used to obtain facial data to assess the FAS facial features. Research efforts have focused on indirect anthropometry such as 3D surface imaging systems to collect facial data for facial analysis. However, 3D surface imaging systems are costly. As an alternative, approaches for 3D reconstruction from a single 2D image of the face using a 3D morphable model (3DMM) were explored in this research study. The research project was accomplished in several steps. 3D facial data were obtained from the publicly available BU-3DFE database, developed by the State University of New York. The 3D face scans in the training set were landmarked by different observers. The reliability and precision in selecting 3D landmarks were evaluated. The intraclass correlation coefficients for intra- and inter-observer reliability were greater than 0.95. The average intra-observer error was 0.26 mm and the average inter-observer error was 0.89 mm. A rigid registration was performed on the 3D face scans in the training set. Following rigid registration, a dense point-to-point correspondence across a set of aligned face scans was computed using the Gaussian process model fitting approach. A 3DMM of the face was constructed from the fully registered 3D face scans. The constructed 3DMM of the face was evaluated based on generalization, specificity, and compactness. The quantitative evaluations show that the constructed 3DMM achieves reliable results. 3D face reconstructions from single 2D images were estimated based on the 3DMM. The MetropolisHastings algorithm was used to fit the 3DMM features to 2D image features to generate the 3D face reconstruction. Finally, the geometric accuracy of the reconstructed 3D faces was evaluated based on ground-truth 3D face scans. The average root mean square error for the surface-to-surface comparisons between the reconstructed faces and the ground-truth face scans was 2.99 mm. In conclusion, a framework to estimate 3D face reconstructions from single 2D facial images was developed and the reconstruction errors were evaluated. The geometric accuracy of the 3D face reconstructions was comparable to that found in the literature. However, future work should consider minimizing reconstruction errors to acceptable clinical standards in order for the framework to be useful for 3D-from-2D reconstruction in general, and also for developing FAS applications. Finally, future work should consider estimating a 3D face using multi-view 2D images to increase the information available for 3D-from-2D reconstruction

Machine Learning towards General Medical Image Segmentation

The quality of patient care associated with diagnostic radiology is proportionate to a physician\u27s workload. Segmentation is a fundamental limiting precursor to diagnostic and therapeutic procedures. Advances in machine learning aims to increase diagnostic efficiency to replace single applications with generalized algorithms. We approached segmentation as a multitask shape regression problem, simultaneously predicting coordinates on an object\u27s contour while jointly capturing global shape information. Shape regression models inherent point correlations to recover ambiguous boundaries not supported by clear edges and region homogeneity. Its capabilities was investigated using multi-output support vector regression (MSVR) on head and neck (HaN) CT images. Subsequently, we incorporated multiplane and multimodality spinal images and presented the first deep learning multiapplication framework for shape regression, the holistic multitask regression network (HMR-Net). MSVR and HMR-Net\u27s performance were comparable or superior to state-of-the-art algorithms. Multiapplication frameworks bridges any technical knowledge gaps and increases workflow efficiency