Adaptive threshold optimisation for colour-based lip segmentation in automatic lip-reading systems

A thesis submitted to the Faculty of Engineering and the Built Environment, University of the Witwatersrand, Johannesburg, in ful lment of the requirements for the degree of Doctor of Philosophy. Johannesburg, September 2016Having survived the ordeal of a laryngectomy, the patient must come to terms with the resulting loss of speech. With recent advances in portable computing power, automatic lip-reading (ALR) may become a viable approach to voice restoration. This thesis addresses the image processing aspect of ALR, and focuses three contributions to colour-based lip segmentation. The rst contribution concerns the colour transform to enhance the contrast between the lips and skin. This thesis presents the most comprehensive study to date by measuring the overlap between lip and skin histograms for 33 di erent colour transforms. The hue component of HSV obtains the lowest overlap of 6:15%, and results show that selecting the correct transform can increase the segmentation accuracy by up to three times. The second contribution is the development of a new lip segmentation algorithm that utilises the best colour transforms from the comparative study. The algorithm is tested on 895 images and achieves percentage overlap (OL) of 92:23% and segmentation error (SE) of 7:39 %. The third contribution focuses on the impact of the histogram threshold on the segmentation accuracy, and introduces a novel technique called Adaptive Threshold Optimisation (ATO) to select a better threshold value. The rst stage of ATO incorporates -SVR to train the lip shape model. ATO then uses feedback of shape information to validate and optimise the threshold. After applying ATO, the SE decreases from 7:65% to 6:50%, corresponding to an absolute improvement of 1:15 pp or relative improvement of 15:1%. While this thesis concerns lip segmentation in particular, ATO is a threshold selection technique that can be used in various segmentation applications.MT201

Character Recognition

Character recognition is one of the pattern recognition technologies that are most widely used in practical applications. This book presents recent advances that are relevant to character recognition, from technical topics such as image processing, feature extraction or classification, to new applications including human-computer interfaces. The goal of this book is to provide a reference source for academic research and for professionals working in the character recognition field

An investigation of the breast cancer classification using various machine learning techniques

It is an extremely cumbersome process to predict a disease based on the visual diagnosis of cell type with precision or accuracy, especially when multiple features are associated. Cancer is one such example where the phenomenon is very complex and also multiple features of cell types are involved. Breast cancer is a disease mostly affects female population and the number of affected people is highest among all cancer types in India. In the present investigation, various pattern recognition techniques were used for the classification of breast cancer using cell image processing. Under these pattern recognition techniques, cell image segmentation, texture based image feature extraction and subsequent classification of breast cancer cells was successfully performed. When four different machine learning techniques: Kth nearest neighbor (KNN), Artificial Neural Network ( ANN), Support Vector Machine (SVM) and Least Square Support Vector Machine (LS-SVM) was used to classify 81 cell images, it was observed from the results that the LS-SVM with both Radial Basis Function (RBF) and linear kernel classifiers demonstrated the highest classification rate of 95.3488% among four other classifiers while SVM with linear kernel resulted a classification rate of 93.02% which was close to LSSVM classifier. Thus, it was demonstrated that the LS-SVM classifier showed accuracy higher than other classifiers reported so far. Moreover, our classifier can classify the disease in a short period of time using only cell images unlike other approaches reported so far

Automatic image characterization of psoriasis lesions

Psoriasis is a chronic skin disease that affects 125 million people worldwide and, particularly, 2% of the Spanish population, characterized by the appearance of skin lesions due to a growth of the epidermis that is seven times larger than usual. Its diagnosis and monitoring are based on the use of methodologies for measuring the severity and extent of these spots, and this includes a large subjective component. For this reason, this paper presents an automatic method for characterizing psoriasis images that is divided into four parts: image preparation or pre-processing, feature extraction, classification of the lesions, and the obtaining of parameters. The methodology proposed in this work covers different digital-image processing techniques, namely, marker-based image delimitation, hair removal, nipple detection, lesion contour detection, areal-measurement-based lesion classification, as well as lesion characterization by means of red and white intensity. The results obtained were also endorsed by a professional dermatologist. This methodology provides professionals with a common software tool for monitoring the different existing typologies, which proved satisfactory in the cases analyzed for a set of 20 images corresponding to different types of lesions.Ministerio de Economía, Industria y Competitividad | Ref. TIN2016-76770-

Soft computing applied to optimization, computer vision and medicine

Artificial intelligence has permeated almost every area of life in modern society, and its significance continues to grow. As a result, in recent years, Soft Computing has emerged as a powerful set of methodologies that propose innovative and robust solutions to a variety of complex problems. Soft Computing methods, because of their broad range of application, have the potential to significantly improve human living conditions. The motivation for the present research emerged from this background and possibility. This research aims to accomplish two main objectives: On the one hand, it endeavors to bridge the gap between Soft Computing techniques and their application to intricate problems. On the other hand, it explores the hypothetical benefits of Soft Computing methodologies as novel effective tools for such problems. This thesis synthesizes the results of extensive research on Soft Computing methods and their applications to optimization, Computer Vision, and medicine. This work is composed of several individual projects, which employ classical and new optimization algorithms. The manuscript presented here intends to provide an overview of the different aspects of Soft Computing methods in order to enable the reader to reach a global understanding of the field. Therefore, this document is assembled as a monograph that summarizes the outcomes of these projects across 12 chapters. The chapters are structured so that they can be read independently. The key focus of this work is the application and design of Soft Computing approaches for solving problems in the following: Block Matching, Pattern Detection, Thresholding, Corner Detection, Template Matching, Circle Detection, Color Segmentation, Leukocyte Detection, and Breast Thermogram Analysis. One of the outcomes presented in this thesis involves the development of two evolutionary approaches for global optimization. These were tested over complex benchmark datasets and showed promising results, thus opening the debate for future applications. Moreover, the applications for Computer Vision and medicine presented in this work have highlighted the utility of different Soft Computing methodologies in the solution of problems in such subjects. A milestone in this area is the translation of the Computer Vision and medical issues into optimization problems. Additionally, this work also strives to provide tools for combating public health issues by expanding the concepts to automated detection and diagnosis aid for pathologies such as Leukemia and breast cancer. The application of Soft Computing techniques in this field has attracted great interest worldwide due to the exponential growth of these diseases. Lastly, the use of Fuzzy Logic, Artificial Neural Networks, and Expert Systems in many everyday domestic appliances, such as washing machines, cookers, and refrigerators is now a reality. Many other industrial and commercial applications of Soft Computing have also been integrated into everyday use, and this is expected to increase within the next decade. Therefore, the research conducted here contributes an important piece for expanding these developments. The applications presented in this work are intended to serve as technological tools that can then be used in the development of new devices

Contributions to the segmentation of dermoscopic images

Tese de mestrado. Mestrado em Engenharia Biomédica. Faculdade de Engenharia. Universidade do Porto. 201

Machine learned boundary definitions for an expert's tracing assistant in image processing

Department Head: Anton Willem Bohm.Includes bibliographical references (pages 178-184).Most image processing work addressing boundary definition tasks embeds the assumption that an edge in an image corresponds to the boundary of interest in the world. In straightforward imagery this is true, however it is not always the case. There are images in which edges are indistinct or obscure, and these images can only be segmented by a human expert. The work in this dissertation addresses the range of imagery between the two extremes of those straightforward images and those requiring human guidance to appropriately segment. By freeing systems of a priori edge definitions and building in a mechanism to learn the boundary definitions needed, systems can do better and be more broadly applicable. This dissertation presents the construction of such a boundary-learning system and demonstrates the validity of this premise on real data. A framework was created for the task in which expert-provided boundary exemplars are used to create training data, which in turn are used by a neural network to learn the task and replicate the expert's boundary tracing behavior. This is the framework for the Expert's Tracing Assistant (ETA) system. For a representative set of nine structures in the Visible Human imagery, ETA was compared and contrasted to two state-of-the-art, user guided methods--Intelligent Scissors (IS) and Active Contour Models (ACM). Each method was used to define a boundary, and the distances between these boundaries and an expert's ground truth were compared. Across independent trials, there will be a natural variation in an expert's boundary tracing, and this degree of variation served as a benchmark against which these three methods were compared. For simple structural boundaries, all the methods were equivalent. However, in more difficult cases, ETA was shown to significantly better replicate the expert's boundary than either IS or ACM. In these cases, where the expert's judgement was most called into play to bound the structure, ACM and IS could not adapt to the boundary character used by the expert while ETA could

Automatic image characterization of psoriasis lesions

Psoriasis is a chronic skin disease that affects 125 million people worldwide and, par-ticularly, 2% of the Spanish population, characterized by the appearance of skin lesions due to a growth of the epidermis that is seven times larger than usual. Its diagnosis and monitoring are based on the use of methodologies for measuring the severity and extent of these spots, and this includes a large subjective component. For this reason, this paper presents an automatic method for characterizing psoriasis images that is divided into four parts: image preparation or pre-processing, feature extraction, classification of the lesions, and the obtaining of parameters. The methodology proposed in this work covers different digital-image processing techniques, namely, marker-based image delimitation, hair removal, nipple detection, lesion contour detection, areal-measurement-based lesion classification, as well as lesion characterization by means of red and white intensity. The results obtained were also endorsed by a professional dermatologist. This methodology provides professionals with a common software tool for monitoring the different existing typologies, which proved satisfactory in the cases analyzed for a set of 20 images corresponding to different types of lesions

Texture and Colour in Image Analysis

Research in colour and texture has experienced major changes in the last few years. This book presents some recent advances in the field, specifically in the theory and applications of colour texture analysis. This volume also features benchmarks, comparative evaluations and reviews