Recognizing Visual Object Using Machine Learning Techniques

Nowadays, Visual Object Recognition (VOR) has received growing interest from researchers and it has become a very active area of research due to its vital applications including handwriting recognition, diseases classification, face identification ..etc. However, extracting the relevant features that faithfully describe the image represents the challenge of most existing VOR systems. This thesis is mainly dedicated to the development of two VOR systems, which are presented in two different contributions. As a first contribution, we propose a novel generic feature-independent pyramid multilevel (GFIPML) model for extracting features from images. GFIPML addresses the shortcomings of two existing schemes namely multi-level (ML) and pyramid multi-level (PML), while also taking advantage of their pros. As its name indicates, the proposed model can be used by any kind of the large variety of existing features extraction methods. We applied GFIPML for the task of Arabic literal amount recognition. Indeed, this task is challenging due to the specific characteristics of Arabic handwriting. While most literary works have considered structural features that are sensitive to word deformations, we opt for using Local Phase Quantization (LPQ) and Binarized Statistical Image Feature (BSIF) as Arabic handwriting can be considered as texture. To further enhance the recognition yields, we considered a multimodal system based on the combination of LPQ with multiple BSIF descriptors, each one with a different filter size. As a second contribution, a novel simple yet effcient, and speedy TR-ICANet model for extracting features from unconstrained ear images is proposed. To get rid of unconstrained conditions (e.g., scale and pose variations), we suggested first normalizing all images using CNN. The normalized images are fed then to the TR-ICANet model, which uses ICA to learn filters. A binary hashing and block-wise histogramming are used then to compute the local features. At the final stage of TR-ICANet, we proposed to use an effective normalization method namely Tied Rank normalization in order to eliminate the disparity within blockwise feature vectors. Furthermore, to improve the identification performance of the proposed system, we proposed a softmax average fusing of CNN-based feature extraction approaches with our proposed TR-ICANet at the decision level using SVM classifier

Contributions to non-conventional biometric systems : improvements on the fingerprint, facial and handwriting recognition approach

Tese (doutorado)—Universidade de Brasília, Faculdade de Tecnologia, Departamento de Engenharia Mecânica, 2021.Os sistemas biométricos são amplamente utilizados pela sociedade. A maioria das aplicações desses sistemas está associada à identificação civil e à investigação criminal. No entanto, com o tempo, o desempenho dos métodos tradicionais de biometria está chegando ao limite. Neste contexto, sistemas biométricos emergentes ou não convencionais estão ganhando importância. Embora promissores, novos sistemas, assim como qualquer nova tecnologia, trazem consigo não apenas potencialidades, mas também fragilidades. Este trabalho apresenta contribuições para três importantes sistemas biométricos não convencionais (SBNC): impressão digital, reconhecimento facial e reconhecimento de escrita. No que diz respeito às impressões digitais, este trabalho apresenta um novo método para detectar a vida em dispositivos de impressão digital multivista sem toque, utilizando descritores de textura e redes neurais artificiais. Com relação ao reconhecimento facial, um método de reconhecimento de faces baseado em algoritmos de característica invariante à escala (SIFT e SURF) que opera sem a necessidade de treinamento prévio do classificador e que realiza o rastreamento de indivíduos em ambientes não controlados é apresentado. Finalmente, um método de baixo custo que usa sinais de acelerômetro e giroscópio obtidos a partir de um sensor acoplado a canetas convencionais para realizar o reconhecimento em tempo real de assinaturas é apresentado. Resultados mostram que os métodos propostos são promissores e que juntos podem contribuir para o aprimoramento dos SBNCCoordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES).Biometric systems are widely used by society. Most applications are associated with civil identification and criminal investigation. However, over time, traditional methods of performing biometrics have been reaching their limits. In this context, emerging or nonconventional biometric systems (NCBS) are gaining ground. Although promising, new systems, as well as any new technology, bring not only potentialities but also weaknesses. This work presents contributions to three important non-conventional biometric systems: fingerprint, facial, and handwriting recognition. With regard to fingerprints, this work presents a novel method for detecting life on Touchless Multi-view Fingerprint Devices, using Texture Descriptors and Artificial Neural Networks. With regard to face recognition, a facial recognition method is presented, based on Scale Invariant Feature Algorithms (SIFT and SURF), that operates without the need of previous training of a classifier and can be used to track individuals in an unconstrained environment. Finally, a low-cost on-line handwriting signature recognition method that uses accelerometer and gyroscope signals obtained from a sensor coupled to conventional pens to identify individuals in real time is presented. Results show that the proposed methods are promising and that together may contribute to the improvement of the NCB

Handwriting processes when spelling morphologically complex words in children with and without Developmental Language Disorder

INTRODUCTION: Representations activated during handwriting production code information on morphological structure and reflect decomposition of the root and suffix. Children with Developmental Language Disorder (DLD) have significant difficulties in spelling morphologically complex words, but previous research has not sought evidence for a morphological decomposition effect via an examination of handwriting processes in this population. METHOD: Thirty-three children aged 9-10 years with DLD, 33 children matched for chronological age (CA), and 33 younger children aged 7-8 years matched for oral language ability (LA) completed a dictated spelling task (21 words; 12 with inflectional suffixes, nine with derivational suffixes). The task was completed on paper with an inking pen linked to a graphics tablet running the handwriting software Eye and Pen. Pause analyses and letter duration analyses were conducted. RESULTS: The three groups showed similar handwriting processes, evidencing a morphological decomposition effect in a natural writing task. Pause durations observed at the root/suffix boundary were significantly longer than those occurring in the root. Letter durations were also significantly longer for the letter immediately prior to the boundary compared to the letter after it. Nevertheless, despite being commensurate to their LA matches for mean pause durations and letter durations, children with DLD were significantly poorer at spelling derivational morphemes. Handwriting processes did significantly predict spelling accuracy but to a much lesser extent compared to reading ability. DISCUSSION: It is suggested that derivational spelling difficulties in DLD may derive more from problems with underspecified orthographic representations as opposed to handwriting processing differences

Effects of Interpretation Error on User Learning in Novel Input Mechanisms

Novel input mechanisms generate signals that are interpreted as commands in computer systems. Sometimes noise from various sources can cause the system to produce errors when attempting to interpret the signal, causing a misrepresentation of the user's intention. While research has been done in understanding how these interpretation errors affect the performance of users of novel signal-based input mechanisms, such as a brain-computer interface (BCI), there is a lack of knowledge in how user learning is affected. Previous literature in command-based selection tasks has suggested that errors will have a negative impact on expertise development; however, the presence of errors could conversely improve a user's learning by demanding more attention from the user. This thesis begins by studying people's ability to use a novel input mechanism with a noisy input signal: a motor imagery BCI. By converting a user's brain signals into computer commands, a user could complete selection tasks using imagined movement. However, the high degree of interpretation errors caused by noise in the input signals made it difficult to differentiate the user's intent from the noise. As such, the results of the BCI study served as motivation to test the effects of interpretation errors on user learning. Two studies were conducted to determine how user performance and learning were affected by different rates of interpretation error in a novel input mechanism. The results from these two studies showed that interpretation errors led to slower task completion times, lower accuracy in memory recall, greater rates of user errors, and increased frustration. This new knowledge about the effects of interpretation errors can contribute to better design of input mechanisms and training programs for novel input systems

Character Recognition

Character recognition is one of the pattern recognition technologies that are most widely used in practical applications. This book presents recent advances that are relevant to character recognition, from technical topics such as image processing, feature extraction or classification, to new applications including human-computer interfaces. The goal of this book is to provide a reference source for academic research and for professionals working in the character recognition field

How effective is fine motor training in children with ADHD? : a scoping review

Background: Motor deficiencies are observed in a large number of children with ADHD. Especially fine motor impairments can lead to academic underachievement, low self-esteem and frustration in affected children. Despite these far-reaching consequences, fine motor deficiencies have remained widely undertreated in the ADHD population. The aim of this review was to systematically map the evidence on existing training programs for remediating fine motor impairments in children with ADHD and to assess their effectiveness. Methods: The scoping review followed the PRISMA-ScR guidelines. In March 2020, PsycINFO, MEDLINE (PubMed), Web of Science, Google Scholar and The Cochrane Database of Systematic Reviews were searched for evidence. The eligibility criteria and the data charting process followed the PICO framework, complemented by study design. The investigated population included children with a formal ADHD diagnosis (either subtype) or elevated ADHD symptoms aged between 4 and 12 years, both on and off medication. All training interventions aiming at improving fine motor skills, having a fine motor component or fine motor improvements as a secondary outcome were assessed for eligibility; no comparators were specified. Results: Twelve articles were included in the final report, comprising observational and experimental studies as well as a review. Both offline and online or virtual training interventions were reported, often accompanied by physical activity and supplemented by training sessions at home. The training programs varied in length and intensity, but generally comprised several weeks and single or multiple training sessions per week. All interventions including more than one session were effective in the treatment of fine motor deficiencies in children with ADHD and had a wide range of additional positive outcomes. The effects could be maintained at follow-up. Conclusions: Fine motor training in children with ADHD can be very effective and multiple approaches including specific fine motor and cognitive training components, some kind of physical activity, feedback mechanisms, or multimodal treatments can be successful. Training programs need to be tailored to the specific characteristics of the ADHD population. A mHealth approach using serious games could be promising in this context due to its strong motivational components

Touch-screen Behavioural Biometrics on Mobile Devices

Robust user verification on mobile devices is one of the top priorities globally from a financial security and privacy viewpoint and has led to biometric verification complementing or replacing PIN and password methods. Research has shown that behavioural biometric methods, with their promise of improved security due to inimitable nature and the lure of unintrusive, implicit, continuous verification, could define the future of privacy and cyber security in an increasingly mobile world. Considering the real-life nature of problems relating to mobility, this study aims to determine the impact of user interaction factors that affect verification performance and usability for behavioural biometric modalities on mobile devices. Building on existing work on biometric performance assessments, it asks: To what extent does the biometric performance remain stable when faced with movements or change of environment, over time and other device related factors influencing usage of mobile devices in real-life applications? Further it seeks to provide answers to: What could further improve the performance for behavioural biometric modalities? Based on a review of the literature, a series of experiments were executed to collect a dataset consisting of touch dynamics based behavioural data mirroring various real-life usage scenarios of a mobile device. Responses were analysed using various uni-modal and multi-modal frameworks. Analysis demonstrated that existing verification methods using touch modalities of swipes, signatures and keystroke dynamics adapt poorly when faced with a variety of usage scenarios and have challenges related to time persistence. The results indicate that a multi-modal solution does have a positive impact towards improving the verification performance. On this basis, it is recommended to explore alternatives in the form of dynamic, variable thresholds and smarter template selection strategy which hold promise. We believe that the evaluation results presented in this thesis will streamline development of future solutions for improving the security of behavioural-based modalities on mobile biometrics