Towards Learning Representations in Visual Computing Tasks

abstract: The performance of most of the visual computing tasks depends on the quality of the features extracted from the raw data. Insightful feature representation increases the performance of many learning algorithms by exposing the underlying explanatory factors of the output for the unobserved input. A good representation should also handle anomalies in the data such as missing samples and noisy input caused by the undesired, external factors of variation. It should also reduce the data redundancy. Over the years, many feature extraction processes have been invented to produce good representations of raw images and videos. The feature extraction processes can be categorized into three groups. The first group contains processes that are hand-crafted for a specific task. Hand-engineering features requires the knowledge of domain experts and manual labor. However, the feature extraction process is interpretable and explainable. Next group contains the latent-feature extraction processes. While the original feature lies in a high-dimensional space, the relevant factors for a task often lie on a lower dimensional manifold. The latent-feature extraction employs hidden variables to expose the underlying data properties that cannot be directly measured from the input. Latent features seek a specific structure such as sparsity or low-rank into the derived representation through sophisticated optimization techniques. The last category is that of deep features. These are obtained by passing raw input data with minimal pre-processing through a deep network. Its parameters are computed by iteratively minimizing a task-based loss. In this dissertation, I present four pieces of work where I create and learn suitable data representations. The first task employs hand-crafted features to perform clinically-relevant retrieval of diabetic retinopathy images. The second task uses latent features to perform content-adaptive image enhancement. The third task ranks a pair of images based on their aestheticism. The goal of the last task is to capture localized image artifacts in small datasets with patch-level labels. For both these tasks, I propose novel deep architectures and show significant improvement over the previous state-of-art approaches. A suitable combination of feature representations augmented with an appropriate learning approach can increase performance for most visual computing tasks.Dissertation/ThesisDoctoral Dissertation Computer Science 201

A clinically motivated self-supervised approach for content-based image retrieval of CT liver images

Deep learning-based approaches for content-based image retrieval (CBIR) of computed tomography (CT) liver images is an active field of research, but suffer from some critical limitations. First, they are heavily reliant on labeled data, which can be challenging and costly to acquire. Second, they lack transparency and explainability, which limits the trustworthiness of deep CBIR systems. We address these limitations by: (1) Proposing a self-supervised learning framework that incorporates domain-knowledge into the training procedure, and, (2) by providing the first representation learning explainability analysis in the context of CBIR of CT liver images. Results demonstrate improved performance compared to the standard self-supervised approach across several metrics, as well as improved generalization across datasets. Further, we conduct the first representation learning explainability analysis in the context of CBIR, which reveals new insights into the feature extraction process. Lastly, we perform a case study with cross-examination CBIR that demonstrates the usability of our proposed framework. We believe that our proposed framework could play a vital role in creating trustworthy deep CBIR systems that can successfully take advantage of unlabeled data

Novel Image Representations and Learning Tasks

abstract: Computer Vision as a eld has gone through signicant changes in the last decade. The eld has seen tremendous success in designing learning systems with hand-crafted features and in using representation learning to extract better features. In this dissertation some novel approaches to representation learning and task learning are studied. Multiple-instance learning which is generalization of supervised learning, is one example of task learning that is discussed. In particular, a novel non-parametric k- NN-based multiple-instance learning is proposed, which is shown to outperform other existing approaches. This solution is applied to a diabetic retinopathy pathology detection problem eectively. In cases of representation learning, generality of neural features are investigated rst. This investigation leads to some critical understanding and results in feature generality among datasets. The possibility of learning from a mentor network instead of from labels is then investigated. Distillation of dark knowledge is used to eciently mentor a small network from a pre-trained large mentor network. These studies help in understanding representation learning with smaller and compressed networks.Dissertation/ThesisDoctoral Dissertation Computer Science 201

Psychiatric Case Record

Bipolar Disorder-Mania: Patient was apparently normal one-month back, Then all of a sudden he developed sleep disturbances –mainly difficult in initiation of sleep. He also started abusing his family members for unwanted things. Subsequently, he started talking excessively and irritable. Sometimes he sings film songs and dances. He used to say that God Supreme exists in himself and so he has all the powers of Almighty. With that superior power he says that he can solve all the problems in this world. He also says that he has invented herbs to keep people young. For the past one week, he talks excessively without having an hour of sleep & wanders here and there & found excessively smoking. He becomes excessively spiritual and goes to near by villages for offering prayers to God. He takes only a little food everyday and he is very much keen in personal cleanliness. Paranoid Schizophrenia: She was apparently normal 8 months back, then she developed sleep disturbances in the form of difficult in falling asleep. She was found talking & smiling to herself at night & day with mirror gazing. She started saying that her neighbour & relatives are planning to kill herself by poisoning. In this context she had frequent quarrels with them and she refused to take food prepared by her mother in law. She left the home at night without informing any one and started wandering in the road side near her home. She was complaining that she hears voices as if her neighbour & relatives were talking about her among themselves She was not doing house hold activities for past 6 months and she was not taking care of her child. Her personal hygiene was very much deteriorated slowly as she used to take bath & brush, only if she was asked to do so. She started abusing & assaulting the strangers and family members. Generalised Anxiety Disorder: Six months back he was apparently normal. He is working as a system analyst in a private bank . He had once, made a mistake in his bank work for which he was given charges by his employer, followed this event he becomes very tense and afraid whenever his boss called him. He is very cautious that he should not commit any mistakes. Even though he is not doing so, he fears that he may commit some mistake in his work. At that moment he develops palpitation, giddiness, breathlessness, excessive sweating over palms and soles. Slowly these symptoms present through out the day even when he was not in his office, and he could not control his fearfulness. For the past 6 months he didn’t sleep well. His sleep is disturbed by bad dreams. Recurrent Depressive Disorder: Patient was apparently alright 2 months back. Then she developed sleep disturbances particularly early morning awakening, she use to wake up by 3.00 am and use to brood about herself and started crying. She was not doing her domestic work as before, as she felt excess tiredness and use to take frequent rests. She developed poor communication. She had lost her interest in pleasurable activities and was not interested in watching TV, and attending family gatherings. She stayed aloof most of the time & calm, quiet and withdrawn. She was expressing her helplessness and hopelessness about the future. She started to have decline in maintaining self care. 15 days back, she frequently expressed suicidal ideas and she had attempted suicide by hanging herself and was rescued by neighbours. 5 days back, she started talking in an irrelevant manner. She was smiling to self. She was assaulting her family members. She was suspicious that her neighbour had done black magic on her and also saying that people are talking about her. She reported hearing the voice of her neighbour scolding and threatening her. Organic Brain Syndrome – Dementia: Ten months back he was apparently alright. Then his relatives noticed himself frequently misplaces things inside his home. Then he started behaving aggressively. He was beating his wife without reason. He was roaming here and there, running out of home and wandering aimlessly. He was not able to come back home when he goes out. He was brought back to home by his relatives. Slowly he developed fearfulness and tremulousness while he was staying alone. He also started saying that his family members & neighbours were talking about himself, in this context he would make frequent quarrels with them. He also started hearing voices of known male voices abusing himself in third person. He sleeps for few hour only. He is passing urine and motion inside the house. He is asking about his brother and mother-in-law who were expired long back. He behaves abnormally such as pouring water in the plate while eating. And his relatives found the symptoms were worsened by evening. All these symptoms started insidiously, increased in severity through time and attained the present state. No history of loss of appetite / crying spells / suicidal tendencies / convulsions / fever / head injury

Visual Impairment and Blindness

Blindness and vision impairment affect at least 2.2 billion people worldwide with most individuals having a preventable vision impairment. The majority of people with vision impairment are older than 50 years, however, vision loss can affect people of all ages. Reduced eyesight can have major and long-lasting effects on all aspects of life, including daily personal activities, interacting with the community, school and work opportunities, and the ability to access public services. This book provides an overview of the effects of blindness and visual impairment in the context of the most common causes of blindness in older adults as well as children, including retinal disorders, cataracts, glaucoma, and macular or corneal degeneration

COHORT IDENTIFICATION FROM FREE-TEXT CLINICAL NOTES USING SNOMED CT’S SEMANTIC RELATIONS

In this paper, a new cohort identification framework that exploits the semantic hierarchy of SNOMED CT is proposed to overcome the limitations of supervised machine learning-based approaches. Eligibility criteria descriptions and free-text clinical notes from the 2018 National NLP Clinical Challenge (n2c2) were processed to map to relevant SNOMED CT concepts and to measure semantic similarity between the eligibility criteria and patients. The eligibility of a patient was determined if the patient had a similarity score higher than a threshold cut-off value, which was established where the best F1 score could be achieved. The performance of the proposed system was evaluated for three eligibility criteria. The current framework’s macro-average F1 score across three eligibility criteria was higher than the previously reported results of the 2018 n2c2 (0.933 vs. 0.889). This study demonstrated that SNOMED CT alone can be leveraged for cohort identification tasks without referring to external textual sources for training.Doctor of Philosoph

Quality of care in incident type 2 diabetes and initial presentation of vascular complications: Prospective cohort study using linked electronic health records from CALIBER research platform

Background. Numbers of new cases of type 2 diabetes (T2D) are increasing rapidly. Early and continuing intervention after T2D presentation is crucial for best possible outcomes, ensuring that the existing high burden of T2D will not be aggravated. Identification of patterns of continuous care and predictors for meeting key targets for T2D management can improve quality of care. Glycaemic control is particularly important for primary prevention of vascular complications but its relationship with contemporary cardiovascular diseases (CVDs) has been less explored. More importantly, long-term glycaemic control can be assessed from routine monitoring, potentially providing new insight into T2D management to prevent vascular complications. Linked electronic health records are invaluable data resources for investigating these issues. Objective. To examine the quality of care in an incident T2D cohort through assessment of temporal trends of care, predictors of glycaemic, blood pressure and lipid control, and associations of short-term and long-term glycaemic control with chronic vascular complications. Methods. The data source for studies in this thesis was CALIBER which links electronic health records from primary care, hospitalisation, myocardial infarction and mortality registries. Patients newly diagnosed with T2D between 1998 and 2010 were followed-up until a censoring administrative date or initial occurrence of vascular complications. Trends in receipt of care and attainment of glycaemic, blood pressure and total cholesterol targets were examined. Predictors for meeting the targets were explored using multinomial logistic regressions. Association of early glycaemic control with a range of specific cardiovascular complications were investigated using Cox regressions. A longitudinal metric for glycaemic control was developed by quantifying time spent at target during follow-up and was tested for its association with cardiovascular and microvascular outcomes using mixed logistic regressions. Results. A total of 52,379 incident T2D patients were identified with a median follow-up of over 4 years. Positive trends were observed for blood pressure and total cholesterol control, but not for glycaemic control, whilst attainment of HbA1c and blood pressure targets over time consistently fell short. Older age at diagnosis was an important predictor for meeting the key targets. In 36,149 patients free from prior CVD, early glycaemic and blood pressure control was associated with lower risk for heart failure and peripheral arterial disease, whereas cholesterol control with myocardial infarction and transient ischaemic attack. Shorter duration at glycaemic target was associated with higher risk of major adverse cardiovascular events, cardiovascular death and diabetic retinopathy. Conclusions. This thesis highlights missed opportunities and inequality in T2D care. Both short-term and long-term glycaemic control are important for reducing risk of vascular complications. Limitations and implications of the findings for clinical practice and research were discussed

Mobile Health Technologies

Mobile Health Technologies, also known as mHealth technologies, have emerged, amongst healthcare providers, as the ultimate Technologies-of-Choice for the 21st century in delivering not only transformative change in healthcare delivery, but also critical health information to different communities of practice in integrated healthcare information systems. mHealth technologies nurture seamless platforms and pragmatic tools for managing pertinent health information across the continuum of different healthcare providers. mHealth technologies commonly utilize mobile medical devices, monitoring and wireless devices, and/or telemedicine in healthcare delivery and health research. Today, mHealth technologies provide opportunities to record and monitor conditions of patients with chronic diseases such as asthma, Chronic Obstructive Pulmonary Diseases (COPD) and diabetes mellitus. The intent of this book is to enlighten readers about the theories and applications of mHealth technologies in the healthcare domain

Type two diabetes and eye health

This thesis contributes to the understanding of how people with Type 2 Diabetes (T2D) negotiate self-care and management of diabetes and eye health. The study aims to deliver an Enhanced Diabetic Optometric Practice (EDOP) which involves a graphic portrayal of diabetic retinopathy, as it manifests itself in the eye and in the patient’s own eyes, whereby retinal images will be discussed within a normal optometric practice environment. This PhD research study used the qualitative method of thematic and Foucauldian discourse analysis (FDA) to investigate if an EDOP is able to heighten the participant’s concern of sight loss and thus lead to better diabetic control, and improved self-motivation and management. The research progressed in three stages; Study (1) A systematic review and meta-synthesis of qualitative research investigating the barriers to self-care for people with T2D, Study (2) A qualitative analysis of diabetes self-help literature and eye health, and Study (3) Evaluation of an Enhanced Diabetic Optometric Practice (EDOP). A review of the literature evaluates research in the field of optometry and ophthalmology with regard to the use of retinal images for educating people with T2D about their diabetes and the ocular complications. The findings of the three studies revealed, valuable insight into the barriers and constraints to self-care that people with T2D routinely face, enabling greater understanding of how to facilitate effective diabetes self-management Study (1). Study (2) discerned that self-help texts cannot facilitate the empowerment of people with diabetes who aspire to selfregulation, as they are constrained by the dominant compliant discourse of the expert-patient relationship. Finally, in Study (3) EDOP, optometrists can provide an enhanced optometric service, educating and motivating people with T2D to better self-care practices. This thesis concludes that the optometrist, by way of the EDOP and the pertinent threat of sight loss can assist people with T2D to gain the confidence to apply the skills to effective self-management and so prevent blindness

Opportunities and obstacles for deep learning in biology and medicine

Deep learning describes a class of machine learning algorithms that are capable of combining raw inputs into layers of intermediate features. These algorithms have recently shown impressive results across a variety of domains. Biology and medicine are data-rich disciplines, but the data are complex and often ill-understood. Hence, deep learning techniques may be particularly well suited to solve problems of these fields. We examine applications of deep learning to a variety of biomedical problems-patient classification, fundamental biological processes and treatment of patients-and discuss whether deep learning will be able to transform these tasks or if the biomedical sphere poses unique challenges. Following from an extensive literature review, we find that deep learning has yet to revolutionize biomedicine or definitively resolve any of the most pressing challenges in the field, but promising advances have been made on the prior state of the art. Even though improvements over previous baselines have been modest in general, the recent progress indicates that deep learning methods will provide valuable means for speeding up or aiding human investigation. Though progress has been made linking a specific neural network\u27s prediction to input features, understanding how users should interpret these models to make testable hypotheses about the system under study remains an open challenge. Furthermore, the limited amount of labelled data for training presents problems in some domains, as do legal and privacy constraints on work with sensitive health records. Nonetheless, we foresee deep learning enabling changes at both bench and bedside with the potential to transform several areas of biology and medicine