Continual Classification Learning Using Generative Models

Continual learning is the ability to sequentially learn over time by accommodating knowledge while retaining previously learned experiences. Neural networks can learn multiple tasks when trained on them jointly, but cannot maintain performance on previously learned tasks when tasks are presented one at a time. This problem is called catastrophic forgetting. In this work, we propose a classification model that learns continuously from sequentially observed tasks, while preventing catastrophic forgetting. We build on the lifelong generative capabilities of [10] and extend it to the classification setting by deriving a new variational bound on the joint log likelihood, $\log p(x; y)$.Comment: 5 pages, 4 figures, under review in Continual learning Workshop NIPS 201

Variational Saccading: Efficient Inference for Large Resolution Images

Image classification with deep neural networks is typically restricted to images of small dimensionality such as 224 x 244 in Resnet models [24]. This limitation excludes the 4000 x 3000 dimensional images that are taken by modern smartphone cameras and smart devices. In this work, we aim to mitigate the prohibitive inferential and memory costs of operating in such large dimensional spaces. To sample from the high-resolution original input distribution, we propose using a smaller proxy distribution to learn the co-ordinates that correspond to regions of interest in the high-dimensional space. We introduce a new principled variational lower bound that captures the relationship of the proxy distribution's posterior and the original image's co-ordinate space in a way that maximizes the conditional classification likelihood. We empirically demonstrate on one synthetic benchmark and one real world large resolution DSLR camera image dataset that our method produces comparable results with ~10x faster inference and lower memory consumption than a model that utilizes the entire original input distribution. Finally, we experiment with a more complex setting using mini-maps from Starcraft II [56] to infer the number of characters in a complex 3d-rendered scene. Even in such complicated scenes our model provides strong localization: a feature missing from traditional classification models.Comment: Published BMVC 2019 & NIPS 2018 Bayesian Deep Learning Worksho

Compassion focussed self-help for skin conditions in individuals with insecure attachment: A pilot evaluation of the acceptability and potential effectiveness

Further research is needed to develop psychological interventions for people living with skin condition. This research letter reports on a preliminary evaluation of targeted self-helpa encompassing mindful breathing and compassionate imagery (i.e., evoking a self- compassionate mental images), with the aim of reducing skin specific related distress such as shame. The aim of this 4-week preliminary study was to investigate the usability and acceptability of self-help for people living with skin conditions, through a feedback form administered two weeks after the intervention

A mixed methods survey of social anxiety, anxiety, depression and wig use in alopecia

Objectives This study aimed to examine levels of social anxiety, anxiety and depression reported by people with alopecia as a result of a dermatological condition and associations with wig use. The study also sought to report on experiences of wearing wigs in social situations and the relationship with social confidence. Design A cross-sectional survey was sent by email to the Alopecia UK charity mailing list and advertised on social media. Participants Inclusion criteria were a diagnosis of alopecia, aged 13 or above and sufficient English to complete the survey. Exclusion criteria included experiencing hair loss as a result of chemotherapy treatment or psychological disorder. Participants (n=338) were predominantly female (97.3%), Caucasian (93.5%) and aged between 35 and 54 years (49.4%) with a diagnosis of alopecia areata (82.6%). Main outcome measures The Social Phobia Inventory measured symptoms of social anxiety, and the Hospital Anxiety and Depression Scale was used to measure symptoms of anxiety and depression. Survey questions were designed to measure the use of wigs. Open-ended questions enabled participants to comment on their experiences of wearing wigs. Results Clinically significant levels of social anxiety (47.5%), anxiety (35.5%) and depression (29%) were reported. Participants who reported worries about not wearing a wig reported significantly higher levels of depression: t(103)=3.40, p≤0.001; anxiety: t(109)=4.80, p≤0.001; and social anxiety: t(294)=3.89, p≤0.001. Wearing wigs was reported as increasing social confidence; however, the concealment it afforded was also reported as both reducing fear of negative evaluation and maintaining anxiety. Discussion Overall, 46% of participants reported that wearing a wig had a positive impact on their everyday life with negative experiences related to fears of the wig being noticed. Psychological interventions alongside wig provision would be beneficial for people living with alopecia

Starting to develop self-help for social anxiety associated with vitiligo: using clinical significance to measure the potential effectiveness of enhanced psychological self-help

Background Vitiligo can be associated with high levels of distress, yet there are currently no self-help interventions available. Objectives To describe the initial development of a psychosocial self-help intervention designed to reduce social anxiety associated with vitiligo. Also to examine whether including a planning exercise, aimed at increasing use of the intervention (termed implementation intentions), has the potential to achieve a clinically significant reduction in distress. Methods Participants (n = 75) were randomized to one of three groups: cognitive behavioural self-help (CBSH), CBSH augmented with implementation intentions (CBSH+), or no intervention. Participants were assessed at baseline and after 8 weeks on measures of social anxiety, anxiety and depression, and appearance-related concern. The two intervention groups also completed a questionnaire evaluating their use of, and satisfaction with, the intervention. Results High levels of social anxiety and concern over appearance were reported. Twenty-four per cent of participants in the CBSH+ group experienced clinically significant change on the measure of social anxiety compared with 8% in the CBSH group and 0% in the control group. In addition, 58% of the control group deteriorated during the study period. There were no significant differences between the conditions on the other outcome measures. Participants reported that the self-help leaflets were helpful. Conclusions The findings demonstrate that augmented CBSH provides a relatively simple and accessible intervention that can result in a clinically significant reduction in social anxiety. The augmented intervention has potential and might be further developed and evaluated in subsequent trials

The importance of mindfulness in psychosocial distress and quality of life in dermatology patients

Background: Mindfulness, defined as purposively and non-judgementally paying attention in the present moment, could be used within psychosocial interventions to reduce the distress associated with social anxiety and avoidance found in many skin conditions. However, little is known about the relationship between naturally occurring levels of mindfulness and distress in dermatology patients. Objective: This study sought to examine the relationship between mindfulness and psychosocial distress in a dermatological sample. It was hypothesised that higher levels of mindfulness would be associated with lower levels of social anxiety, anxiety, depression, and skin shame, and with better quality of life. Method: Adult dermatology outpatients (N=120) from one hospital completed items assessing subjective severity, skin shame, fear of negative evaluation (BFNE), anxiety and depression (HADS), quality of life (DLQI), and levels of mindfulness (FFMQ). Results: Considering depression, 14% reported mild, 5% moderate and 2.5% severe symptoms. For anxiety, 22% reported mild, 23% moderate and 6% severe symptoms. In addition, 33.4% reported clinically significant social anxiety. After controlling for subjective severity, mindfulness explained an additional 19% of the variance in depression, 39% in anxiety, 41% in social anxiety, 13% in skin shame, and 6% in dermatological quality of life. One specific facet of mindfulness (acting with awareness) was found to be the most consistent predictor of distress. Conclusions: The findings indicate that higher levels of mindfulness are associated with lower distress. This suggests that facilitating mindfulness may be helpful in reducing distress in dermatology patients and the use of mindfulness techniques warrants further investigation

The influence of optimism, social support and anxiety on aggression in a sample of dermatology patients. An analysis of cross-sectional data.

Background: Individuals with visible skin conditions often experience stigmatisation and discrimination. This may trigger maladaptive responses such as feelings of anger and hostility with negative consequences to social interactions and relationships. Objectives: The present study aimed to identify psychosocial factors contributing to aggression levels in dermatology patients. Methods: Data was obtained from ninety-one participants recruited from out-patient clinics in the north of England, UK. This study used dermatology specific data extracted from a large UK database of medical conditions collected by the Appearance Research Collaboration (ARC). This study looked at the impact of optimism (LOT-R), perceptions of social support (SFSSQ) social acceptance, fear of negative Evaluation (FNE), appearance concern (CARVAL/CARSAL), appearance discrepancy PADQ), social comparison (INCOMM) and wellbeing (HADS) on aggression levels (RAQ) in a sample of dermatology patients. Results: In order to assess the relationship between variables, a hierarchical regression analysis was performed. Dispositional style (optimism) was shown to have a strong negative relationship with aggression (β = -0.37 t =-2.97 p = 0.004). Higher levels of perceived social support were significantly associated with lower levels of aggression (β = -0.258 t = -2.26 p = 0.02). Anxiety was also found to have a significant positive relationship with aggression (β = 0.356, t = 2.564, p = 0.01). Conclusions: The study provides evidence for the importance of perceived social support and optimism in psychological adjustment to skin conditions. Psychosocial interventions provided to dermatology patients might need to address aggression levels and seek to enhance social support and the ability to be optimistic

Are sex and history of pruritic skin conditions factors which affect the phenomenon of visually evoked itch? An exploratory study

Introduction: We have previously shown that sensations of itch and the scratch response can be evoked using itch-related images. However, we did not determine whether individual differences in a person’s experience of itch could moderate this effect. This exploratory study aimed to determine whether sex or a history of pruritic skin conditions (PSCs) could influence the effects of visually evoked itch and scratch. Methods: Forty-one participants (19 males; 16 with a history of PSCs) viewed static images that could either be itch or nonitch related. These were further separated by picture type: “skin contact” (ants crawling on the hand vs. a butterfly on the finger); “skin response” (scratching an insect bite vs. washing the hands); “skin condition” (psoriasis vs. freckles) or “context only” (insects vs. birds). Images were rated using a 10-point scale by answering: “How itchy do you feel?” (Self-rating) and “How itchy do you think the person in the picture feels?” (Other-rating). Frequency and location of scratching was also recorded. Results: The highest itch scores were to itch-related skin contact pictures. Females gave higher itch ratings than males, and people with a history of PSCs gave higher itch ratings when viewing images of people scratching. There was no correlation between itch ratings and scratch response, and no relationship between body site viewed and location of scratching. Discussion: There is a heightened response to itch-related cues in females and those with PSCs, indicating a more centrally mediated pathway bringing subconscious itch sensations into conscious awareness in these populations. These findings could influence personalized treatment interventions aimed at reducing awareness of itch sensations in susceptible individuals