Do Invariances in Deep Neural Networks Align with Human Perception?

An evaluation criterion for safe and trustworthy deep learning is how well the invariances captured by representations of deep neural networks (DNNs) are shared with humans. We identify challenges in measuring these invariances. Prior works used gradient-based methods to generate identically represented inputs (IRIs), i.e., inputs which have identical representations (on a given layer) of a neural network, and thus capture invariances of a given network. One necessary criterion for a network's invariances to align with human perception is for its IRIs look “similar” to humans. Prior works, however, have mixed takeaways; some argue that later layers of DNNs do not learn human-like invariances yet others seem to indicate otherwise. We argue that the loss function used to generate IRIs can heavily affect takeaways about invariances of the network and is the primary reason for these conflicting findings. We propose an adversarial regularizer on the IRI-generation loss that finds IRIs that make any model appear to have very little shared invariance with humans. Based on this evidence, we argue that there is scope for improving models to have human-like invariances, and further, to have meaningful comparisons between models one should use IRIs generated using the regularizer-free loss. We then conduct an in-depth investigation of how different components (e.g. architectures, training losses, data augmentations) of the deep learning pipeline contribute to learning models that have good alignment with humans. We find that architectures with residual connections trained using a (self-supervised) contrastive loss with `p ball adversarial data augmentation tend to learn invariances that are most aligned with humans. Code: github.com/nvedant07/Human-NN-Alignment. We strongly recommend reading the arxiv version of this paper: https://arxiv.org/abs/2111.14726

Chronic hypothermia and energy expenditure in a neurodevelopmentally disabled patient: a case study

Hypothermia is defined as a core body temperature of \u3c35°C and results in a decrease in measured resting energy expenditure. A 51-year-old mentally disabled patient experienced chronic hypothermia from neurologic sequelae. Because of her continued weight gain and increased body fat in the presence of presumed hypocaloric nutrition, indirect calorimetry measurements were performed twice in a 3-month period. The resting energy expenditure measurements prompted a reduction of her daily caloric intake to prevent further overfeeding. Hypothermia reduces oxygen consumption and, as a consequence, decreases resting energy expenditure. In patients for whom chronic hypothermia is a problem, nutritional intake must be adjusted to prevent overfeeding, excessive weight gain, and the long-term complications of an excess of total calories

The influence of semantic and phonological factors on syntactic decisions: An event-related brain potential study

During language production and comprehension, information about a word's syntactic properties is sometimes needed. While the decision about the grammatical gender of a word requires access to syntactic knowledge, it has also been hypothesized that semantic (i.e., biological gender) or phonological information (i.e., sound regularities) may influence this decision. Event-related potentials (ERPs) were measured while native speakers of German processed written words that were or were not semantically and/or phonologically marked for gender. Behavioral and ERP results showed that participants were faster in making a gender decision when words were semantically and/or phonologically gender marked than when this was not the case, although the phonological effects were less clear. In conclusion, our data provide evidence that even though participants performed a grammatical gender decision, this task can be influenced by semantic and phonological factors

Insight dimensions and cognitive function in psychosis: a longitudinal study

BACKGROUND: It has been reported that lack of insight is significantly associated with cognitive disturbance in schizophrenia. This study examines the longitudinal relationships between insight dimensions and cognitive performance in psychosis. METHODS: Participants were 75 consecutively admitted inpatients with schizophrenia, affective disorder with psychotic symptoms or schizoaffective disorder. Assessments were conducted at two time points during the study: at the time of hospital discharge after an acute psychotic episode and at a follow-up time that occurred more than 6 months after discharge. A multidimensional approach of insight was chosen and three instruments for its assessment were used: the Scale to Assess Unawareness of Mental Disorder (SUMD), three items concerning insight on the Assessment and Documentation in Psychopathology (AMDP) system and the Insight and Treatment Attitudes Questionnaire. The neuropsychological battery included a wide range of tests that assessed global cognitive function, attention, memory, and executive functions. RESULTS: After conducting adequate statistical correction to avoid Type I bias, insight dimensions and cognitive performance were not found to be significantly associated at cross-sectional and longitudinal assessments. In addition, baseline cognitive performance did not explain changes in insight dimensions at follow-up. Similar results were found in the subset of patients with schizophrenia (n = 37). The possibility of a Type II error might have increased due to sample attrition at follow-up. CONCLUSION: These results suggest that lack of insight dimensions and cognitive functioning may be unrelated phenomena in psychosis

Histoplasma capsulatum Encodes a Dipeptidyl Peptidase Active against the Mammalian Immunoregulatory Peptide, Substance P

The pathogenic fungus Histoplasma capsulatum secretes dipeptidyl peptidase (Dpp) IV enzyme activity and has two putative DPPIV homologs (HcDPPIVA and HcDPPIVB). We previously showed that HcDPPIVB is the gene responsible for the majority of secreted DppIV activity in H. capsulatum culture supernatant, while we could not detect any functional contribution from HcDPPIVA. In order to determine whether HcDPPIVA encodes a functional DppIV enzyme, we expressed HcDPPIVA in Pichia pastoris and purified the recombinant protein. The recombinant enzyme cleaved synthetic DppIV substrates and had similar biochemical properties to other described DppIV enzymes, with temperature and pH optima of 42°C and 8, respectively. Recombinant HcDppIVA cleaved the host immunoregulatory peptide substance P, indicating the enzyme has the potential to affect the immune response during infection. Expression of HcDPPIVA under heterologous regulatory sequences in H. capsulatum resulted in increased secreted DppIV activity, indicating that the encoded protein can be expressed and secreted by its native organism. However, HcDPPIVA was not required for virulence in a murine model of histoplasmosis. This work reports a fungal enzyme that can function to cleave the immunomodulatory host peptide substance P

Long-Term Memory for Pavlovian Fear Conditioning Requires Dopamine in the Nucleus Accumbens and Basolateral Amygdala

The neurotransmitter dopamine (DA) is essential for learning in a Pavlovian fear conditioning paradigm known as fear-potentiated startle (FPS). Mice lacking the ability to synthesize DA fail to learn the association between the conditioned stimulus and the fear-inducing footshock. Previously, we demonstrated that restoration of DA synthesis to neurons of the ventral tegmental area (VTA) was sufficient to restore FPS. Here, we used a target-selective viral restoration approach to determine which mesocorticolimbic brain regions receiving DA signaling from the VTA require DA for FPS. We demonstrate that restoration of DA synthesis to both the basolateral amygdala (BLA) and nucleus accumbens (NAc) is required for long-term memory of FPS. These data provide crucial insight into the dopamine-dependent circuitry involved in the formation of fear-related memory

The Cortisol Response to Anticipated Intergroup Interactions Predicts Self-Reported Prejudice

Objectives: While prejudice has often been shown to be rooted in experiences of threat, the biological underpinnings of this threat–prejudice association have received less research attention. The present experiment aims to test whether activations of the hypothalamus-pituitary-adrenal (HPA) axis, due to anticipated interactions with out-group members, predict self-reported prejudice. Moreover, we explore potential moderators of this relationship (i.e., interpersonal similarity; subtle vs. blatant prejudice). Methodology/Principal findings: Participants anticipated an interaction with an out-group member who was similar or dissimilar to the self. To index HPA activation, cortisol responses to this event were measured. Then, subtle and blatant prejudices were measured via questionnaires. Findings indicated that only when people anticipated an interaction with an out-group member who was dissimilar to the self, their cortisol response to this event significantly predicted subtle (r =.50) and blatant (r =.53) prejudice. Conclusions: These findings indicate that prejudicial attitudes are linked to HPA-axis activity. Furthermore, when intergroup interactions are interpreted to be about individuals (and not so much about groups), experienced threat (or its biological substrate) is less likely to relate to prejudice. This conclusion is discussed in terms of recent insights from social neuroscience