Understanding polysemanticity in neural networks through coding theory

Despite substantial efforts, neural network interpretability remains an elusive goal, with previous research failing to provide succinct explanations of most single neurons' impact on the network output. This limitation is due to the polysemantic nature of most neurons, whereby a given neuron is involved in multiple unrelated network states, complicating the interpretation of that neuron. In this paper, we apply tools developed in neuroscience and information theory to propose both a novel practical approach to network interpretability and theoretical insights into polysemanticity and the density of codes. We infer levels of redundancy in the network's code by inspecting the eigenspectrum of the activation's covariance matrix. Furthermore, we show how random projections can reveal whether a network exhibits a smooth or non-differentiable code and hence how interpretable the code is. This same framework explains the advantages of polysemantic neurons to learning performance and explains trends found in recent results by Elhage et al.~(2022). Our approach advances the pursuit of interpretability in neural networks, providing insights into their underlying structure and suggesting new avenues for circuit-level interpretability

Integrating snow science and wildlife ecology in Arctic-boreal North America

Snow covers Arctic and boreal regions (ABRs) for approximately 9 months of the year, thus snowscapes dominate the form and function of tundra and boreal ecosystems. In recent decades, Arctic warming has changed the snowcover\u27s spatial extent and distribution, as well as its seasonal timing and duration, while also altering the physical characteristics of the snowpack. Understanding the little studied effects of changing snowscapes on its wildlife communities is critical. The goal of this paper is to demonstrate the urgent need for, and suggest an approach for developing, an improved suite of temporally evolving, spatially distributed snow products to help understand how dynamics in snowscape properties impact wildlife, with a specific focus on Alaska and northwestern Canada. Via consideration of existing knowledge of wildlife-snow interactions, currently available snow products for focus region, and results of three case studies, we conclude that improving snow science in the ABR will be best achieved by focusing efforts on developing data-model fusion approaches to produce fit-for-purpose snow products that include, but are not limited to, wildlife ecology. The relative wealth of coordinated in situ measurements, airborne and satellite remote sensing data, and modeling tools being collected and developed as part of NASA\u27s Arctic Boreal Vulnerability Experiment and SnowEx campaigns, for example, provide a data rich environment for developing and testing new remote sensing algorithms and retrievals of snowscape properties

Oculomotor Guidance and Capture by Irrelevant Faces

Even though it is generally agreed that face stimuli constitute a special class of stimuli, which are treated preferentially by our visual system, it remains unclear whether faces can capture attention in a stimulus-driven manner. Moreover, there is a long-standing debate regarding the mechanism underlying the preferential bias of selecting faces. Some claim that faces constitute a set of special low-level features to which our visual system is tuned; others claim that the visual system is capable of extracting the meaning of faces very rapidly, driving attentional selection. Those debates continue because many studies contain methodological peculiarities and manipulations that prevent a definitive conclusion. Here, we present a new visual search task in which observers had to make a saccade to a uniquely colored circle while completely irrelevant objects were also present in the visual field. The results indicate that faces capture and guide the eyes more than other animated objects and that our visual system is not only tuned to the low-level features that make up a face but also to its meaning

Sensing of Fatty Acids for Octanoylation of Ghrelin Involves a Gustatory G-Protein

Ghrelin is an important regulator of energy--and glucose homeostasis. The octanoylation at Ser(3) is essential for ghrelin's biological effects but the mechanisms involved in the octanoylation are unknown. We investigated whether the gustatory G-protein, α-gustducin, and the free fatty acid receptors GPR40 and GPR120 are involved in the fatty acid sensing mechanisms of the ghrelin cell.Wild-type (WT) and α-gustducin knockout (gust(-/-)) mice were fed a glyceryl trioctanoate-enriched diet (OD) during 2 weeks. Ghrelin levels and gastric emptying were determined. Co-localization between GPR40, GPR120 and ghrelin or α-gustducin/α-transducin was investigated by immunofluorescence staining. The role of GPR120 in the effect of medium and long chain fatty acids on the release of ghrelin was studied in the ghrelinoma cell line, MGN3-1. The effect of the GPR40 agonist, MEDICA16, and the GPR120 agonist, grifolic acid, on ghrelin release was studied both in vitro and in vivo.Feeding an OD specifically increased octanoyl ghrelin levels in the stomach of WT mice but not of gust(-/-) mice. Gastric emptying was accelerated in WT but not in gust(-/-) mice. GPR40 was colocalized with desoctanoyl but not with octanoyl ghrelin, α-gustducin or α-transducin positive cells in the stomach. GPR120 only colocalized with ghrelin in the duodenum. Addition of octanoic acid or α-linolenic acid to MGN3-1 cells increased and decreased octanoyl ghrelin levels, respectively. Both effects could not be blocked by GPR120 siRNA. MEDICA16 and grifolic acid did not affect ghrelin secretion in vitro but oral administration of grifolic acid increased plasma ghrelin levels.This study provides the first evidence that α-gustducin is involved in the octanoylation of ghrelin and shows that the ghrelin cell can sense long- and medium-chain fatty acids directly. GPR120 but not GPR40 may play a role in the lipid sensing cascade of the ghrelin cell

The kidney failure risk equation:evaluation of novel input variables including eGFR estimated using the CKD-EPI 2021 equation in 59 cohorts

SIGNIFICANCE STATEMENT: The kidney failure risk equation (KFRE) uses age, sex, GFR, and urine albumin-to-creatinine ratio (ACR) to predict 2- and 5-year risk of kidney failure in populations with eGFR <60 ml/min per 1.73 m 2 . However, the CKD-EPI 2021 creatinine equation for eGFR is now recommended for use but has not been fully tested in the context of KFRE. In 59 cohorts comprising 312,424 patients with CKD, the authors assessed the predictive performance and calibration associated with the use of the CKD-EPI 2021 equation and whether additional variables and accounting for the competing risk of death improves the KFRE's performance. The KFRE generally performed well using the CKD-EPI 2021 eGFR in populations with eGFR <45 ml/min per 1.73 m 2 and was not improved by adding the 2-year prior eGFR slope and cardiovascular comorbidities. BACKGROUND: The kidney failure risk equation (KFRE) uses age, sex, GFR, and urine albumin-to-creatinine ratio (ACR) to predict kidney failure risk in people with GFR <60 ml/min per 1.73 m 2 . METHODS: Using 59 cohorts with 312,424 patients with CKD, we tested several modifications to the KFRE for their potential to improve the KFRE: using the CKD-EPI 2021 creatinine equation for eGFR, substituting 1-year average ACR for single-measure ACR and 1-year average eGFR in participants with high eGFR variability, and adding 2-year prior eGFR slope and cardiovascular comorbidities. We also assessed calibration of the KFRE in subgroups of eGFR and age before and after accounting for the competing risk of death. RESULTS: The KFRE remained accurate and well calibrated overall using the CKD-EPI 2021 eGFR equation. The other modifications did not improve KFRE performance. In subgroups of eGFR 45-59 ml/min per 1.73 m 2 and in older adults using the 5-year time horizon, the KFRE demonstrated systematic underprediction and overprediction, respectively. We developed and tested a new model with a spline term in eGFR and incorporating the competing risk of mortality, resulting in more accurate calibration in those specific subgroups but not overall. CONCLUSIONS: The original KFRE is generally accurate for eGFR <45 ml/min per 1.73 m 2 when using the CKD-EPI 2021 equation. Incorporating competing risk methodology and splines for eGFR may improve calibration in low-risk settings with longer time horizons. Including historical averages, eGFR slopes, or a competing risk design did not meaningfully alter KFRE performance in most circumstances

SNP array-based whole genome homozygosity mapping as the first step to a molecular diagnosis in patients with Charcot-Marie-Tooth disease

Considerable non-allelic heterogeneity for autosomal recessively inherited Charcot-Marie-Tooth (ARCMT) disease has challenged molecular testing and often requires a large amount of work in terms of DNA sequencing and data interpretation or remains unpractical. This study tested the value of SNP array-based whole-genome homozygosity mapping as a first step in the molecular genetic diagnosis of sporadic or ARCMT in patients from inbred families or outbred populations with the ancestors originating from the same geographic area. Using 10 K 2.0 and 250 K Nsp Affymetrix SNP arrays, 15 (63%) of 24 CMT patients received an accurate genetic diagnosis. We used our Java-based script eHoPASA CMT—easy Homozygosity Profiling of SNP arrays for CMT patients to display the location of homozygous regions and their extent of marker count and base-pairs throughout the whole genome. CMT4C was the most common genetic subtype with mutations detected in SH3TC2, one (p.E632Kfs13X) appearing to be a novel founder mutation. A sporadic patient with severe CMT was homozygous for the c.250G > C (p.G84R) HSPB1 mutation which has previously been reported to cause autosomal dominant dHMN. Two distantly related CMT1 patients with early disease onset were found to carry a novel homozygous mutation in MFN2 (p.N131S). We conclude that SNP array-based homozygosity mapping is a fast, powerful, and economic tool to guide molecular genetic testing in ARCMT and in selected sporadic CMT patients

Tyrosine-Phosphorylated Caveolin-1 Blocks Bacterial Uptake by Inducing Vav2-RhoA-Mediated Cytoskeletal Rearrangements

During the early stages of infection, Neisseria gonorrhoeae triggers a phosphotyrosine-dependent Cav1-Vav2-RhoA signaling cascade that promotes the pathogen's extracellular state

Stay Tuned: What Is Special About Not Shifting Attention?

Background: When studying attentional orienting processes, brain activity elicited by symbolic cue is usually compared to a neutral condition in which no information is provided about the upcoming target location. It is generally assumed that when a neutral cue is provided, participants do not shift their attention. The present study sought to validate this assumption. We further investigated whether anticipated task demands had an impact on brain activity related to processing symbolic cues. Methodology/Principal Findings: Two experiments were conducted, during which event-related potentials were elicited by symbolic cues that instructed participants to shift their attention to a particular location on a computer screen. In Experiment 1, attention shift-inducing cues were compared to non-informative cues, while in both conditions participants were required to detect target stimuli that were subsequently presented at peripheral locations. In Experiment 2, a non-ambiguous "stay-central'' cue that explicitly required participants not to shift their attention was used instead. In the latter case, target stimuli that followed a stay-central cue were also presented at a central location. Both experiments revealed enlarged early latency contralateral ERP components to shift-inducing cues compared to those elicited by either non-informative (exp. 1) or stay-central cues (exp. 2). In addition, cueing effects were modulated by the anticipated difficulty of the upcoming target, particularly so in Experiment 2. A positive difference, predominantly over the posterior contralateral scalp areas, could be observed for stay-central cues, especially for those predicting that the upcoming target would be easy. This effect was not present for non-informative cues. Conclusions/Significance: We interpret our result in terms of a more rapid engagement of attention occurring in the presence of a more predictive instruction (i.e. stay-central easy target). Our results indicate that the human brain is capable of very rapidly identifying the difference between different types of instructions

Dose-Dependent Effects of Endotoxin on Neurobehavioral Functions in Humans

Clinical and experimental evidence document that inflammation and increased peripheral cytokine levels are associated with depression-like symptoms and neuropsychological disturbances in humans. However, it remains unclear whether and to what extent cognitive functions like memory and attention are affected by and related to the dose of the inflammatory stimulus. Thus, in a cross-over, double-blind, experimental approach, healthy male volunteers were administered with either placebo or bacterial lipopolysaccharide (LPS) at doses of 0.4 (n = 18) or 0.8 ng/kg of body weight (n = 16). Pro- and anti-inflammatory cytokines, norephinephrine and cortisol concentrations were analyzed before and 1, 1.75, 3, 4, 6, and 24 h after injection. In addition, changes in mood and anxiety levels were determined together with working memory (n-back task) and long term memory performance (recall of emotional and neutral pictures of the International Affective Picture System). Endotoxin administration caused a profound transient physiological response with dose-related elevations in body temperature and heart rate, increases in plasma interleukin (IL)-6, IL-10, tumor necrosis factor (TNF)-α and IL-1 receptor antagonist (IL-1ra), salivary and plasma cortisol, and plasma norepinephrine. These changes were accompanied by dose-related decreased mood and increased anxiety levels. LPS administration did not affect accuracy in working memory performance but improved reaction time in the high-dose LPS condition compared to the control conditon. In contrast, long-term memory performance was impaired selectively for emotional stimuli after administration of the lower but not of the higher dose of LPS. These data suggest the existence of at least two counter-acting mechanisms, one promoting and one inhibiting cognitive performance during acute systemic inflammation