Proxy Tasks and Subjective Measures Can Be Misleading in Evaluating Explainable AI Systems

Explainable artificially intelligent (XAI) systems form part of sociotechnical systems, e.g., human+AI teams tasked with making decisions. Yet, current XAI systems are rarely evaluated by measuring the performance of human+AI teams on actual decision-making tasks. We conducted two online experiments and one in-person think-aloud study to evaluate two currently common techniques for evaluating XAI systems: (1) using proxy, artificial tasks such as how well humans predict the AI's decision from the given explanations, and (2) using subjective measures of trust and preference as predictors of actual performance. The results of our experiments demonstrate that evaluations with proxy tasks did not predict the results of the evaluations with the actual decision-making tasks. Further, the subjective measures on evaluations with actual decision-making tasks did not predict the objective performance on those same tasks. Our results suggest that by employing misleading evaluation methods, our field may be inadvertently slowing its progress toward developing human+AI teams that can reliably perform better than humans or AIs alone

Recombinant human leptin treatment in genetic lipodystrophic syndromes: the long-term Spanish experience

Lipodystrophies are a group of diseases mainly characterized by a loss of adipose tissue and frequently associated with insulin resistance, hypertriglyceridemia, and hepatic steatosis. In uncommon lipodystrophies, these complications frequently are difficult to control with conventional therapeutic approaches. This retrospective study addressed the effectiveness of recombinant methionyl leptin (metreleptin) for improving glucose metabolism, lipid profile, and hepatic steatosis in patients with genetic lipodystrophic syndromes. We studied nine patients (five females and four males) with genetic lipodystrophies [seven with Berardinelli-Seip syndrome, one with atypical progeroid syndrome, and one with type 2 familial partial lipodystrophy (FPLD)]. Six patients were children under age 9 years, and all patients had baseline triglycerides levels >2.26 mmol/L and hepatic steatosis; six had poorly controlled diabetes mellitus. Metreleptin was self-administered subcutaneously daily at a final dose that ranged between 0.05 and 0.24 mg/(kg day) [median: 0.08 mg/(kg day)] according to the body weight. The duration of treatment ranged from 9 months to 5 years, 9 months (median: 3 years). Plasma glucose, hemoglobin A1c (Hb A1c), lipid profile, plasma insulin and leptin, and hepatic enzymes were evaluated at baseline and at least every 6 months. Except for the patient with FPLD, metreleptin replacement significantly improved metabolic control (Hb A1c: from 10.4 to 7.1 %, p < 0.05). Plasma triglycerides were reduced 76 % on average, and hepatic enzymes decreased more than 65 %. This study extends knowledge about metreleptin replacement in genetic lipodystrophies, bearing out its effectiveness for long periods of time.This study was supported by the Instituto de Salud Carlos III and the European Regional Development Fund, FEDER (Grant: PI081449) and Consellería de Industria, Xunta de Galicia (Grant: 10PXIB208013PR). S. Sánchez-Iglesias is a Research Fellow granted by the Asociación Española de Familiares y Afectados de Lipodistrofias (AELIP).S

Weight regain after a diet-induced loss is predicted by higher baseline leptin and lower ghrelin plasma levels

CONTEXT: Appetite-related hormones may play an important role in weight regain after obesity therapy. OBJECTIVE: Our objective was to investigate the potential involvement of ghrelin, leptin, and insulin plasma levels in weight regain after a therapeutic hypocaloric diet. DESIGN: A group of obese/overweight volunteers (49 women and 55 men; 35 ± 7 yr; 30.7 ± 2.4 kg/m(2)) followed an 8-wk hypocaloric diet (-30% energy expenditure) and were evaluated again 32 wk after treatment. Body weight as well as plasma fasting ghrelin, leptin, and insulin concentrations were measured at three points (wk 0, 8, and 32). RESULTS: After the 8-wk hypocaloric diet, the average weight loss was -5.0 ± 2.2% (P < 0.001). Plasma leptin and insulin concentrations decreased significantly, whereas ghrelin levels did not markedly change. In the group regaining more than 10% of the weight loss, leptin levels were higher (P < 0.01), whereas ghrelin levels were lower (P < 0.05). No differences were observed in insulin levels. Weight regain at wk 32 was negatively correlated with ghrelin and positively associated with leptin levels at baseline (wk 0) and endpoint (wk 8). These outcomes showed a gender-specific influence, being statistically significant among men for ghrelin and between women for leptin. Moreover, a decrease in ghrelin after an 8-wk hypocaloric diet was related to an increased risk for weight regain (odds ratio = 3.109; P = 0.008) whereas a greater reduction in leptin (odds ratio = 0.141; P = 0.001) was related to weight-loss maintenance. CONCLUSIONS: Subjects with higher plasma leptin and lower ghrelin levels at baseline could be more prone to regain lost weight, and hormones levels could be proposed as biomarkers for predicting obesity-treatment outcomes

Acidification increases abundances of Vibrionales and Planctomycetia associated to a seaweed-grazer system: potential consequences for disease and prey digestion efficiency

Ocean acidification significantly affects marine organisms in several ways, with complex interactions. Seaweeds might benefit from rising CO2 through increased photosynthesis and carbon acquisition, with subsequent higher growth rates. However, changes in seaweed chemistry due to increased CO2 may change the nutritional quality of tissue for grazers. In addition, organisms live in close association with a diverse microbiota, which can also be influenced by environmental changes, with feedback effects. As gut microbiomes are often linked to diet, changes in seaweed characteristics and associated microbiome can affect the gut microbiome of the grazer, with possible fitness consequences. In this study, we experimentally investigated the effects of acidification on the microbiome of the invasive brown seaweed Sargassum muticum and a native isopod consumer Synisoma nadejda. Both were exposed to ambient CO2 conditions (380 ppm, pH 8.16) and an acidification treatment (1,000 ppm, pH 7.86) for three weeks. Microbiome diversity and composition were determined using high-throughput sequencing of the variable regions V5-7 of 16S rRNA. We anticipated that as a result of acidification, the seaweed-associated bacterial community would change, leading to further changes in the gut microbiome of grazers. However, no significant effects of elevated CO2 on the overall bacterial community structure and composition were revealed in the seaweed. In contrast, significant changes were observed in the bacterial community of the grazer gut. Although the bacterial community of S. muticum as whole did not change, Oceanospirillales and Vibrionales (mainly Pseudoalteromonas) significantly increased their abundance in acidified conditions. The former, which uses organic matter compounds as its main source, may have opportunistically taken advantage of the possible increase of the C/N ratio in the seaweed under acidified conditions. Pseudoalteromonas, commonly associated to diseased seaweeds, suggesting that acidification may facilitate opportunistic/pathogenic bacteria. In the gut of S. nadejda, the bacterial genus Planctomycetia increased abundance under elevated CO2. This shift might be associated to changes in food (S. muticum) quality under acidification. Planctomycetia are slow-acting decomposers of algal polymers that could be providing the isopod with an elevated algal digestion and availability of inorganic compounds to compensate the shifted C/N ratio under acidification in their food. In conclusion, our results indicate that even after only three weeks of acidified conditions, bacterial communities associated to ungrazed seaweed and to an isopod grazer show specific, differential shifts in associated bacterial community. These have potential consequences for seaweed health (as shown in corals) and isopod food digestion. The observed changes in the gut microbiome of the grazer seem to reflect changes in the seaweed chemistry rather than its microbial composition.Erasmus Mundus Doctoral Programme MARES on Marine Ecosystem Health Conservation [MARES_13_08]; FCT (Foundation for Science and Technology, Portugal) [SFRH/BPD/63703/2009, SFRH/BPD/107878/2015, SFRH/BPD/116774/2016]; EU SEAS-ERA project INVASIVES [SEAS-ERA/0001/2012]; [CCMAR/Multi/04326/2013

The PDZ Protein Canoe/AF-6 Links Ras-MAPK, Notch and Wingless/Wnt Signaling Pathways by Directly Interacting with Ras, Notch and Dishevelled

Over the past few years, it has become increasingly apparent that signal transduction pathways are not merely linear cascades; they are organized into complex signaling networks that require high levels of regulation to generate precise and unique cell responses. However, the underlying regulatory mechanisms by which signaling pathways cross-communicate remain poorly understood. Here we show that the Ras-binding protein Canoe (Cno)/AF-6, a PDZ protein normally associated with cellular junctions, is a key modulator of Wingless (Wg)/Wnt, Ras-Mitogen Activated Protein Kinase (MAPK) and Notch (N) signaling pathways cross-communication. Our data show a repressive effect of Cno/AF-6 on these three signaling pathways through physical interactions with Ras, N and the cytoplasmic protein Dishevelled (Dsh), a key Wg effector. We propose a model in which Cno, through those interactions, actively coordinates, at the membrane level, Ras-MAPK, N and Wg signaling pathways during progenitor specification

Common variants in Alzheimer’s disease and risk stratification by polygenic risk scores

Funder: Funder: Fundación bancaria ‘La Caixa’ Number: LCF/PR/PR16/51110003 Funder: Grifols SA Number: LCF/PR/PR16/51110003 Funder: European Union/EFPIA Innovative Medicines Initiative Joint Number: 115975 Funder: JPco-fuND FP-829-029 Number: 733051061Genetic discoveries of Alzheimer's disease are the drivers of our understanding, and together with polygenetic risk stratification can contribute towards planning of feasible and efficient preventive and curative clinical trials. We first perform a large genetic association study by merging all available case-control datasets and by-proxy study results (discovery n = 409,435 and validation size n = 58,190). Here, we add six variants associated with Alzheimer's disease risk (near APP, CHRNE, PRKD3/NDUFAF7, PLCG2 and two exonic variants in the SHARPIN gene). Assessment of the polygenic risk score and stratifying by APOE reveal a 4 to 5.5 years difference in median age at onset of Alzheimer's disease patients in APOE ɛ4 carriers. Because of this study, the underlying mechanisms of APP can be studied to refine the amyloid cascade and the polygenic risk score provides a tool to select individuals at high risk of Alzheimer's disease

New insights into the genetic etiology of Alzheimer's disease and related dementias

Characterization of the genetic landscape of Alzheimer's disease (AD) and related dementias (ADD) provides a unique opportunity for a better understanding of the associated pathophysiological processes. We performed a two-stage genome-wide association study totaling 111,326 clinically diagnosed/'proxy' AD cases and 677,663 controls. We found 75 risk loci, of which 42 were new at the time of analysis. Pathway enrichment analyses confirmed the involvement of amyloid/tau pathways and highlighted microglia implication. Gene prioritization in the new loci identified 31 genes that were suggestive of new genetically associated processes, including the tumor necrosis factor alpha pathway through the linear ubiquitin chain assembly complex. We also built a new genetic risk score associated with the risk of future AD/dementia or progression from mild cognitive impairment to AD/dementia. The improvement in prediction led to a 1.6- to 1.9-fold increase in AD risk from the lowest to the highest decile, in addition to effects of age and the APOE ε4 allele