Jacobian ensembles improve robustness trade-offs to adversarial attacks

Deep neural networks have become an integral part of our software infrastructure and are being deployed in many widely-used and safety-critical applications. However, their integration into many systems also brings with it the vulnerability to test time attacks in the form of Universal Adversarial Perturbations (UAPs). UAPs are a class of perturbations that when applied to any input causes model misclassification. Although there is an ongoing effort to defend models against these adversarial attacks, it is often difficult to reconcile the trade-offs in model accuracy and robustness to adversarial attacks. Jacobian regularization has been shown to improve the robustness of models against UAPs, whilst model ensembles have been widely adopted to improve both predictive performance and model robustness. In this work, we propose a novel approach, Jacobian Ensembles – a combination of Jacobian regularization and model ensembles to significantly increase the robustness against UAPs whilst maintaining or improving model accuracy. Our results show that Jacobian Ensembles achieves previously unseen levels of accuracy and robustness, greatly improving over previous methods that tend to skew towards only either accuracy or robustness

Distributed variance regularized Multitask Learning

Past research on Multitask Learning (MTL) has focused mainly on devising adequate regularizers and less on their scalability. In this paper, we present a method to scale up MTL methods which penalize the variance of the task weight vectors. The method builds upon the alternating direction method of multipliers to decouple the variance regularizer. It can be efficiently implemented by a distributed algorithm, in which the tasks are first independently solved and subsequently corrected to pool information from other tasks. We show that the method works well in practice and convergences in few distributed iterations. Furthermore, we empirically observe that the number of iterations is nearly independent of the number of tasks, yielding a computational gain of O(T) over standard solvers. We also present experiments on a large URL classification dataset, which is challenging both in terms of volume of data points and dimensionality. Our results confirm that MTL can obtain superior performance over either learning a common model or independent task learning

Eyetracking Metrics in Young Onset Alzheimer’s Disease: A Window into Cognitive Visual Functions

Young onset Alzheimer’s disease (YOAD) is defined as symptom onset before the age of 65 years and is particularly associated with phenotypic heterogeneity. Atypical presentations, such as the clinic-radiological visual syndrome posterior cortical atrophy (PCA), often lead to delays in accurate diagnosis. Eyetracking has been used to demonstrate basic oculomotor impairments in individuals with dementia. In the present study, we aim to explore the relationship between eyetracking metrics and standard tests of visual cognition in individuals with YOAD. Fifty-seven participants were included: 36 individuals with YOAD (n =  26 typical AD; n =  10 PCA) and 21 age-matched healthy controls. Participants completed three eyetracking experiments: fixation, pro-saccade, and smooth pursuit tasks. Summary metrics were used as outcome measures and their predictive value explored looking at correlations with visuoperceptual and visuospatial metrics. Significant correlations between eyetracking metrics and standard visual cognitive estimates are reported. A machine-learning approach using a classification method based on the smooth pursuit raw eyetracking data discriminates with approximately 95% accuracy patients and controls in cross-validation tests. Results suggest that the eyetracking paradigms of a relatively simple and specific nature provide measures not only reflecting basic oculomotor characteristics but also predicting higher order visuospatial and visuoperceptual impairments. Eyetracking measures can represent extremely useful markers during the diagnostic phase and may be exploited as potential outcome measures for clinical trials

Differential Stress-Induced Neuronal Activation Patterns in Mouse Lines Selectively Bred for High, Normal or Low Anxiety

There is evidence for a disturbed perception and processing of emotional information in pathological anxiety. Using a rat model of trait anxiety generated by selective breeding, we previously revealed differences in challenge-induced neuronal activation in fear/anxiety-related brain areas between high (HAB) and low (LAB) anxiety rats. To confirm whether findings generalize to other species, we used the corresponding HAB/LAB mouse model and investigated c-Fos responses to elevated open arm exposure. Moreover, for the first time we included normal anxiety mice (NAB) for comparison. The results confirm that HAB mice show hyperanxious behavior compared to their LAB counterparts, with NAB mice displaying an intermediate anxiety phenotype. Open arm challenge revealed altered c-Fos response in prefrontal-cortical, limbic and hypothalamic areas in HAB mice as compared to LAB mice, and this was similar to the differences observed previously in the HAB/LAB rat lines. In mice, however, additional differential c-Fos response was observed in subregions of the amygdala, hypothalamus, nucleus accumbens, midbrain and pons. Most of these differences were also seen between HAB and NAB mice, indicating that it is predominately the HAB line showing altered neuronal processing. Hypothalamic hypoactivation detected in LAB versus NAB mice may be associated with their low-anxiety/high-novelty-seeking phenotype. The detection of similarly disturbed activation patterns in a key set of anxiety-related brain areas in two independent models reflecting psychopathological states of trait anxiety confirms the notion that the altered brain activation in HAB animals is indeed characteristic of enhanced (pathological) anxiety, providing information for potential targets of therapeutic intervention

Year in review in Intensive Care Medicine 2009: II. Neurology, cardiovascular, experimental, pharmacology and sedation, communication and teaching

N/

Sarilumab in patients admitted to hospital with severe or critical COVID-19: a randomised, double-blind, placebo-controlled, phase 3 trial

Background: Elevated proinflammatory cytokines are associated with greater COVID-19 severity. We aimed to assess safety and efficacy of sarilumab, an interleukin-6 receptor inhibitor, in patients with severe (requiring supplemental oxygen by nasal cannula or face mask) or critical (requiring greater supplemental oxygen, mechanical ventilation, or extracorporeal support) COVID-19. Methods: We did a 60-day, randomised, double-blind, placebo-controlled, multinational phase 3 trial at 45 hospitals in Argentina, Brazil, Canada, Chile, France, Germany, Israel, Italy, Japan, Russia, and Spain. We included adults (≥18 years) admitted to hospital with laboratory-confirmed SARS-CoV-2 infection and pneumonia, who required oxygen supplementation or intensive care. Patients were randomly assigned (2:2:1 with permuted blocks of five) to receive intravenous sarilumab 400 mg, sarilumab 200 mg, or placebo. Patients, care providers, outcome assessors, and investigators remained masked to assigned intervention throughout the course of the study. The primary endpoint was time to clinical improvement of two or more points (seven point scale ranging from 1 [death] to 7 [discharged from hospital]) in the modified intention-to-treat population. The key secondary endpoint was proportion of patients alive at day 29. Safety outcomes included adverse events and laboratory assessments. This study is registered with ClinicalTrials.gov, NCT04327388; EudraCT, 2020-001162-12; and WHO, U1111-1249-6021. Findings: Between March 28 and July 3, 2020, of 431 patients who were screened, 420 patients were randomly assigned and 416 received placebo (n=84 [20%]), sarilumab 200 mg (n=159 [38%]), or sarilumab 400 mg (n=173 [42%]). At day 29, no significant differences were seen in median time to an improvement of two or more points between placebo (12·0 days [95% CI 9·0 to 15·0]) and sarilumab 200 mg (10·0 days [9·0 to 12·0]; hazard ratio [HR] 1·03 [95% CI 0·75 to 1·40]; log-rank p=0·96) or sarilumab 400 mg (10·0 days [9·0 to 13·0]; HR 1·14 [95% CI 0·84 to 1·54]; log-rank p=0·34), or in proportions of patients alive (77 [92%] of 84 patients in the placebo group; 143 [90%] of 159 patients in the sarilumab 200 mg group; difference −1·7 [−9·3 to 5·8]; p=0·63 vs placebo; and 159 [92%] of 173 patients in the sarilumab 400 mg group; difference 0·2 [−6·9 to 7·4]; p=0·85 vs placebo). At day 29, there were numerical, non-significant survival differences between sarilumab 400 mg (88%) and placebo (79%; difference +8·9% [95% CI −7·7 to 25·5]; p=0·25) for patients who had critical disease. No unexpected safety signals were seen. The rates of treatment-emergent adverse events were 65% (55 of 84) in the placebo group, 65% (103 of 159) in the sarilumab 200 mg group, and 70% (121 of 173) in the sarilumab 400 mg group, and of those leading to death 11% (nine of 84) were in the placebo group, 11% (17 of 159) were in the sarilumab 200 mg group, and 10% (18 of 173) were in the sarilumab 400 mg group. Interpretation: This trial did not show efficacy of sarilumab in patients admitted to hospital with COVID-19 and receiving supplemental oxygen. Adequately powered trials of targeted immunomodulatory therapies assessing survival as a primary endpoint are suggested in patients with critical COVID-19. Funding: Sanofi and Regeneron Pharmaceuticals

Rationale, study design, and analysis plan of the Alveolar Recruitment for ARDS Trial (ART): study protocol for a randomized controlled trial

BACKGROUND: Acute respiratory distress syndrome (ARDS) is associated with high in-hospital mortality. Alveolar recruitment followed by ventilation at optimal titrated PEEP may reduce ventilator-induced lung injury and improve oxygenation in patients with ARDS, but the effects on mortality and other clinical outcomes remain unknown. This article reports the rationale, study design, and analysis plan of the Alveolar Recruitment for ARDS Trial (ART). METHODS/DESIGN: ART is a pragmatic, multicenter, randomized (concealed), controlled trial, which aims to determine if maximum stepwise alveolar recruitment associated with PEEP titration is able to increase 28-day survival in patients with ARDS compared to conventional treatment (ARDSNet strategy). We will enroll adult patients with ARDS of less than 72 h duration. The intervention group will receive an alveolar recruitment maneuver, with stepwise increases of PEEP achieving 45 cmH2O and peak pressure of 60 cmH2O, followed by ventilation with optimal PEEP titrated according to the static compliance of the respiratory system. In the control group, mechanical ventilation will follow a conventional protocol (ARDSNet). In both groups, we will use controlled volume mode with low tidal volumes (4 to 6 mL/kg of predicted body weight) and targeting plateau pressure 6430 cmH2O. The primary outcome is 28-day survival, and the secondary outcomes are: length of ICU stay; length of hospital stay; pneumothorax requiring chest tube during first 7 days; barotrauma during first 7 days; mechanical ventilation-free days from days 1 to 28; ICU, in-hospital, and 6-month survival. ART is an event-guided trial planned to last until 520 events (deaths within 28 days) are observed. These events allow detection of a hazard ratio of 0.75, with 90% power and two-tailed type I error of 5%. All analysis will follow the intention-to-treat principle. DISCUSSION: If the ART strategy with maximum recruitment and PEEP titration improves 28-day survival, this will represent a notable advance to the care of ARDS patients. Conversely, if the ART strategy is similar or inferior to the current evidence-based strategy (ARDSNet), this should also change current practice as many institutions routinely employ recruitment maneuvers and set PEEP levels according to some titration metho

Global patient outcomes after elective surgery: prospective cohort study in 27 low-, middle- and high-income countries.

BACKGROUND: As global initiatives increase patient access to surgical treatments, there remains a need to understand the adverse effects of surgery and define appropriate levels of perioperative care. METHODS: We designed a prospective international 7-day cohort study of outcomes following elective adult inpatient surgery in 27 countries. The primary outcome was in-hospital complications. Secondary outcomes were death following a complication (failure to rescue) and death in hospital. Process measures were admission to critical care immediately after surgery or to treat a complication and duration of hospital stay. A single definition of critical care was used for all countries. RESULTS: A total of 474 hospitals in 19 high-, 7 middle- and 1 low-income country were included in the primary analysis. Data included 44 814 patients with a median hospital stay of 4 (range 2-7) days. A total of 7508 patients (16.8%) developed one or more postoperative complication and 207 died (0.5%). The overall mortality among patients who developed complications was 2.8%. Mortality following complications ranged from 2.4% for pulmonary embolism to 43.9% for cardiac arrest. A total of 4360 (9.7%) patients were admitted to a critical care unit as routine immediately after surgery, of whom 2198 (50.4%) developed a complication, with 105 (2.4%) deaths. A total of 1233 patients (16.4%) were admitted to a critical care unit to treat complications, with 119 (9.7%) deaths. Despite lower baseline risk, outcomes were similar in low- and middle-income compared with high-income countries. CONCLUSIONS: Poor patient outcomes are common after inpatient surgery. Global initiatives to increase access to surgical treatments should also address the need for safe perioperative care. STUDY REGISTRATION: ISRCTN5181700

Geoeconomic variations in epidemiology, ventilation management, and outcomes in invasively ventilated intensive care unit patients without acute respiratory distress syndrome: a pooled analysis of four observational studies

Background: Geoeconomic variations in epidemiology, the practice of ventilation, and outcome in invasively ventilated intensive care unit (ICU) patients without acute respiratory distress syndrome (ARDS) remain unexplored. In this analysis we aim to address these gaps using individual patient data of four large observational studies. Methods: In this pooled analysis we harmonised individual patient data from the ERICC, LUNG SAFE, PRoVENT, and PRoVENT-iMiC prospective observational studies, which were conducted from June, 2011, to December, 2018, in 534 ICUs in 54 countries. We used the 2016 World Bank classification to define two geoeconomic regions: middle-income countries (MICs) and high-income countries (HICs). ARDS was defined according to the Berlin criteria. Descriptive statistics were used to compare patients in MICs versus HICs. The primary outcome was the use of low tidal volume ventilation (LTVV) for the first 3 days of mechanical ventilation. Secondary outcomes were key ventilation parameters (tidal volume size, positive end-expiratory pressure, fraction of inspired oxygen, peak pressure, plateau pressure, driving pressure, and respiratory rate), patient characteristics, the risk for and actual development of acute respiratory distress syndrome after the first day of ventilation, duration of ventilation, ICU length of stay, and ICU mortality. Findings: Of the 7608 patients included in the original studies, this analysis included 3852 patients without ARDS, of whom 2345 were from MICs and 1507 were from HICs. Patients in MICs were younger, shorter and with a slightly lower body-mass index, more often had diabetes and active cancer, but less often chronic obstructive pulmonary disease and heart failure than patients from HICs. Sequential organ failure assessment scores were similar in MICs and HICs. Use of LTVV in MICs and HICs was comparable (42\ub74% vs 44\ub72%; absolute difference \u20131\ub769 [\u20139\ub758 to 6\ub711] p=0\ub767; data available in 3174 [82%] of 3852 patients). The median applied positive end expiratory pressure was lower in MICs than in HICs (5 [IQR 5\u20138] vs 6 [5\u20138] cm H2O; p=0\ub70011). ICU mortality was higher in MICs than in HICs (30\ub75% vs 19\ub79%; p=0\ub70004; adjusted effect 16\ub741% [95% CI 9\ub752\u201323\ub752]; p<0\ub70001) and was inversely associated with gross domestic product (adjusted odds ratio for a US$10 000 increase per capita 0\ub780 [95% CI 0\ub775\u20130\ub786]; p<0\ub70001). Interpretation: Despite similar disease severity and ventilation management, ICU mortality in patients without ARDS is higher in MICs than in HICs, with a strong association with country-level economic status. Funding: No funding