Incorporating Behavioral Constraints in Online AI Systems

AI systems that learn through reward feedback about the actions they take are increasingly deployed in domains that have significant impact on our daily life. However, in many cases the online rewards should not be the only guiding criteria, as there are additional constraints and/or priorities imposed by regulations, values, preferences, or ethical principles. We detail a novel online agent that learns a set of behavioral constraints by observation and uses these learned constraints as a guide when making decisions in an online setting while still being reactive to reward feedback. To define this agent, we propose to adopt a novel extension to the classical contextual multi-armed bandit setting and we provide a new algorithm called Behavior Constrained Thompson Sampling (BCTS) that allows for online learning while obeying exogenous constraints. Our agent learns a constrained policy that implements the observed behavioral constraints demonstrated by a teacher agent, and then uses this constrained policy to guide the reward-based online exploration and exploitation. We characterize the upper bound on the expected regret of the contextual bandit algorithm that underlies our agent and provide a case study with real world data in two application domains. Our experiments show that the designed agent is able to act within the set of behavior constraints without significantly degrading its overall reward performance.Comment: 9 pages, 6 figure

Infusing Knowledge into the Textual Entailment Task Using Graph Convolutional Networks

Textual entailment is a fundamental task in natural language processing. Most approaches for solving the problem use only the textual content present in training data. A few approaches have shown that information from external knowledge sources like knowledge graphs (KGs) can add value, in addition to the textual content, by providing background knowledge that may be critical for a task. However, the proposed models do not fully exploit the information in the usually large and noisy KGs, and it is not clear how it can be effectively encoded to be useful for entailment. We present an approach that complements text-based entailment models with information from KGs by (1) using Personalized PageR- ank to generate contextual subgraphs with reduced noise and (2) encoding these subgraphs using graph convolutional networks to capture KG structure. Our technique extends the capability of text models exploiting structural and semantic information found in KGs. We evaluate our approach on multiple textual entailment datasets and show that the use of external knowledge helps improve prediction accuracy. This is particularly evident in the challenging BreakingNLI dataset, where we see an absolute improvement of 5-20% over multiple text-based entailment models

Cerebral venous sinus thrombosis due to vaccine-induced immune thrombotic thrombocytopenia in middle-income countries

Background: Adenovirus-based COVID-19 vaccines are extensively used in low- and middle-income countries (LMICs). Remarkably, cases of cerebral venous sinus thrombosis due to vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) have rarely been reported from LMICs. Aims: We studied the frequency, manifestations, treatment, and outcomes of CVST-VITT in LMICs. Methods: We report data from an international registry on CVST after COVID-19 vaccination. VITT was classified according to the Pavord criteria. We compared CVST-VITT cases from LMICs to cases from high-income countries (HICs). Results: Until August 2022, 228 CVST cases were reported, of which 63 were from LMICs (all middle-income countries [MICs]: Brazil, China, India, Iran, Mexico, Pakistan, Turkey). Of these 63, 32 (51%) met the VITT criteria, compared to 103 of 165 (62%) from HICs. Only 5 of the 32 (16%) CVST-VITT cases from MICs had definite VITT, mostly because anti-platelet factor 4 antibodies were often not tested. The median age was 26 (interquartile range [IQR] 20–37) versus 47 (IQR 32–58) years, and the proportion of women was 25 of 32 (78%) versus 77 of 103 (75%) in MICs versus HICs, respectively. Patients from MICs were diagnosed later than patients from HICs (1/32 [3%] vs. 65/103 [63%] diagnosed before May 2021). Clinical manifestations, including intracranial hemorrhage, were largely similar as was intravenous immunoglobulin use. In-hospital mortality was lower in MICs (7/31 [23%, 95% confidence interval (CI) 11–40]) than in HICs (44/102 [43%, 95% CI 34–53], p = 0.039). Conclusions: The number of CVST-VITT cases reported from LMICs was small despite the widespread use of adenoviral vaccines. Clinical manifestations and treatment of CVST-VITT cases were largely similar in MICs and HICs, while mortality was lower in patients from MICs.</p

Sex differences in cerebral venous sinus thrombosis after adenoviral vaccination against COVID-19

Introduction: Cerebral venous sinus thrombosis associated with vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) is a severe disease with high mortality. There are few data on sex differences in CVST-VITT. The aim of our study was to investigate the differences in presentation, treatment, clinical course, complications, and outcome of CVST-VITT between women and men. Patients and methods: We used data from an ongoing international registry on CVST-VITT. VITT was diagnosed according to the Pavord criteria. We compared the characteristics of CVST-VITT in women and men. Results: Of 133 patients with possible, probable, or definite CVST-VITT, 102 (77%) were women. Women were slightly younger [median age 42 (IQR 28–54) vs 45 (28–56)], presented more often with coma (26% vs 10%) and had a lower platelet count at presentation [median (IQR) 50x109/L (28–79) vs 68 (30–125)] than men. The nadir platelet count was lower in women [median (IQR) 34 (19–62) vs 53 (20–92)]. More women received endovascular treatment than men (15% vs 6%). Rates of treatment with intravenous immunoglobulins were similar (63% vs 66%), as were new venous thromboembolic events (14% vs 14%) and major bleeding complications (30% vs 20%). Rates of good functional outcome (modified Rankin Scale 0-2, 42% vs 45%) and in-hospital death (39% vs 41%) did not differ. Discussion and conclusions: Three quarters of CVST-VITT patients in this study were women. Women were more severely affected at presentation, but clinical course and outcome did not differ between women and men. VITT-specific treatments were overall similar, but more women received endovascular treatment.</p

Sex differences in cerebral venous sinus thrombosis after adenoviral vaccination against COVID-19

Introduction: Cerebral venous sinus thrombosis associated with vaccine-induced immune thrombotic thrombocytopenia (CVST-VITT) is a severe disease with high mortality. There are few data on sex differences in CVST-VITT. The aim of our study was to investigate the differences in presentation, treatment, clinical course, complications, and outcome of CVST-VITT between women and men. Patients and methods: We used data from an ongoing international registry on CVST-VITT. VITT was diagnosed according to the Pavord criteria. We compared the characteristics of CVST-VITT in women and men. Results: Of 133 patients with possible, probable, or definite CVST-VITT, 102 (77%) were women. Women were slightly younger [median age 42 (IQR 28–54) vs 45 (28–56)], presented more often with coma (26% vs 10%) and had a lower platelet count at presentation [median (IQR) 50x109/L (28–79) vs 68 (30–125)] than men. The nadir platelet count was lower in women [median (IQR) 34 (19–62) vs 53 (20–92)]. More women received endovascular treatment than men (15% vs 6%). Rates of treatment with intravenous immunoglobulins were similar (63% vs 66%), as were new venous thromboembolic events (14% vs 14%) and major bleeding complications (30% vs 20%). Rates of good functional outcome (modified Rankin Scale 0-2, 42% vs 45%) and in-hospital death (39% vs 41%) did not differ. Discussion and conclusions: Three quarters of CVST-VITT patients in this study were women. Women were more severely affected at presentation, but clinical course and outcome did not differ between women and men. VITT-specific treatments were overall similar, but more women received endovascular treatment.</p

Measuring routine childhood vaccination coverage in 204 countries and territories, 1980-2019 : a systematic analysis for the Global Burden of Disease Study 2020, Release 1

Background Measuring routine childhood vaccination is crucial to inform global vaccine policies and programme implementation, and to track progress towards targets set by the Global Vaccine Action Plan (GVAP) and Immunization Agenda 2030. Robust estimates of routine vaccine coverage are needed to identify past successes and persistent vulnerabilities. Drawing from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2020, Release 1, we did a systematic analysis of global, regional, and national vaccine coverage trends using a statistical framework, by vaccine and over time. Methods For this analysis we collated 55 326 country-specific, cohort-specific, year-specific, vaccine-specific, and dosespecific observations of routine childhood vaccination coverage between 1980 and 2019. Using spatiotemporal Gaussian process regression, we produced location-specific and year-specific estimates of 11 routine childhood vaccine coverage indicators for 204 countries and territories from 1980 to 2019, adjusting for biases in countryreported data and reflecting reported stockouts and supply disruptions. We analysed global and regional trends in coverage and numbers of zero-dose children (defined as those who never received a diphtheria-tetanus-pertussis [DTP] vaccine dose), progress towards GVAP targets, and the relationship between vaccine coverage and sociodemographic development. Findings By 2019, global coverage of third-dose DTP (DTP3; 81.6% [95% uncertainty interval 80.4-82 .7]) more than doubled from levels estimated in 1980 (39.9% [37.5-42.1]), as did global coverage of the first-dose measles-containing vaccine (MCV1; from 38.5% [35.4-41.3] in 1980 to 83.6% [82.3-84.8] in 2019). Third- dose polio vaccine (Pol3) coverage also increased, from 42.6% (41.4-44.1) in 1980 to 79.8% (78.4-81.1) in 2019, and global coverage of newer vaccines increased rapidly between 2000 and 2019. The global number of zero-dose children fell by nearly 75% between 1980 and 2019, from 56.8 million (52.6-60. 9) to 14.5 million (13.4-15.9). However, over the past decade, global vaccine coverage broadly plateaued; 94 countries and territories recorded decreasing DTP3 coverage since 2010. Only 11 countries and territories were estimated to have reached the national GVAP target of at least 90% coverage for all assessed vaccines in 2019. Interpretation After achieving large gains in childhood vaccine coverage worldwide, in much of the world this progress was stalled or reversed from 2010 to 2019. These findings underscore the importance of revisiting routine immunisation strategies and programmatic approaches, recentring service delivery around equity and underserved populations. Strengthening vaccine data and monitoring systems is crucial to these pursuits, now and through to 2030, to ensure that all children have access to, and can benefit from, lifesaving vaccines. Copyright (C) 2021 The Author(s). Published by Elsevier Ltd.Peer reviewe