PikeLPN: Mitigating Overlooked Inefficiencies of Low-Precision Neural Networks

Low-precision quantization is recognized for its efficacy in neural network optimization. Our analysis reveals that non-quantized elementwise operations which are prevalent in layers such as parameterized activation functions, batch normalization, and quantization scaling dominate the inference cost of low-precision models. These non-quantized elementwise operations are commonly overlooked in SOTA efficiency metrics such as Arithmetic Computation Effort (ACE). In this paper, we propose ACEv2 - an extended version of ACE which offers a better alignment with the inference cost of quantized models and their energy consumption on ML hardware. Moreover, we introduce PikeLPN, a model that addresses these efficiency issues by applying quantization to both elementwise operations and multiply-accumulate operations. In particular, we present a novel quantization technique for batch normalization layers named QuantNorm which allows for quantizing the batch normalization parameters without compromising the model performance. Additionally, we propose applying Double Quantization where the quantization scaling parameters are quantized. Furthermore, we recognize and resolve the issue of distribution mismatch in Separable Convolution layers by introducing Distribution-Heterogeneous Quantization which enables quantizing them to low-precision. PikeLPN achieves Pareto-optimality in efficiency-accuracy trade-off with up to 3X efficiency improvement compared to SOTA low-precision models.Comment: Accepted in CVPR 2024. 10 Figures, 9 Table

Detection and investigation of temporal clusters of congenital anomaly in Europe: seven years of experience of the EUROCAT surveillance system

Detection and investigation of congenital anomaly clusters is one part of surveillance to detect new or changing teratogenic exposures in the population. The EUROCAT (European Surveillance of Congenital Anomalies) cluster monitoring system and results are described here. Monitoring was conducted annually from 2007 to 2013 for 18 registries covering an annual birth population up to 0.5 million births. For each registry and 72 anomaly subgroups, the scan “moving window” technique was used to detect clusters in time occurring within the last 2 years based on estimated date of conception. Registries conducted preliminary investigations using a standardised protocol to determine whether there was cause for concern, and expert review was used at key points. 165 clusters were detected, a rate of 3.4 % of all 4823 cluster tests performed over 7 years, more than expected by chance. Preliminary investigations of 126 new clusters confirmed that 35 % were an unusual aggregation of cases, while 56 % were explained by data quality or diagnostic issues, and 9 % were not investigated. For confirmed clusters, the registries’ course of action was continuing monitoring. Three confirmed clusters continued to grow in size for a limited period in subsequent monitoring. This system is best suited to early detection of exposures which are sudden, widespread and/or highly teratogenic, and was reassuring in demonstrating an absence of a sustained exposure of this type. Such proactive monitoring can be run efficiently without overwhelming the surveillance system with false positives, and serves an additional purpose of data quality control

ColdZyme® reduces viral load and upper respiratory tract infection duration and protects airway epithelia from infection with human rhinoviruses

Upper respiratory tract infection (URTI) has a significant economic and social impact and is a major factor compromising athletes’ training and competition. The effects of ColdZyme® Mouth Spray on URTI were investigated using an in vivo study in athletes, combined with a novel in vitro air–liquid interface human airway model. Endurance athletes were randomised to ColdZyme (n = 78) or placebo (n = 76) and monitored over 3 months. They completed daily symptom and training logs and collected throat swabs over 7 days during perceived URTI. In vitro studies examined rhinovirus infectivity and epithelial barrier integrity of airway epithelial cells. Eighty‐two in vivo episodes were analysed with significantly lower (P = 0.012) episode duration in the ColdZyme vs. Placebo group (mean ± SD, 6.2 ± 2.6, (median [interquartile range]) 5.5 [4–9] days vs. 10.7 ± 10.2, 7.0 [5–11]). There was no difference in incidence (P = 0.149). Training absence and symptom ratings were lower (P < 0.05) in the ColdZyme group. Swabs were returned for 50 episodes, with at least one pathogen detected in all (rhinovirus was most abundant). Absolute quantification (qPCR) for rhinovirus revealed a significantly lower 7‐day area under the curve in ColdZyme vs. placebo (median reduction, 94%, P = 0.029). In vitro, viral load was significantly lower (median reductions 80–100%), and epithelial barrier integrity better maintained, and no virus was detected by immunofluorescence analyses of pseudostratified epithelia, with ColdZyme treatment (all P < 0.05). ColdZyme is beneficial for reducing URTI duration, symptom ratings and missed training days. These novel data suggest that the mechanisms involve the protection of epithelial cells against rhinovirus infection and damage. image Key points: Upper respiratory tract infections (URTI) are a common complaint in the general population and athletes alike, with social, well‐being and economic consequences, including performance detriments in athletes and reduced work productivity in the general population. Strategies to minimise the risk of contracting a URTI and/or reduce the time taken to clear an infection are desirable to athletes and the general population alike. The present study employed an in vivo study with athletes in combination with a novel in vitro human airway cell model to examine the effects of ColdZyme Mouth Spray on URTI and viral infectivity. The duration for which URTI symptoms persisted was lower with ColdZyme treatment, which also resulted in fewer training absence days. Swabs from participants in the in vivo study and supernatants from the in vitro studies showed lower rhinovirus viral load with ColdZyme treatment compared with placebo or control

Co-infections, secondary infections, and antimicrobial use in patients hospitalised with COVID-19 during the first pandemic wave from the ISARIC WHO CCP-UK study: a multicentre, prospective cohort study

Background: Microbiological characterisation of co-infections and secondary infections in patients with COVID-19 is lacking, and antimicrobial use is high. We aimed to describe microbiologically confirmed co-infections and secondary infections, and antimicrobial use, in patients admitted to hospital with COVID-19. Methods: The International Severe Acute Respiratory and Emerging Infections Consortium (ISARIC) WHO Clinical Characterisation Protocol UK (CCP-UK) study is an ongoing, prospective cohort study recruiting inpatients from 260 hospitals in England, Scotland, and Wales, conducted by the ISARIC Coronavirus Clinical Characterisation Consortium. Patients with a confirmed or clinician-defined high likelihood of SARS-CoV-2 infection were eligible for inclusion in the ISARIC WHO CCP-UK study. For this specific study, we excluded patients with a recorded negative SARS-CoV-2 test result and those without a recorded outcome at 28 days after admission. Demographic, clinical, laboratory, therapeutic, and outcome data were collected using a prespecified case report form. Organisms considered clinically insignificant were excluded. Findings: We analysed data from 48 902 patients admitted to hospital between Feb 6 and June 8, 2020. The median patient age was 74 years (IQR 59–84) and 20 786 (42·6%) of 48 765 patients were female. Microbiological investigations were recorded for 8649 (17·7%) of 48 902 patients, with clinically significant COVID-19-related respiratory or bloodstream culture results recorded for 1107 patients. 762 (70·6%) of 1080 infections were secondary, occurring more than 2 days after hospital admission. Staphylococcus aureus and Haemophilus influenzae were the most common pathogens causing respiratory co-infections (diagnosed ≤2 days after admission), with Enterobacteriaceae and S aureus most common in secondary respiratory infections. Bloodstream infections were most frequently caused by Escherichia coli and S aureus. Among patients with available data, 13 390 (37·0%) of 36 145 had received antimicrobials in the community for this illness episode before hospital admission and 39 258 (85·2%) of 46 061 patients with inpatient antimicrobial data received one or more antimicrobials at some point during their admission (highest for patients in critical care). We identified frequent use of broad-spectrum agents and use of carbapenems rather than carbapenem-sparing alternatives. Interpretation: In patients admitted to hospital with COVID-19, microbiologically confirmed bacterial infections are rare, and more likely to be secondary infections. Gram-negative organisms and S aureus are the predominant pathogens. The frequency and nature of antimicrobial use are concerning, but tractable targets for stewardship interventions exist. Funding: National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, UK Department for International Development, Bill &amp; Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, and NIHR HPRU in Respiratory Infections at Imperial College London

Co-infections, secondary infections, and antimicrobial use in patients hospitalised with COVID-19 during the first pandemic wave from the ISARIC WHO CCP-UK study: a multicentre, prospective cohort study

Background: Microbiological characterisation of co-infections and secondary infections in patients with COVID-19 is lacking, and antimicrobial use is high. We aimed to describe microbiologically confirmed co-infections and secondary infections, and antimicrobial use, in patients admitted to hospital with COVID-19. Methods: The International Severe Acute Respiratory and Emerging Infections Consortium (ISARIC) WHO Clinical Characterisation Protocol UK (CCP-UK) study is an ongoing, prospective cohort study recruiting inpatients from 260 hospitals in England, Scotland, and Wales, conducted by the ISARIC Coronavirus Clinical Characterisation Consortium. Patients with a confirmed or clinician-defined high likelihood of SARS-CoV-2 infection were eligible for inclusion in the ISARIC WHO CCP-UK study. For this specific study, we excluded patients with a recorded negative SARS-CoV-2 test result and those without a recorded outcome at 28 days after admission. Demographic, clinical, laboratory, therapeutic, and outcome data were collected using a prespecified case report form. Organisms considered clinically insignificant were excluded. Findings: We analysed data from 48 902 patients admitted to hospital between Feb 6 and June 8, 2020. The median patient age was 74 years (IQR 59–84) and 20 786 (42·6%) of 48 765 patients were female. Microbiological investigations were recorded for 8649 (17·7%) of 48 902 patients, with clinically significant COVID-19-related respiratory or bloodstream culture results recorded for 1107 patients. 762 (70·6%) of 1080 infections were secondary, occurring more than 2 days after hospital admission. Staphylococcus aureus and Haemophilus influenzae were the most common pathogens causing respiratory co-infections (diagnosed ≤2 days after admission), with Enterobacteriaceae and S aureus most common in secondary respiratory infections. Bloodstream infections were most frequently caused by Escherichia coli and S aureus. Among patients with available data, 13 390 (37·0%) of 36 145 had received antimicrobials in the community for this illness episode before hospital admission and 39 258 (85·2%) of 46 061 patients with inpatient antimicrobial data received one or more antimicrobials at some point during their admission (highest for patients in critical care). We identified frequent use of broad-spectrum agents and use of carbapenems rather than carbapenem-sparing alternatives. Interpretation: In patients admitted to hospital with COVID-19, microbiologically confirmed bacterial infections are rare, and more likely to be secondary infections. Gram-negative organisms and S aureus are the predominant pathogens. The frequency and nature of antimicrobial use are concerning, but tractable targets for stewardship interventions exist. Funding: National Institute for Health Research (NIHR), UK Medical Research Council, Wellcome Trust, UK Department for International Development, Bill &amp; Melinda Gates Foundation, EU Platform for European Preparedness Against (Re-)emerging Epidemics, NIHR Health Protection Research Unit (HPRU) in Emerging and Zoonotic Infections at University of Liverpool, and NIHR HPRU in Respiratory Infections at Imperial College London

Characterisation of in-hospital complications associated with COVID-19 using the ISARIC WHO Clinical Characterisation Protocol UK: a prospective, multicentre cohort study

Background: COVID-19 is a multisystem disease and patients who survive might have in-hospital complications. These complications are likely to have important short-term and long-term consequences for patients, health-care utilisation, health-care system preparedness, and society amidst the ongoing COVID-19 pandemic. Our aim was to characterise the extent and effect of COVID-19 complications, particularly in those who survive, using the International Severe Acute Respiratory and Emerging Infections Consortium WHO Clinical Characterisation Protocol UK. Methods: We did a prospective, multicentre cohort study in 302 UK health-care facilities. Adult patients aged 19 years or older, with confirmed or highly suspected SARS-CoV-2 infection leading to COVID-19 were included in the study. The primary outcome of this study was the incidence of in-hospital complications, defined as organ-specific diagnoses occurring alone or in addition to any hallmarks of COVID-19 illness. We used multilevel logistic regression and survival models to explore associations between these outcomes and in-hospital complications, age, and pre-existing comorbidities. Findings: Between Jan 17 and Aug 4, 2020, 80 388 patients were included in the study. Of the patients admitted to hospital for management of COVID-19, 49·7% (36 367 of 73 197) had at least one complication. The mean age of our cohort was 71·1 years (SD 18·7), with 56·0% (41 025 of 73 197) being male and 81·0% (59 289 of 73 197) having at least one comorbidity. Males and those aged older than 60 years were most likely to have a complication (aged ≥60 years: 54·5% [16 579 of 30 416] in males and 48·2% [11 707 of 24 288] in females; aged &lt;60 years: 48·8% [5179 of 10 609] in males and 36·6% [2814 of 7689] in females). Renal (24·3%, 17 752 of 73 197), complex respiratory (18·4%, 13 486 of 73 197), and systemic (16·3%, 11 895 of 73 197) complications were the most frequent. Cardiovascular (12·3%, 8973 of 73 197), neurological (4·3%, 3115 of 73 197), and gastrointestinal or liver (0·8%, 7901 of 73 197) complications were also reported. Interpretation: Complications and worse functional outcomes in patients admitted to hospital with COVID-19 are high, even in young, previously healthy individuals. Acute complications are associated with reduced ability to self-care at discharge, with neurological complications being associated with the worst functional outcomes. COVID-19 complications are likely to cause a substantial strain on health and social care in the coming years. These data will help in the design and provision of services aimed at the post-hospitalisation care of patients with COVID-19. Funding: National Institute for Health Research and the UK Medical Research Council