BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition

We summarize the results of a host of efforts using giant automatic speech recognition (ASR) models pre-trained using large, diverse unlabeled datasets containing approximately a million hours of audio. We find that the combination of pre-training, self-training and scaling up model size greatly increases data efficiency, even for extremely large tasks with tens of thousands of hours of labeled data. In particular, on an ASR task with 34k hours of labeled data, by fine-tuning an 8 billion parameter pre-trained Conformer model we can match state-of-the-art (SoTA) performance with only 3% of the training data and significantly improve SoTA with the full training set. We also report on the universal benefits gained from using big pre-trained and self-trained models for a large set of downstream tasks that cover a wide range of speech domains and span multiple orders of magnitudes of dataset sizes, including obtaining SoTA performance on many public benchmarks. In addition, we utilize the learned representation of pre-trained networks to achieve SoTA results on non-ASR tasks.Comment: 14 pages, 7 figures, 13 tables; v2: minor corrections, reference baselines and bibliography updated; v3: corrections based on reviewer feedback, bibliography update

Is it feasible and safe to wake cardiac arrest patients receiving mild therapeutic hypothermia after 12 hours to enable early neuro-prognostication. The Therapeutic Hypothermia and eArly Waking (THAW) trial protocol

Mild therapeutic hypothermia (MTH 33°C) post out-of-hospital cardiac arrest (OHCA) is widely accepted as standard of care. However, uncertainty remains around the dose and therapy duration. OHCA patients are usually kept sedated±paralyzed and ventilated for the first 24–36 hours, which allows for targeted temperature management, but makes neurological prognostication challenging. The aim of this study is to investigate the feasibility and safety of assessing the unconscious OHCA patient after 12 hours for early waking/extubation while continuing to provide MTH for 24 hours, and fever prevention for 72 hours by using an intravenous temperature management (IVTM) system and established conscious MTH anti-shiver regimens. This is a single-center, prospective, non-randomized observational study that will compare the results of early awakening (at 12 hours) with historical controls. A total of 50 consecutive unconscious survivors of OHCA, treated with MTH, who meet the Therapeutic Hypothermia and eArly Waking (THAW) inclusion criteria will be enrolled. The patient will receive MTH by using IVTM. After 12 hours of MTH, patients will be assessed by using strict clinical criteria to determine suitability for early waking and extubation. Once awake and extubated, MTH will continue for 24 hours with skin counter-warming and anti-shiver regimen followed fever prevention up to 72 hours. All patients will have serial electroencephalogram (EEG), somatic sensory potential, and neuro-biomarkers performed on admission to intensive care unit, 6 and 12 hours, then every 24 hours until 72 hours. The study has been approved by the National Research Ethics Service, Health Research Authority

Stability and Control characteristics of MIG-21 aircraft

This document provides the stability and control derivatives data for the MIG-21BIS aircraft in the form readily usable for control system synthesis. Analytical prediction of the aircraft modes, typical time responses as well as Bode plots in the frequency domain are presented. Longitudinal dynamics data presented in this document supersedes the one provided in NAL PD SE 8501