Dynamic ASR Pathways: An Adaptive Masking Approach Towards Efficient Pruning of A Multilingual ASR Model

Neural network pruning offers an effective method for compressing a multilingual automatic speech recognition (ASR) model with minimal performance loss. However, it entails several rounds of pruning and re-training needed to be run for each language. In this work, we propose the use of an adaptive masking approach in two scenarios for pruning a multilingual ASR model efficiently, each resulting in sparse monolingual models or a sparse multilingual model (named as Dynamic ASR Pathways). Our approach dynamically adapts the sub-network, avoiding premature decisions about a fixed sub-network structure. We show that our approach outperforms existing pruning methods when targeting sparse monolingual models. Further, we illustrate that Dynamic ASR Pathways jointly discovers and trains better sub-networks (pathways) of a single multilingual model by adapting from different sub-network initializations, thereby reducing the need for language-specific pruning

Differential Susceptibility of Human Peripheral Blood T Cells to Suppression by Environmental Levels of Sodium Arsenite and Monomethylarsonous Acid

Human exposure to arsenic in drinking water is known to contribute to many different health outcomes such as cancer, diabetes, and cardiopulmonary disease. Several epidemiological studies suggest that T cell function is also altered by drinking water arsenic exposure. However, it is unclear how individual responses differ to various levels of exposure to arsenic. Our laboratory has recently identified differential responses of human peripheral blood mononuclear cell (HPMBC) T cells as measured by polyclonal T cell activation by mitogens during sodium arsenite exposure. T cells from certain healthy individuals exposed to various concentrations (1–100 nM) of arsenite in vitro showed a dose-dependent suppression at these extremely low concentrations (∼0.1–10 ppb) of arsenite, whereas other individuals were not suppressed at low concentrations. In a series of more than 30 normal donors, two individuals were found to be sensitive to low concentration (10 nM equivalent ∼1 ppb drinking water exposure) to sodium arsenite-induced inhibition of T cell proliferation produced by phytohemagglutinin (PHA) and anti-CD3/anti-CD28. In an arsenite-susceptible individual, arsenite suppressed the activation of Th1 (Tbet) cells, and decreased the percentage of cells in the double positive Th17 (RORγt) and Treg (FoxP3) population. While the majority of normal blood donors tested were not susceptible to inhibition of proliferation at the 1–100 nM concentrations of As+3, it was found that all donors were sensitive to suppression by 100 nM monomethylarsonous acid (MMA+3), a key metabolite of arsenite. Thus, our studies demonstrate for the first time that low ppb-equivalent concentrations of As+3 are immunosuppressive to HPBMC T cells in some individuals, but that most donor HPBMC are sensitive to suppression by MMA+3 at environmentally relevant exposure levels

Prompting Large Language Models with Speech Recognition Abilities

Large language models have proven themselves highly flexible, able to solve a wide range of generative tasks, such as abstractive summarization and open-ended question answering. In this paper we extend the capabilities of LLMs by directly attaching a small audio encoder allowing it to perform speech recognition. By directly prepending a sequence of audial embeddings to the text token embeddings, the LLM can be converted to an automatic speech recognition (ASR) system, and be used in the exact same manner as its textual counterpart. Experiments on Multilingual LibriSpeech (MLS) show that incorporating a conformer encoder into the open sourced LLaMA-7B allows it to outperform monolingual baselines by 18% and perform multilingual speech recognition despite LLaMA being trained overwhelmingly on English text. Furthermore, we perform ablation studies to investigate whether the LLM can be completely frozen during training to maintain its original capabilities, scaling up the audio encoder, and increasing the audio encoder striding to generate fewer embeddings. The results from these studies show that multilingual ASR is possible even when the LLM is frozen or when strides of almost 1 second are used in the audio encoder opening up the possibility for LLMs to operate on long-form audio

Advances in targeting cyclic nucleotide phosphodiesterases

Cyclic nucleotide phosphodiesterases (PDEs) catalyse the hydrolysis of cyclic AMP and cyclic GMP, thereby regulating the intracellular concentrations of these cyclic nucleotides, their signalling pathways and, consequently, myriad biological responses in health and disease. Currently, a small number of PDE inhibitors are used clinically for treating the pathophysiological dysregulation of cyclic nucleotide signalling in several disorders, including erectile dysfunction, pulmonary hypertension, acute refractory cardiac failure, intermittent claudication and chronic obstructive pulmonary disease. However, pharmaceutical interest in PDEs has been reignited by the increasing understanding of the roles of individual PDEs in regulating the subcellular compartmentalization of specific cyclic nucleotide signalling pathways, by the structure-based design of novel specific inhibitors and by the development of more sophisticated strategies to target individual PDE variants

A semi-automatic segmentation method for meningioma developed using a variational approach model

Background Meningioma is the commonest primary brain tumour. Volumetric post-contrast magnetic resonance imaging (MRI) is recognised as gold standard for delineation of meningioma volume but is hindered by manual processing times. We aimed to investigate the utility of a model-based variational approach in segmenting meningioma. Methods A database of patients with a meningioma (2007–2015) was queried for patients with a contrast-enhanced volumetric MRI, who had consented to a research tissue biobank. Manual segmentation by a neuroradiologist was performed and results were compared to the mathematical model, using a battery of tests including the Sørensen–Dice coefficient (DICE) and JACCARD index. A publicly available meningioma dataset (708 segmented T1 contrast-enhanced slices) was also used to test the reliability of the model. Results 49 meningioma cases were included. The most common meningioma location was convexity (n = 15, 30.6%). The mathematical model segmented all but one incidental meningioma, which failed due to the lack of contrast uptake. The median meningioma volume by manual segmentation was 19.0 cm3 (IQR 4.9–31.2). The median meningioma volume using the mathematical model was 16.9 cm3 (IQR 4.6–28.34). The mean DICE score was 0.90 (SD = 0.04). The mean JACCARD index was 0.82 (SD = 0.07). For the publicly available dataset, the mean DICE and JACCARD scores were 0.90 (SD = 0.06) and 0.82 (SD = 0.10), respectively. Conclusions Segmentation of meningioma volume using the proposed mathematical model was possible with accurate results. Application of this model on contrast-enhanced volumetric imaging may help reduce work burden on neuroradiologists with the increasing number in meningioma diagnoses

Superconductivity above 70 K observed in lutetium polyhydrides

The binary polyhydrides of heavy rare earth lutetium that shares a similar valence electron configuration to lanthanum have been experimentally discovered to be superconductive. The lutetium polyhydrides were successfully synthesized at high pressure and high temperature conditions using a diamond anvil cell in combinations with the in-situ high pressure laser heating technique. The resistance measurements as a function of temperature were performed at the same pressure of synthesis in order to study the transitions of superconductivity (SC). The superconducting transition with a maximum onset temperature (Tc) 71 K was observed at pressure of 218 GPa in the experiments. The Tc decreased to 65 K when pressure was at 181 GPa. From the evolution of SC at applied magnetic fields, the upper critical field at zero temperature {\mu}0Hc2(0) was obtained to be ~36 Tesla. The in-situ high pressure X-ray diffraction experiments imply that the high Tc SC should arise from the Lu4H23 phase with Pm-3n symmetry that forms a new type of hydrogen cage framework different from those reported for previous light rare earth polyhydride superconductors

Observational study on variability between biobanks in the estimation of DNA concentration.

BACKGROUND: There is little confidence in the consistency of estimation of DNA concentrations when samples move between laboratories. Evidence on this consistency is largely anecdotal. Therefore there is a need first to measure this consistency among different laboratories and then identify and implement remedies. A pilot experiment to test logistics and provide initial data on consistency was therefore conceived. METHODS: DNA aliquots at nominal concentrations between 10 and 300 ng/mul were dispensed into the wells of 96-well plates by one participant - the coordinating centre. Participants estimated the concentration in each well and returned estimates to the coordinating centre. RESULTS: Considerable overall variability was observed among estimates. There were statistically significant differences between participants' measurements and between fluorescence emission and absorption spectroscopy. CONCLUSION: Anecdotal evidence of variability in DNA concentration estimation has been substantiated. Reduction in variability between participants will require the identification of major sources of variation, specification of effective remedies and their implementation

Drug utilization and cost in a Medicaid population: A simulation study of community vs. mail order pharmacy

<p>Abstract</p> <p>Background</p> <p>Outpatient drugs are dispensed through both community and mail order pharmacies. There is no empirical evidence that substitution of community pharmacy with mail order reduces overall drug expenditures. The need for evaluating the potential effects on utilization and costs of the possible extension of mail order services in Medicaid provides the rationale for conducting this study. This study compares drug utilization and drug product cost in community vs. mail order pharmacy dispensing services in a Medicaid population.</p> <p>Methods</p> <p>This study is a retrospective cohort study comparing utilization and cost patterns in community vs. mail order pharmacy. A simulation model was employed to assess drug utilization and cost in mail order pharmacy using community pharmacy claim data. The model assumed that courses of drug therapy (CDT) in mail order pharmacy would have utilization patterns similar to those found in community pharmacy. A 95% confidence interval surrounding changes in average utilization and average cost were estimated using bootstrap analysis. A sensitivity analysis was performed by varying drug selection criteria and supply, fill point, and medication possession ratio (MPR). Sub-analyses were performed to address differences between mail order and community pharmacy related to therapeutic class and dual-eligible patients.</p> <p>Data for the study derived from pharmacy claims database of Ohio Medicaid State program for the period January 2000-September 2004. Drug claims were aggregated to obtain a set of CDTs representing unique patient IDs and unique drug products. Drug product cost estimates excluded dispensing fees and were used to estimate the cost reduction required in mail order to become cost neutral in comparison with community pharmacy.</p> <p>Results</p> <p>The baseline model revealed that the use of mail order vs. community pharmacy would result in a 5.5% increase in drug utilization and a 5.4% cost reduction required in mail order to become cost neutral. Results from Ohio Medicaid drugs for chronic use revealed a 5.1% increase in utilization and a 4.9% cost reduction required to become cost neutral in comparison with community pharmacy.</p> <p>Conclusion</p> <p>The results of the simulation model indicate that mail order pharmacy increases drug utilization and can also increase drug product cost if the cost per unit is not reduced accordingly. Prior consideration should be given to the patient population, day-supply, disease, therapy, and insurance characteristics to ensure the appropriate use of mail order pharmacy services.</p

A phase I study evaluating the pharmacokinetics, safety and tolerability of an antibody-based tissue factor antagonist in subjects with acute lung injury or acute respiratory distress syndrome

<p>Abstract</p> <p>Background</p> <p>The tissue factor (TF)-dependent extrinsic pathway has been suggested to be a central mechanism by which the coagulation cascade is locally activated in the lungs of patients with acute lung injury and acute respiratory distress syndrome (ALI/ARDS) and thus represents an attractive target for therapeutic intervention. This study was designed to determine the pharmacokinetic and safety profiles of ALT-836, an anti-TF antibody, in patients with ALI/ARDS.</p> <p>Methods</p> <p>This was a prospective, randomized, placebo-controlled, dose-escalation Phase I clinical trial in adult patients who had suspected or proven infection, were receiving mechanical ventilation and had ALI/ARDS (PaO₂/FiO₂≤ 300 mm). Eighteen patients (6 per cohort) were randomized in a 5:1 ratio to receive ALT-836 or placebo, and were treated within 48 hours after meeting screening criteria. Cohorts of patients were administered a single intravenously dose of 0.06, 0.08 or 0.1 mg/kg ALT-836 or placebo. Blood samples were taken for pharmacokinetic and immunogenicity measurements. Safety was assessed by adverse events, vital signs, ECGs, laboratory, coagulation and pulmonary function parameters.</p> <p>Results</p> <p>Pharmacokinetic analysis showed a dose dependent exposure to ALT-836 across the infusion range of 0.06 to 0.1 mg/kg. No anti-ALT-836 antibody response was observed in the study population during the trial. No major bleeding episodes were reported in the ALT-836 treated patients. The most frequent adverse events were anemia, observed in both placebo and ALT-836 treated patients, and ALT-836 dose dependent, self-resolved hematuria, which suggested 0.08 mg/kg as an acceptable dose level of ALT-836 in this patient population.</p> <p>Conclusions</p> <p>Overall, this study showed that ALT-836 could be safely administered to patients with sepsis-induced ALI/ARDS.</p> <p>Trial registration</p> <p>ClinicalTrials.gov: <a href="http://www.clinicaltrials.gov/ct2/show/NCT01438853">NCT01438853</a></p