17 research outputs found

    AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation

    Full text link
    Direct speech-to-speech translation (S2ST) aims to convert speech from one language into another, and has demonstrated significant progress to date. Despite the recent success, current S2ST models still suffer from distinct degradation in noisy environments and fail to translate visual speech (i.e., the movement of lips and teeth). In this work, we present AV-TranSpeech, the first audio-visual speech-to-speech (AV-S2ST) translation model without relying on intermediate text. AV-TranSpeech complements the audio stream with visual information to promote system robustness and opens up a host of practical applications: dictation or dubbing archival films. To mitigate the data scarcity with limited parallel AV-S2ST data, we 1) explore self-supervised pre-training with unlabeled audio-visual data to learn contextual representation, and 2) introduce cross-modal distillation with S2ST models trained on the audio-only corpus to further reduce the requirements of visual data. Experimental results on two language pairs demonstrate that AV-TranSpeech outperforms audio-only models under all settings regardless of the type of noise. With low-resource audio-visual data (10h, 30h), cross-modal distillation yields an improvement of 7.6 BLEU on average compared with baselines. Audio samples are available at https://AV-TranSpeech.github.ioComment: Accepted to ACL 202

    Effect of magnesium sulfate on cerebral vasospasm in the treatment of aneurysmal subarachnoid hemorrhage: a systematic review and meta-analysis

    Get PDF
    IntroductionThe use of magnesium sulfate for treating aneurysmal subarachnoid hemorrhage (aSAH) has shown inconsistent results across studies. To assess the impact of magnesium sulfate on outcomes after aSAH, we conducted a systematic review and meta-analysis of relevant randomized controlled trials.MethodsPubMed, Embase, and the Cochrane Library were searched for relevant literature on magnesium sulfate for aSAH from database inception to March 20, 2023. The primary outcome was cerebral vasospasm (CV), and secondary outcomes included delayed cerebral ischemia (DCI), secondary cerebral infarction, rebleeding, neurological dysfunction, and mortality.ResultsOf the 558 identified studies, 16 comprising 3,503 patients were eligible and included in the analysis. Compared with control groups (saline or standard treatment), significant differences were reported in outcomes of CV [odds ratio (OR) = 0.61, p = 0.04, 95% confidence interval (CI) (0.37–0.99)], DCI [OR = 0.57, p = 0.01, 95% CI (0.37–0.88)], secondary cerebral infarction [OR = 0.49, p = 0.01, 95% CI (0.27–0.87)] and neurological dysfunction [OR = 0.55, p = 0.04, 95% CI (0.32–0.96)] after magnesium sulfate administration, with no significant differences detected in mortality [OR = 0.92, p = 0.47, 95% CI (0.73–1.15)] and rebleeding [OR = 0.68, p = 0.55, 95% CI (0.19–2.40)] between the two groups.ConclusionThe superiority of magnesium sulfate over standard treatments for CV, DCI, secondary cerebral infarction, and neurological dysfunction in patients with aSAH was demonstrated. Further randomized trials are warranted to validate these findings with increased sample sizes

    Activating a Semiconductor-Liquid Junction via Laser-Derived Dual Interfacial Layers for Boosted Photoelectrochemical Water Splitting

    No full text
    The semiconductor liquid junction SCLJ , the dominant place in photoelectrochemical PEC catalysis, determines the interfacial activity and stability of photoelectrodes, whcih directly affects the viability of PEC hydrogen generation. Though efforts dedicated in past decades, a challenge remains regarding creating a synchronously active and stable SCLJ, owing to the technical hurdles of simultaneously overlaying the two advantages. The present work demonstrates that creating an SCLJ with a unique configuration of the dual interfacial layers can yield BiVO4 photoanodes with synchronously boosted photoelectrochemical activity and operational stability, with values located at the top in the records of such photoelectrodes. The bespoke dual interfacial layers, accessed via grafting laser generated carbon dots with phenolic hydroxyl groups LGCDs PHGs , are experimentally verified effective, not only in generating the uniform layer of LGCDs with covalent anchoring for inhibited photocorrosion, but also in activating, respectively, the charge separation and transfer in each layer for boosted charge carrier kinetics, resulting in FeNiOOH LGCDs PHGs MBVO photoanodes with a dual configuration with the photocurrent density of 6.08 mA cm amp; 8722;2 1.23 VRHE, and operational stability up to 120 h 1.23 VRHE. Further work exploring LGCDs PHGs from catecholic molecules warrants the proposed strategy as being a universal alternative for addressing the interfacial charge carrier kinetics and operational stability of semiconductor photoelectrode
    corecore