1,376 research outputs found

    T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5

    Full text link
    In Spoken language understanding (SLU), a natural solution is concatenating pre-trained speech models (e.g. HuBERT) and pretrained language models (PLM, e.g. T5). Most previous works use pretrained language models with subword-based tokenization. However, the granularity of input units affects the alignment of speech model outputs and language model inputs, and PLM with character-based tokenization is underexplored. In this work, we conduct extensive studies on how PLMs with different tokenization strategies affect spoken language understanding task including spoken question answering (SQA) and speech translation (ST). We further extend the idea to create T5lephone(pronounced as telephone), a variant of T5 that is pretrained using phonemicized text. We initialize T5lephone with existing PLMs to pretrain it using relatively lightweight computational resources. We reached state-of-the-art on NMSQA, and the T5lephone model exceeds T5 with other types of units on end-to-end SQA and ST

    Hemispheric dispersion of radioactive plume laced with fission nuclides from the Fukushima nuclear event

    Get PDF
    Radioactivities of particulate 131I and 137Cs released from the Fukushima nuclear accident were monitored in a regional aerosol network including two high mountain sites (central Taiwan and Tibetan Plateau). The results were integrated with data measured elsewhere around the world, with special focus on the mid-latitudes. The hemispheric transport of the Fukushima radiation clouds (FRCs) by the westerlies took 18days,displayinganexponentiallikedecreaseeastward,withadilutionfactorofatleastfiveordersofmagnitudefollowingafullcircuitaroundtheglobe.TheinitialtwowavesofFRCsmaytravelatdifferentatitudes:thefirstoneat18 days, displaying an exponential-like decrease eastward, with a dilution factor of at least five orders of magnitude following a full circuit around the globe. The initial two waves of FRCs may travel at different atitudes: the first one at 3–4 km, whereas the second one up to 5 km or more. 131I and 137Cs were fractionated during transport, with 137Cs concentrated in the shallower layer, susceptible to depositional removal, while 131I moving faster and higher. This accident may be exemplified to identify some atmospheric processes on the hemispheric scale

    Plasma Metabolites associated With Cognitive Function across Race/Ethnicities affirming the Importance of Healthy Nutrition

    Get PDF
    INTRODUCTION: We studied the replication and generalization of previously identified metabolites potentially associated with global cognitive function in multiple race/ethnicities and assessed the contribution of diet to these associations. METHODS: We tested metabolite-cognitive function associations in U.S.A. Hispanic/Latino adults (n = 2222) from the Community Health Study/ Study of Latinos (HCHS/SOL) and in European (n = 1365) and African (n = 478) Americans from the Atherosclerosis Risk In Communities (ARIC) Study. We applied Mendelian Randomization (MR) analyses to assess causal associations between the metabolites and cognitive function and between Mediterranean diet and cognitive function. RESULTS: Six metabolites were consistently associated with lower global cognitive function across all studies. Of these, four were sugar-related (e.g., ribitol). MR analyses provided weak evidence for a potential causal effect of ribitol on cognitive function and bi-directional effects of cognitive performance on diet. DISCUSSION: Several diet-related metabolites were associated with global cognitive function across studies with different race/ethnicities. HIGHLIGHTS: Metabolites associated with cognitive function in Puerto Rican adults were recently identified. We demonstrate the generalizability of these associations across diverse race/ethnicities. Most identified metabolites are related to sugars. Mendelian Randomization (MR) provides weak evidence for a causal effect of ribitol on cognitive function. Beta-cryptoxanthin and other metabolites highlight the importance of a healthy diet

    IMPAD1 functions as mitochondrial electron transport inhibitor that prevents ROS production and promotes lung cancer metastasis through the AMPK-Notch1-HEY1 pathway

    Get PDF
    The tumor microenvironment (TME) and metabolic reprogramming have been implicated in cancer development and progression. However, the link between TME, metabolism, and cancer progression in lung cancer is unclear. In the present study, we identified IMPAD1 from the conditioned medium of highly invasive CL1-5. High expression of IMPAD1 was associated with a poorer clinical phenotype in lung cancer patients, with reduced survival and increased lymph node metastasis. Knockdown of IMPAD1 significantly inhibited migration/invasion abilities and metastasis in vitro and in vivo. Upregulation of IMPAD1 and subsequent accumulation of AMP in cells increased the pAMPK, leading to Notch1 and HEY1 upregulation. As AMP is an ADORA1 agonist, treatment with ADORA1 inhibitor reduced the expression of pAMPK and HEY1 expression in IMPAD1-overexpressing cells. IMPAD1 caused mitochondria dysfunction by inhibiting mitochondrial Complex I activity, which reduced mitochondrial ROS levels and activated the AMPK-HEY1 pathway. Collectively this study supports the multipotent role of IMPAD1 in promotion of lung cancer metastasis by simultaneously increasing AMP levels, inhibition of Complex I activity to decrease ROS levels, thereby activating AMPK-Notch1-HEY1 signaling, and providing an alternative metabolic pathway in energy stress conditions

    The effect of low-level laser irradiation (In-Ga-Al-AsP - 660 nm) on melanoma in vitro and in vivo

    Get PDF
    <p>Abstract</p> <p>Background</p> <p>It has been speculated that the biostimulatory effect of Low Level Laser Therapy could cause undesirable enhancement of tumor growth in neoplastic diseases. The aim of the present study is to analyze the behavior of melanoma cells (B16F10) <it>in vitro </it>and the <it>in vivo </it>development of melanoma in mice after laser irradiation.</p> <p>Methods</p> <p>We performed a controlled <it>in vitro </it>study on B16F10 melanoma cells to investigate cell viability and cell cycle changes by the Tripan Blue, MTT and cell quest histogram tests at 24, 48 and 72 h post irradiation. The <it>in vivo </it>mouse model (male Balb C, n = 21) of melanoma was used to analyze tumor volume and histological characteristics. Laser irradiation was performed three times (once a day for three consecutive days) with a 660 nm 50 mW CW laser, beam spot size 2 mm<sup>2</sup>, irradiance 2.5 W/cm<sup>2 </sup>and irradiation times of 60s (dose 150 J/cm<sup>2</sup>) and 420s (dose 1050 J/cm<sup>2</sup>) respectively.</p> <p>Results</p> <p>There were no statistically significant differences between the <it>in vitro </it>groups, except for an increase in the hypodiploid melanoma cells (8.48 ± 1.40% and 4.26 ± 0.60%) at 72 h post-irradiation. This cancer-protective effect was not reproduced in the <it>in vivo </it>experiment where outcome measures for the 150 J/cm<sup>2 </sup>dose group were not significantly different from controls. For the 1050 J/cm<sup>2 </sup>dose group, there were significant increases in tumor volume, blood vessels and cell abnormalities compared to the other groups.</p> <p>Conclusion</p> <p>LLLT Irradiation should be avoided over melanomas as the combination of high irradiance (2.5 W/cm<sup>2</sup>) and high dose (1050 J/cm<sup>2</sup>) significantly increases melanoma tumor growth <it>in vivo</it>.</p
    corecore