561 research outputs found

    Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASR

    Full text link
    An end-to-end (E2E) ASR model implicitly learns a prior Internal Language Model (ILM) from the training transcripts. To fuse an external LM using Bayes posterior theory, the log likelihood produced by the ILM has to be accurately estimated and subtracted. In this paper we propose two novel approaches to estimate the ILM based on Listen-Attend-Spell (LAS) framework. The first method is to replace the context vector of the LAS decoder at every time step with a vector that is learned with training transcripts. Furthermore, we propose another method that uses a lightweight feed-forward network to directly map query vector to context vector in a dynamic sense. Since the context vectors are learned by minimizing the perplexities on training transcripts, and their estimation is independent of encoder output, hence the ILMs are accurately learned for both methods. Experiments show that the ILMs achieve the lowest perplexity, indicating the efficacy of the proposed methods. In addition, they also significantly outperform the shallow fusion method, as well as two previously proposed ILM Estimation (ILME) approaches on several datasets.Comment: Proceedings of INTERSPEEC

    mHealth in China and the United States: How Mobile Technology is Transforming Healthcare in the World's Two Largest Economies

    Get PDF
    In this paper, we explore ways mobile technology can help with these difficulties. Specifically, we look at avenues through which mobile devices boost productivity, aid communications, and help providers improve affordability, access, and treatment. Using data drawn from China and the United States as well as global trends, we look at recent developments andemerging opportunities in mobile health, or mHealth. We argue that mobile technology assists patients, health providers, and policymakers in several different respects. It helps patients by giving them tools to monitor their health conditions and communicate those results to physicians. It enables health providers to connect with colleagues and offers alternative sources of information for patients. It is also an important tool to inform policymakers on health delivery and medical outcomes
    • …
    corecore