Investigating the Effects of Word Substitution Errors on Sentence Embeddings

A key initial step in several natural language processing (NLP) tasks involves embedding phrases of text to vectors of real numbers that preserve semantic meaning. To that end, several methods have been recently proposed with impressive results on semantic similarity tasks. However, all of these approaches assume that perfect transcripts are available when generating the embeddings. While this is a reasonable assumption for analysis of written text, it is limiting for analysis of transcribed text. In this paper we investigate the effects of word substitution errors, such as those coming from automatic speech recognition errors (ASR), on several state-of-the-art sentence embedding methods. To do this, we propose a new simulator that allows the experimenter to induce ASR-plausible word substitution errors in a corpus at a desired word error rate. We use this simulator to evaluate the robustness of several sentence embedding methods. Our results show that pre-trained neural sentence encoders are both robust to ASR errors and perform well on textual similarity tasks after errors are introduced. Meanwhile, unweighted averages of word vectors perform well with perfect transcriptions, but their performance degrades rapidly on textual similarity tasks for text with word substitution errors.Comment: 4 Pages, 2 figures. Copyright IEEE 2019. Accepted and to appear in the Proceedings of the 44th International Conference on Acoustics, Speech, and Signal Processing 2019 (IEEE-ICASSP-2019), May 12-17 in Brighton, U.K. Personal use of this material is permitted. However, permission to reprint/republish this material must be obtained from the IEE

A Cognitive-Perceptual Approach to Conceptualizing Speech Intelligibility Deficits and Remediation Practice in Hypokinetic Dysarthria

Hypokinetic dysarthria is a common manifestation of Parkinson's disease, which negatively influences quality of life. Behavioral techniques that aim to improve speech intelligibility constitute the bulk of intervention strategies for this population, as the dysarthria does not often respond vigorously to medical interventions. Although several case and group studies generally support the efficacy of behavioral treatment, much work remains to establish a rigorous evidence base. This absence of definitive research leaves both the speech-language pathologist and referring physician with the task of determining the feasibility and nature of therapy for intelligibility remediation in PD. The purpose of this paper is to introduce a novel framework for medical practitioners in which to conceptualize and justify potential targets for speech remediation. The most commonly targeted deficits (e.g., speaking rate and vocal loudness) can be supported by this approach, as well as underutilized and novel treatment targets that aim at the listener's perceptual skills

ALS Longitudinal Studies With Frequent Data Collection at Home: Study Design and Baseline Data

Objective: To design an ALS clinical study in which patients are remotely recruited, screened, enrolled and then assessed via daily data collection at home by themselves or caregivers. Methods: This observational, natural-history study included two academic medical centers, one providing overall clinical management and the other overseeing computing and web-services design and management. Both healthy and ALS subjects were recruited on the Internet via advertisement on governmental and foundation websites as well as through Facebook and Google paid advertisements. Individuals underwent screening and enrollment remotely, including signing an electronic informed consent form. Participants were then provided self-measurement equipment and instructed on their use through a series of web-based videos. The equipment included a handgrip dynamometer, spirometer with smartphone connection, electrical impedance myography device, and an activity tracker. ALS Functional Rating Scale-Revised data were also collected. Subjects were asked to collect data daily for three months and twice-weekly for the subsequent six months. Results: One hundred and eleven ALS patients and 30 healthy individuals enrolled in the study from across 41 states (74 men, 62 women). Baseline median ALSFRS-R score was 33. Seventy two percent of the ALS patients sent equipment and 88% of the healthy subjects sent equipment were able to complete a first set of measurements. Expected baseline differences between the ALS patients and healthy participants were identified for all measures. Conclusions: It is possible to design and institute an at-home based study in ALS patients, using a number of state-of-the-art approaches, including web-based consenting and training and Internet-connected measurement devices

The SOLAS air-sea gas exchange experiment (SAGE) 2004

Author Posting. © The Author(s), 2010. This is the author's version of the work. It is posted here by permission of Elsevier B.V. for personal use, not for redistribution. The definitive version was published in Deep Sea Research Part II: Topical Studies in Oceanography 58 (2011): 753-763, doi:10.1016/j.dsr2.2010.10.015.The SOLAS air-sea gas exchange experiment (SAGE) was a multiple-objective study investigating gas-transfer processes and the influence of iron fertilisation on biologically driven gas exchange in high-nitrate low-silicic acid low-chlorophyll (HNLSiLC) Sub-Antarctic waters characteristic of the expansive Subpolar Zone of the southern oceans. This paper provides a general introduction and summary of the main experimental findings. The release site was selected from a pre-voyage desktop study of environmental parameters to be in the south-west Bounty Trough (46.5°S 172.5°E) to the south-east of New Zealand and the experiment conducted between mid-March and mid-April 2004. In common with other mesoscale iron addition experiments (FeAX’s), SAGE was designed as a Lagrangian study quantifying key biological and physical drivers influencing the air-sea gas exchange processes of CO2, DMS and other biogenic gases associated with an iron-induced phytoplankton bloom. A dual tracer SF6/3He release enabled quantification of both the lateral evolution of a labelled volume (patch) of ocean and the air-sea tracer exchange at the 10’s of km’s scale, in conjunction with the iron fertilisation. Estimates from the dual-tracer experiment found a quadratic dependency of the gas exchange coefficient on windspeed that is widely applicable and describes air-sea gas exchange in strong wind regimes. Within the patch, local and micrometeorological gas exchange process studies (100 m scale) and physical variables such as near-surface turbulence, temperature microstructure at the interface, wave properties, and wind speed were quantified to further assist the development of gas exchange models for high-wind environments. There was a significant increase in the photosynthetic competence (Fv/Fm) of resident phytoplankton within the first day following iron addition, but in contrast to other FeAX’s, rates of net primary production and column-integrated chlorophyll a concentrations had only doubled relative to the unfertilised surrounding waters by the end of the experiment. After 15 days and four iron additions totalling 1.1 tonne Fe2+, this was a very modest response compared to the other mesoscale iron enrichment experiments. An investigation of the factors limiting bloom development considered co- limitation by light and other nutrients, the phytoplankton seed-stock and grazing regulation. Whilst incident light levels and the initial Si:N ratio were the lowest recorded in all FeAX’s to date, there was only a small seed-stock of diatoms (less than 1% of biomass) and the main response to iron addition was by the picophytoplankton. A high rate of dilution of the fertilised patch relative to phytoplankton growth rate, the greater than expected depth of the surface mixed layer and microzooplankton grazing were all considered as factors that prevented significant biomass accumulation. In line with the limited response, the enhanced biological draw-down of pCO2 was small and masked by a general increase in pCO2 due to mixing with higher pCO2 waters. The DMS precursor DMSP was kept in check through grazing activity and in contrast to most FeAX’s dissolved dimethylsulfide (DMS) concentration declined through the experiment. SAGE is an important low-end member in the range of responses to iron addition in FeAX’s. In the context of iron fertilisation as a geoengineering tool for atmospheric CO2 removal, SAGE has clearly demonstrated that a significant proportion of the low iron ocean may not produce a phytoplankton bloom in response to iron addition.SAGE was jointly funded through the New Zealand Foundation for Research, Science and Technology (FRST) programs (C01X0204) "Drivers and Mitigation of Global Change" and (C01X0223) "Ocean Ecosystems: Their Contribution to NZ Marine Productivity." Funding was also provided for specific collaborations by the US National Science Foundation from grants OCE-0326814 (Ward), OCE-0327779 (Ho), and OCE 0327188 OCE-0326814 (Minnett) and the UK Natural Environment Research Council NER/B/S/2003/00282 (Archer). The New Zealand International Science and Technology (ISAT) linkages fund provided additional funding (Archer and Ziolkowski), and the many collaborator institutions also provided valuable support