Towards Language-Universal End-to-End Speech Recognition

Building speech recognizers in multiple languages typically involves replicating a monolingual training recipe for each language, or utilizing a multi-task learning approach where models for different languages have separate output labels but share some internal parameters. In this work, we exploit recent progress in end-to-end speech recognition to create a single multilingual speech recognition system capable of recognizing any of the languages seen in training. To do so, we propose the use of a universal character set that is shared among all languages. We also create a language-specific gating mechanism within the network that can modulate the network's internal representations in a language-specific way. We evaluate our proposed approach on the Microsoft Cortana task across three languages and show that our system outperforms both the individual monolingual systems and systems built with a multi-task learning approach. We also show that this model can be used to initialize a monolingual speech recognizer, and can be used to create a bilingual model for use in code-switching scenarios.Comment: submitted to ICASSP 201

Chartering the Way to a Free and Appropriate Public Education (FAPE): The Challenges for Charter Schools to Provide FAPE

Charter schools are publicly funded schools that are an integral part of the school choice movement, following a market-model of education based on autonomy, competition, and choice. However, charter schools are also mandated to adhere to all laws and regulations in the Individuals with Disabilities Education Act (IDEA) when educating students with disabilities. The education of students with disabilities within the charter school environment can result in policy tensions. This paper will examine the salient issues surrounding special education as it pertains to the state, authorizer, and operator in the areas of transparency, processes, and outcomes

Improved training for online end-to-end speech recognition systems

Achieving high accuracy with end-to-end speech recognizers requires careful parameter initialization prior to training. Otherwise, the networks may fail to find a good local optimum. This is particularly true for online networks, such as unidirectional LSTMs. Currently, the best strategy to train such systems is to bootstrap the training from a tied-triphone system. However, this is time consuming, and more importantly, is impossible for languages without a high-quality pronunciation lexicon. In this work, we propose an initialization strategy that uses teacher-student learning to transfer knowledge from a large, well-trained, offline end-to-end speech recognition model to an online end-to-end model, eliminating the need for a lexicon or any other linguistic resources. We also explore curriculum learning and label smoothing and show how they can be combined with the proposed teacher-student learning for further improvements. We evaluate our methods on a Microsoft Cortana personal assistant task and show that the proposed method results in a 19 % relative improvement in word error rate compared to a randomly-initialized baseline system.Comment: Interspeech 201

Improving Performance Isolation on Chip Multiprocessors via an Operating System Scheduler

We describe a new operating system scheduling algorithm that improves performance isolation on chip multiprocessors (CMP). Poor performance isolation occurs when an application’s performance is determined by the behaviour of its co-runners, i.e., other applications simultaneously running with it. This performance dependency is caused by unfair, corunner-dependent cache allocation on CMPs. Poor performance isolation interferes with the operating system’s control over priority enforcement and hinders QoS provisioning. Previous solutions required modifications to the hardware. We present a new software solution. Our cache-fair algorithm ensures that the application runs as quickly as it would under fair cache allocation, regardless of how the cache is actually allocated. If the thread executes fewer instructions per cycle than it would under fair cache allocation, the scheduler increases that thread’s CPU timeslice. This way, the thread’s overall performance does not suffer because it is allowed to use the CPU longer. We describe our implementation of the algorithm in Solaris™ 10, and show that it significantly improves performance isolation for SPEC CPU, SPEC JBB and TPC-C.Engineering and Applied Science

Inter-hemispheric linkages in climate change: paleo-perspectives for future climate change

The Pole-Equator-Pole (PEP) projects of the PANASH (Paleoclimates of the Northern and Southern Hemisphere) programme have significantly advanced our understanding of past climate change on a global basis and helped to integrate paleo-science across regions and research disciplines. PANASH science allows us to constrain predictions for future climate change and to contribute to the management of consequent environmental changes. We identify three broad areas where PEP science makes key contributions. 1. The pattern of global changes. Knowing the exact timing of glacial advances (synchronous or otherwise) during the last glaciation is critical to understanding interhemispheric links in climate. Work in PEPI demonstrated that the tropical Andes in South America were deglaciated earlier than the Northern Hemisphere (NH) and that an extended warming began there ca. 21 000 cal years BP. The general pattern is consistent with Antarctica and has now been replicated from studies in Southern Hemisphere (SH) regions of the PEPII transect. That significant deglaciation of SH alpine systems and Antarctica led deglaciation of NH ice sheets may reflect either i) faster response times in alpine systems and Antarctica, ii) regional moisture patterns that influenced glacier mass balance, or iii) a SH temperature forcing that led changes in the NH. This highlights the limitations of current understanding and the need for further fundamental paleoclimate research. 2. Changes in modes of operation of oscillatory climate systems. Work across all the PEP transects has led to the recognition that the El Niño Southern Oscillation (ENSO) phenomenon has changed markedly through time. It now appears that ENSO operated during the last glacial termination and during the early Holocene, but that precipitation teleconnections even within the Pacific Basin were turned down, or off. In the modern ENSO phenomenon both inter-annual and seven year periodicities are present, with the inter-annual signal dominant. Paleo-data demonstrate that the relative importance of the two periodicities changes through time, with longer periodicities dominant in the early Holocene. 3. The recognition of climate modulation of oscillatory systems by climate events. We examine the relationship of ENSO to a SH climate event, the Antarctic cold reversal (ACR), in the New Zealand region. We demonstrate that the onset of the ACR was associated with the apparent switching on of an ENSO signal in New Zealand. We infer that this related to enhanced zonal SW winds with the amplification of the pressure fields allowing an existing but weak ENSO signal to manifest itself. Teleconnections of this nature would be difficult to predict for future abrupt change as boundary conditions cannot readily be specified. Paleo-data are critical to predicting the teleconnections of future changes