Analyzing Hidden Representations in End-to-End Automatic Speech Recognition Systems

Neural models have become ubiquitous in automatic speech recognition systems. While neural networks are typically used as acoustic models in more complex systems, recent studies have explored end-to-end speech recognition systems based on neural networks, which can be trained to directly predict text from input acoustic features. Although such systems are conceptually elegant and simpler than traditional systems, it is less obvious how to interpret the trained models. In this work, we analyze the speech representations learned by a deep end-to-end model that is based on convolutional and recurrent layers, and trained with a connectionist temporal classification (CTC) loss. We use a pre-trained model to generate frame-level features which are given to a classifier that is trained on frame classification into phones. We evaluate representations from different layers of the deep model and compare their quality for predicting phone labels. Our experiments shed light on important aspects of the end-to-end model such as layer depth, model complexity, and other design choices.Comment: NIPS 201

Preliminary study of regulation technology of wind field distribution on QTT site based on test of equivalent wind field

The effect of wind gust on the large reflector antenna is one of the main factors that can affect the antenna performance and therefore, this effect must be minimized to meet the strict performance requirement in the world largest steerable telescope, which is QiTai Telescope (QTT). In this paper, the characteristics of the topography as well as the wind distribution around QTT site have been analyzed and consequently, a technology for improving the wind distribution in an active way has been proposed. Additionally, an equivalent wind distribution test rig for the proposed technology has been built in the lab and the corresponding experiment has been carried out. The experimental data indicated that the proposed technology was a promising tool for regulating the wind distribution for the large reflector antenna and it was found that the proposed technology can significantly reduce the wind speed as well as the wind impact range after the wind regulation has been given in the test. The results in this paper has provided a solid foundation for the regulation of the wind distribution of the QTT site

Numerical simulation on gas production from a hydrate reservoir underlain by a free gas zone

Physical and mathematical models of gas production by depressurization from a hydrate reservoir underlain by a free gas zone are established. The mathematical model can interpret the effects of the flow of multiphase fluids, the process of hydrate dissociation, ice-water phase transition, the variation of permeability, the convection and conduction on hydrate dissociation and gas and water production. The evolutions of temperature, pressure, and saturations in the hydrate and free gas zones are elucidated during gas production. The variation of some parameters, such as gas and water rates, with time is presented. The results show that the overlying hydrate zone can supply a certain amount of gas to improve the output of a production well and evidently prolong the lifespan of a gas reservoir

The simulation of nature gas production from ocean gas hydrate reservoir by depressurization

The vast amount of hydrocarbon gas encaged in gas hydrates is regarded as a kind of future potential energy supply due to its wide deposition and cleanness. How to exploit gas hydrate with safe, effective and economical methods is being pursued. In this paper, a mathematical model is developed to simulate the hydrate dissociation by depressurization in hydrate-bearing porous medium. The model can be used to analyze the effects of the flow of multiphase fluids, the intrinsic kinetic process of hydrate dissociation, the endothermic process of hydrate dissociation, ice-water phase equilibrium, the variation of permeability, the convection and conduction on the hydrate dissociation and gas and water production. The numerical results agreed well with the 1-D and 2-D experiments. The numerical results for 3-D hydrate reservoir show that in the first stage of depressurization gas can be produced effectively from hydrate reservoir. With the depletion of reservoir energy because of endothermic process of hydrate dissociation the gas rate decreases rapidly. Then, methods such as thermal stimulation and inhibitor injection should be considered to replace depressurization

thesimulationofnaturegasproductionfromoceangashydratereservoirbydepressurization

The vast amount of hydrocarbon gas encaged in gas hydrates is regarded as a kind of future potential energy supply due to its wide deposition and cleanness. How to exploit gas hydrate with safe, effective and economical methods is being pursued. In this paper, a mathematical model is developed to simulate the hydrate dissociation by depressurization in hydrate-bearing porous medium. The model can be used to analyze the effects of the flow of multiphase fluids, the intrinsic kinetic process of hydrate dissociation, the endothermic process of hydrate dissociation, ice-water phase equilibrium, the variation of permeability, the convection and conduction on the hydrate dissociation and gas and water production. The numerical results agreed well with the 1-D and 2-D experiments. The numerical results for 3-D hydrate reservoir show that in the first stage of depressurization gas can be produced effectively from hydrate reservoir. With the depletion of reservoir energy because of endothermic process of hydrate dissociation the gas rate decreases rapidly. Then, methods such as thermal stimulation and inhibitor injection should be considered to replace depressurization

The Experimental and Numerical Studies on Gas Production from Hydrate Reservoir by Depressurization

A set of experimental system to study hydrate dissociation in porous media is built and some experiments on hydrate dissociation by depressurization are carried out. A mathematical model is developed to simulate the hydrate dissociation by depressurization in hydrate-bearing porous media. The model can be used to analyze the effects of the flow of multiphase fluids, the kinetic process and endothermic process of hydrate dissociation, ice-water phase equilibrium, the variation of permeability, convection and conduction on the hydrate dissociation, and gas and water productions. The numerical results agree well with the experimental results, which validate our mathematical model. For a 3-D hydrate reservoir of Class 3, the evolutions of pressure, temperature, and saturations are elucidated and the effects of some main parameters on gas and water rates are analyzed. Numerical results show that gas can be produced effectively from hydrate reservoir in the first stage of depressurization. Then, methods such as thermal stimulation or inhibitor injection should be considered due to the energy deficiency of formation energy. The numerical results for 3-D hydrate reservoir of Class 1 show that the overlying gas hydrate zone can apparently enhance gas rate and prolong life span of gas reservoir