Audio Caption: Listen and Tell

Increasing amount of research has shed light on machine perception of audio events, most of which concerns detection and classification tasks. However, human-like perception of audio scenes involves not only detecting and classifying audio sounds, but also summarizing the relationship between different audio events. Comparable research such as image caption has been conducted, yet the audio field is still quite barren. This paper introduces a manually-annotated dataset for audio caption. The purpose is to automatically generate natural sentences for audio scene description and to bridge the gap between machine perception of audio and image. The whole dataset is labelled in Mandarin and we also include translated English annotations. A baseline encoder-decoder model is provided for both English and Mandarin. Similar BLEU scores are derived for both languages: our model can generate understandable and data-related captions based on the dataset.Comment: accepted by ICASSP201

Methods and materials for teaching English as a second language

Thesis (Ed.M.)--Boston University. Missing pages 5-2

Visual Speech Enhancement

When video is shot in noisy environment, the voice of a speaker seen in the video can be enhanced using the visible mouth movements, reducing background noise. While most existing methods use audio-only inputs, improved performance is obtained with our visual speech enhancement, based on an audio-visual neural network. We include in the training data videos to which we added the voice of the target speaker as background noise. Since the audio input is not sufficient to separate the voice of a speaker from his own voice, the trained model better exploits the visual input and generalizes well to different noise types. The proposed model outperforms prior audio visual methods on two public lipreading datasets. It is also the first to be demonstrated on a dataset not designed for lipreading, such as the weekly addresses of Barack Obama.Comment: Accepted to Interspeech 2018. Supplementary video: https://www.youtube.com/watch?v=nyYarDGpcY

DO BANJARESE WOMEN AND MEN SPEAK DIFFERENTLY?

Language and gender have been an interesting topic of discussion in some studies as to whether the linguistic features use by women and men are significantly different. A study in Tucso

She inches glass to break: conversations between friends

She inches glass to break: conversations between friends is a project that aims to manifest, through research and practice, my own feminist language within the videos I have produced in my final year of my Masters of Fine Arts. My feminist language is Australian and intersectional, invested in combating sexism, racism and in deepening language and representation around sexuality in relation to Asian women. This project discusses my video She inches glass to break (2018) in length, which created intersectional feminist dialogue in response to feminist filmmaker Ulrike Ottinger’s film Ticket of No Return (1979) and Breakfast at Tiffany’s (1961). Additionally, given this project’s investment in language, this body of work is influenced both by aspects of psychoanalysis – in which speech is central to a “therapeutic action” – and by feminist linguistics in which linguistic analysis reveals some of the mechanisms through which language constrains, coerces and represents women, men and non-binary people in oppressive ways

El uso de estrategias de comunicación de aprendices de inglés como L2 con diferentes niveles de competencia en un contexto oral interactivo

Indexación: Web of Science; Scielo.Abstract: This study aims to examine the different communication strategies (CSs) EFL learners employ when communicating orally, and determine the relationship between the learners’ proficiency level and their CS use. Spoken data from three conversations held by Spanish learners of English of different levels were analysed in order to determine the type of CSs they used when interacting with a native speaker (NS) in an informal environment outside the classroom. The identification of the CSs was carried out following Dörnyei and Körmos’ taxonomy (1998). Overall results show that there is an association between the learners’ proficiency level and their CS usage. Results from a detailed analysis confirmed this relationship and revealed that the learners’ linguistic competence is not only related to the frequency of the CSs used but mostly to the type of CS.Resumen: El objetivo de este estudio fue analizar las diferentes estrategias de comunicación (EsC) que utilizan aprendices de inglés como L2 al comunicarse oralmente, y determinar la relación entre la competencia lingüística de estos estudiantes y el uso de las EsC. Se analizó un corpus oral obtenido de tres conversaciones entre estudiantes de inglés de distintos niveles de competencia con el propósito de descubrir el tipo de EsC que éstos utilizan al interactuar con un hablante nativo en un ambiente informal fuera del aula. La identificación de las EsC utilizadas se realizó mediante la taxonomía propuesta por Dörnyei y Körmos (1998). Desde un punto de vista general los resultados muestran que existe una asociación entre el nivel de competencia lingüística de los estudiantes y las EsC que éstos utilizan. Esto fue corroborado mediante un análisis más detallado de los datos que demostró una relación no sólo entre el nivel de competencia y la frecuencia de uso de las EsC sino principalmente con el tipo de estrategias utilizadas por cada nivel.http://www.scielo.cl/scielo.php?pid=S0718-09342016000100004&script=sci_abstrac

Some Introductory Notes on the Development and Characteristics of Sabah Malay

This is a preliminary description of the Malay variety used as a lingua franca in the Malaysian state of Sabah at the northernmost top of Borneo. The paper discusses a number of common linguistic features that distinguish Sabah Malay from other Malay varieties and analyses these features from a historical linguistic perspective. While it is argued that Sabah Malay has a close historical relation with other Malay dialects spoken in Borneo, especially Brunei Malay, the vernacular is also influenced phonologically and lexically by Sabah's indigenous and immigrant speech communities. Words and sentences recorded or elicited during fieldwork in various parts of Sabah illustrate these points