Excellence in English: what we can learn from 12 outstanding schools

"One of the most pressing issues in English facing a large number of schools today is how to improve from being good to outstanding. The aim of this report is to improve practice in English across all schools and particularly to help them become outstanding. The report provides 12 case studies of schools which are successful in helping their pupils to make outstanding progress in English." - Cover

Multimodal agent interfaces and system architectures for health and fitness companions

Multimodal conversational spoken dialogues using physical and virtual agents provide a potential interface to motivate and support users in the domain of health and fitness. In this paper we present how such multimodal conversational Companions can be implemented to support their owners in various pervasive and mobile settings. In particular, we focus on different forms of multimodality and system architectures for such interfaces

The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems

This paper introduces the Ubuntu Dialogue Corpus, a dataset containing almost 1 million multi-turn dialogues, with a total of over 7 million utterances and 100 million words. This provides a unique resource for research into building dialogue managers based on neural language models that can make use of large amounts of unlabeled data. The dataset has both the multi-turn property of conversations in the Dialog State Tracking Challenge datasets, and the unstructured nature of interactions from microblog services such as Twitter. We also describe two neural learning architectures suitable for analyzing this dataset, and provide benchmark performance on the task of selecting the best next response.Comment: SIGDIAL 2015. 10 pages, 5 figures. Update includes link to new version of the dataset, with some added features and bug fixes. See: https://github.com/rkadlec/ubuntu-ranking-dataset-creato

Frames: A Corpus for Adding Memory to Goal-Oriented Dialogue Systems

This paper presents the Frames dataset (Frames is available at http://datasets.maluuba.com/Frames), a corpus of 1369 human-human dialogues with an average of 15 turns per dialogue. We developed this dataset to study the role of memory in goal-oriented dialogue systems. Based on Frames, we introduce a task called frame tracking, which extends state tracking to a setting where several states are tracked simultaneously. We propose a baseline model for this task. We show that Frames can also be used to study memory in dialogue management and information presentation through natural language generation

Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses

Automatically evaluating the quality of dialogue responses for unstructured domains is a challenging problem. Unfortunately, existing automatic evaluation metrics are biased and correlate very poorly with human judgements of response quality. Yet having an accurate automatic evaluation procedure is crucial for dialogue research, as it allows rapid prototyping and testing of new models with fewer expensive human evaluations. In response to this challenge, we formulate automatic dialogue evaluation as a learning problem. We present an evaluation model (ADEM) that learns to predict human-like scores to input responses, using a new dataset of human response scores. We show that the ADEM model's predictions correlate significantly, and at a level much higher than word-overlap metrics such as BLEU, with human judgements at both the utterance and system-level. We also show that ADEM can generalize to evaluating dialogue models unseen during training, an important step for automatic dialogue evaluation.Comment: ACL 201

Can We Speak?: Approaching Oral Proficiency in the EFL Classroom

A oralidade tem vindo a ser progressivamente promovida em programas e currículos, tanto nacional como internacionalmente, como um dos grandes objetivos do ensino da língua estrangeira. No entanto, as características únicas desta competência fazem de si a mais difícil de abordar em contextos de sala de aula. Apesar de toda a relevância dada à oralidade, bem como a todos os seus constituintes na maioria dos documentos oficiais nacionais e internacionais, como as novas metas de Inglês para Portugal, as Aprendizagens Essenciais e o Quadro Comum de Referência para as Línguas (QECR), os professores portugueses parecem debater-se para conseguirem aplicar procedimentos adequados para desenvolverem tais competências na sua plenitude. Assim, este projeto inclui uma análise da teoria e da prática do ensino da língua inglesa nas salas de aula portuguesas, considerando a abordagem à oralidade no geral e à inteligibilidade em particular. Na realidade, o conceito de inteligibilidade está hoje firmemente enraizado na área da linguística aplicada como um dos fatores determinantes para explicar o sucesso, ou não, da comunicação entre interlocutores de diferentes origens culturais e linguísticas. Este estudo está dividido em duas partes distintas, uma primeira parte de cariz teórico e uma segunda parte de cariz prático. Nos capítulos da parte 1 são postos criticamente em perspetiva os conceitos globalização, comunicação e mudança, como base para uma reflexão acerca dos fatores históricos e antropológicos mais influentes para a disseminação e estatuto da língua inglesa. O foco é então direcionado para o papel do Inglês na Europa, bem como em Portugal, atendendo aos contextos de ensino-aprendizagem de ambos para irem ao encontro das necessidades linguísticas dos alunos coevos. Numa tentativa de clarificar os complexos desenvolvimentos da língua, este estudo examina os fundamentos que subjazem a conceitos-chave de proficiência linguística em ambiente educacional, assim como as premissas teóricas que os norteiam. Logo, serão igualmente reavaliadas algumas das compartimentações habituais no mundo anglófono, de acordo com a mudança do “centro de gravidade” que está a ocorrer no uso da língua inglesa. Como afirmado, a parte 2 do estudo é eminentemente prática. O plano e o método através dos quais o estudo se desenvolveu são apresentados, detalhando-se a abordagem metodológica da investigação em relação à informação quantitativa e qualitativa recolhida (questionários / observações em sala de aula / entrevistas / gravações áudio). O propósito é perceber o que está a ser feito pelos professores em sala de aula em termos de oralidade e quão inteligíveis são os alunos de inglês do 9º ano de escolaridade. A partir da informação recolhida, é feita uma análise dos resultados mais pertinentes, que por sua vez conduzirá às implicações e conclusão do estudo. Estas duas últimas secções discutem os potenciais efeitos dos resultados obtidos no processo ensino-aprendizagem da oralidade e a sua influência na inteligibilidade dos alunos, enquanto falantes e ouvintes.Speaking has been increasingly promoted in language syllabuses and curriculums, both nationally and internationally, as one of the major aims of foreign language teaching. However, the unique features of this skill make it the most challenging one to address in classroom-based contexts. Despite the conspicuous importance given to speaking and all its subsets in most national and international official documents, new English targets for Portugal, the subject’s core curriculum and the Common European Framework of Reference for Languages (CEFR), Portuguese teachers seem to be at odds with suitable procedures to fully develop them inside the classroom. Thus, this project entails an analysis of the theory and practice of classroom English language teaching (ELT) in Portugal concerned with speaking in general and intelligibility in particular. Indeed, the concept of intelligibility is now firmly established in the field of applied linguistics as one of the key factors in explaining success or otherwise in communication between interlocutors from cultural and linguistic diverse backgrounds. This study is divided in two overarching parts, part 1 is a more theoretical one, whereas part 2 is a more practical one. Throughout the chapters of part 1 globalization, communication and change are critically put into perspective, laying the foundation for a reflection on the most significant historical and anthropological factors for English’s global spread and current status. The focus is then narrowed down to the role of English in Europe and further on in Portugal, bearing in mind the language learning and teaching contexts of these settings to meet the needs of students’ present-day reality. In order to shed greater light on these complex language developments, this study examines the rationale underlying some of the core concepts on educational language proficiency, including their definitions and key characteristics, as well as outlining the theoretical premises on which they are grounded. Thus, traditional divides in the English-speaking world are here reexamined in accordance with the change taking place in the ‘centre of gravity’ of the English language. As stated, part 2 of the study is eminently practical. The design and methods on which the study is carried out are delineated, detailing the research methodological approach of quantitative and qualitative data collection (questionnaires / classroom observations / semi-structured interviews / audio recordings). The goal is to understand what teachers do inside their classrooms in terms of speaking ability, as well as how intelligible 9th grade English students are. From the set of gathered data stems an analysis of the major findings, which in turn lead to the implications and conclusion of the study. These two last sections discuss the potential effect of the findings to the teaching and learning of speaking and its influence on the students’ intelligibility, either as speakers or listeners