Parallel Distributed Grammar Engineering for Practical Applications

Based on a detailed case study of parallel grammar development distributed across two sites, we review some of the requirements for regression testing in grammar engineering, summarize our approach to systematic competence and performance profiling, and discuss our experience with grammar development for a commercial application. If possible, the workshop presentation will be organized around a software demonstration

Semantics-based Automated Web Testing

We present TAO, a software testing tool performing automated test and oracle generation based on a semantic approach. TAO entangles grammar-based test generation with automated semantics evaluation using a denotational semantics framework. We show how TAO can be incorporated with the Selenium automation tool for automated web testing, and how TAO can be further extended to support automated delta debugging, where a failing web test script can be systematically reduced based on grammar-directed strategies. A real-life parking website is adopted throughout the paper to demonstrate the effectivity of our semantics-based web testing approach.Comment: In Proceedings WWV 2015, arXiv:1508.0338

Experiences with the GTU grammar development environment

In this paper we describe our experiences with a tool for the development and testing of natural language grammars called GTU (German: Grammatik-Testumgebumg; grammar test environment). GTU supports four grammar formalisms under a window-oriented user interface. Additionally, it contains a set of German test sentences covering various syntactic phenomena as well as three types of German lexicons that can be attached to a grammar via an integrated lexicon interface. What follows is a description of the experiences we gained when we used GTU as a tutoring tool for students and as an experimental tool for CL researchers. From these we will derive the features necessary for a future grammar workbench.Comment: 7 pages, uses aclap.st

Improving language mapping in clinical fMRI through assessment of grammar.

IntroductionBrain surgery in the language dominant hemisphere remains challenging due to unintended post-surgical language deficits, despite using pre-surgical functional magnetic resonance (fMRI) and intraoperative cortical stimulation. Moreover, patients are often recommended not to undergo surgery if the accompanying risk to language appears to be too high. While standard fMRI language mapping protocols may have relatively good predictive value at the group level, they remain sub-optimal on an individual level. The standard tests used typically assess lexico-semantic aspects of language, and they do not accurately reflect the complexity of language either in comprehension or production at the sentence level. Among patients who had left hemisphere language dominance we assessed which tests are best at activating language areas in the brain.MethodWe compared grammar tests (items testing word order in actives and passives, wh-subject and object questions, relativized subject and object clauses and past tense marking) with standard tests (object naming, auditory and visual responsive naming), using pre-operative fMRI. Twenty-five surgical candidates (13 females) participated in this study. Sixteen patients presented with a brain tumor, and nine with epilepsy. All participants underwent two pre-operative fMRI protocols: one including CYCLE-N grammar tests (items testing word order in actives and passives, wh-subject and object questions, relativized subject and object clauses and past tense marking); and a second one with standard fMRI tests (object naming, auditory and visual responsive naming). fMRI activations during performance in both protocols were compared at the group level, as well as in individual candidates.ResultsThe grammar tests generated more volume of activation in the left hemisphere (left/right angular gyrus, right anterior/posterior superior temporal gyrus) and identified additional language regions not shown by the standard tests (e.g., left anterior/posterior supramarginal gyrus). The standard tests produced more activation in left BA 47. Ten participants had more robust activations in the left hemisphere in the grammar tests and two in the standard tests. The grammar tests also elicited substantial activations in the right hemisphere and thus turned out to be superior at identifying both right and left hemisphere contribution to language processing.ConclusionThe grammar tests may be an important addition to the standard pre-operative fMRI testing

Testing the use of grammar: Beyond grammatical accuracy

Udostępnienie publikacji Wydawnictwa Uniwersytetu Łódzkiego finansowane w ramach projektu „Doskonałość naukowa kluczem do doskonałości kształcenia”. Projekt realizowany jest ze środków Europejskiego Funduszu Społecznego w ramach Programu Operacyjnego Wiedza Edukacja Rozwój; nr umowy: POWER.03.05.00-00-Z092/17-00

Teaching grammar and testing grammar in the English primary school: The impact on teachers and teaching of the grammar element of the statutory test in Spelling, Punctuation and Grammar (SPaG) in England

In the academic year 2012-2013, Year 6 primary school pupils in England sat the first of a new statutory test in Spelling, Punctuation and Grammar (‘SPaG’) as part of their end of primary school assessments in English. This UKLA funded research examines the impact on teachers and their teaching of the grammar element of the statutory SPaG test. The aim of the research has been to evaluate the nature and the extent of changes to the teaching of grammar and to wider literacy teaching since the introduction of SPaG. The research explores teachers’ responses to teaching grammar to a statutory test format, and how teachers have implemented rapid curriculum change in their classrooms. The research explores issues of teacher knowledge, understanding, skill and enjoyment in relation to grammar, at their own level and for teaching pupils. In this research, teachers also discuss their observations of how pupils have responded to explicit grammar teaching and the grammar test. As part of this research we accessed Department for Education data on pupils by gender, ethnicity, language and deprivation in relation to SPaG attainment in 2014, to examine SPaG attainment patterns nationally. The research also analysed SPaG attainment for groups of pupils in four Local Authorities (anonymised as Castlehaven, Longcliffe, Narrowgate and Norchester), specifically in relation to pupils’ ethnicity, languages, deprivation and special educational needs. Main findings: In English primary schools, since the introduction of the statutory SPaG test: • Time spent teaching decontextualized and contextualised grammar has increased significantly; • Grammar is now taught explicitly and formally as a classroom literacy routine; • The grammar test format influences teaching content and approaches; • Teachers observe that pupils enjoy learning grammar and taking the test; • Teachers disagree about the extent to which explicit grammar teaching and testing have a positive impact on pupils’ language and literacy skills; • Teachers feel more confident about teaching grammar. Additional desk-based research indicates: • Ethnic and linguistic minority pupils perform as well as, or better than, white and native English speaking pupils on the SPaG test; • Pupil socioeconomic deprivation is the strongest indicator of low performance on SPaG; • Socioeconomically disadvantaged pupils perform better on SPaG when they are learning in classrooms that are linguistically and ethnically diverse

Grammar Learning Strategies and Language Attainment: Seeking a Relationship

Despite major advances in research on language learning strategies, there are still areas that have received only scant attention, and one of them is undoubtedly learning grammar. The paper contributes to the paucity of empirical investigations in this domain by presenting the findings of a study which sought to investigate the relationship between the use of grammar learning strategies (GLS) reported by 142 English Department students and target language attainment, operationalized as their performance in a practical grammar course and the end-of-the-year examination. Information about GLS use was obtained by means of a tool that was designed on the basis of a theoretical scheme proposed by Oxford, Rang Lee and Park (2007) in which GLS are divided into three categories depending on whether they represent implicit learning with focus on form, explicit inductive learning and explicit deductive learning. The analysis failed to find a strong positive relationship between the use of GLS and achievement, irrespective of the level of the BA program, or statistically significant differences in this respect between lower-level and higher-level participants. The highest, albeit very weak, correlation was identified between the use of GLS associated with explicit deductive learning and grammar course grades, which testifies to the traditional nature of instruction the subjects receive. The findings serve as a basis for putting forward a handful of recommendations for learning, teaching and testing grammar as well as directions for future studies into grammar learning strategies