Problems in Evaluating Grammatical Error Detection Systems

ABSTRACT Many evaluation issues for grammatical error detection have previously been overlooked, making it hard to draw meaningful comparisons between different approaches, even when they are evaluated on the same corpus. To begin with, the three-way contingency between a writer's sentence, the annotator's correction, and the system's output makes evaluation more complex than in some other NLP tasks, which we address by presenting an intuitive evaluation scheme. Of particular importance to error detection is the skew of the data -the low frequency of errors as compared to non-errors -which distorts some traditional measures of performance and limits their usefulness, leading us to recommend the reporting of raw measurements (true positives, false negatives, false positives, true negatives). Other issues that are particularly vexing for error detection focus on defining these raw measurements: specifying the size or scope of an error, properly treating errors as graded rather than discrete phenomena, and counting non-errors. We discuss recommendations for best practices with regard to reporting the results of system evaluation for these cases, recommendations which depend upon making clear one's assumptions and applications for error detection. By highlighting the problems with current error detection evaluation, the field will be better able to move forward

Nationwide Investigation of the Pyrethroid Susceptibility of Mosquito Larvae Collected from Used Tires in Vietnam

Pyrethroid resistance is envisioned to be a major problem for the vector control program since, at present, there are no suitable chemical substitutes for pyrethroids. Cross-resistance to knockdown agents, which are mainly used in mosquito coils and related products as spatial repellents, is the most serious concern. Since cross-resistance is a global phenomenon, we have started to monitor the distribution of mosquito resistance to pyrethroids. The first pilot study was carried out in Vietnam. We periodically drove along the national road from the north end to the Mekong Delta in Vietnam and collected mosquito larvae from used tires. Simplified susceptibility tests were performed using the fourth instar larvae of Aedes aegypti, Aedes albopictus, and Culex quinquefasciatus. Compared with the other species, Ae. aegypti demonstrated the most prominent reduction in susceptibility. For Ae. aegypti, significant increases in the susceptibility indices with a decrease in the latitude of collection points were observed, indicating that the susceptibility of Ae. aegypti against d-allethrin was lower in the southern part, including mountainous areas, as compared to that in the northern part of Vietnam. There was a significant correlation between the susceptibility indices in Ae. aegypti and the sum of annual pyrethroid use for malaria control (1998–2002). This might explain that the use of pyrethroids as residual treatment inside houses and pyrethroid-impregnated bed nets for malaria control is attributable to low pyrethroid susceptibility in Ae. aegypti. Such insecticide treatment appeared to have been intensively administered in the interior and along the periphery of human habitation areas where, incidentally, the breeding and resting sites of Ae. aegypti are located. This might account for the strong selection pressure toward Ae. aegypti and not Ae. albopictus

Functional Neuromuscular Junctions Formed by Embryonic Stem Cell-Derived Motor Neurons

A key objective of stem cell biology is to create physiologically relevant cells suitable for modeling disease pathologies in vitro. Much progress towards this goal has been made in the area of motor neuron (MN) disease through the development of methods to direct spinal MN formation from both embryonic and induced pluripotent stem cells. Previous studies have characterized these neurons with respect to their molecular and intrinsic functional properties. However, the synaptic activity of stem cell-derived MNs remains less well defined. In this study, we report the development of low-density co-culture conditions that encourage the formation of active neuromuscular synapses between stem cell-derived MNs and muscle cells in vitro. Fluorescence microscopy reveals the expression of numerous synaptic proteins at these contacts, while dual patch clamp recording detects both spontaneous and multi-quantal evoked synaptic responses similar to those observed in vivo. Together, these findings demonstrate that stem cell-derived MNs innervate muscle cells in a functionally relevant manner. This dual recording approach further offers a sensitive and quantitative assay platform to probe disorders of synaptic dysfunction associated with MN disease

The Role of the Parkinson's Disease Gene PARK9 in Essential Cellular Pathways and the Manganese Homeostasis Network in Yeast

YPK9 (Yeast PARK9; also known as YOR291W) is a non-essential yeast gene predicted by sequence to encode a transmembrane P-type transport ATPase. However, its substrate specificity is unknown. Mutations in the human homolog of YPK9, ATP13A2/PARK9, have been linked to genetic forms of early onset parkinsonism. We previously described a strong genetic interaction between Ypk9 and another Parkinson's disease (PD) protein α-synuclein in multiple model systems, and a role for Ypk9 in manganese detoxification in yeast. In humans, environmental exposure to toxic levels of manganese causes a syndrome similar to PD and is thus an environmental risk factor for the disease. How manganese contributes to neurodegeneration is poorly understood. Here we describe multiple genome-wide screens in yeast aimed at defining the cellular function of Ypk9 and the mechanisms by which it protects cells from manganese toxicity. In physiological conditions, we found that Ypk9 genetically interacts with essential genes involved in cellular trafficking and the cell cycle. Deletion of Ypk9 sensitizes yeast cells to exposure to excess manganese. Using a library of non-essential gene deletions, we screened for additional genes involved in tolerance to excess manganese exposure, discovering several novel pathways involved in manganese homeostasis. We defined the dependence of the deletion strain phenotypes in the presence of manganese on Ypk9, and found that Ypk9 deletion modifies the manganese tolerance of only a subset of strains. These results confirm a role for Ypk9 in manganese homeostasis and illuminates cellular pathways and biological processes in which Ypk9 likely functions

Four novel UCP3 gene variants associated with childhood obesity: effect on fatty acid oxidation and on prevention of triglyceride storage

The objective of the study was to look for uncoupling protein 3 (UCP3) gene variants in early-onset severe childhood obesity and to determine their effect on long-chain fatty acid oxidation and triglyceride storage

2D versus 3D human induced pluripotent stem cell-derived cultures for neurodegenerative disease modelling

Neurodegenerative diseases, such as Alzheimer's disease (AD), Parkinson's disease (PD), Huntington's disease (HD) and amyotrophic lateral sclerosis (ALS), affect millions of people every year and so far, there are no therapeutic cures available. Even though animal and histological models have been of great aid in understanding disease mechanisms and identifying possible therapeutic strategies, in order to find disease-modifying solutions there is still a critical need for systems that can provide more predictive and physiologically relevant results. One possible avenue is the development of patient-derived models, e.g. by reprogramming patient somatic cells into human induced pluripotent stem cells (hiPSCs), which can then be differentiated into any cell type for modelling. These systems contain key genetic information from the donors, and therefore have enormous potential as tools in the investigation of pathological mechanisms underlying disease phenotype, and progression, as well as in drug testing platforms. hiPSCs have been widely cultured in 2D systems, but in order to mimic human brain complexity, 3D models have been proposed as a more advanced alternative. This review will focus on the use of patient-derived hiPSCs to model AD, PD, HD and ALS. In brief, we will cover the available stem cells, types of 2D and 3D culture systems, existing models for neurodegenerative diseases, obstacles to model these diseases in vitro, and current perspectives in the field