A generic template for the evaluation of dialogue management systems

We present a generic template for spoken dialogue systems integrating speech recognition and synthesis with 'higher-level' natural language dialogue modelling components. The generic model is abstracted from a number of real application systems targetted at very different domains. Our research aim in developing this generic template is to investigate a new approach to the evaluation of Dialogue Management Systems. Rather than attempting to measure accuracy/speed of output, we propose principles for the evaluation of the underlying theoretical linguistic model of Dialogue Management in a given system, in terms of how well it fits our generic template for Dialogue Management Systems. This is a measure of 'genericness' or 'application-independence' of a given system, which can be used to moderate accuracy/speed scores in comparisons of very unlike DMSs serving different domains. This relates to (but is orthogonal to) Dialogue Management Systems evaluation in terms of naturalness and like measurable metrics (eg. Dybkjaer et al 1995, Vilnat 1996, EAGLES 1994, Fraser 1995); it follows more closely emerging qualitative evaluation techniques for NL grammatical parsing schemes (Leech et al 1996, Atwell 1996)

Visualising the influence of data structure choice on the performance of a distributed database system

The choice of data structure is an important decision in any software project. Application developers do not necessarily have a good understanding of how a particular system manages its data structures and how this might influence performance. We provide visualisations representing the behaviour of different data structures in an object oriented distributed database system. The data is obtained from cache monitoring software and the visualisations therefore represent the actual, as opposed to the theoretical, behaviour. The visualisations can be used as a supplement to the textual description of how a particular system manages its data structures so providing developers, educators and students with a clearer understanding of the implications of their choice of data structure

Pragmatic data modelling and design for end users

Many people are dependent on desktop end user tools such as spreadsheets and databases to manage their data. While they may have the technical skills to set up data repositories, many end users lack the analysis skills to design data models which reflect their often deceptively complex requirements. We advocate that a comprehensive data model should always be developed, with expert help, so that the end user can feel confident the subtleties of the data are fully understood. We then suggest that some pragmatic decisions can be made to simplify the model so that the end user can retain control over setting up and maintaining the application

Quantifying the direct and indirect protection provided by insecticide treated bed nets against malaria

Long lasting insecticidal nets (LLINs) provide both direct and indirect protection against malaria. As pyrethroid resistance evolves in mosquito vectors, it will be useful to understand how the specific benefits LLINs afford individuals and communities may be affected. Here we use modelling to show that there is no minimum LLIN usage needed for users and non-users to benefit from community protection. Modelling results also indicate that pyrethroid resistance in local mosquitoes will likely diminish the direct and indirect benefits from insecticides, leaving the barrier effects intact, but LLINs are still expected to provide enhanced benefit over untreated nets even at high levels of pyrethroid resistance

The influence of feeding behaviour and temperature on the capacity of mosquitoes to transmit malaria

Insecticide-treated bed nets reduce malaria transmission by limiting contact between mosquito vectors and human hosts when mosquitoes feed during the night. However, malaria vectors can also feed in the early evening and in the morning when people are not protected. Here, we explored how the timing of blood feeding interacts with environmental temperature to influence the capacity of Anopheles mosquitoes to transmit the human malaria parasite Plasmodium falciparum. In laboratory experiments, we found no effect of biting time itself on the proportion of mosquitoes that became infectious (vector competence) at constant temperature. However, when mosquitoes were maintained under more realistic fluctuating temperatures, there was a significant increase in competence for mosquitoes feeding in the evening (18:00), and a significant reduction in competence for those feeding in the morning (06:00), relative to those feeding at midnight (00:00). These effects appear to be due to thermal sensitivity of malaria parasites during the initial stages of parasite development within the mosquito, and the fact that mosquitoes feeding in the evening experience cooling temperatures during the night, whereas mosquitoes feeding in the morning quickly experience warming temperatures that are inhibitory to parasite establishment. A transmission dynamics model illustrates that such differences in competence could have important implications for malaria prevalence, the extent of transmission that persists in the presence of bed nets, and the epidemiological impact of behavioural resistance. These results indicate that the interaction of temperature and feeding behaviour could be a major ecological determinant of the vectorial capacity of malaria mosquitoes

Developing a corpus-based grammar model within a continuous commercial speech recognition package

This paper is derived from experiments with a commercial ’off-the-shelf’ continuous speech recognition system, applied to the apparently restricted domain of Air Traffic Control (ATC) for light aircraft. The system is required to transcribe key sub-phrases in a transmission by the ATC to a particular aircraft, the commercial speech recognition system providing the main recognition component. After the development of a corpus of transmissions, it was realised that key information is often interspersed with unconstrained English. Initial attempts focused on using a wildcard mechanism for the non-key sub- phrases. The mechanism, however, proved to be valuable only in simplistic grammars due to its overgenerative nature. The speech recognition system showed us that whilst useful mechanisms are provided, such as the wildcard mechanism, they tend to make over-simplistic assumptions about English grammar and dialogue structure

An Analysis of Genetic Diversity and Inbreeding in Wuchereria bancrofti: Implications for the Spread and Detection of Drug Resistance

Estimates of genetic diversity in helminth infections of humans often have to rely on genotyping (immature) parasite transmission stages instead of adult worms. Here we analyse the results of one such study investigating a single polymorphic locus (a change at position 200 of the β-tubulin gene) in microfilariae of the lymphatic filarial parasite Wuchereria bancrofti. The presence of this genetic change has been implicated in benzimidazole resistance in parasitic nematodes of farmed ruminants. Microfilariae were obtained from patients of three West African villages, two of which were sampled prior to the introduction of mass drug administration. An individual-based stochastic model was developed showing that a wide range of allele frequencies in the adult worm populations could have generated the observed microfilarial genetic diversity. This suggests that appropriate theoretical null models are required in order to interpret studies that genotype transmission stages. Wright's hierarchical F-statistic was used to investigate the population structure in W. bancrofti microfilariae and showed significant deficiency of heterozygotes compared to the Hardy-Weinberg equilibrium; this may be partially caused by a high degree of parasite genetic differentiation between hosts. Studies seeking to quantify accurately the genetic diversity of helminth populations by analysing transmission stages should increase their sample size to account for the variability in allele frequency between different parasite life-stages. Helminth genetic differentiation between hosts and non-random mating will also increase the number of hosts (and the number of samples per host) that need to be genotyped, and could enhance the rate of spread of anthelmintic resistance

Assessing the impact of low-technology emanators alongside long-lasting insecticidal nets to control malaria: Spatial repellents and malaria control

Malaria control in sub-Saharan Africa relies on the widespread use of long-lasting insecticidal nets (LLINs) or the indoor residual spraying of insecticide. Disease transmission may be maintained even when these indoor interventions are universally used as some mosquitoes will bite in the early morning and evening when people are outside. As countries seek to eliminate malaria, they can target outdoor biting using new vector control tools such as spatial repellent emanators, which emit airborne insecticide to form a protective area around the user. Field data are used to incorporate a low-technology emanator into a mathematical model of malaria transmission to predict its public health impact across a range of scenarios. Targeting outdoor biting by repeatedly distributing emanators alongside LLINs increases the chance of elimination, but the additional benefit depends on the level of anthropophagy in the local mosquito population, emanator effectiveness and the pre-intervention proportion of mosquitoes biting outdoors. High proportions of pyrethroid-resistant mosquitoes diminish LLIN impact because of reduced mosquito mortality. When mosquitoes are highly anthropophagic, this reduced mortality leads to more outdoor biting and a reduced additional benefit of emanators, even if emanators are assumed to retain their effectiveness in the presence of pyrethroid resistance. Different target product profiles are examined, which show the extra epidemiological benefits of spatial repellents that induce mosquito mortality. This article is part of the theme issue 'Novel control strategies for mosquito-borne diseases'