Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses

Automatically evaluating the quality of dialogue responses for unstructured domains is a challenging problem. Unfortunately, existing automatic evaluation metrics are biased and correlate very poorly with human judgements of response quality. Yet having an accurate automatic evaluation procedure is crucial for dialogue research, as it allows rapid prototyping and testing of new models with fewer expensive human evaluations. In response to this challenge, we formulate automatic dialogue evaluation as a learning problem. We present an evaluation model (ADEM) that learns to predict human-like scores to input responses, using a new dataset of human response scores. We show that the ADEM model's predictions correlate significantly, and at a level much higher than word-overlap metrics such as BLEU, with human judgements at both the utterance and system-level. We also show that ADEM can generalize to evaluating dialogue models unseen during training, an important step for automatic dialogue evaluation.Comment: ACL 201

Ethical Challenges in Data-Driven Dialogue Systems

The use of dialogue systems as a medium for human-machine interaction is an increasingly prevalent paradigm. A growing number of dialogue systems use conversation strategies that are learned from large datasets. There are well documented instances where interactions with these system have resulted in biased or even offensive conversations due to the data-driven training process. Here, we highlight potential ethical issues that arise in dialogue systems research, including: implicit biases in data-driven systems, the rise of adversarial examples, potential sources of privacy violations, safety concerns, special considerations for reinforcement learning systems, and reproducibility concerns. We also suggest areas stemming from these issues that deserve further investigation. Through this initial survey, we hope to spur research leading to robust, safe, and ethically sound dialogue systems.Comment: In Submission to the AAAI/ACM conference on Artificial Intelligence, Ethics, and Societ

The role of community and population ecology in applying mycorrhizal fungi for improved food security.

The global human population is expected to reach ∼9 billion by 2050. Feeding this many people represents a major challenge requiring global crop yield increases of up to 100%. Microbial symbionts of plants such as arbuscular mycorrhizal fungi (AMF) represent a huge, but unrealized resource for improving yields of globally important crops, especially in the tropics. We argue that the application of AMF in agriculture is too simplistic and ignores basic ecological principals. To achieve this challenge, a community and population ecology approach can contribute greatly. First, ecologists could significantly improve our understanding of the determinants of the survival of introduced AMF, the role of adaptability and intraspecific diversity of AMF and whether inoculation has a direct or indirect effect on plant production. Second, we call for extensive metagenomics as well as population genomics studies that are crucial to assess the environmental impact that introduction of non-local AMF may have on native AMF communities and populations. Finally, we plead for an ecologically sound use of AMF in efforts to increase food security at a global scale in a sustainable manner

Considering Intra-individual Genetic Heterogeneity to Understand Biodiversity

In this chapter, I am concerned with the concept of Intra-individual Genetic Hetereogeneity (IGH) and its potential influence on biodiversity estimates. Definitions of biological individuality are often indirectly dependent on genetic sampling -and vice versa. Genetic sampling typically focuses on a particular locus or set of loci, found in the the mitochondrial, chloroplast or nuclear genome. If ecological function or evolutionary individuality can be defined on the level of multiple divergent genomes, as I shall argue is the case in IGH, our current genetic sampling strategies and analytic approaches may miss out on relevant biodiversity. Now that more and more examples of IGH are available, it is becoming possible to investigate the positive and negative effects of IGH on the functioning and evolution of multicellular individuals more systematically. I consider some examples and argue that studying diversity through the lens of IGH facilitates thinking not in terms of units, but in terms of interactions between biological entities. This, in turn, enables a fresh take on the ecological and evolutionary significance of biological diversity

Correction: Spore development and nuclear inheritance in arbuscular mycorrhizal fungi

<p>Abstract</p> <p>Background</p> <p>A conventional tenet of classical genetics is that progeny inherit half their genome from each parent in sexual reproduction instead of the complete genome transferred to each daughter during asexual reproduction. The transmission of hereditary characteristics from parents to their offspring is therefore predictable, although several exceptions are known. Heredity in microorganisms, however, can be very complex, and even unknown as is the case for coenocytic organisms such as Arbuscular Mycorrhizal Fungi (AMF). This group of fungi are plant-root symbionts, ubiquitous in most ecosystems, which reproduce asexually via multinucleate spores for which sexuality has not yet been observed.</p> <p>Results</p> <p>We examined the number of nuclei per spore of four AMF taxa using high Z-resolution live confocal microscopy and found that the number of nuclei was correlated with spore diameter. We show that AMF have the ability, through the establishment of new symbioses, to pass hundreds of nuclei to subsequent generations of multinucleated spores. More importantly, we observed surprising heterogeneity in the number of nuclei among sister spores and show that massive nuclear migration and mitosis are the mechanisms by which AMF spores are formed. We followed spore development of <it>Glomus irregulare </it>from hyphal swelling to spore maturity and found that the spores reached mature size within 30 to 60 days, and that the number of nuclei per spores increased over time.</p> <p>Conclusions</p> <p>We conclude that the spores used for dispersal of AMF contain nuclei with two origins, those that migrate into the spore and those that arise by mitosis in the spore. Therefore, these spores do not represent a stage in the life cycle with a single nucleus, raising the possibility that AMF, unlike all other known eukaryotic organisms, lack the genetic bottleneck of a single-nucleus stage.</p

Postmating Female Control: 20 Years of Cryptic Female Choice

Cryptic female choice (CFC) represents postmating intersexual selection arising from female-driven mechanisms at or after mating that bias sperm use and impact male paternity share. Although biologists began to study CFC relatively late, largely spurred by Eberhard's book published 20 years ago, the field has grown rapidly since then. Here, we review empirical progress to show that numerous female processes offer potential for CFC, from mating through to fertilization, although seldom has CFC been clearly demonstrated. We then evaluate functional implications, and argue that, under some conditions, CFC might have repercussions for female fitness, sexual conflict, and intersexual coevolution, with ramifications for related evolutionary phenomena, such as speciation. We conclude by identifying directions for future research in this rapidly growing field

Single nucleus genome sequencing reveals high similarity among nuclei of an endomycorrhizal fungus

Nuclei of arbuscular endomycorrhizal fungi have been described as highly diverse due to their asexual nature and absence of a single cell stage with only one nucleus. This has raised fundamental questions concerning speciation, selection and transmission of the genetic make-up to next generations. Although this concept has become textbook knowledge, it is only based on studying a few loci, including 45S rDNA. To provide a more comprehensive insight into the genetic makeup of arbuscular endomycorrhizal fungi, we applied de novo genome sequencing of individual nuclei of Rhizophagus irregularis. This revealed a surprisingly low level of polymorphism between nuclei. In contrast, within a nucleus, the 45S rDNA repeat unit turned out to be highly diverged. This finding demystifies a long-lasting hypothesis on the complex genetic makeup of arbuscular endomycorrhizal fungi. Subsequent genome assembly resulted in the first draft reference genome sequence of an arbuscular endomycorrhizal fungus. Its length is 141 Mbps, representing over 27,000 protein-coding gene models. We used the genomic sequence to reinvestigate the phylogenetic relationships of Rhizophagus irregularis with other fungal phyla. This unambiguously demonstrated that Glomeromycota are more closely related to Mucoromycotina than to its postulated sister Dikarya

Stressed out symbiotes:hypotheses for the influence of abiotic stress on arbuscular mycorrhizal fungi

Abiotic stress is a widespread threat to both plant and soil communities. Arbuscular mycorrhizal (AM) fungi can alleviate effects of abiotic stress by improving host plant stress tolerance, but the direct effects of abiotic stress on AM fungi are less well understood. We propose two hypotheses predicting how AM fungi will respond to abiotic stress. The stress exclusion hypothesis predicts that AM fungal abundance and diversity will decrease with persistent abiotic stress. The mycorrhizal stress adaptation hypothesis predicts that AM fungi will evolve in response to abiotic stress to maintain their fitness. We conclude that abiotic stress can have effects on AM fungi independent of the effects on the host plant. AM fungal communities will change in composition in response to abiotic stress, which may mean the loss of important individual species. This could alter feedbacks to the plant community and beyond. AM fungi will adapt to abiotic stress independent of their host plant. The adaptation of AM fungi to abiotic stress should allow the maintenance of the plant-AM fungal mutualism in the face of changing climates. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1007/s00442-016-3673-7) contains supplementary material, which is available to authorized users