Multiresolution Recurrent Neural Networks: An Application to Dialogue Response Generation

We introduce the multiresolution recurrent neural network, which extends the sequence-to-sequence framework to model natural language generation as two parallel discrete stochastic processes: a sequence of high-level coarse tokens, and a sequence of natural language tokens. There are many ways to estimate or learn the high-level coarse tokens, but we argue that a simple extraction procedure is sufficient to capture a wealth of high-level discourse semantics. Such procedure allows training the multiresolution recurrent neural network by maximizing the exact joint log-likelihood over both sequences. In contrast to the standard log- likelihood objective w.r.t. natural language tokens (word perplexity), optimizing the joint log-likelihood biases the model towards modeling high-level abstractions. We apply the proposed model to the task of dialogue response generation in two challenging domains: the Ubuntu technical support domain, and Twitter conversations. On Ubuntu, the model outperforms competing approaches by a substantial margin, achieving state-of-the-art results according to both automatic evaluation metrics and a human evaluation study. On Twitter, the model appears to generate more relevant and on-topic responses according to automatic evaluation metrics. Finally, our experiments demonstrate that the proposed model is more adept at overcoming the sparsity of natural language and is better able to capture long-term structure.Comment: 21 pages, 2 figures, 10 table

R3: Reinforced Ranker-Reader for open-domain Question Answering

In recent years researchers have achieved considerable success applying neural network methods to question answering (QA). These approaches have achieved state of the art results in simplified closed-domain settings such as the SQuAD (Rajpurkar et al., 2016) dataset, which provides a pre-selected passage, from which the answer to a given question may be extracted. More recently, researchers have begun to tackle open-domain QA, in which the model is given a question and access to a large corpus (e.g., wikipedia) instead of a pre-selected passage (Chen et al., 2017a). This setting is more complex as it requires large-scale search for relevant passages by an information retrieval component, combined with a reading comprehension model that "reads" the passages to generate an answer to the question. Performance in this setting lags considerably behind closed-domain performance. In this paper, we present a novel open-domain QA system called Reinforced Ranker-Reader $(R^3)$, based on two algorithmic innovations. First, we propose a new pipeline for open-domain QA with a Ranker component, which learns to rank retrieved passages in terms of likelihood of generating the ground-truth answer to a given question. Second, we propose a novel method that jointly trains the Ranker along with an answer-generation Reader model, based on reinforcement learning. We report extensive experimental results showing that our method significantly improves on the state of the art for multiple open-domain QA datasets.Comment: 8 pages, accepted by AAAI 201

From sea monsters to charismatic megafauna: changes in perception and use of large marine animals

Marine megafauna has always elicited contrasting feelings. In the past, large marine animals were often depicted as fantastic mythological creatures and dangerous monsters, while also arousing human curiosity. Marine megafauna has been a valuable resource to exploit, leading to the collapse of populations and local extinctions. In addition, some species have been perceived as competitors of fishers for marine resources and were often actively culled. Since the 1970s, there has been a change in the perception and use of megafauna. The growth of marine tourism, increasingly oriented towards the observation of wildlife, has driven a shift from extractive to non-extractive use, supporting the conservation of at least some species of marine megafauna. In this paper, we review and compare the changes in the perception and use of three megafaunal groups, cetaceans, elasmobranchs and groupers, with a special focus on European cultures. We highlight the main drivers and the timing of these changes, compare different taxonomic groups and species, and highlight the implications for management and conservation. One of the main drivers of the shift in perception, shared by all the three groups of megafauna, has been a general increase in curiosity towards wildlife, stimulated inter alia by documentaries (from the early 1970s onwards), and also promoted by easy access to scuba diving. At the same time, environmental campaigns have been developed to raise public awareness regarding marine wildlife, especially cetaceans, a process greatly facilitated by the rise of Internet and the World Wide Web. Currently, all the three groups (cetaceans, elasmobranchs and groupers) may represent valuable resources for ecotourism. Strikingly, the economic value of live specimens may exceed their value for human consumption. A further change in perception involving all the three groups is related to a growing understanding and appreciation of their key ecological role. The shift from extractive to non-extractive use has the potential for promoting species conservation and local economic growth. However, the change in use may not benefit the original stakeholders (e.g. fishers or whalers) and there may therefore be a case for providing compensation for disadvantaged stakeholders. Moreover, it is increasingly clear that even non-extractive use may have a negative impact on marine megafauna, therefore regulations are needed.SFRH/BPD/102494/2014, UID/MAR/04292/2019, IS1403info:eu-repo/semantics/publishedVersio

New insights into the genetic etiology of Alzheimer's disease and related dementias

Characterization of the genetic landscape of Alzheimer's disease (AD) and related dementias (ADD) provides a unique opportunity for a better understanding of the associated pathophysiological processes. We performed a two-stage genome-wide association study totaling 111,326 clinically diagnosed/'proxy' AD cases and 677,663 controls. We found 75 risk loci, of which 42 were new at the time of analysis. Pathway enrichment analyses confirmed the involvement of amyloid/tau pathways and highlighted microglia implication. Gene prioritization in the new loci identified 31 genes that were suggestive of new genetically associated processes, including the tumor necrosis factor alpha pathway through the linear ubiquitin chain assembly complex. We also built a new genetic risk score associated with the risk of future AD/dementia or progression from mild cognitive impairment to AD/dementia. The improvement in prediction led to a 1.6- to 1.9-fold increase in AD risk from the lowest to the highest decile, in addition to effects of age and the APOE ε4 allele

On-farm Food Safety: Aquaponics

Good agricultural practices and produce handling advice to prevent zoonoses in fish-and-produce production systems are detailed

Identification of Nile tilapia (Oreochromis niloticus) and its hybrids in natural environments in Hawaii

The history of tilapia in Hawaii began in the 1950s with the introduction of five species for recreational, research, and commercial purposes (Hida et al., 1962; Szyper et al., 2000). In 2000, the existing tilapia stocks were evaluated for their utility in establishing a tilapia producing industry (Szyper et al., 2000). The study showed that the stocks were inferior in terms of growth when compared to Nile tilapia (Oreochromis niloticus), a species that could not be imported for private and commercial use (Szyper et al., 2000). Supporters of the species\u27 entry into Hawaii argued that it was already established in natural bodies of water, and its introduction would have little effect on the environment. Tilapia were collected from 10 sites throughout the state of Hawaii to determine if O. niloticus is indeed established in the wild. Total genomic DNA was extracted from fin clips. Potential species identification was based on the sequencing of the mitochondrial DNA control region (mtDNA CR). Unique sequences were compared with those published in GenBank. Nile tilapia was found on the island of Hawaii, and its potential hybrids were identified on the islands of Molokai, Maui, as well as Hawaii

Multiscale Characterization of Lignocellulosic Biomass Variability and Its Implications to Preprocessing and Conversion: A Case Study for Corn Stover

Feedstock variability that originates from biomass production and field conditions propagates through the value chain, posing a significant challenge to the emerging biorefinery industry. Variability in feedstock properties impacts feeding, handling, equipment operations, and conversion performance. Feedstock quality attributes, and their variations, are often overlooked in assessing feedstock value and utilization for conversion to fuels, chemicals, and products. This study developed and employed a multiscale analytical characterization approach coupled with data analytic methods to better understand the sources and distribution of feedstock quality variability through evaluation of 24 corn stover bales collected in 4 counties of Iowa. In total, 216 core samples were generated by sampling nine positions on each bale using a reliable bale coring process. The samples were characterized for a broad suite of physicochemical properties ranging across field and bale, macro, micro, and molecular scales. Results demonstrated that feedstock quality attributes can vary at all spatial scales and that multiple sources of variability must be considered in order to establish and manage biomass quality for conversion processes

Passive Recovery of Vegetation after Herbivore Eradication on Santa Cruz Island, California

Understanding how insular ecosystems recover or are restructured after the eradication of an invasive species is crucial in evaluating conservation success and prioritizing island conservation efforts. Globally, herbivores have been removed from 762 islands, most with limited active restoration actions following eradication. Few studies have documented the effects of invasive herbivore removal after multiple decades of passive recovery. Here we evaluate recovery of vegetation on Santa Cruz Island, California, after the removal of feral sheep (Ovis aries) in 1984. We repeat a study conducted in 1980, and examine vegetation changes 28 years after the eradication. Before eradication, grazed areas were characterized by reduced plant cover, high exposure of bare ground, and erosion. After 28 years of passive recovery, transect data showed a 23% increase in woody overstory, whereas analysis of photographs from landscapes photographed pre- and post-eradication showed a 26% increase in woody vegetation. Whole island vegetation maps similarly showed a transition from grass/bare ground (74.3% of cover) to woody plants (77.2% of cover), indicating the transition away from predominantly exotic annual grassland toward a community similar to the overstory of coastal scrubland but with an understory dominated by non-native annual grasses. We estimate that replacement of grasses/bare ground by native woody vegetation has led to 70 and 17% increases in the stored carbon and nitrogen pools on the island, respectively. Our results demonstrate that these island ecosystems can experience significant recovery of native floral communities without intensive post-eradication restoration, and results of recovery may take decades to be realized