1,302 research outputs found

    1-PAGER: One Pass Answer Generation and Evidence Retrieval

    Full text link
    We present 1-Pager the first system that answers a question and retrieves evidence using a single Transformer-based model and decoding process. 1-Pager incrementally partitions the retrieval corpus using constrained decoding to select a document and answer string, and we show that this is competitive with comparable retrieve-and-read alternatives according to both retrieval and answer accuracy metrics. 1-Pager also outperforms the equivalent closed-book question answering model, by grounding predictions in an evidence corpus. While 1-Pager is not yet on-par with more expensive systems that read many more documents before generating an answer, we argue that it provides an important step toward attributed generation by folding retrieval into the sequence-to-sequence paradigm that is currently dominant in NLP. We also show that the search paths used to partition the corpus are easy to read and understand, paving a way forward for interpretable neural retrieval.Comment: Accepted at EMNLP 2023 (Findings

    NAIL: Lexical Retrieval Indices with Efficient Non-Autoregressive Decoders

    Full text link
    Neural document rerankers are extremely effective in terms of accuracy. However, the best models require dedicated hardware for serving, which is costly and often not feasible. To avoid this serving-time requirement, we present a method of capturing up to 86% of the gains of a Transformer cross-attention model with a lexicalized scoring function that only requires 10-6% of the Transformer's FLOPs per document and can be served using commodity CPUs. When combined with a BM25 retriever, this approach matches the quality of a state-of-the art dual encoder retriever, that still requires an accelerator for query encoding. We introduce NAIL (Non-Autoregressive Indexing with Language models) as a model architecture that is compatible with recent encoder-decoder and decoder-only large language models, such as T5, GPT-3 and PaLM. This model architecture can leverage existing pre-trained checkpoints and can be fine-tuned for efficiently constructing document representations that do not require neural processing of queries.Comment: To appear at EMNLP 202

    A interiorização do ensino superior no Rio Grande do Sul

    Get PDF
    This article aims to explain, briefly, the evolution of higher education in Rio Grande do Sul, through data on the evolution of the number of higher education institutions, courses, vacancies, subscribers, enrollment and admission of students, between the years 1991 and 2013. Outside the Porto Alegre, the relative participation of the public institutions, in total vacancies, increased, inverse phenomenon to what occurred in the capital. This fact reflects the results of the creation of UNIPAMPA, three Federal Institutes of Education, Science and Technology (Ifs), beyond the hinterland campuses of the UFSM and UERGS. Outside the Porto Alegre, unlike what occurred in the capital, there was an increase of relative share in total enrollment and admissions from public institutions in relation to private institutions of higher education. It was concluded that there was a decrease in the degree of internalization of number of higher education institutions; increased internalization of the number of subscribers, enrollments and admissions of students; and stability of the number of courses and vacancie

    A teoria econômica da religião: aspectos gerais

    Get PDF
    This work aims to present the Economics of Religion. The methodology used is a literature review. Shows the importance of religion from the perspective of Economics . It addresses the connections between Economics of Religion and Rational Choice Theory. We present the concepts of religious commodity, consumer and religious producers . We discuss the differences between the Economics of Religion and the Secularization Thesis, emphasizing, mainly, the empirical reality of the persistence and intensity of religious factor. Is commented on the level of religious beliefs among researchers of Natural Sciences and Social Sciences in the USA It also presents the origin and subsequent development of the Economics of Religion . Explains the issues on which leans this discipline , ie, its object of study . The main conclusion is that , given the specificity of the Economics of Religion, research linking religion and economics can benefit both disciplines in different ways

    MICK: A Meta-Learning Framework for Few-shot Relation Classification with Small Training Data

    Full text link
    Few-shot relation classification seeks to classify incoming query instances after meeting only few support instances. This ability is gained by training with large amount of in-domain annotated data. In this paper, we tackle an even harder problem by further limiting the amount of data available at training time. We propose a few-shot learning framework for relation classification, which is particularly powerful when the training data is very small. In this framework, models not only strive to classify query instances, but also seek underlying knowledge about the support instances to obtain better instance representations. The framework also includes a method for aggregating cross-domain knowledge into models by open-source task enrichment. Additionally, we construct a brand new dataset: the TinyRel-CM dataset, a few-shot relation classification dataset in health domain with purposely small training data and challenging relation classes. Experimental results demonstrate that our framework brings performance gains for most underlying classification models, outperforms the state-of-the-art results given small training data, and achieves competitive results with sufficiently large training data

    Uma perspectiva sobre a evolução do sistema de inovação industrial gaúcho: análise dos resultados das pesquisas de inovação (pintec) 2000 e 2011.

    Get PDF
    This work aims to present the main results of the analysis of the data provided by the Innovation Survey (PINTEC) 2000 and 2011 for the state of Rio Grande do Sul, Brazil. This paper also defines technical concepts of innovation according to the main manuals dealing with the development of indicators systems for Science, Technology and Innovation (ST & I). The results of PINTEC 2011 are compared with those from the 2000 PINTEC in order to infer the innovative performance of manufacturing companies at Rio Grande do Sul and Brazil during the period analyzed in this study. We conclude that regional manufacturing industry firms have become more innovative, in average, than those located in other Brazilian states

    Uma perspectiva sobre a evolução do sistema de inovação industrial gaúcho: análise dos resultados das pesquisas de inovação (pintec) 2000 e 2011.

    Get PDF
    This work aims to present the main results of the analysis of the data provided by the Innovation Survey (PINTEC) 2000 and 2011 for the state of Rio Grande do Sul, Brazil. This paper also defines technical concepts of innovation according to the main manuals dealing with the development of indicators systems for Science, Technology and Innovation (ST & I). The results of PINTEC 2011 are compared with those from the 2000 PINTEC in order to infer the innovative performance of manufacturing companies at Rio Grande do Sul and Brazil during the period analyzed in this study. We conclude that regional manufacturing industry firms have become more innovative, in average, than those located in other Brazilian states
    corecore