Variable beam search for generative neural parsing and its fit with neuro-imaging signal

International audienc

FlauBERT: Unsupervised Language Model Pre-training for French

International audienceLanguage models have become a key step to achieve state-of-the art results in many different Natural Language Processing (NLP) tasks. Leveraging the huge amount of unlabeled texts nowadays available, they provide an efficient way to pre-train continuous word representations that can be fine-tuned for a downstream task, along with their contextualization at the sentence level. This has been widely demonstrated for English using contextualized representations (Dai and Le, 2015; Peters et al., 2018; Howard and Ruder, 2018; Radford et al., 2018; Devlin et al., 2019; Yang et al., 2019b). In this paper, we introduce and share FlauBERT, a model learned on a very large and heterogeneous French corpus. Models of different sizes are trained using the new CNRS (French National Centre for Scientific Research) Jean Zay supercomputer. We apply our French language models to diverse NLP tasks (text classification, paraphrasing, natural language inference, parsing, word sense disambiguation) and show that most of the time they outperform other pre-training approaches. Different versions of FlauBERT as well as a unified evaluation protocol for the downstream tasks, called FLUE (French Language Understanding Evaluation), are shared to the research community for further reproducible experiments in French NLP

Fungal Biotechnology in Space: Why and How?

Fungi have been companions of mankind for millennia. Mushrooms inspired our eating culture, and yeasts and filamentous fungi were developed into highly efficient cell factories during the last 100 years to produce many products utilized in different industries worldwide. What more is to come in the next 100 years? We propose here that fungi can become important cell factories for life in space, especially regarding the filamentous fungus Aspergillus niger as the cutting-edge must-have for space travel in the twenty-first century and beyond. First, it is one of the most robust and efficient production systems used nowadays in industrial biotechnology. Second, it is a multipurpose cell factory that produces a diverse range of organic acids, proteins, enzymes and natural products. And third, it is a common fungal isolate of the International Space Station. A. niger could thus become an essential companion of astronauts for the autonomous production of food, enzymes and antibiotics during space travel. What needs to be done to achieve these visionary goals? In this chapter, we will discuss the opportunities of A. niger as a cell factory spanning from Earth to space. We summarize the current state of the art of A. niger biotechnology on Earth and discuss the general tools and technologies still in need of development to take a new step for mankind: space biotechnology