BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling

The pre-training of large language models usually requires massive amounts of resources, both in terms of computation and data. Frequently used web sources such as Common Crawl might contain enough noise to make this pre-training sub-optimal. In this work, we experiment with different sampling methods from the Spanish version of mC4, and present a novel data-centric technique which we name $\textit{perplexity sampling}$ that enables the pre-training of language models in roughly half the amount of steps and using one fifth of the data. The resulting models are comparable to the current state-of-the-art, and even achieve better results for certain tasks. Our work is proof of the versatility of Transformers, and paves the way for small teams to train their models on a limited budget. Our models are available at this $\href{https://huggingface.co/bertin-project}{URL}$.Comment: Published at Procesamiento del Lenguaje Natura

Survival of lichens and bacteria exposed to outer space conditions - Results of the Lithopanspermia experiments

n the space experiments Lithopanspermia, experimental support was provided to the likelihood of the lithopanspermia concept that considers a viable transport of microorganisms between the terrestrial planets by means of meteorites. The rock colonising lichens Rhizocarpon geographicum and Xanthoria elegans, the vagrant lichen Aspicilia fruticulosa, and endolithic and endoevaporitic communities of cyanobacteria and bacteria with their natural rock substrate were exposed to space for 10 days onboard the Biopan facility of the European Space Agency (ESA). Biopan was closed during launch and re-entry. In addition, in the Stone facility, one sample of R. geographicum on its natural granitic substrate was attached at the outer surface of the re-entry capsule close to the stagnation point, only protected by a thin cover of glass textolite. Post-flight analysis, which included determination of the photosynthetic activity, LIVE/DEAD staining, and germination capacity of the ascospores, demonstrated that all three lichen were quite resistant to outer space conditions, which include the full spectrum of solar extraterrestrial electromagnetic radiation or selected wavelength ranges. This high resistance of the lichens to space appears to be due to their symbiotic nature and protection by their upper pigmented layer, the cortex. In contrast, the rock- or halite-inhabiting bacteria were severely damaged by the same exposure. After atmospheric re-entry, the granite of the Stone sample was transformed into a glassy, nearly homogenous material, with several friction striae. None of the lichen cells survived this re-entry process. The data suggest that lichens are suitable candidates for testing the concept of lithopanspermia, because they are extremely resistant to the harsh environment of outer space. The more critical event is the atmospheric re-entry after being captured by a planet. Experiments simulating the re-entry process of a microbe-carrying meteoroid did not show any survivors

Ancient diversity in host-parasite interaction genes in a model parasitic nematode

Abstract Host-parasite interactions exert strong selection pressures on the genomes of both host and parasite. These interactions can lead to negative frequency-dependent selection, a form of balancing selection that is hypothesised to explain the high levels of polymorphism seen in many host immune and parasite antigen loci. Here, we sequence the genomes of several individuals of Heligmosomoides bakeri, a model parasite of house mice, and Heligmosomoides polygyrus, a closely related parasite of wood mice. Although H. bakeri is commonly referred to as H. polygyrus in the literature, their genomes show levels of divergence that are consistent with at least a million years of independent evolution. The genomes of both species contain hyper-divergent haplotypes that are enriched for proteins that interact with the host immune response. Many of these haplotypes originated prior to the divergence between H. bakeri and H. polygyrus, suggesting that they have been maintained by long-term balancing selection. Together, our results suggest that the selection pressures exerted by the host immune response have played a key role in shaping patterns of genetic diversity in the genomes of parasitic nematodes

HOPE (SOLTI-1903) breast cancer study: real-world, patient-centric, clinical practice study to assess the impact of genomic data on next treatment decision-choice in patients with locally advanced or metastatic breast cancer

Background Metastatic breast cancer (mBC) causes nearly all BC-related deaths. Next-generation sequencing (NGS) technologies allow for the application of personalized medicine using targeted therapies that could improve patients' outcomes. However, NGS is not routinely used in the clinical practice and its cost induces access-inequity among patients. We hypothesized that promoting active patient participation in the management of their disease offering access to NGS testing and to the subsequent medical interpretation and recommendations provided by a multidisciplinary molecular advisory board (MAB) could contribute to progressively overcome this challenge. We designed HOPE (SOLTI-1903) breast cancer trial, a study where patients voluntarily lead their inclusion through a digital tool (DT). The main objectives of HOPE study are to empower mBC patients, gather real-world data on the use of molecular information in the management of mBC and to generate evidence to assess the clinical utility for healthcare systems.Trial design After self-registration through the DT, the study team validates eligibility criteria and assists patients with mBC in the subsequent steps. Patients get access to the information sheet and sign the informed consent form through an advanced digital signature. Afterwards, they provide the most recent (preferably) metastatic archival tumor sample for DNA-sequencing and a blood sample obtained at the time of disease progression for ctDNA analysis. Paired results are reviewed by the MAB, considering patient's medical history. The MAB provides a further interpretation of molecular results and potential treatment recommendations, including ongoing clinical trials and further (germline) genetic testing. Participants self-document their treatment and disease evolution for the next 2 years. Patients are encouraged to involve their physicians in the study. HOPE also includes a patient empowerment program with educational workshops and videos about mBC and precision medicine in oncology. The primary endpoint of the study was to describe the feasibility of a patient-centric precision oncology program in mBC patients when a comprehensive genomic profile is available to decide on a subsequent line of treatment

Impact of the first wave of the SARS-CoV-2 pandemic on the outcome of neurosurgical patients: A nationwide study in Spain

Objective To assess the effect of the first wave of the SARS-CoV-2 pandemic on the outcome of neurosurgical patients in Spain. Settings The initial flood of COVID-19 patients overwhelmed an unprepared healthcare system. Different measures were taken to deal with this overburden. The effect of these measures on neurosurgical patients, as well as the effect of COVID-19 itself, has not been thoroughly studied. Participants This was a multicentre, nationwide, observational retrospective study of patients who underwent any neurosurgical operation from March to July 2020. Interventions An exploratory factorial analysis was performed to select the most relevant variables of the sample. Primary and secondary outcome measures Univariate and multivariate analyses were performed to identify independent predictors of mortality and postoperative SARS-CoV-2 infection. Results Sixteen hospitals registered 1677 operated patients. The overall mortality was 6.4%, and 2.9% (44 patients) suffered a perioperative SARS-CoV-2 infection. Of those infections, 24 were diagnosed postoperatively. Age (OR 1.05), perioperative SARS-CoV-2 infection (OR 4.7), community COVID-19 incidence (cases/10 5 people/week) (OR 1.006), postoperative neurological worsening (OR 5.9), postoperative need for airway support (OR 5.38), ASA grade =3 (OR 2.5) and preoperative GCS 3-8 (OR 2.82) were independently associated with mortality. For SARS-CoV-2 postoperative infection, screening swab test <72 hours preoperatively (OR 0.76), community COVID-19 incidence (cases/10 5 people/week) (OR 1.011), preoperative cognitive impairment (OR 2.784), postoperative sepsis (OR 3.807) and an absence of postoperative complications (OR 0.188) were independently associated. Conclusions Perioperative SARS-CoV-2 infection in neurosurgical patients was associated with an increase in mortality by almost fivefold. Community COVID-19 incidence (cases/10 5 people/week) was a statistically independent predictor of mortality. Trial registration number CEIM 20/217

Country-level gender inequality is associated with structural differences in the brains of women and men

男女間の不平等と脳の性差 --男女間の不平等は脳構造の性差と関連する--. 京都大学プレスリリース. 2023-05-10.Gender inequality across the world has been associated with a higher risk to mental health problems and lower academic achievement in women compared to men. We also know that the brain is shaped by nurturing and adverse socio-environmental experiences. Therefore, unequal exposure to harsher conditions for women compared to men in gender-unequal countries might be reflected in differences in their brain structure, and this could be the neural mechanism partly explaining women’s worse outcomes in gender-unequal countries. We examined this through a random-effects meta-analysis on cortical thickness and surface area differences between adult healthy men and women, including a meta-regression in which country-level gender inequality acted as an explanatory variable for the observed differences. A total of 139 samples from 29 different countries, totaling 7, 876 MRI scans, were included. Thickness of the right hemisphere, and particularly the right caudal anterior cingulate, right medial orbitofrontal, and left lateral occipital cortex, presented no differences or even thicker regional cortices in women compared to men in gender-equal countries, reversing to thinner cortices in countries with greater gender inequality. These results point to the potentially hazardous effect of gender inequality on women’s brains and provide initial evidence for neuroscience-informed policies for gender equality

Country-level gender inequality is associated with structural differences in the brains of women and men

Gender inequality across the world has been associated with a higher risk to mental health problems and lower academic achievement in women compared to men. We also know that the brain is shaped by nurturing and adverse socio-environmental experiences. Therefore, unequal exposure to harsher conditions for women compared to men in gender-unequal countries might be reflected in differences in their brain structure, and this could be the neural mechanism partly explaining women's worse outcomes in gender-unequal countries. We examined this through a random-effects meta-analysis on cortical thickness and surface area differences between adult healthy men and women, including a meta-regression in which country-level gender inequality acted as an explanatory variable for the observed differences. A total of 139 samples from 29 different countries, totaling 7,876 MRI scans, were included. Thickness of the right hemisphere, and particularly the right caudal anterior cingulate, right medial orbitofrontal, and left lateral occipital cortex, presented no differences or even thicker regional cortices in women compared to men in gender-equal countries, reversing to thinner cortices in countries with greater gender inequality. These results point to the potentially hazardous effect of gender inequality on women's brains and provide initial evidence for neuroscience-informed policies for gender equality

Trends in the epidemiology of catheter-related bloodstream infections; towards a paradigm shift, Spain, 2007 to 2019

Altres ajuts: Departament de Salut. Generalitat de Catalunya ("Pla estratègic de recerca i innovació en salut (PERIS) 2019-2021"); Ministerio de Asuntos Económicos y Transformación Digital; Red Española de Investigación en Patología Infecciosa (REIPI).Background: Catheter-related bloodstream infections (CRBSI) are frequent healthcare-associated infections and an important cause of death. Aim: To analyse changes in CRBSI epidemiology observed by the Infection Control Catalan Programme (VINCat). Methods: A cohort study including all hospital-acquired CRBSI episodes diagnosed at 55 hospitals (2007-2019) in Catalonia, Spain, was prospectively conducted. CRBSI incidence rates were adjusted per 1,000patientdays. To assess the CRBSI rate trend per year, negative binomial models were used, with the number of events as the dependent variable, and the year as the main independent variable. From each model, the annual rate of CRBSI diagnosed per 1,000patientdays and the incidence rate ratio (IRR) with its 95% confidence intervals (CI) were reported. Results: During the study, 9,290 CRBSI episodes were diagnosed (mean annual incidence rate:0.20episodes/1,000patientdays). Patients' median age was 64.1years; 36.6% (3,403/9,290) were female. In total, 73.7% (n=6,845) of CRBSI occurred in non-intensive care unit (ICU) wards, 62.7% (n=5,822) were related to central venous catheter (CVC), 24.1% (n=2,236) to peripheral venous catheters (PVC) and 13.3% (n=1,232) to peripherally-inserted central venous catheters (PICVC). Incidence rate fell over the study period (IRR:0.94;95%CI:0.93-0.96), especially in the ICU (IRR:0.88;95%CI:0.87-0.89). As a whole, while episodes of CVC CRBSI fell significantly (IRR:0.88;95%CI:0.87-0.91), peripherally-inserted catheter CRBSI (PVC and PICVC) rose, especially in medical wards (IRR PICVC:1.08;95%CI:1.05-1.11; IRR PVC: 1.03; 95% 1.00-1.05). Conclusions: Over the study, CRBSIs associated with CVC and diagnosed in ICUs decreased while episodes in conventional wards involving peripherally-inserted catheters increased. Hospitals should implement preventive measures in conventional wards

Clonal chromosomal mosaicism and loss of chromosome Y in elderly men increase vulnerability for SARS-CoV-2

The pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2, COVID-19) had an estimated overall case fatality ratio of 1.38% (pre-vaccination), being 53% higher in males and increasing exponentially with age. Among 9578 individuals diagnosed with COVID-19 in the SCOURGE study, we found 133 cases (1.42%) with detectable clonal mosaicism for chromosome alterations (mCA) and 226 males (5.08%) with acquired loss of chromosome Y (LOY). Individuals with clonal mosaic events (mCA and/or LOY) showed a 54% increase in the risk of COVID-19 lethality. LOY is associated with transcriptomic biomarkers of immune dysfunction, pro-coagulation activity and cardiovascular risk. Interferon-induced genes involved in the initial immune response to SARS-CoV-2 are also down-regulated in LOY. Thus, mCA and LOY underlie at least part of the sex-biased severity and mortality of COVID-19 in aging patients. Given its potential therapeutic and prognostic relevance, evaluation of clonal mosaicism should be implemented as biomarker of COVID-19 severity in elderly people. Among 9578 individuals diagnosed with COVID-19 in the SCOURGE study, individuals with clonal mosaic events (clonal mosaicism for chromosome alterations and/or loss of chromosome Y) showed an increased risk of COVID-19 lethality