From general language understanding to noisy text comprehension

Obtaining meaning-rich representations of social media inputs, such as Tweets (unstructured and noisy text), from general-purpose pre-trained language models has become challenging, as these inputs typically deviate from mainstream English usage. The proposed research establishes effective methods for improving the comprehension of noisy texts. For this, we propose a new generic methodology to derive a diverse set of sentence vectors combining and extracting various linguistic characteristics from latent representations of multi-layer, pre-trained language models. Further, we clearly establish how BERT, a state-of-the-art pre-trained language model, comprehends the linguistic attributes of Tweets to identify appropriate sentence representations. Five new probing tasks are developed for Tweets, which can serve as benchmark probing tasks to study noisy text comprehension. Experiments are carried out for classification accuracy by deriving the sentence vectors from GloVe-based pre-trained models and Sentence-BERT, and by using different hidden layers from the BERT model. We show that the initial and middle layers of BERT have better capability for capturing the key linguistic characteristics of noisy texts than its latter layers. With complex predictive models, we further show that the sentence vector length has lesser importance to capture linguistic information, and the proposed sentence vectors for noisy texts perform better than the existing state-of-the-art sentence vectors. © 2021 by the authors. Licensee MDPI, Basel, Switzerland

Challenges in Acquiring Clinical Simultaneous SPECT-MRI on a PET-MRI Scanner

The INSERT is the world’s first clinical SPECTMRI brain imaging system based on scintillation detectors with a SiPM readout. Here we demonstrate its use within a clinical MRI environment for the first time. Using a standard transmit-receive head coil, and with an appropriate selection of a custom MRI sequence (GRE), we overcome mutual interference. The INSERT and its bulky 50 kg tungsten collimator introduce magnetic field inhomogeneity. Due to the specific MRI-compatible collimator design, inhomogeneity is compensated by shimming, leading to simultaneous acquisition. We process the SPECT data acquired alongside the MRI sequence to evaluate the SPECT system performance and the impact of the MRI. Finally, we present a set of simultaneous SPECT-MRI acquisitions, demonstrating multimodal imaging capabilities, albeit with a limited MRI sequence

The relationship between international trade and non-nutritional health outcomes : A systematic review of quantitative studies

Markets throughout the world have been reducing barriers to international trade and investment in recent years. The resulting increases in levels of international trade and investment have subsequently generated research interest into the potential population health impact. We present a systematic review of quantitative studies investigating the relationship between international trade, foreign direct investment and non-nutritional health outcomes. Articles were systematically collected from the SCOPUS, PubMed, EconLit and Web of Science databases. Due to the heterogeneous nature of the evidence considered, the 16 included articles were subdivided into individual level data analyses, selected country analyses and international panel analyses. Articles were then quality assessed using a tool developed as part of the project. Nine of the studies were assessed to be high quality, six as medium quality, and one as low quality. The evidence from the quantitative literature suggests that overall, there appears to be a beneficial association between international trade and population health. There was also evidence of the importance of foreign direct investment, yet a lack of research considering the direction of causality. Taken together, quantitative research into the relationship between trade and non-nutritional health indicates trade to be beneficial, yet this body of research is still in its infancy. Future quantitative studies based on this foundation will provide a stronger basis on which to inform relevant national and international institutions about the health consequences of trade policies

OBO Foundry in 2021: Operationalizing Open Data Principles to Evaluate Ontologies

Biological ontologies are used to organize, curate, and interpret the vast quantities of data arising from biological experiments. While this works well when using a single ontology, integrating multiple ontologies can be problematic, as they are developed independently, which can lead to incompatibilities. The Open Biological and Biomedical Ontologies Foundry was created to address this by facilitating the development, harmonization, application, and sharing of ontologies, guided by a set of overarching principles. One challenge in reaching these goals was that the OBO principles were not originally encoded in a precise fashion, and interpretation was subjective. Here we show how we have addressed this by formally encoding the OBO principles as operational rules and implementing a suite of automated validation checks and a dashboard for objectively evaluating each ontology’s compliance with each principle. This entailed a substantial effort to curate metadata across all ontologies and to coordinate with individual stakeholders. We have applied these checks across the full OBO suite of ontologies, revealing areas where individual ontologies require changes to conform to our principles. Our work demonstrates how a sizable federated community can be organized and evaluated on objective criteria that help improve overall quality and interoperability, which is vital for the sustenance of the OBO project and towards the overall goals of making data FAIR. Competing Interest StatementThe authors have declared no competing interest

Search for dark matter produced in association with bottom or top quarks in √s = 13 TeV pp collisions with the ATLAS detector

A search for weakly interacting massive particle dark matter produced in association with bottom or top quarks is presented. Final states containing third-generation quarks and miss- ing transverse momentum are considered. The analysis uses 36.1 fb−1 of proton–proton collision data recorded by the ATLAS experiment at √s = 13 TeV in 2015 and 2016. No significant excess of events above the estimated backgrounds is observed. The results are in- terpreted in the framework of simplified models of spin-0 dark-matter mediators. For colour- neutral spin-0 mediators produced in association with top quarks and decaying into a pair of dark-matter particles, mediator masses below 50 GeV are excluded assuming a dark-matter candidate mass of 1 GeV and unitary couplings. For scalar and pseudoscalar mediators produced in association with bottom quarks, the search sets limits on the production cross- section of 300 times the predicted rate for mediators with masses between 10 and 50 GeV and assuming a dark-matter mass of 1 GeV and unitary coupling. Constraints on colour- charged scalar simplified models are also presented. Assuming a dark-matter particle mass of 35 GeV, mediator particles with mass below 1.1 TeV are excluded for couplings yielding a dark-matter relic density consistent with measurements

Sensitivity of SARS-CoV-2 B.1.1.7 to mRNA vaccine-elicited antibodies

SARS-CoV-2 transmission is uncontrolled in many parts of the world, compounded in some areas by higher transmission potential of the B1.1.7 variant1 now reported in 94 countries. It is unclear whether responses to SARS-CoV-2 vaccines based on the prototypic strain will be impacted by mutations found in B.1.1.7. Here we assessed immune responses following vaccination with mRNA-based vaccine BNT162b22. We measured neutralising antibody responses following first and second immunisations using pseudoviruses expressing the wild-type Spike protein or the 8 amino acid mutations found in the B.1.1.7 spike protein. The vaccine sera exhibited a broad range of neutralising titres against the wild-type pseudoviruses that were modestly reduced against B.1.1.7 variant. This reduction was also evident in sera from some convalescent patients. Decreased B.1.1.7 neutralisation was also observed with monoclonal antibodies targeting the N-terminal domain (9 out of 10), the RBM (5 out of 31), but not in RBD neutralising mAbs binding outside the RBM. Introduction of the E484K mutation in a B.1.1.7 background to reflect a newly emergent Variant of Concern (VOC 202102/02) led to a more substantial loss of neutralising activity by vaccine-elicited antibodies and mAbs (19 out of 31) over that conferred by the B.1.1.7 mutations alone. E484K emergence on a B.1.1.7 background represents a threat to the vaccine BNT162b