Hubness Reduction Improves Sentence-BERT Semantic Spaces

Semantic representations of text, i.e. representations of natural language which capture meaning by geometry, are essential for areas such as information retrieval and document grouping. High-dimensional trained dense vectors have received much attention in recent years as such representations. We investigate the structure of semantic spaces that arise from embeddings made with Sentence-BERT and find that the representations suffer from a well-known problem in high dimensions called hubness. Hubness results in asymmetric neighborhood relations, such that some texts (the hubs) are neighbours of many other texts while most texts (so-called anti-hubs), are neighbours of few or no other texts. We quantify the semantic quality of the embeddings using hubness scores and error rate of a neighbourhood based classifier. We find that when hubness is high, we can reduce error rate and hubness using hubness reduction methods. We identify a combination of two methods as resulting in the best reduction. For example, on one of the tested pretrained models, this combined method can reduce hubness by about 75% and error rate by about 9%. Thus, we argue that mitigating hubness in the embedding space provides better semantic representations of text.Comment: Accepted at NLDL 202

Client Adaptation improves Federated Learning with Simulated Non-IID Clients

We present a federated learning approach for learning a client adaptable, robust model when data is non-identically and non-independently distributed (non-IID) across clients. By simulating heterogeneous clients, we show that adding learned client-specific conditioning improves model performance, and the approach is shown to work on balanced and imbalanced data set from both audio and image domains. The client adaptation is implemented by a conditional gated activation unit and is particularly beneficial when there are large differences between the data distribution for each client, a common scenario in federated learning.Comment: 11 pages, 11 figures. To appear at International Workshop on Federated Learning for User Privacy and Data Confidentiality in Conjunction with ICML 202

Allocentric representation in the human amygdala and ventral visual stream

The hippocampus and the entorhinal cortex are considered the main brain structures for allocentric representation of the external environment. Here, we show that the amygdala and the ventral visual stream are involved in allocentric representation. Thirty-one young men explored 35 virtual environments during high-resolution functional magnetic resonance imaging (fMRI) of the medial temporal lobe (MTL) and were subsequently tested on recall of the allocentric pattern of the objects in each environment-in other words, the positions of the objects relative to each other and to the outer perimeter. We find increasingly unique brain activation patterns associated with increasing allocentric accuracy in distinct neural populations in the perirhinal cortex, parahippocampal cortex, fusiform cortex, amygdala, hippocampus, and entorhinal cortex. In contrast to the traditional view of a hierarchical MTL network with the hippocampus at the top, we demonstrate, using recently developed graph analyses, a hierarchical allocentric MTL network without a main connector hub

A Critical Analysis of the Environmental Dossiers from the OECD Sponsorship Programme for the Testing of Manufactured Nanomaterials

In 2015, the OECD finally published the findings of its seven year testing programme for manufactured nanomaterials.</p

Life cycle modelling of environmental impacts of application of processed organic municipal solid waste on agricultural land (EASEWASTE)

A model capable of quantifying the potential environmental impacts of agricultural application of composted or anaerobically digested source-separated organic municipal solid waste (MSW) is presented. In addition to the direct impacts, the model accounts for savings by avoiding the production and use of commercial fertilizers. The model is part of a larger model, Environmental Assessment of Solid Waste Systems and Technology (EASEWASTE), developed as a decisionsupport model, focusing on assessment of alternative waste management options. The environmental impacts of the land application of processed organic waste are quantified by emission coefficients referring to the composition of the processed waste and related to specific crop rotation as well as soil type. The model contains several default parameters based on literature data, field experiments and modelling by the agro-ecosystem model, Daisy. All data can be modified by the user allowing application of the model to other situations. A case study including four scenarios was performed to illustrate the use of the model. One tonne of nitrogen in composted and anaerobically digested MSW was applied as fertilizer to loamy and sandy soil at a plant farm in western Denmark. Application of the processed organic waste mainly affected the environmental impact categories global warming (0.4–0.7 PE), acidification (–0.06 (saving)–1.6 PE), nutrient enrichment (–1.0 (saving)–3.1 PE), and toxicity. The main contributors to these categories were nitrous oxide formation (global warming), ammonia volatilization (acidification and nutrient enrichment), nitrate losses (nutrient enrichment and groundwater contamination), and heavy metal input to soil (toxicity potentials). The local agricultural conditions as well as the composition of the processed MSW showed large influence on the environmental impacts. A range of benefits, mainly related to improved soil quality from long-term application of the processed organic waste, could not be generally quantified with respect to the chosen life cycle assessment impact categories and were therefore not included in the model. These effects should be considered in conjunction with the results of the life cycle assessment