Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddings

Models based on the transformer architecture, such as BERT, have marked a crucial step for- ward in the field of Natural Language Pro- cessing. Importantly, they allow the creation of word embeddings that capture important semantic information about words in context. However, as single entities, these embeddings are difficult to interpret and the models used to create them have been described as opaque. Binder and colleagues proposed an intuitive embedding space where each dimension is based on one of 65 core semantic features. Un- fortunately, the space only exists for a small data-set of 535 words, limiting its uses. Pre- vious work (Utsumi, 2018, 2020; Turton et al., 2020) has shown that Binder features can be derived from static embeddings and success- fully extrapolated to a large new vocabulary. Taking the next step, this paper demonstrates that Binder features can be derived from the BERT embedding space. This provides two things; (1) semantic feature values derived from contextualised word embeddings and (2) insights into how semantic features are repre- sented across the different layers of the BERT model

Trait Anxiety Effects on Late Phase Threatening Speech Processing: Evidence from Electroencephalography

The effects of threatening stimuli, including threatening language, on trait anxiety have been widely studied. However, whether anxiety levels have a direct effect on language processing has not been so consistently explored. The present study focuses on event-related potential (ERP) patterns resulting from electroencephalographic (EEG) measurement of participants' (n = 36) brain activity while they perform a dichotic listening task. Participants' anxiety level was measured via a behavioural inhibition system scale (BIS). Later, participants listened to dichotically paired sentences, one neutral and the other threatening, and indicated at which ear they heard the threatening stimulus. Threatening sentences expressed threat semantically-only, prosodically-only, or both combined (congruent threat). ERPs showed a late positivity, interpreted as a late positive complex (LPC). Results from Bayesian hierarchical models provided strong support for an association between LPC and BIS score. This was interpreted as an effect of trait anxiety on deliberation processes. We discuss two possible interpretations. On the one hand, verbal repetitive thinking, as associated with anxious rumination and worry, can be the mechanism disrupting late phase deliberation processes. Instantiated by inner speech, verbal repetitive thinking might be the vehicle of anxiety-related reappraisal and/or rehearsal. On the other hand, increased BIS could be simply affecting an extended evaluation stage as proposed by multistep models, maybe due to over-engagement with threat or to task-related effects

LA EDUCACIÓN PARA UNA CIUDADANÍA PELIGROSA

El concepto de educación pública se encuentra bajo la influencia de las imágenes dominantes y dominadoras más que en la autentica comprensión de la complejidad de las realidades diarias del aula. Basándose en los trabajos de Debord y Foucault, especialmente en sus visiones libertarias y antiestáticas del poder, de la autoridad y del control en la sociedad contemporánea, este artículo examina cómo el control social se ejerce a través de las imágenes dominantes y una mezcla de vigilancia y espectáculo. En respuesta a estas condiciones, desarrollamos el concepto de «ciudadanía peligrosa». Reclamamos que las condiciones contemporáneas requieren de una Educación para la Ciudadanía antiopresiva, que se tome en serio las desigualdades sociales y económicas, y la opresión fruto del capitalismo neoliberal que restringe las posibilidades antiopresivas y establece unas pedagogías oficiales y sancionadoras. El poder pedagógico de la ciudadanía peligrosa reside: 1) en la capacidad de alentar al alumnado y al profesorado sobre las implicaciones de su propia enseñanza y aprendizaje; 2) en visualizar una educación focalizada en la libertad y en la democracia, y 3) en interrogar y deconstruir sus bienintencionadas complicidades con el sistema a partir de prácticas y textos culturales, especialmente para relacionar las condiciones opresivas con las prácticas culturales del mismo estilo, y viceversaConceptualizations of public schooling rest upon the influence of dominant and dominating images rather than on more authentic understandings of the complex realities of classroom life. Drawing upon the work of both Debord and Foucault, particularly their libertarian and anti-statist visions of power, authority, and control in contemporary society, this article examines how social control is exercised via controlling images and a merger of surveillance and spectacle. In response to these conditions we develop the concept of “dangerous citizenship.” We argue that contemporary conditions demand an antioppressive citizenship education, one that takes seriously social and economic inequalities and oppression that result from neoliberal capitalism and that builds upon the antioppressive possibilities of established and offi cially sanctioned pedagogies. The pedagogical power dangerous citizenship resides in its capacity to encourage students and educators to challenge the implications of their own education/instruction, to envision an education that is free and democratic to the core, and to interrogate and uncover their own well-intentioned complicity in the conditions within which various cultural texts and practices appear, especially to the extent that oppressive conditions create oppressive cultural practices, and vicevers

Speaking of shape: The effects of language-specific encoding on semantic representations

The question of whether different linguistic patterns differentially influence semantic and conceptual representations is of central interest in cognitive science. In this paper, we investigate whether the regular encoding of shape within a nominal classification system leads to an increased salience of shape in speakers' semantic representations by comparing English, (Amazonian) Spanish, and Bora, a shape-based classifier language spoken in the Amazonian regions of Columbia and Peru. Crucially, in displaying obligatory use, pervasiveness in grammar, high discourse frequency, and phonological variability of forms corresponding to particular shape features, the Bora classifier system differs in important ways from those in previous studies investigating effects of nominal classification, thereby allowing better control of factors that may have influenced previous findings. In addition, the inclusion of Spanish monolinguals living in the Bora village allowed control for the possibility that differences found between English and Bora speakers may be attributed to their very different living environments. We found that shape is more salient in the semantic representation of objects for speakers of Bora, which systematically encodes shape, than for speakers of English and Spanish, which do not. Our results are consistent with assumptions that semantic representations are shaped and modulated by our specific linguistic experiences

EVALUATION OF RADIOLYSIS INDUCED HYDROGEN GENERATION IN DOT 6M DRUMS FROM INTEC

Three DOT 6M 30-gallon drums are scheduled to be shipped from the Idaho Nuclear Technology Engineering Center (INTEC) at the Idaho National Laboratory (INL) to L-Area at the Savannah River Site (SRS). These three drums contain radioactive materials that resulted from the material recovery effort following a small explosion that had occurred in the Idaho Chemical Processing Plant (ICPP) hot chemistry laboratory (HCL). In support of the shipment and subsequent storage of the three DOT 6M drums, an evaluation of the potential for molecular hydrogen production in the drums has been completed and documented herein. The potential sources of hydrogen evaluated in the current report include radiolytic decomposition of polymeric materials in the DOT 6M drums No.3031 and No.3598 and the radiolytic decomposition of water in drum No.20102. No other potential sources have been identified based upon reported drum contents and packaging configuration. A parametric approach was used to evaluate the maximum quantity of molecular hydrogen that can be expected to evolve in two DOT 6M 30-gallon drums in support of receipt and subsequent interim storage prior to canyon processing. These drums are two of three drums scheduled for shipment from INTEC to SRS as part of the decommissioning effort of the INTEC facility. The three DOT 6M drums will be received at L-Area in SRS and stored for up to 13-years prior to final disposition at HB-Line in 2020. Results of the current analysis do not include parametric analysis of drum No.20102 containing 114/133 SAL (salvage) which contains UO{sub 3} powder. This drum has not been identified as containing polymeric materials and a conservative calculation indicates that the maximum gross molecular hydrogen production due to the radiolysis of adsorbed moisture would yield a production rate of 5.1-cm{sup 3}/yr, driven primarily by the large surface are to volume ratio of the oxide powder. The remaining two drums, No.3031 and No.3598 contain polymer bags and/or bottles that will be subject to radiolytically induced hydrogen gas generation due to decomposition of the polymers. Conservative values for hydrogen gas generation rates and rates of pressure increase within the drums have been determined based upon a number of inputs and assumptions. The results are that hydrogen will be produced at a rate of 1.93-cm{sup 3}/yr and 1.50-cm{sup 3}/yr, respectively for drums No.3031 and No.3598. Projected molecular hydrogen concentrations at 2020 have been calculated to remain below the lower flammability limit of 4% molecular hydrogen by volume in air

INVENTORY AND DESCRIPTION OF COMMERCIAL REACTOR FUELS WITHIN THE UNITED STATES

There are currently 104 nuclear reactors in 31 states, operated by 51 different utilities. Operation of these reactors generates used fuel assemblies that require storage prior to final disposition. The regulatory framework within the United States (U.S.) allows for the licensing of used nuclear fuel storage facilities for an initial licensing period of up to 40 years with potential for license extensions in 40 years increments. Extended storage, for periods of up to 300 years, is being considered within the U.S. Therefore, there is an emerging need to develop the technical bases to support the licensing for long-term storage. In support of the Research and Development (R&D) activities required to support the technical bases, a comprehensive assessment of the current inventory of used nuclear fuel based upon publicly available resources has been completed that includes the most current projections of used fuel discharges from operating reactors. Negotiations with the nuclear power industry are ongoing concerning the willingness of individual utilities to provide information and material needed to complete the R&D activities required to develop the technical bases for used fuel storage for up to 300 years. This report includes a status of negotiations between DOE and industry in these regards. These negotiations are expected to result in a framework for cooperation between the Department and industry in which industry will provide and specific information on used fuel inventory and the Department will compensate industry for the material required for Research and Development and Testing and Evaluation Facility activities

NDA SYSTEM RESPONSE MODELING AND ITS APPLICATION

The Portsmouth gaseous diffusion plant (PORTS) is a uranium enrichment facility that was historically used to enrich uranium to levels that range from 2% to greater than 97%. The feed material for PORTS was obtained from the Paducah Gaseous Diffusion Plant (PGDP) that produced uranium in the form of UF6 that was enriched to about 1 to 2%. The enrichment process involves a multistage process by which gaseous UF{sub 6} passed through a diffusion barrier in each stage. The porous diffusion barrier in each stage retards the rate of the diffusion of the heavier {sup 238}U atoms relative to the diffusion of the lighter {sup 235}U atoms. By this process the product stream is slightly enriched by each stage of the process. Each stage consists of a compressor, converter and a motor. There are more than 4000 stages that are linked together with piping of various diameters to form the PORTS cascade. The cascade spans three interconnected buildings and comprises miles of piping, thousands of seals, converters, valves, motors, and compressors. During operation, PORTS process equipment contained UF{sub 6} gas with uranium enrichment that increased in the process stream from the first to the last stage in a known manner. Gaseous UF{sub 6} moving through the PORTS process equipment had potential to form deposits within the process equipment by several mechanisms, including solidification due to incorrect temperature and pressure conditions during the process, inleakage of atmospheric moisture that chemically reacts with UF{sub 6} to form hydrated uranyl fluoride solids, reduction reactions of UF{sub 6} with cascade metals, and UF{sub 6} condensation on the internal equipment surfaces. As a result, the process equipment of the PORTS contains a variable and unknown quantity of uranium with variable enrichment that has been deposited within the equipment during plant operations. The exact chemical form of this uranium is variable, although it is expected that the bulk of the material is of the form of uranyl fluoride that will become hydrated on exposure to moisture in air when the systems are no longer buffered. The deposit geometry and thickness is uncertain and variable. However, a reasonable assessment of the level of material holdup in this equipment is necessary to support decommissioning efforts. The assessment of nuclear material holdup in process equipment is a complex process that requires integration of process knowledge, nondestructive assay (NDA) measurements, and computer modeling to maximize capabilities and minimize uncertainty. The current report is focused on the use of computer modeling and simulation of NDA measurements

Lunar surface engineering properties experiment definition. Volume 1: Mechanics, properties, and stabilization of lunar soils

Lunar soil simulation and stabilization, and impact penetrometer studie

Using conversational data to determine lexical frequency in British Sign Language: The influence of text type

This paper presents findings from an objective lexical frequency study in British Sign Language (BSL) based on 24,823 tokens collected as part of the BSL Corpus Project. The BSL study is only the fourth objective frequency study involving sign languages to be reported and is also the first study for any sign language to be based on entirely on spontaneous conversational data. When compared to previous frequency studies (both spoken and signed), some similarities can be observed although differences that may be attributed to text type are also recorded. When compared with subjective frequency ratings collected for BSL, a positive relationship is reported (similar to what has been observed for spoken languages). This is in contrast to a previous study which suggested a much weaker relationship between the two; however, this conclusion was based on a frequency count derived from narratives. These differences highlight the importance of using frequency measures derived from natural and spontaneous data, an opinion that has been emphasised in the spoken language literature