Linear Representations of Sentiment in Large Language Models

Sentiment is a pervasive feature in natural language text, yet it is an open question how sentiment is represented within Large Language Models (LLMs). In this study, we reveal that across a range of models, sentiment is represented linearly: a single direction in activation space mostly captures the feature across a range of tasks with one extreme for positive and the other for negative. Through causal interventions, we isolate this direction and show it is causally relevant in both toy tasks and real world datasets such as Stanford Sentiment Treebank. Through this case study we model a thorough investigation of what a single direction means on a broad data distribution. We further uncover the mechanisms that involve this direction, highlighting the roles of a small subset of attention heads and neurons. Finally, we discover a phenomenon which we term the summarization motif: sentiment is not solely represented on emotionally charged words, but is additionally summarized at intermediate positions without inherent sentiment, such as punctuation and names. We show that in Stanford Sentiment Treebank zero-shot classification, 76% of above-chance classification accuracy is lost when ablating the sentiment direction, nearly half of which (36%) is due to ablating the summarized sentiment direction exclusively at comma positions

Alternative Methods for Characterization of Extracellular Vesicles

Extracellular vesicles (ECVs) are nano-sized vesicles released by all cells in vitro as well as in vivo. Their role has been implicated mainly in cell–cell communication, but also in disease biomarkers and more recently in gene delivery. They represent a snapshot of the cell status at the moment of release and carry bioreactive macromolecules such as nucleic acids, proteins, and lipids. A major limitation in this emerging new field is the availability/awareness of techniques to isolate and properly characterize ECVs. The lack of gold standards makes comparing different studies very difficult and may potentially hinder some ECVs-specific evidence. Characterization of ECVs has also recently seen many advances with the use of Nanoparticle Tracking Analysis, flow cytometry, cryo-electron microscopy instruments, and proteomic technologies. In this review, we discuss the latest developments in translational technologies involving characterization methods including the facts in their support and the challenges they face

Role of Endothelial Progenitor Cells and Inflammatory Cytokines in Healing of Diabetic Foot Ulcers

Background: To evaluate changes in endothelial progenitor cells (EPCs) and cytokines in patients with diabetic foot ulceration (DFU) in association with wound healing. Methods: We studied healthy subjects, diabetic patients not at risk of DFU, at risk of DFU and with active DFU. We prospectively followed the DFU patients over a 12-week period. We also investigated similar changes in diabetic rabbit and mouse models of wound healing. Results: All EPC phenotypes except the kinase insert domain receptor (KDR)+CD133+ were reduced in the at risk and the DFU groups compared to the controls. There were no major EPC differences between the control and not at risk group, and between the at risk and DFU groups. Serum stromal-cell derived factor-1 (SDF-1) and stem cell factor (SCF) were increased in DFU patients. DFU patients who healed their ulcers had lower CD34+KDR+ count at visits 3 and 4, serum c-reactive protein (CRP) and granulocyte-macrophage colony-stimulating factor (GM-CSF) at visit 1, interleukin-1 (IL-1) at visits 1 and 4. EPCs tended to be higher in both diabetic animal models when compared to their non-diabetic counterparts both before and ten days after wounding. Conclusions: Uncomplicated diabetes does not affect EPCs. EPCs are reduced in patients at risk or with DFU while complete wound healing is associated with CD34+KDR+ reduction, suggesting possible increased homing. Low baseline CRP, IL-1α and GM-CSF serum levels were associated with complete wound healing and may potentially serve as prognostic markers of DFU healing. No animal model alone is representative of the human condition, indicating the need for multiple experimental models

Orion Capsule Handling Qualities for Atmospheric Entry

Two piloted simulations were conducted at NASA's Johnson Space Center using the Cooper-Harper scale to study the handling qualities of the Orion Command Module capsule during atmospheric entry flight. The simulations were conducted using high fidelity 6-DOF simulators for Lunar Return Skip Entry and International Space Station Return Direct Entry flight using bank angle steering commands generated by either the Primary (PredGuid) or Backup (PLM) guidance algorithms. For both evaluations, manual control of bank angle began after descending through Entry Interface into the atmosphere until drogue chutes deployment. Pilots were able to use defined bank management and reversal criteria to accurately track the bank angle commands, and stay within flight performance metrics of landing accuracy, g-loads, and propellant consumption, suggesting that the pilotability of Orion under manual control is both achievable and provides adequate trajectory performance with acceptable levels of pilot effort. Another significant result of these analyses is the applicability of flying a complex entry task under high speed entry flight conditions relevant to the next generation Multi Purpose Crew Vehicle return from Mars and Near Earth Objects

Design Build

The 2011 Design/Build Studio included 13 undergraduate architects, 2 graduate architects, 6 landscape architects, and 1 interior designer. Under the careful supervision and guidance of Bruce Bassler, this team worked to design and deliver a complete sleeping cabin to the Scenic Park campground in South Sioux City, Nebraska

NAD+ protects against EAE by regulating CD4+ T-cell differentiation

CD4+ T cells are involved in the development of autoimmunity, including multiple sclerosis (MS). Here we show that nicotinamide adenine dinucleotide (NAD+) blocks experimental autoimmune encephalomyelitis (EAE), a mouse model of MS, by inducing immune homeostasis through CD4+IFNγ+IL-10+ T cells and reverses disease progression by restoring tissue integrity via remyelination and neuroregeneration. We show that NAD+ regulates CD4+ T-cell differentiation through tryptophan hydroxylase-1 (Tph1), independently of well-established transcription factors. In the presence of NAD+, the frequency of T-bet−/− CD4+IFNγ+ T cells was twofold higher than wild-type CD4+ T cells cultured in conventional T helper 1 polarizing conditions. Our findings unravel a new pathway orchestrating CD4+ T-cell differentiation and demonstrate that NAD+ may serve as a powerful therapeutic agent for the treatment of autoimmune and other diseases

Physical constraints of cultural evolution of dialects in killer whales

Data collection was supported by a variety of organizations, including the Russian Fund for the Fundamental Research (Grant No. 15-04-05540), the Rufford Small Grants Fund, Whale and Dolphin Conservation, the Fundação para a Ciência e a Tecnologia (Grant No. SFRH/BD/30303/2006), Russell Trust Award of the University of St. Andrews, the Office of Naval Research, the Icelandic Research Fund (i. Rannsóknasjóður), the National Geographic Society Science and Exploration Europe (Grant No. GEFNE65-12), Vancouver Aquarium Marine Science Centre, the Canadian Ministry of Fisheries and Oceans, and the North Gulf Oceanic Society.Odontocete sounds are produced by two pairs of phonic lips situated in soft nares below the blowhole; the right pair is larger and is more likely to produce clicks, while the left pair is more likely to produce whistles. This has important implications for the cultural evolution of delphinid sounds: the greater the physical constraints, the greater the probability of random convergence. In this paper the authors examine the call structure of eight killer whale populations to identify structural constraints and to determine if they are consistent among all populations. Constraints were especially pronounced in two-voiced calls. In the calls of all eight populations, the lower component of two-voiced (biphonic) calls was typically centered below 4 kHz, while the upper component was typically above that value. The lower component of two-voiced calls had a narrower frequency range than single-voiced calls in all populations. This may be because some single-voiced calls are homologous to the lower component, while others are homologous to the higher component of two-voiced calls. Physical constraints on the call structure reduce the possible variation and increase the probability of random convergence, producing similar calls in different populations.PostprintPeer reviewe

A school-based resilience intervention to decrease tobacco, alcohol and marijuana use in high school students

<p>Abstract</p> <p>Background</p> <p>Despite schools theoretically being an ideal setting for accessing adolescents and preventing initiation of substance use, there is limited evidence of effective interventions in this setting. Resilience theory provides one approach to achieving such an outcome through improving adolescent mental well-being and resilience. A study was undertaken to examine the potential effectiveness of such an intervention approach in improving adolescent resilience and protective factor scores; and reducing the prevalence of adolescent tobacco, alcohol and marijuana use in three high schools.</p> <p>Methods</p> <p>A non-controlled before and after study was undertaken. Data regarding student resilience and protective factors, and measures of tobacco, alcohol and marijuana use were collected from grade 7 to 10 students at baseline (n = 1449) and one year following a three year intervention (n = 1205).</p> <p>Results</p> <p>Significantly higher resilience and protective factors scores, and significantly lower prevalence of substance use were evident at follow up.</p> <p>Conclusions</p> <p>The results suggest that the intervention has the potential to increase resilience and protective factors, and to decrease the use of tobacco, alcohol and marijuana by adolescents. Further more rigorous research is required to confirm this potential.</p

覚（午十月十七日夕六ツ月迄、手打人久保田久作殿外）

This dataset includes amygdala segmentation and tractography results from the first 50 subjects (28 female, age 22–35 years, mean 30 years) from the WU-Minn HCP Data-80 unrelated subjects release in the human connectome database (http://humanconnectome.org) [Van Essen et al., 2013]. This dataset accompanies the publication "Deconstructing White Matter Connectivity of Human Amygdala Nuclei with Thalamus and Cortex Subdivisions In Vivo