Function Vectors in Large Language Models

We report the presence of a simple neural mechanism that represents an input-output function as a vector within autoregressive transformer language models (LMs). Using causal mediation analysis on a diverse range of in-context-learning (ICL) tasks, we find that a small number attention heads transport a compact representation of the demonstrated task, which we call a function vector (FV). FVs are robust to changes in context, i.e., they trigger execution of the task on inputs such as zero-shot and natural text settings that do not resemble the ICL contexts from which they are collected. We test FVs across a range of tasks, models, and layers and find strong causal effects across settings in middle layers. We investigate the internal structure of FVs and find while that they often contain information that encodes the output space of the function, this information alone is not sufficient to reconstruct an FV. Finally, we test semantic vector composition in FVs, and find that to some extent they can be summed to create vectors that trigger new complex tasks. Taken together, our findings suggest that LLMs contain internal abstractions of general-purpose functions that can be invoked in a variety of contexts.Comment: 43 pages, 25 figures, 20 tables, Code and data at https://functions.baulab.inf

Tools for adaptive governance for complex social-ecological systems: A review of role-playing-games as serious games at the community-policy interface

The management of natural resources—from forests to fisheries to freshwater—is becoming increasingly complex and requires new tools and processes for engaging with individuals, communities, and decision-makers. Policy makers and practitioners have begun using serious games (SGs) (those used for purposes other than entertainment) to overcome some of the complex challenges of governing resources in social-ecological systems. This paper uses a systematic literature review methodology to assess role-playing SGs for natural resource management. Fifty-two articles from the role-playing game (RPG) subset of SGs are identified, synthesised and analysed using a multi-criteria evaluation framework. First, we explore three theoretical and conceptual elements of games: principles of RPGs, functions of games, and (practical) game characteristics. We evaluate game elements, including game design, adherence to reality and the degree to which games integrate elements of participatory—and action research. These dimensions of RPGs are then analysed and discussed. Particular attention is paid to the value and application of RPGs to address complex problems with interacting environmental, social, cultural and economic challenges, and the extent to which they can inform adaptive governance solutions. Results show that RPGs can be a valuable tool at different levels; however, we also identify important gaps in the current state of knowledge, in particular, related to bridging community—and higher-level decision-making scales through RPGs

A BALB/c murine lung alveolar carcinoma used to establish a surgical spontaneous metastasis model

Line-1, a weakly immunogenic lung tumor cell line derived from the BALB/c mouse, metastasizes spontaneously to the lungs of mice following subcutaneous administration. The parameters that influence metastasis as well as the progression of metastatic lung disease following surgical resection of primary subcutaneous tumors were characterized. Histological analysis of the lungs obtained from mice bearing different size subcutaneous tumors demonstrated that >90% of the mice developed micrometastatic disease in the lungs when the tumor exceeded 650 mm 3 in size. Surgical resection of subcutaneous tumors resulted in the cure of primary disease in 95% of the mice. Macroscopic tumor nodules were grossly visible in the lungs of 75% of the mice 5 weeks after surgery. Serum amyloid A level correlated with primary tumor burden and was diagnostic for the presence of metastatic disease. The efficiency of metastasis, post-surgical primary tumor recurrence and long-term survival were significantly different between BALB/c mice obtained from different suppliers. The Line-1-BALB/c surgical metastasis model provides a clinically relevant tool for the evaluation of anti-cancer therapies, especially those that are designed to target long-term suppression of minimal residual disease following surgical intervention.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/42586/1/10585_2004_Article_DO00000954.pd

The Revised TESS Input Catalog and Candidate Target List

We describe the catalogs assembled and the algorithms used to populate the revised TESS Input Catalog (TIC), based on the incorporation of the Gaia second data release. We also describe a revised ranking system for prioritizing stars for 2-minute cadence observations, and assemble a revised Candidate Target List (CTL) using that ranking. The TIC is available on the Mikulski Archive for Space Telescopes (MAST) server, and an enhanced CTL is available through the Filtergraph data visualization portal system at the URL http://filtergraph.vanderbilt.edu/tess_ctl.Comment: 30 pages, 16 figures, submitted to AAS Journals; provided to the community in advance of publication in conjunction with public release of the TIC/CTL on 28 May 201

Spectroscopic and Mechanistic Studies of Heterodimetallic Forms of Metallo-β-lactamase NDM-1

In an effort to characterize the roles of each metal ion in metallo-β-lactamase NDM-1, heterodimetallic analogues (CoCo-, ZnCo-, and CoCd-) of the enzyme were generated and characterized. UV–vis, 1H NMR, EPR, and EXAFS spectroscopies were used to confirm the fidelity of the metal substitutions, including the presence of a homogeneous, heterodimetallic cluster, with a single-atom bridge. This marks the first preparation of a metallo-β-lactamase selectively substituted with a paramagnetic metal ion, Co(II), either in the Zn1 (CoCd-NDM-1) or in the Zn2 site (ZnCo-NDM-1), as well as both (CoCo-NDM-1). We then used these metal-substituted forms of the enzyme to probe the reaction mechanism, using steady-state and stopped-flow kinetics, stopped-flow fluorescence, and rapid-freeze-quench EPR. Both metal sites show significant effects on the kinetic constants, and both paramagnetic variants (CoCd- and ZnCo-NDM-1) showed significant structural changes on reaction with substrate. These changes are discussed in terms of a minimal kinetic mechanism that incorporates all of the data

Critical literacy as a pedagogical goal in English language teaching

In this chapter, the authors provide an overview of the area of critical literacy as it pertains to second language pedagogy (curriculum and instruction). After considering the historical origins of critical literacy (from antiquity, and including in first language education), they consider how it began to penetrate the field of applied linguistics. They note the geographical and institutional spread of critical literacy practice as documented by published accounts. They then sketch the main features of L2 critical literacy practice. To do this, they acknowledge how practitioners have reported on their practices regarding classroom content and process. The authors also draw attention to the outcomes of these practices as well as challenges that practitioners have encountered in incorporating critical literacy into their second language classrooms

Autoimmune and autoinflammatory mechanisms in uveitis

The eye, as currently viewed, is neither immunologically ignorant nor sequestered from the systemic environment. The eye utilises distinct immunoregulatory mechanisms to preserve tissue and cellular function in the face of immune-mediated insult; clinically, inflammation following such an insult is termed uveitis. The intra-ocular inflammation in uveitis may be clinically obvious as a result of infection (e.g. toxoplasma, herpes), but in the main infection, if any, remains covert. We now recognise that healthy tissues including the retina have regulatory mechanisms imparted by control of myeloid cells through receptors (e.g. CD200R) and soluble inhibitory factors (e.g. alpha-MSH), regulation of the blood retinal barrier, and active immune surveillance. Once homoeostasis has been disrupted and inflammation ensues, the mechanisms to regulate inflammation, including T cell apoptosis, generation of Treg cells, and myeloid cell suppression in situ, are less successful. Why inflammation becomes persistent remains unknown, but extrapolating from animal models, possibilities include differential trafficking of T cells from the retina, residency of CD8(+) T cells, and alterations of myeloid cell phenotype and function. Translating lessons learned from animal models to humans has been helped by system biology approaches and informatics, which suggest that diseased animals and people share similar changes in T cell phenotypes and monocyte function to date. Together the data infer a possible cryptic infectious drive in uveitis that unlocks and drives persistent autoimmune responses, or promotes further innate immune responses. Thus there may be many mechanisms in common with those observed in autoinflammatory disorders

Prevalence of swallow, communication, voice and cognitive compromise following hospitalisation for COVID-19: the PHOSP-COVID analysis

Objective: Identify prevalence of self-reported swallow, communication, voice and cognitive compromise following hospitalisation for COVID-19. Design: Multicentre prospective observational cohort study using questionnaire data at visit 1 (2–7 months post discharge) and visit 2 (10–14 months post discharge) from hospitalised patients in the UK. Lasso logistic regression analysis was undertaken to identify associations. Setting: 64 UK acute hospital Trusts. Participants: Adults aged >18 years, discharged from an admissions unit or ward at a UK hospital with COVID-19. Main outcome measures: Self-reported swallow, communication, voice and cognitive compromise. Results: Compromised swallowing post intensive care unit (post-ICU) admission was reported in 20% (188/955); 60% with swallow problems received invasive mechanical ventilation and were more likely to have undergone proning (p=0.039). Voice problems were reported in 34% (319/946) post-ICU admission who were more likely to have received invasive (p<0.001) or non-invasive ventilation (p=0.001) and to have been proned (p<0.001). Communication compromise was reported in 23% (527/2275) univariable analysis identified associations with younger age (p<0.001), female sex (p<0.001), social deprivation (p<0.001) and being a healthcare worker (p=0.010). Cognitive issues were reported by 70% (1598/2275), consistent at both visits, at visit 1 respondents were more likely to have higher baseline comorbidities and at visit 2 were associated with greater social deprivation (p<0.001). Conclusion: Swallow, communication, voice and cognitive problems were prevalent post hospitalisation for COVID-19, alongside whole system compromise including reduced mobility and overall health scores. Research and testing of rehabilitation interventions are required at pace to explore these issues

The Effect of Thermal Reduction on the Photoluminescence and Electronic Structures of Graphene Oxides

[[abstract]]Electronic structures of graphene oxide (GO) and hydro-thermally reduced graphene oxides (rGOs)processed at low temperatures (120–1806C) were studied using X-ray absorption near-edge structure XANES), X-ray emission spectroscopy (XES) and resonant inelastic X-ray scattering (RIXS). C K-edge XANES spectra of rGOs reveal that thermal reduction restores C 5 C sp2 bonds and removes some of the oxygen and hydroxyl groups of GO, which initiates the evolution of carbonaceous species. The combination of C K-edge XANES and Ka XES spectra shows that the overlapping p and p* orbitals in rGOs and GO are similar to that of highly ordered pyrolytic graphite (HOPG), which has no band-gap. C Ka RIXS spectra provide evidence that thermal reduction changes the density of states (DOSs) that is generated in the p-region and/or in the gap between the p and p* levels of the GO and rGOs. Two-dimensional C Ka RIXS mapping of the heavy reduction of rGOs further confirms that the residual oxygen and/or oxygen-containing functional groups modify the p and s features, which are dispersed by the photon excitation energy. The dispersion behavior near the K point is approximately linear and differs from the parabolic-like dispersion observed in HOPG.[[notice]]補正完畢[[journaltype]]國外[[incitationindex]]SCI[[ispeerreviewed]]Y[[booktype]]電子版[[countrycodes]]GB

Effective in vivo and ex vivo gene transfer to intestinal mucosa by VSV-G-pseudotyped lentiviral vectors

<p>Abstract</p> <p>Background</p> <p>Gene transfer to the gastrointestinal (GI) mucosa is a therapeutic strategy which could prove particularly advantageous for treatment of various hereditary and acquired intestinal disorders, including inflammatory bowel disease (IBD), GI infections, and cancer.</p> <p>Methods</p> <p>We evaluated vesicular stomatitis virus glycoprotein envelope (VSV-G)-pseudotyped lentiviral vectors (LV) for efficacy of gene transfer to both murine rectosigmoid colon <it>in vivo </it>and human colon explants <it>ex vivo</it>. LV encoding beta-galactosidase (LV-β-Gal) or firefly-luciferase (LV-fLuc) reporter genes were administered by intrarectal instillation in mice, or applied topically for <it>ex vivo </it>transduction of human colorectal explant tissues from normal individuals. Macroscopic and histological evaluations were performed to assess any tissue damage or inflammation. Transduction efficiency and systemic biodistribution were evaluated by real-time quantitative PCR. LV-fLuc expression was evaluated by <it>ex vivo </it>bioluminescence imaging. LV-β-Gal expression and identity of transduced cell types were examined by histochemical and immunofluorescence staining.</p> <p>Results</p> <p>Imaging studies showed positive fLuc signals in murine distal colon; β-Gal-positive cells were found in both murine and human intestinal tissue. In the murine model, β-Gal-positive epithelial and lamina propria cells were found to express cytokeratin, CD45, and CD4. LV-transduced β-Gal-positive cells were also seen in human colorectal explants, consisting mainly of CD45, CD4, and CD11c-positive cells confined to the LP.</p> <p>Conclusions</p> <p>We have demonstrated the feasibility of LV-mediated gene transfer into colonic mucosa. We also identified differential patterns of mucosal gene transfer dependent on whether murine or human tissue was used. Within the limitations of the study, the LV did not appear to induce mucosal damage and were not distributed beyond the distal colon.</p