On the Multilingual Ability of Decoder-based Pre-trained Language Models: Finding and Controlling Language-Specific Neurons

Current decoder-based pre-trained language models (PLMs) successfully demonstrate multilingual capabilities. However, it is unclear how these models handle multilingualism. We analyze the neuron-level internal behavior of multilingual decoder-based PLMs, Specifically examining the existence of neurons that fire ``uniquely for each language'' within decoder-only multilingual PLMs. We analyze six languages: English, German, French, Spanish, Chinese, and Japanese, and show that language-specific neurons are unique, with a slight overlap (< 5%) between languages. These neurons are mainly distributed in the models' first and last few layers. This trend remains consistent across languages and models. Additionally, we tamper with less than 1% of the total neurons in each model during inference and demonstrate that tampering with a few language-specific neurons drastically changes the probability of target language occurrence in text generation.Comment: Accepted to NAACL2024. Our code is available at https://github.com/kojima-takeshi188/lang_neuro

First Data Release of the Hyper Suprime-Cam Subaru Strategic Program

The Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP) is a three-layered imaging survey aimed at addressing some of the most outstanding questions in astronomy today, including the nature of dark matter and dark energy. The survey has been awarded 300 nights of observing time at the Subaru Telescope and it started in March 2014. This paper presents the first public data release of HSC-SSP. This release includes data taken in the first 1.7 years of observations (61.5 nights) and each of the Wide, Deep, and UltraDeep layers covers about 108, 26, and 4 square degrees down to depths of i~26.4, ~26.5, and ~27.0 mag, respectively (5sigma for point sources). All the layers are observed in five broad bands (grizy), and the Deep and UltraDeep layers are observed in narrow bands as well. We achieve an impressive image quality of 0.6 arcsec in the i-band in the Wide layer. We show that we achieve 1-2 per cent PSF photometry (rms) both internally and externally (against Pan-STARRS1), and ~10 mas and 40 mas internal and external astrometric accuracy, respectively. Both the calibrated images and catalogs are made available to the community through dedicated user interfaces and database servers. In addition to the pipeline products, we also provide value-added products such as photometric redshifts and a collection of public spectroscopic redshifts. Detailed descriptions of all the data can be found online. The data release website is https://hsc-release.mtk.nao.ac.jp/.Comment: 34 pages, 20 figures, 7 tables, moderate revision, accepted for publication in PAS

ホイク ノ バ ニ オケル ホイクシャ ノ ソダチアイ ニ アソビ バメン ノ ジッセン キロク ケントウ ヲ チュウシン トシタ マナビ

保育の現状は厳しく、保育時間の延長、保育の効率化が望まれ、保育者が担当する乳幼児の数は定数いっぱいで、保育現場は多忙を極めている。新保育所保育指針(2008年3月告示)においても保育現場の課題の一つに、保育者の資質向上のための各園の努力が求められている。保育現場各所では、様々な方法で職員集団の質を高める工夫がされ、保育者は学びを深める工夫をしている。本研究は、昨年の本学研究紀要掲載の園内研修の進展内容であり、一園期の場面取り研究からの保育者の育ちを土台としてさらに、二園期以降の研修の場で、遊び場面の実践記録を書き、記録からの保育の振り返りを通して、子どもも、保育者も遊びから学び、遊びに返す保育の実践の内容を記録から読み取り、考察することで、保育者たちが子どもの育ちへの気づきを見つめ、意見交換し学んだことを整理したものである

Proteomic analysis identifies proteins that continue to grow hepatic stem-like cells without differentiation

To understand the molecular mechanism underlying vigorous proliferative activity of hepatic stem-like (HSL) cells, we performed two-dimensional electrophoresis to identify the proteins statistically more abundant in rapidly growing undifferentiated HSL cells than in sodium butyrate-treated differentiated HSL cells. Matrix-assisted laser desorption/ionization-time of flight mass spectrometry and Mascot search identified 6 proteins including prohibitin, vimentin, ezrin, annexin A3, acidic ribosomal phosphoprotein P0 and Grp75. Prohibitin and vimentin control the mitogen-activated protein (MAP) kinase pathway. Ezrin is phosphorylated by various protein-tyrosine kinases and modulates interactions between cytoskeletal and membrane proteins. Annexin A3 has a role in DNA synthesis. Acidic ribosomal phosphoprotein P0 and Grp75 play in protein synthesis. These results suggest that the proteins related to the MAP kinase cascade had some role in continuous proliferation of HSL cells without differentiation

Fabrication of high-concentration Cu-doped deuterated targets for fast ignition experiments

In high-energy-density physics, including inertial fusion energy using high-power lasers, doping tracer atoms and deuteration of target materials play an important role in diagnosis. For example, a low-concentration Cu dopant acts as an x-ray source for electron temperature detection while a deuterium dopant acts as a neutron source for fusion reaction detection. However, the simultaneous achievement of Cu doping, a deuterated polymer, mechanical toughness and chemical robustness during the fabrication process is not so simple. In this study, we report the successful fabrication of a Cu-doped deuterated target. The obtained samples were characterized by inductively coupled plasma optical emission spectrometry, differential scanning calorimetry and Fourier transform infrared spectroscopy. Simultaneous measurements of Cu K-shell x-ray emission and beam fusion neutrons were demonstrated using a petawatt laser at Osaka University.Ikeda T., Kaneyasu Y., Hosokawa H., et al. Fabrication of high-concentration Cu-doped deuterated targets for fast ignition experiments. Nuclear Fusion 63, 016010 (2023); https://doi.org/10.1088/1741-4326/aca2ba

Pneumonia Caused by Severe Acute Respiratory Syndrome Coronavirus 2 and Influenza Virus: A Multicenter Comparative Study

Background: Detailed differences in clinical information between severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pneumonia (CP), which is the main phenotype of SARS-CoV-2 disease, and influenza pneumonia (IP) are still unclear. Methods: A prospective, multicenter cohort study was conducted by including patients with CP who were hospitalized between January and June 2020 and a retrospective cohort of patients with IP hospitalized from 2009 to 2020. We compared the clinical presentations and studied the prognostic factors of CP and IP. Results: Compared with the IP group (n = 66), in the multivariate analysis, the CP group (n = 362) had a lower percentage of patients with underlying asthma or chronic obstructive pulmonary disease (P < .01), lower neutrophil-to-lymphocyte ratio (P < .01), lower systolic blood pressure (P < .01), higher diastolic blood pressure (P < .01), lower aspartate aminotransferase level (P < .05), higher serum sodium level (P < .05), and more frequent multilobar infiltrates (P < .05). The diagnostic scoring system based on these findings showed excellent differentiation between CP and IP (area under the receiver operating characteristic curve, 0.889). Moreover, the prognostic predictors were different between CP and IP. Conclusions: Comprehensive differences between CP and IP were revealed, highlighting the need for early differentiation between these 2 pneumonias in clinical settings

Simulation of developmental changes in action potentials with ventricular cell models

During cardiomyocyte development, early embryonic ventricular cells show spontaneous activity that disappears at a later stage. Dramatic changes in action potential are mediated by developmental changes in individual ionic currents. Hence, reconstruction of the individual ionic currents into an integrated mathematical model would lead to a better understanding of cardiomyocyte development. To simulate the action potential of the rodent ventricular cell at three representative developmental stages, quantitative changes in the ionic currents, pumps, exchangers, and sarcoplasmic reticulum (SR) Ca2+ kinetics were represented as relative activities, which were multiplied by conductance or conversion factors for individual ionic systems. The simulated action potential of the early embryonic ventricular cell model exhibited spontaneous activity, which ceased in the simulated action potential of the late embryonic and neonatal ventricular cell models. The simulations with our models were able to reproduce action potentials that were consistent with the reported characteristics of the cells in vitro. The action potential of rodent ventricular cells at different developmental stages can be reproduced with common sets of mathematical equations by multiplying conductance or conversion factors for ionic currents, pumps, exchangers, and SR Ca2+ kinetics by relative activities

Low HER2 expression is a predictor of poor prognosis in stage I triple-negative breast cancer

IntroductionTriple-negative breast cancer (TNBC) is negative for hormone receptors and human epidermal growth factor receptor 2 (HER2). In stage I TNBC, adjuvant therapy or follow-up are performed according to risk factors, but clinical trial data is scarce. In recent years, it has been reported that HER2-low cases (1+/2+ and in situ hybridization negative) have different prognoses than HER2-0 cases. However, the risk of recurrence and risk factors in this HER2-low population for stage I TNBC have not yet been investigated.MethodsHerein, out of 174 patients with TNBC who underwent surgery from June 2004 to December 2009 at the National Cancer Center Hospital (Tokyo), we retrospectively examined 42 cases diagnosed as T1N0M0 TNBC after excluding those treated with preoperative chemotherapy.ResultsAll patients were female, the median age was 60.5 years, and 11 cases were HER2-low and 31 cases were HER2-0. The median follow-up period was 121 months. Postoperative adjuvant therapy was administered in 30 patients and recurrence occurred in 8 patients. HER2-low cases showed a significantly shorter disease-free survival (HR: 7.0; 95% CI: 1.2– 40.2; P=0.0016) and a trend towards shorter overall survival (hazard ratio [HR]: 4.2, 95% confidence interval [CI]: 0.58–31.4) compared with that of HER2-0 cases. HER2 was also identified as a factor for poor prognosis from the point- estimated values in univariate and multivariate analyses after confirming that there was no correlation between the other factors.ConclusionFor patients with stage I TNBC, the HER2-low population had a significantly worse prognosis than the HER2-0 population

Comparison of how first-year students at the Faculty of Nursing at university A understand the concept of “Community” before and after taking “Community Home nursing theoryⅠ and Community Home nursing practiceⅠ”

departmental bulletin pape