LEALLA: Learning Lightweight Language-agnostic Sentence Embeddings with Knowledge Distillation

Large-scale language-agnostic sentence embedding models such as LaBSE (Feng et al., 2022) obtain state-of-the-art performance for parallel sentence alignment. However, these large-scale models can suffer from inference speed and computation overhead. This study systematically explores learning language-agnostic sentence embeddings with lightweight models. We demonstrate that a thin-deep encoder can construct robust low-dimensional sentence embeddings for 109 languages. With our proposed distillation methods, we achieve further improvements by incorporating knowledge from a teacher model. Empirical results on Tatoeba, United Nations, and BUCC show the effectiveness of our lightweight models. We release our lightweight language-agnostic sentence embedding models LEALLA on TensorFlow Hub.Comment: EACL 2023 main conference; LEALLA models: https://tfhub.dev/google/collections/LEALL

Bacteriophage-Induced Antigenic Conversion and Transduction of Drug Resistance in Group E Salmonellas

It has been demonstrated that the phages obtained from SM-resistant cells of group E2, or propagated on SM-resistant cells of group E1 were capable of transducing SM-resistance in SM-sensitive cells of group E1. In some instances, the transmission of drug resistance was associated with antigenic change in recipient cells, while in others the former was not associated with the latter. It was also confirmed that antigenic conversion was associated with lysogenization of recipient cells, while the transmission of drug resistance was not associated with lysogenization unless being associated with antigenic conversion. The differences were discussed between the transmission of SM-resistance or the transduction and the phage-induced antigenic conversion

Laparoscopic resection of two peritoneal loose bodies on the rectosigmoid colon

Laparoscopic examination of a 77-year-old woman revealed two peritoneal loose bodies connected to fatty appendices on the rectosigmoid colon and resected at the stalks. The peritoneal loose bodies were found to be fat-containing masses on preoperative magnetic resonance imaging, and postoperative pathological examination revealed fat degeneration tissue with or without fibrous outer layers

Influence of light alcohol consumption on lifestyle-related diseases : a predictor of fatty liver with liver enzyme elevation in Japanese females with metabolic syndrome

Background Although heavy drinking is known to lead to liver injury, some recent studies have reported that light alcohol consumption (LAC) may play a protective role against fatty liver in the general population, and may even play a protective role against non-alcoholic fatty liver disease (NAFLD) in males with metabolic syndrome (MS). However, the association between LAC and fatty liver with liver enzyme elevation in females with MS is unclear. Methods Participants of this study were 20,853 females who underwent a regular health check-up between April 2008 and March 2012 at our hospital. Enrolled subjects were 1141 females with MS, who underwent all necessary tests and drank less than 20 g/day of alcohol. We investigated the presence of fatty liver with liver enzyme elevation, defined in this study as alanine aminotransferase (ALT) levels ≧31 IU/I, and the association between LAC and fatty liver with ALT elevation. Results There was no significant difference in the prevalence of fatty liver and ALT between light drinkers and non-drinkers. The prevalence of individuals receiving a treatment for dyslipidemia and impaired glucose tolerance (IGT) was significantly lower in light drinkers than in non-drinkers. Body mass index (BMI), waist circumference (WC), diastolic blood pressure (DBP), triglyceride (TG), uric acid (UA), IGT, and visceral fat type MS (V-type MS) were significant predictors of the prevalence of fatty liver with ALT elevation in logistic regression analysis. The odds ratio [OR] (95 % confidence interval [CI], p value) for fatty liver with ALT elevation were as follows: BMI, 2.181 (1.445–3.293, p <0.001); WC, 1.853 (1.280–2.684, p <0.01); DBP, 1.604 (1.120–2.298, p <0.05); TG, 2.202 (1.562–3.105, p <0.001); UA, 2.959 (1.537–5.698, p <0.01); IGT, 1.692 (1.143–2.506, p <0.01); and V-type MS, 3.708 (2.529–5.437, p <0.001). Conclusions There was no significant difference in the prevalence of fatty liver with ALT elevation in females with MS between light drinkers and non-drinkers, suggesting that other factors such as BMI, WC, V-type MS, and lifestyle-related disease may be more important than LAC for the prevalence of fatty liver with ALT elevation

SOCS-1/SSI-1-Deficient NKT Cells Participate in Severe Hepatitis through Dysregulated Cross-Talk Inhibition of IFN-γ and IL-4 Signaling In Vivo

AbstractSuppressor of cytokine signaling-1 (SOCS-1), also known as STAT-induced STAT inhibitor-1 (SSI-1), is a negative feedback molecule for cytokine signaling, and its in vivo deletion induces fulminant hepatitis. However, elimination of the STAT1 or STAT6 gene or deletion of NKT cells substantially prevented severe hepatitis in SOCS-1-deficient mice, while administration of IFN-γ and IL-4 accelerated its development. SOCS-1 deficiency not only sustained IFN-γ/IL-4 signaling but also eliminated the cross-inhibitory action of IFN-γ on IL-4 signaling. These results suggest that SOCS-1 deficiency-induced persistent activation of STAT1 and STAT6, which would be inhibited by SOCS-1 under normal conditions, may induce abnormal activation of NKT cells, thus leading to lethal pathological changes in SOCS-1-deficient mice

Unilateral minimal ovarian cancer with peritoneal implant and an intraepithelial carcinoma in the contralateral fallopian tube

Here we present postoperative pathology of an 82-year-old woman who presented with massive ascites, and an implant-like adenocarcinoma on her intrapelvic peritoneum, which revealed a minimal (<5mm) serous adenocarcinoma on her left ovary and an intraepithelial carcinoma on inner surface of her right Fallopian tube.  The left ovarian serous adenocarcinoma may have originated as an intraepithelial carcinoma on contralateral Fallopian tube

上皮成長因子受容体を標的とした結腸直腸腫瘍の分子イメージング : 動物モデルにおける腫瘍の検出と治療評価

To overcome the problem of overlooking colorectal tumors, a new and highly sensitive modality of colonoscopy is needed. Moreover, it is also important to establish a new modality to evaluate viable tumor volume in primary lesions of colorectal cancer (CRC) during chemotherapy. Therefore, we carried out molecular imaging of colorectal tumors targeting epidermal growth factor receptor (EGFR), which is highly expressed on tumor cells, for evaluating chemotherapeutic efficacy and for endoscopic detection of colorectal adenomas. We first attempted to image five CRC cell lines with various levels of EGFR expression using an Alexa Fluor‐labeled anti‐EGFR monoclonal antibody (AF‐EGFR‐Ab). A strong fluorescence signal was observed in the cells depending on the level of EGFR expression. When nude mice xenografted with LIM1215 CRC cells, which highly express EGFR, were i.v. injected with AF‐EGFR‐Ab, a strong fluorescence signal appeared in the tumor with a high signal to noise ratio, peaking at 48 hours after injection and then gradually decreasing, as shown using an IVIS Spectrum system. When the xenografted mice were treated with 5‐fluorouracil, fluorescence intensity in the tumor decreased in proportion to the viable tumor cell volume. Moreover, when the colorectum of azoxymethane‐treated rats was observed using a thin fluorescent endoscope with AF‐EGFR‐Ab, all 10 small colorectal adenomas (≤3 mm) were detected with a clear fluorescence signal. These preliminary results of animal experiments suggest that EGFR‐targeted fluorescent molecular imaging may be useful for quantitatively evaluating cell viability in CRC during chemotherapy, and also for detecting small adenomas using a fluorescent endoscope

Acute intraabdominal hemorrhage from an aneurysm on uterine artery

A 36-year-old woman was underwent emergency laparotomy for acute intraabdominal hemorrhage, but bleeding points were not found. Abdominal pains continued after the laparotomy, and rupture of aneurysm on uterine artery was found in angiography. An transcatheter arterial embolization was done for the uterine artery, and the aneurysm was found to disappear in 4-day-after the angiography. Rupture of an aneurysm on uterine artery should be considered for the causes of acute intraabdominal hemorrhage