Selective Token Generation for Few-shot Natural Language Generation

Natural language modeling with limited training data is a challenging problem, and many algorithms make use of large-scale pretrained language models (PLMs) for this due to its great generalization ability. Among them, additive learning that incorporates a task-specific adapter on top of the fixed large-scale PLM has been popularly used in the few-shot setting. However, this added adapter is still easy to disregard the knowledge of the PLM especially for few-shot natural language generation (NLG) since an entire sequence is usually generated by only the newly trained adapter. Therefore, in this work, we develop a novel additive learning algorithm based on reinforcement learning (RL) that selectively outputs language tokens between the task-general PLM and the task-specific adapter during both training and inference. This output token selection over the two generators allows the adapter to take into account solely the task-relevant parts in sequence generation, and therefore makes it more robust to overfitting as well as more stable in RL training. In addition, to obtain the complementary adapter from the PLM for each few-shot task, we exploit a separate selecting module that is also simultaneously trained using RL. Experimental results on various few-shot NLG tasks including question answering, data-to-text generation and text summarization demonstrate that the proposed selective token generation significantly outperforms the previous additive learning algorithms based on the PLMs.Comment: COLING 202

Protective effect of Buddha’s Temple extract against tert-butyl hydroperoxide stimulation-induced oxidative stress in DF-1 cells

Objective This study aimed to determine the protective efficacy of Buddha’s Temple (BT) extract against tert-butyl hydroperoxide (t-BHP)-induced oxidative stress in Gallus gallus chicken embryo fibroblast cell line (DF-1) and its effects on the cell lipid metabolism. Methods In this experimental study, Gallus gallus DF-1 fibroblast cells were pretreated with BT 10−7 for 24 hours, followed by their six-hour exposure to t-BHP (100 μM). Water-soluble tetrazolium salt-8 (WST-8) assays were performed, and the growth curve was computed. The intracellular gene expression changes caused by BT extract were confirmed through quantitative polymerase chain reaction (qPCR). Flow cytometry, oil red O staining experiment, and thin-layer chromatography were performed for the detection of intracellular metabolic mechanism changes. Results The WST-8 assay results showed that the BT pretreatment of Gallus gallus DF-1 fibroblast cell increased their cell survival rate by 1.08%±0.04%, decreased the reactive oxygen species (ROS) level by 0.93%±0.12% even after exposure to oxidants, and stabilized mitochondrial activity by 1.37%±0.36%. In addition, qPCR results confirmed that the gene expression levels of tumor necrosis factor α (TNFα), TIR domain-containing adapter inducing IFN-beta (TICAM1), and glucose-regulated protein 78 (GRP78) were regulated, which contributed to cell stabilization. Thin-layer chromatography and oil red O analyses showed a clear decrease in the contents of lipid metabolites such as triacylglycerol and free fatty acids. Conclusion In this study, we confirmed that the examined BT extract exerted selective protective effects on Gallus gallus DF-1 fibroblast cells against cell damage caused by t-BHP, which is a strong oxidative inducer. Furthermore, we established that this extract significantly reduced the intracellular ROS accumulation due to oxidative stress, which contributes to an increase in poultry production and higher incomes

A highly sensitive and selective viral protein detection method based on RNA oligonucleotide nanoparticle

Globally, approximately 170 million people (representing approximately 3% of the population worldwide), are infected with hepatitis C virus (HCV) and at risk of serious liver disease, including chronic hepatitis. We propose a new quantum dots (QDs)-supported RNA oligonucleotide approach for the specific and sensitive detection of viral protein using a biochip. This method was developed by immobilizing a HCV nonstructural protein 5B (NS5B) on the surface of a glass chip via the formation of a covalent bond between an amine protein group and a ProLinker™ glass chip. The QDs-supported RNA oligonucleotide was conjugated via an amide formation reaction from coupling of a 5′-end-amine-modified RNA oligonucleotide on the surface of QDs displaying carboxyl groups via standard EDC coupling. The QDs-conjugated RNA oligonucleotide was interacted to immobilized viral protein NS5B on the biochip. The detection is based on the variation of signal of QDs-supported RNA oligonucleotide bound on an immobilized biochip. It was demonstrated that the value of the signal has a linear relationship with concentrations of the HCV NS5B viral protein in the 1 μg mL−1 to 1 ng mL−1 range with a detection limit of 1 ng mL−1. The major advantages of this RNA-oligonucleotide nanoparticle assay are its good specificity, ease of performance, and ability to perform one-spot monitoring. The proposed method could be used as a general method of HCV detection and is expected to be applicable to other types of diseases as well

Immune-enhancing screening of fourteen plants on murine macrophage RAW 264.7 cells

Purpose: To investigate the potential immune-enhancing effects of fourteen natural plant extracts on mouse macrophage RAW 264.7 cells.Methods: Fourteen plant extracts from 7 different plants were tested on RAW 264.7 cells to determine their immunostimulant activities. Methylthiazolydiphenyltetrazolium bromide (MTT) and Griess assays were performed to evaluate cell viability and nitric oxide (NO) production, respectively. Then, immune related proteins were measured by western blot analysis, while cytokines and phagocytic activity were determined by enzyme-linked immunosorbent assay (ELISA) method.Results: Among the 14 plant extracts, the hot water extract of Agastache rugose was selected based on the screening results on NO production. The hot water extract of A. rugose significantly increased NO production in a concentration-dependent manner without any cytotoxicity. In addition, the expression levels of proteins (iNOS and COX-2) and cytokines (TNF-α, IL-1β, IL-6 and IL-12) closely related to immune reaction were also significantly upregulated. Furthermore, phagocytic activity of RAW 264.7 cells significantly increased following treatment with A. rugosa.Conclusion: The hot water extract of A. rugosa exhibits significant immune-stimulant activity. Therefore, A. rugosa can be used as a natural resource for immune enhancement or dietary supplement.Keywords: Immune enhancing activity, Macrophage polarization, Natural plant extracts, Agastache rugosa, RAW 264.

Rational Perturbation of the Fluorescence Quantum Yield in Emission‐Tunable and Predictable Fluorophores (Seoul‐Fluors) by a Facile Synthetic Method Involving C—H Activation†

Abstract Fluorescence imaging enables the uniquely sensitive observation of functional‐ and molecular‐recognition events in living cells. However, only a limited range of biological processes have been subjected to imaging because of the lack of a design strategy and difficulties in the synthesis of biosensors. Herein, we report a facile synthesis of emission‐tunable and predictable Seoul‐Fluors, 9‐aryl‐1,2‐dihydrolopyrrolo[3,4‐b]indolizin‐3‐ones, with various R1 and R2 substituents by coinage‐metal‐catalyzed intramolecular 1,3‐dipolar cycloaddition and subsequent palladium‐mediated C—H activation. We also showed that the quantum yields of Seoul‐Fluors are controlled by the electronic nature of the substituents, which influences the extent of photoinduced electron transfer. On the basis of this understanding, we demonstrated our design strategy by the development of a Seoul‐Fluor‐based chemosensor 20 for reactive oxygen species that was not accessible by a previous synthetic route

Recommended immunization schedule for children and adolescents: the Korean Pediatric Society, 2013

This article contains the recommended immunization schedule by the Committee on Infectious Diseases of the Korean Pediatric Society, updated in March 2013, when Haemophilus influenzae type b vaccine is now included in the National Immunization Program in Korea. It also includes catch-up immunization schedule for children and adolescents who are behind the recommended schedule. These schedules are a minor revision of the corresponding parts of Immunization Guideline, 7th edition, of the Korean Pediatric Society, released in 2012. Pediatricians should be aware of these schedules to provide adequate immunization to Korean children and adolescents

The amount of astrocytic GABA positively correlates with the degree of tonic inhibition in hippocampal CA1 and cerebellum

A tonic form of synaptic inhibition occurs in discrete regions of the central nervous system and has an important role in controlling neuronal excitability. Recently, we reported that GABA present in astrocyte is the major source of tonic inhibition in cerebellum and that GABA is released through Bestrophin-1 channel by direct permeation. In this study, we screened for the presence of astrocytic GABA in various brain regions such as hippocampus, thalamus, hypothalamus and cerebellum using immunohistochemistry. We found that astrocytic GABA was present in the regions that were reported to show tonic inhibition. Because the existence of tonic inhibition in hippocampal CA1 is somewhat controversial, we compared the amount of astrocytic GABA and tonic inhibition between the hippocampal CA1 pyramidal cell layer and the cerebellar granule cell layer. Unlike cerebellar glial cells, hippocampal astrocytes did not contain GABA. The tonic inhibition was also much lower in the pyramidal neurons of hippocampal CA1 compared to the granule cells of cerebellum. Nevertheless, most of the hippocampal astrocytes expressed Bestrophin-1 channel. These data indicate that the absence of astrocytic GABA results in a low level of tonic inhibition in hippocampal CA1 region