Multi-aspect Repetition Suppression and Content Moderation of Large Language Models

Natural language generation is one of the most impactful fields in NLP, and recent years have witnessed its evolution brought about by large language models (LLMs). As the key instrument for writing assistance applications, they are generally prone to replicating or extending offensive content provided in the input. In low-resource data regime, they can also lead to repetitive outputs (Holtzman et al., 2019) [1]. Usually, offensive content and repetitions are mitigated with post-hoc methods, including n-gram level blocklists, top-k and nucleus sampling. In this paper, we introduce a combination of exact and non-exact repetition suppression using token and sequence level unlikelihood loss, repetition penalty during training, inference, and post-processing respectively. We further explore multi-level unlikelihood loss to the extent that it endows the model with abilities to avoid generating offensive words and phrases from the beginning. Finally, with comprehensive experiments, we demonstrate that our proposed methods work exceptionally in controlling the repetition and content quality of LLM outputs

Quantum Transports in Two-Dimensions with Long Range Hopping: Shielding, Localization and the Extended Isolated State

We investigate the effects of disorder and shielding on quantum transports in a two dimensional system with all-to-all long range hopping. In the weak disorder, cooperative shielding manifests itself as perfect conducting channels identical to those of the short range model, as if the long range hopping does not exist. With increasing disorder, the average and fluctuation of conductance are larger than those in the short range model, since the shielding is effectively broken and therefore long range hopping starts to take effect. Over several orders of disorder strength (until $\sim 10^4$ times of nearest hopping), although the wavefunctions are not fully extended, they are also robustly prevented from being completely localized into a single site. Each wavefunction has several localization centers around the whole sample, thus leading to a fractal dimension remarkably smaller than 2 and also remarkably larger than 0, exhibiting a hybrid feature of localization and delocalization. The size scaling shows that for sufficiently large size and disorder strength, the conductance tends to saturate to a fixed value with the scaling function $\beta\sim 0$, which is also a marginal phase between the typical metal ($\beta>0$) and insulating phase ($\beta<0$). The all-to-all coupling expels one isolated but extended state far out of the band, whose transport is extremely robust against disorder due to absence of backscattering. The bond current picture of this isolated state shows a quantum version of short circuit through long hopping.Comment: 15 pages, 8 figure

Biased diversity metrics revealed by bacterial 16S pyrotags derived from different primer sets.

published_or_final_versio

East Learns from West: Asiatic Honeybees Can Understand Dance Language of European Honeybees

The honeybee waggle dance, through which foragers advertise the existence and location of a food source to their hive mates, is acknowledged as the only known form of symbolic communication in an invertebrate. However, the suggestion, that different species of honeybee might possess distinct ‘dialects’ of the waggle dance, remains controversial. Furthermore, it remains unclear whether different species of honeybee can learn from and communicate with each other. This study reports experiments using a mixed-species colony that is composed of the Asiatic bee Apis cerana cerana (Acc), and the European bee Apis mellifera ligustica (Aml). Using video recordings made at an observation hive, we first confirm that Acc and Aml have significantly different dance dialects, even when made to forage in identical environments. When reared in the same colony, these two species are able to communicate with each other: Acc foragers could decode the dances of Aml to successfully locate an indicated food source. We believe that this is the first report of successful symbolic communication between two honeybee species; our study hints at the possibility of social learning between the two honeybee species, and at the existence of a learning component in the honeybee dance language

Effects of different nutrient solutions on the acclimatisation of in vitro Caladium plantlets using a simplified hydroponic system

An efficient acclimatisation protocol is critical to improve the survival rate and promote growth of in vitro plantlets. Herein, tissue-cultured plantlets of ‘Red Flash’ caladium (Caladium × hortulanum Birdsey) were treated with deionised water and three nutrient solutions including Japanese garden formula (JG), South China Agriculture University formula B for leafy vegetables (SCAU-B) and Hoagland solution in a simplified hydroponic system under indoor environmental conditions. The results showed that all the plantlets survived after 30 days of hydroponic culture, and the three nutrient solutions showed significant positive effects on the plant growth and the content of chlorophyll a, chlorophyll b, total chlorophyll, carotenoid, soluble sugar and soluble protein compared to the deionised water treatment. No significant difference was recorded for the other growth parameters except the average leaf number per plantlet among the nutrient solution treatments. For the analysed physiological parameters, the plantlets treated by SCAU-B contained significantly higher content than those of the Hoagland treatment except the protein content. No significant difference was found between the JG and the SCAU-B treatment except the carotenoid content, and between the JG and the Hoagland treatment except the protein content. The plantlets acclimatised in the nutrient solutions also had a good performance when transferred to plastic pots. These results implied that water alone was not capable of maintaining healthy growth of in vitro caladium plantlets, and hydroponics approach using the three nutrient solutions could be a feasible method for acclimatisation of the plantlets

Chemometry use in the evaluation of the sanya bay water quality

No presente estudo foi realizada a identificação dos efeitos antropogênicos e das características naturais marinhas das águas da Baía de Sanya, situada ao sul do Mar da China, através de método quimiométrico. A análise de componentes principais (PCA) aplicada aos dados extraiu quatro eixos que explicaram 85,52% da variância total dos dados. Através das análises de Agrupamento e PCA foram identificados três padrões diferentes de qualidade das águas, baseados nos efeitos antropogênicos e nas características marinhas: Grupo I, localizado nas partes externa e mediana da baía; Grupo II, próximo do centro urbano de Sanya; Grupo III, localizado no estuário do Rio Sanya. Quanto ao padrão temporal, as referidas análises distinguiram uma estação seca, de novembro a abril, e uma estação chuvosa, de maio a outubro, relacionadas ao clima e características naturais. Foi visto que tanto a fonte poluidora externa, representada pelo Rio Sanya, quanto as águas do Mar do Sul da China influenciam a qualidade das águas da Baía de Sanya. Esses resultados podem ser relevantes quando considerados sob o ponto de vista do desenvolvimento socioeconômico e de saúde humana dessa região.In this study, chemometric method is employed to identify anthropogenic effects on the water quality in Sanya Bay, South China Sea, and its marine and natural characteristics. Principal component analysis has extracted the four latent factors, thus explaining 85.52% of the total variance. Cluster analysis and principal component analysis have identified three different patterns of water quality based on anthropogenic effects and marine characteristics: Cluster I located in the outer and middle parts of the bay, Cluster II close to downtown Sanya, Cluster III located in the Sanya River estuary. In terms of the temporal pattern, principal component analysis and cluster analysis have distinguished the dry season from November to the following April, and the rainy season from May to October. The temporal pattern is related to climate and natural characteristics. The similarity index between variables and scores of samples can further distinguish the contribution of the variables to the samples. Both the polluting sources external to the Sanya River and the water from the South China Sea exercise an important influence on the water quality in Sanya Bay. These results may be valuable for socioeconomic development and human health in the Sanya Bay area

MAP3K19 regulatory variation in populations with African ancestry may increase COVID-19 severity

To identify ancestry-linked genetic risk variants associated with COVID-19 hospitalization, we performed an integrative analysis of two genome-wide association studies and resolved four single nucleotide polymorphisms more frequent in COVID-19-hospitalized patients with non-European ancestry. Among them, the COVID-19 risk SNP rs16831827 shows the largest difference in minor allele frequency (MAF) between populations with African and European ancestry and also shows higher MAF in hospitalized COVID-19 patients among cohorts of mixed ancestry (odds ratio [OR] = 1.20, 95% CI: 1.10-1.30) and entirely African ancestry (OR = 1.30, 95% CI: 1.02-1.67). rs16831827 is an expression quantitative trait locus of MAP3K19. MAP3K19 expression is induced during ciliogenesis and most abundant in ciliated tissues including lungs. Single-cell RNA sequencing analyses revealed that MAP3K19 is highly expressed in multiple ciliated cell types. As rs16831827∗T is associated with reduced MAP3K19 expression, it may increase the risk of severe COVID-19 by reducing MAP3K19 expression

Chinese herbal medicine shenqi detoxification granule inhibitsfibrosis in adenine induced chronic renal failure rats

Background: Progressive fibrosis accompanies all chronic renal disease, connective tissue growth factor (CTGF,) and platelet-derived growth factor-B, (PDGF-B,) play important roles in extra-cellular matrix abnormal accumulation, while endothelin -1 (ET-1) nitric oxide (NO,) are related to endothelial dysfunction, which mediates the progression of renal fibrosis. Shenqi Detoxification Granule (SDG), a traditional Chinese herbal formula, has been used for treatment of chronic renal failure in clinic for many years.Materials and Methods: In order to evaluate the efficacy, and explore the mechanism of SDG to inhibit the progression of renal fibrosis, study was carried out using the adenine-induced Wister rats as the CRF model, and losartan as postive control drug. Levels of serum creatinine [Scr], and blood urea nitrogen (BUN), albumin (ALB), 24hrs, urine protein (24hUP), triacylglycerol (TG), and cholesterol (CHO), together with ET-1, and NO were detected. Pathological changes of renal tissues were observed by HE, staining. In addition, CTGF and PDGF-B expression were analyzed by immuno-histo-chemistry.Results:The results indicated that SDG can effectively reduce Scr, BUN, 24hUP, TG, and CHO levels, increase ALB levels, inhibit renal tissue damage in CRF rats, and the mechanism maybe reduce PDGF-B, CTGF expression and ET-1/NO.Conclusion: Shenqi Detoxification Granule is a beneficial treatment for chronic renal failure.Key words: Chronic Renal Failure; fibrosis; Shenqi Detoxification Granule; CTGF; PDGF-B

A new numerical method for the analysis of monolithic seepage problems with complex drainage systems in a groundwater recharge area for a hydropower station in China

After construction of a dam impounding water in a reservoir, a monolithic seepage field develops in the surrounding rock mass. Here, a new finite element method is proposed for determining the shape and characteristics of the 3D monolithic seepage field including the free surface, considering complex drainage systems consisting of densely-spaced drainage holes and drainage galleries. To this end, the previously proposed virtual flux method is improved by a refined numerical integration scheme and a regularized Heaviside function for distinguishing the subregions below and above the free surface within a particular finite element. Leakage and overflow drainage holes are modeled as internal boundaries. The proposed numerical method is verified by an academic example, for which the analytical solution is available. Finally, the numerical simulation of the seepage field developing in the vicinity of a high dam and underground power house, constructed in the context of a hydropower plant project in China is used to show its application to a problem in engineering practice.</p