Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning

The recent surge of generative AI has been fueled by the generative power of diffusion probabilistic models and the scalable capabilities of large language models. Despite their potential, it remains elusive whether diffusion language models can solve general language tasks comparable to their autoregressive counterparts. This paper demonstrates that scaling diffusion models w.r.t. data, sizes, and tasks can effectively make them strong language learners. We build competent diffusion language models at scale by first acquiring knowledge from massive data via masked language modeling pretraining thanks to their intrinsic connections. We then reprogram pretrained masked language models into diffusion language models via diffusive adaptation, wherein task-specific finetuning and instruction finetuning are explored to unlock their versatility in solving general language tasks. Experiments show that scaling diffusion language models consistently improves performance across downstream language tasks. We further discover that instruction finetuning can elicit zero-shot and few-shot in-context learning abilities that help tackle many unseen tasks by following natural language instructions, and show promise in advanced and challenging abilities such as reasoning.Comment: added reference

Case Study on Prestressed CFRP Plates Applied for Strengthening Hollow-Section Beam Removed from an Old Bridge

With the wide application of carbon fiber reinforced polymer (CFRP) plate, used for strengthening existed concrete structures, the prestressing technology of CFRP plate is becoming a hot topic, in order to sufficiently develop its high-strength peculiarity. In this paper, a full-scale hollow-section beam with length of 16 m taken from an old bridge which was in service for about 20 years was first examined for existed cracks and repaired by filling epoxy adhesive, and then the beam was strengthened with prestressed CFRP plates. The CFRP plates were tensioned and fixed with flat-plate anchorages at ends and bonded with adhesive on the bottom surface of the beam. The strengthened beam was experimentally studied using a four-point test to measure the concrete strain along the height of the mid-span section and the mid-span deflection. The finite element model of the strengthened beam was verified by the comparison of test results and used for an extending study of parametric analysis considering the effect of the length and amount of CFRP plates. Results indicated that with an increase in the length and amount of CFRP plates, the mid-span deflection of the beam decreases with the increased cracking resistance and bearing capacity, while the ultimate failure mode transfers from the under-reinforcement to the over-reinforcement

Experimental observation of the effect of immunotherapy on CD4+ T cells and Th1/Th2 cytokines in mice with allergic rhinitis

Abstract The present study aims to investigate the effect of immunotherapy in a mouse model of allergic rhinitis (AR) and to explore the possible molecular mechanisms of action. An animal model of AR was established by sensitization and challenge of BALB/c mice with house dust mite (HDM) extract. The mice were injected subcutaneously with HDM for immunotherapy. AR nasal symptoms were evaluated according to the frequencies of nose rubbing and sneezing and the degree of rhinorrhea. The nasal mucosa and lung tissue architecture and inflammatory status by histological analysis; the infiltration of eosinophils in nasal lavage fluid (NALF) of mice was observed by Diff-Quik stain; ELISA-based quantification of serum HDM-specific IgE and TH1/TH2 cytokine concentration; and flow cytometry detected the number of serum CD4+/CD8+ cells to evaluate the mechanism of immunotherapy. It was found that after immunotherapy, the AR symptom score was reduced, the number of eosinophils in NALF was reduced, and the infiltration of inflammatory cells and tissue damage in the nasal mucosa and lung tissue were alleviated. Immunotherapy can increase the number of CD4+ T cells in the peripheral blood, increase the ratio of CD4+/CD8+ cells, increase the expression of Th1 cytokines such as IL-2 and IFN-γ, reduce the expression of Th2 cytokines such as IL-4 and IL-5. The results showed that repeated intraperitoneal injection of crude extract of HDM for sensitization, followed by nasal drops can effectively construct a mouse model of AR, and subcutaneous injection of immunotherapy in mice can reduce allergic inflammation in model mice and improve the inflammatory infiltration of the nasal cavity in allergic rhinitis. Immunotherapy can reduce the expression of inflammatory factors in AR, improve Th1/Th2 balance, and may play a role in the treatment of AR by improving the function of immune cells