Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning

The recent surge of generative AI has been fueled by the generative power of diffusion probabilistic models and the scalable capabilities of large language models. Despite their potential, it remains elusive whether diffusion language models can solve general language tasks comparable to their autoregressive counterparts. This paper demonstrates that scaling diffusion models w.r.t. data, sizes, and tasks can effectively make them strong language learners. We build competent diffusion language models at scale by first acquiring knowledge from massive data via masked language modeling pretraining thanks to their intrinsic connections. We then reprogram pretrained masked language models into diffusion language models via diffusive adaptation, wherein task-specific finetuning and instruction finetuning are explored to unlock their versatility in solving general language tasks. Experiments show that scaling diffusion language models consistently improves performance across downstream language tasks. We further discover that instruction finetuning can elicit zero-shot and few-shot in-context learning abilities that help tackle many unseen tasks by following natural language instructions, and show promise in advanced and challenging abilities such as reasoning.Comment: added reference

Resolving and Tuning Mechanical Anisotropy in Black Phosphorus via Nanomechanical Multimode Resonance Spectromicroscopy

Black phosphorus (P) has emerged as a layered semiconductor with a unique crystal structure featuring corrugated atomic layers and strong in-plane anisotropy in its physical properties. Here, we demonstrate that the crystal orientation and mechanical anisotropy in free-standing black P thin layers can be precisely determined by spatially resolved multimode nanomechanical resonances. This offers a new means for resolving important crystal orientation and anisotropy in black P device platforms in situ beyond conventional optical and electrical calibration techniques. Furthermore, we show that electrostatic-gating-induced straining can continuously tune the mechanical anisotropic effects on multimode resonances in black P electromechanical devices. Combined with finite element modeling (FEM), we also determine the Young's moduli of multilayer black P to be 116.1 and 46.5 GPa in the zigzag and armchair directions, respectively.Comment: Main Text: 13 Pages, 4 Figures; Supplementary Information: 5 Pages, 2 Figures, 2 Table

Interventional therapy of diabetes mellitus type 2 complicated with acute cerebral hemorrhage by using dexmedetomidine

AbstractObjectiveTo study the effects of dexmedetomidine on cerebral injury, inflammation, oxidative stress and renal function of patients with diabetes mellitus type 2 complicated with acute cerebral hemorrhage.MethodsA total of 98 cases who had been diagnosed with diabetes mellitus type 2 complicated with acute cerebral hemorrhage and treated with interventional therapy in Xin Hua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine from September 2014 January 2016 were chosen to be our study subjects. Among them, 50 cases given dexmedetomidine treatment in the process of anesthesia were included in the dexmedetomidine group (Group A), while the other 48 cases treated with equal amount of normal saline were considered as the negative control group. The postoperative cerebral injury indexes and the serum biochemical indexes were detected after 24 h.ResultsThe contents of serum S100β [(2.1 ± 0.2) μg/L] and neuron-specific enolase (NSE) [(14.2 ± 1.3) μg/mL] in Group A were all significantly lower than serum S100β [(2.9 ± 0.3) μg/L] and NSE [(16.6 ± 1.7) μg/mL] of patients in negative control group. The contents of cerebrospinal fluid S100β [(0.9 ± 0.1) μg/L] and NSE [(10.7 ± 1.3) μg/mL] in Group A were all significantly lower than cerebrospinal fluid S100β [(1.3 ± 0.2) μg/L] and NSE [(15.3 ± 1.7) μg/mL] of patients in negative control group. The contents of erythrocyte sedimentation rate [(11.7 ± 2.5) mm/h], c-reactive protein [(2.3 ± 0.4) mg/L], urea nitrogen [(10.7 ± 1.2) mmol/L] and serum creatinine [(151.6 ± 14.9)] μmol/L in Group A were all significantly lower than erythrocyte sedimentation rate [(23.6 ± 3.8) mm/h], c-reactive protein [(6.9 ± 1.1) mg/L], urea nitrogen [(16.7 ± 1.7) mmol/L] and serum creatinine [(192.5 ± 18.3)] μmol/L of patients in negative control group.ConclusionsThe application of dexmedetomidine in the interventional therapy of diabetes mellitus type 2 complicated with acute cerebral hemorrhage could protect brain and renal functions and reduce systemic inflammatory responses

New Approaches in Multi-View Clustering

Many real-world datasets can be naturally described by multiple views. Due to this, multi-view learning has drawn much attention from both academia and industry. Compared to single-view learning, multi-view learning has demonstrated plenty of advantages. Clustering has long been serving as a critical technique in data mining and machine learning. Recently, multi-view clustering has achieved great success in various applications. To provide a comprehensive review of the typical multi-view clustering methods and their corresponding recent developments, this chapter summarizes five kinds of popular clustering methods and their multi-view learning versions, which include k-means, spectral clustering, matrix factorization, tensor decomposition, and deep learning. These clustering methods are the most widely employed algorithms for single-view data, and lots of efforts have been devoted to extending them for multi-view clustering. Besides, many other multi-view clustering methods can be unified into the frameworks of these five methods. To promote further research and development of multi-view clustering, some popular and open datasets are summarized in two categories. Furthermore, several open issues that deserve more exploration are pointed out in the end

Knockdown of TIGAR by RNA interference induces apoptosis and autophagy in HepG2 hepatocellular carcinoma cells

AbstractApoptosis and autophagy are crucial mechanisms regulating cell death, and the relationship between apoptosis and autophagy in the liver has yet to be thoroughly explored. TIGAR (TP53-induced glycolysis and apoptosis regulator), which is a p53-inducible gene, functions in the suppression of ROS (reactive oxygen species) and protects U2OS cells from undergoing cell death. In this study, silencing TIGAR by RNAi (RNA interference) in HepG2 cells down-regulated both TIGAR mRNA (∼75%) and protein levels (∼80%) and led to the inhibition of cell growth (P<0.01) by apoptosis (P<0.001) and autophagy. We demonstrated that TIGAR can increase ROS levels in HepG2 cells. The down-regulation of TIGAR led to the induction of LC-3 II (specific autophagic marker), the formation of the autophagosome, and increased Beclin-1 expression. 3-MA (3-Methyladenine), an inhibitor of autophagic sequestration blocker, inhibited TIGAR siRNA-enhanced autophagy, as indicated by the decrease in LC-3 II levels. Consequently, these data provide the first evidence that targeted silencing of TIGAR induces apoptotic and autophagic cell death in HepG2 cells, and our data raise hope for the future successful application of TIGAR siRNA in patients with hepatocellular carcinoma (HCC)

Integration of Shangshan culture into the STEAM curriculum and teaching: results of an interview-based study

IntroductionInterdisciplinary science, technology, engineering, arts, and mathematics (STEAM) courses are a popular trend in international education than can help inculcate creativity in students. Although STEAM courses have been widely promoted in China, they are generally unsustainable because they are merely imitations of European and American courses and lack Chinese humanistic factors; a close integration between disciplinary ideas and thinking levels is also lacking. C-STEAM, which is designed to pass down China’s culture, is a form of STEAM education with local Chinese characteristics that are focused on integrating interdisciplinary knowledge with the thought process oriented toward cultural heritage.MethodsIn this study, an innovative higher vocational college course with C-STEAM interdisciplinary principles was constructed, with art and design as the framework, and with the integration of Chinese local culture. Semi-structured interviews were conducted to sample 12 learners from a total of 90 students in the experimental class of the C-STEAM course. The study aimed to provide a deeper understanding of the effectiveness of taking a Packaging Design course combined with C-STEAM from multiple perspectives. After the interviews, based on the BAO model, coding statistics and thematic analysis were conducted to understand the learners’ beliefs, actions, and outcomes after taking the course, and their plans for acquiring C-STEAM interdisciplinary knowledge and learning Chinese local culture.ResultsThe integration of the Shangshan culture (上山文化) into the Packaging Design course proved the importance and significance of adding C-STEAM to the art design course, which helped us understand the specific feelings of students after completing the course and gain a deeper understanding of the changes in their knowledge and skills and their learning effects.DiscussionIntegrating C-STEAM education into courses related to art and design is highly warranted to encourage students to apply their interdisciplinary knowledge to artistic exploration and creation. Moreover, to effectively develop a curriculum system with local characteristics, teachers should provide more opportunities for students to explore and learn C-STEAM in the future, and integrate multiple elements into their teaching. In general, a cultural perspective-based interdisciplinary education helps facilitate the creative transformation of traditional Chinese culture

DopplerBAS: Binaural Audio Synthesis Addressing Doppler Effect

Recently, binaural audio synthesis (BAS) has emerged as a promising research field for its applications in augmented and virtual realities. Binaural audio helps users orient themselves and establish immersion by providing the brain with interaural time differences reflecting spatial information. However, existing BAS methods are limited in terms of phase estimation, which is crucial for spatial hearing. In this paper, we propose the \textbf{DopplerBAS} method to explicitly address the Doppler effect of the moving sound source. Specifically, we calculate the radial relative velocity of the moving speaker in spherical coordinates, which further guides the synthesis of binaural audio. This simple method introduces no additional hyper-parameters and does not modify the loss functions, and is plug-and-play: it scales well to different types of backbones. DopperBAS distinctly improves the representative WarpNet and BinauralGrad backbones in the phase error metric and reaches a new state of the art (SOTA): 0.780 (versus the current SOTA 0.807). Experiments and ablation studies demonstrate the effectiveness of our method.Comment: Accepted to ACL 2023 short paper; key words: binaural audio, stereophonic soun

Perspective Review on Subsea Jet Trenching Technology and Modeling

This paper presents a comprehensive review on subsea jet trenching technology via a critical analysis of its principle, mechanism, devices, modeling approaches, as well as properties of subsea sediments. This review shows that the success of jet trenching operations is closely related to some key factors including the soil conditions, trencher specifications, and characteristics of pipelines or cables. Three case histories are presented to demonstrate the importance of these key factors and their interrelationships. This paper also points out a number of challenges pertaining to the implementation of the jet trenching method in carbonate sediments, as well as some limitations and gaps in the existing modeling approaches. Future perspective researches that are recommended to develop: (1) promising theories, like turbulent submerged flow, and (2) robust numerical approaches, such as the smoothed particle hydrodynamics (SPH) and material point method (MPM) to substantiate the experimental experience and reveal possible hidden mechanisms. Document type: Articl

Effectiveness of Acupuncture for Early Recovery of Bowel Function in Cancer: A Systematic Review and Meta-Analysis

Objectives. The aim of this study was to evaluate the effects of acupuncture therapy to reduce the duration of postoperative ileus (POI) and to enhance bowel function in cancer patients. Methods. A systematic search of electronic databases for studies published from inception until January 2017 was carried out from six databases. Randomized controlled trials (RCTs) involving the use of acupuncture and acupressure for POI and bowel function in cancer patients were identified. Outcomes were extracted from each study and pooled to determine the risk ratio and standardized mean difference. Results. 10 RCTs involving 776 cancer patients were included. Compared with control groups (no acupuncture, sham acupuncture, and other active therapies), acupuncture was associated with shorter time to first flatus and time to first defecation. A subgroup analysis revealed that manual acupuncture was more effective on the time to first flatus and the time to first defecation; electroacupuncture was better in reducing the length of hospital stay. Compared with control groups (sham or no acupressure), acupressure was associated with shorter time to first flatus. However, GRADE approach indicated a low quality of evidence. Conclusions. Acupuncture and acupressure showed large effect size with significantly poor or inferior quality of included trials for enhancing bowel function in cancer patients after surgery. Further well-powered evidence is needed