DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory

Controllable video generation has gained significant attention in recent years. However, two main limitations persist: Firstly, most existing works focus on either text, image, or trajectory-based control, leading to an inability to achieve fine-grained control in videos. Secondly, trajectory control research is still in its early stages, with most experiments being conducted on simple datasets like Human3.6M. This constraint limits the models' capability to process open-domain images and effectively handle complex curved trajectories. In this paper, we propose DragNUWA, an open-domain diffusion-based video generation model. To tackle the issue of insufficient control granularity in existing works, we simultaneously introduce text, image, and trajectory information to provide fine-grained control over video content from semantic, spatial, and temporal perspectives. To resolve the problem of limited open-domain trajectory control in current research, We propose trajectory modeling with three aspects: a Trajectory Sampler (TS) to enable open-domain control of arbitrary trajectories, a Multiscale Fusion (MF) to control trajectories in different granularities, and an Adaptive Training (AT) strategy to generate consistent videos following trajectories. Our experiments validate the effectiveness of DragNUWA, demonstrating its superior performance in fine-grained control in video generation. The homepage link is \url{https://www.microsoft.com/en-us/research/project/dragnuwa/

Identification of Candidate Genes for the Plateau Adaptation of a Tibetan Amphipod, Gammarus lacustris, Through Integration of Genome and Transcriptome Sequencing

The amphipod Gammarus lacustris has been distributing in the Tibetan region with well-known uplifts of the Tibetan plateau. It is hence considered as a good model for investigating stress adaptations of the plateau. Here, we sequenced the whole-genome and full-length transcriptome of G. lacustris, and compared the transcriptome results with its counterpart Gammarus pisinnus from a nearby plain. Our main goal was to provide a genomic resource for investigation of genetic mechanisms, by which G. lacustris adapted to living on the plateau. The final draft genome assembly of G. lacustris was 5.07 gigabases (Gb), and it contained 443,304 scaffolds (>2 kb) with an N50 of 2,578 bp. A total of 8,858 unigenes were predicted in the full-length transcriptome of G. lacustris, with an average gene length of 1,811 bp. Compared with the G. pisinnus transcriptome, 2,672 differentially expressed genes (DEGs) were up-regulated and 2,881 DEGs were down-regulated in the G. lacustris transcriptome. Along with these critical DEGs, several enriched metabolic pathways, such as oxidative phosphorylation, ribosome, cell energy homeostasis, glycolysis and gluconeogenesis, were predicted to play essential roles in the plateau adaptation. In summary, the present study provides a genomic basis for understanding the plateau adaption of G. lacustris, which lays a fundamental basis for further biological and ecological studies on other resident aquatic species in the Tibetan plateau

Research and diagnosis of local slagging in boilers based on impact signal

In view of widespread slagging on heating surfaces of boilers in power plants， the paper introduces a piezoelectric acceleration sensor for slag impact signal measurement to determine the size and position of the impact of slag on the water wall of the cold ash hopper. In order to verify the accuracy of the method， the slag on boiler water wall was simulated in a laboratory. By the symmetric arrangement of the acceleration sensors in four positions of the cold ash hopper， the four vibration starting times and the maximum amplitudes were measured to judge the fallen slag's approximate area. Moreover， the impact coefficient between the slag block and the cold ash hopper was obtained by calculation fitting. Finally， a sensor was installed in a boiler for on-site test in a power plant. The results show that the method can well locate and measure the slag mass

Effect of adipose tissue-derived stem cells therapy on clinical response in patients with primary Sjogren’s syndrome

Abstract The purpose of this trial was to clinically assess the effect and safety of Adipose Tissue-derived Stem Cells (ADSCs) treatment on primary Sjogren’s Syndrome (pSS). In this 6-month randomized, triple-blind, placebo-controlled clinical trial, pSS patients were randomly assigned to two groups. After demographic characteristics and clinical examination were achieved, local injection of ADSCs into bilateral glands was performed with patients in ADSCs group (n = 35) and placebo solution was used for another group (n = 39) at three time points. Patients were followed up at 1-, 3- and 6-month. At each visit, studies of clinical and laboratory outcomes, as well as subjective symptoms, were conducted. A total of 74 subjects who met the including criteria were allocated in two groups and eventually 64 subjects (86.5%) completed the treatments and the follow-up assessments. Secretion of salivary and lachrymal glands were significantly improved in 3-month (P < 0.05). A great improvement of European League Against Rheumatism Sjögren’s Syndrome Disease Activity Index (ESSDAI) was found after ADSCs treatment with intergroup comparison from baseline to follow-up (P < 0.05). There is also a significant difference of European Alliance of Associations for Rheumatology SS Patient Reported Index (ESSPRI) between the two groups in the follow-up (P < 0.05). A significant abatement of IgG, IgM, C3, C4 and ESR between two groups was observed in part of follow-up time points (P < 0.05). The ADSCs therapy can provide relief of oral and eye’s dryness in our trial in a short time and has potential improvement of subjective and systemic syndromes of pSS