ISS++: Image as Stepping Stone for Text-Guided 3D Shape Generation

In this paper, we present a new text-guided 3D shape generation approach (ISS++) that uses images as a stepping stone to bridge the gap between text and shape modalities for generating 3D shapes without requiring paired text and 3D data. The core of our approach is a two-stage feature-space alignment strategy that leverages a pre-trained single-view reconstruction (SVR) model to map CLIP features to shapes: to begin with, map the CLIP image feature to the detail-rich 3D shape space of the SVR model, then map the CLIP text feature to the 3D shape space through encouraging the CLIP-consistency between rendered images and the input text. Besides, to extend beyond the generative capability of the SVR model, we design a text-guided 3D shape stylization module that can enhance the output shapes with novel structures and textures. Further, we exploit pre-trained text-to-image diffusion models to enhance the generative diversity, fidelity, and stylization capability. Our approach is generic, flexible, and scalable, and it can be easily integrated with various SVR models to expand the generative space and improve the generative fidelity. Extensive experimental results demonstrate that our approach outperforms the state-of-the-art methods in terms of generative quality and consistency with the input text. Codes and models are released at https://github.com/liuzhengzhe/ISS-Image-as-Stepping-Stone-for-Text-Guided-3D-Shape-Generation.Comment: Under review of TPAM

ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation

Text-guided 3D shape generation remains challenging due to the absence of large paired text-shape data, the substantial semantic gap between these two modalities, and the structural complexity of 3D shapes. This paper presents a new framework called Image as Stepping Stone (ISS) for the task by introducing 2D image as a stepping stone to connect the two modalities and to eliminate the need for paired text-shape data. Our key contribution is a two-stage feature-space-alignment approach that maps CLIP features to shapes by harnessing a pre-trained single-view reconstruction (SVR) model with multi-view supervisions: first map the CLIP image feature to the detail-rich shape space in the SVR model, then map the CLIP text feature to the shape space and optimize the mapping by encouraging CLIP consistency between the input text and the rendered images. Further, we formulate a text-guided shape stylization module to dress up the output shapes with novel textures. Beyond existing works on 3D shape generation from text, our new approach is general for creating shapes in a broad range of categories, without requiring paired text-shape data. Experimental results manifest that our approach outperforms the state-of-the-arts and our baselines in terms of fidelity and consistency with text. Further, our approach can stylize the generated shapes with both realistic and fantasy structures and textures

EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation

This paper presents a new text-guided technique for generating 3D shapes. The technique leverages a hybrid 3D shape representation, namely EXIM, combining the strengths of explicit and implicit representations. Specifically, the explicit stage controls the topology of the generated 3D shapes and enables local modifications, whereas the implicit stage refines the shape and paints it with plausible colors. Also, the hybrid approach separates the shape and color and generates color conditioned on shape to ensure shape-color consistency. Unlike the existing state-of-the-art methods, we achieve high-fidelity shape generation from natural-language descriptions without the need for time-consuming per-shape optimization or reliance on human-annotated texts during training or test-time optimization. Further, we demonstrate the applicability of our approach to generate indoor scenes with consistent styles using text-induced 3D shapes. Through extensive experiments, we demonstrate the compelling quality of our results and the high coherency of our generated shapes with the input texts, surpassing the performance of existing methods by a significant margin. Codes and models are released at https://github.com/liuzhengzhe/EXIM.Comment: SIGGRAPH Asia 2023 & TOG Project page: https://liuzhengzhe.github.io/EXIM.github.io

Avian Tembusu virus infection effectively triggers host innate immune response through MDA5 and TLR3-dependent signaling pathways

Additional file 4 ATMUV infection causes significant up-regulation of TLR3 and MDA5. RT-PCR was performed to examine the mRNA expression of TLR3 and MDA5 in CEF (A), chickens (B) and 293T cells (C) at the indicated time after ATMUV infection, respectively

NRAV, a Long Noncoding RNA, Modulates Antiviral Responses through Suppression of Interferon-Stimulated Gene Transcription

SummaryLong noncoding RNAs (lncRNAs) modulate various biological processes, but their role in host antiviral responses is largely unknown. Here we identify a lncRNA as a key regulator of antiviral innate immunity. Following from the observation that a lncRNA that we call negative regulator of antiviral response (NRAV) was dramatically downregulated during infection with several viruses, we ectopically expressed NRAV in human cells or transgenic mice and found that it significantly promotes influenza A virus (IAV) replication and virulence. Conversely, silencing NRAV suppressed IAV replication and virus production, suggesting that reduction of NRAV is part of the host antiviral innate immune response to virus infection. NRAV negatively regulates the initial transcription of multiple critical interferon-stimulated genes (ISGs), including IFITM3 and MxA, by affecting histone modification of these genes. Our results provide evidence for a lncRNA in modulating the antiviral interferon response

Direct transformation of-alkane into all-conjugated polyene via cascade dehydrogenation

Selective C(sp$^{3}$) −H activation is of fundamental importance in processing alkane feedstocks to produce high-value-added chemical products. By virtue of an on-surface synthesis strategy, we report selective cascade dehydrogenation of n-alkane molecules under surface constraints, which yields monodispersed all-trans conjugated polyenes with unprecedented length controllability. We are also able to demonstrate the generality of this concept for alkyl-substituted molecules with programmable lengths and diverse functionalities, and more importantly its promising potential in molecular wiring

Association of Genetic Variants of Melatonin Receptor 1B with Gestational Plasma Glucose Level and Risk of Glucose Intolerance in Pregnant Chinese Women

BACKGROUND: This study aimed to explore the association of MTNR1B genetic variants with gestational plasma glucose homeostasis in pregnant Chinese women. METHODS: A total of 1,985 pregnant Han Chinese women were recruited and evaluated for gestational glucose tolerance status with a two-step approach. The four MTNR1B variants rs10830963, rs1387153, rs1447352, and rs2166706 which had been reported to associate with glucose levels in general non-pregnant populations, were genotyped in these women. Using an additive model adjusted for age and body mass index (BMI), association of these variants with gestational fasting and postprandial plasma glucose (FPG and PPG) levels were analyzed by multiple linear regression; relative risk of developing gestational glucose intolerance was calculated by logistic regression. Hardy-Weinberg Equilibrium was tested by Chi-square and linkage disequilibrium (LD) between these variants was estimated by measures of D' and r(2). RESULTS: In the pregnant Chinese women, the MTNR1B variant rs10830963, rs1387153, rs2166706 and rs1447352 were shown to be associated with the increased 1 hour PPG level (p=8.04 × 10(-10), 5.49 × 10(-6), 1.89 × 10(-5) and 0.02, respectively). The alleles were also shown to be associated with gestational glucose intolerance with odds ratios (OR) of 1.64 (p=8.03 × 10(-11)), 1.43 (p=1.94 × 10(-6)), 1.38 (p=1.63 × 10(-5)) and 1.24 (p=0.007), respectively. MTNR1B rs1387153, rs2166706 were shown to be associated with gestational FPG levels (p=0.04). Our data also suggested that, the LD pattern of these variants in the studied women conformed to that in the general populations: rs1387153 and rs2166706 were in high LD, they linked moderately with rs10830963, but might not linked with rs1447352;rs10830963 might not link with rs1447352, either. In addition, the MTNR1B variants were not found to be associated with any other traits tested. CONCLUSIONS: The MTNR1B is likely to be involved in the regulation of glucose homeostasis during pregnancy

Dynamical alterations of brain function and gut microbiome in weight loss

ObjectiveIntermittent energy restriction (IER) is an effective weight loss strategy. However, little is known about the dynamic effects of IER on the brain-gut-microbiome axis.MethodsIn this study, a total of 25 obese individuals successfully lost weight after a 2-month IER intervention. FMRI was used to determine the activity of brain regions. Metagenomic sequencing was performed to identify differentially abundant gut microbes and pathways in from fecal samples.ResultsOur results showed that IER longitudinally reduced the activity of obese-related brain regions at different timepoints, including the inferior frontal orbital gyrus in the cognitive control circuit, the putamen in the emotion and learning circuit, and the anterior cingulate cortex in the sensory circuit. IER longitudinally reduced E. coli abundance across multiple timepoints while elevating the abundance of obesity-related Faecalibacterium prausnitzii, Parabacteroides distasonis, and Bacterokles uniformis. Correlation analysis revealed longitudinally correlations between gut bacteria abundance alterations and brain activity changes.ConclusionsThere was dynamical alteration of BGM axis (the communication of E. coli with specific brain regions) during the weight loss under the IER