16 research outputs found

    GAIA: Zero-shot Talking Avatar Generation

    Full text link
    Zero-shot talking avatar generation aims at synthesizing natural talking videos from speech and a single portrait image. Previous methods have relied on domain-specific heuristics such as warping-based motion representation and 3D Morphable Models, which limit the naturalness and diversity of the generated avatars. In this work, we introduce GAIA (Generative AI for Avatar), which eliminates the domain priors in talking avatar generation. In light of the observation that the speech only drives the motion of the avatar while the appearance of the avatar and the background typically remain the same throughout the entire video, we divide our approach into two stages: 1) disentangling each frame into motion and appearance representations; 2) generating motion sequences conditioned on the speech and reference portrait image. We collect a large-scale high-quality talking avatar dataset and train the model on it with different scales (up to 2B parameters). Experimental results verify the superiority, scalability, and flexibility of GAIA as 1) the resulting model beats previous baseline models in terms of naturalness, diversity, lip-sync quality, and visual quality; 2) the framework is scalable since larger models yield better results; 3) it is general and enables different applications like controllable talking avatar generation and text-instructed avatar generation.Comment: ICLR 2024. Project page: https://microsoft.github.io/GAIA

    A blueberry MIR156a-SPL12 module coordinates the accumulation of chlorophylls and anthocyanins during fruit ripening

    No full text
    Color change is an important event during fruit maturation in blueberry, usually depending on chlorophyll degradation and anthocyanin accumulation. MicroRNA156 (miR156)-SPL modules are an important group of regulatory hubs involved in the regulation of anthocyanin biosynthesis. However, little is known regarding their roles in blueberry or in chlorophyll metabolism during color change. In this study, a MIR156 gene (VcMIR156a) was experimentally identified in blueberry (Vaccinium corymbosum). Overexpression of VcMIR156a in tomato (Solanum lycopersicum) enhanced anthocyanin biosynthesis and chlorophyll degradation in the stem by altering pigment-associated gene expression. Further investigation indicated that the VcSPL12 transcript could be targeted by miR156, and showed the reverse accumulation patterns during blueberry fruit development and maturation. Noticeably, VcSPL12 was highly expressed at green fruit stages, while VcMIR156a transcripts mainly accumulated at the white fruit stage when expression of VcSPL12 was dramatically decreased, implying that VcMIR156a-VcSPL12 is a key regulatory hub during fruit coloration. Moreover, VcSPL12 decreased the expression of several anthocyanin biosynthetic and regulatory genes, and a yeast two-hybrid assay indicated that VcSPL12 interacted with VcMYBPA1. Intriguingly, expression of VcSPL12 significantly enhanced chlorophyll accumulation and altered the expression of several chlorophyll-associated genes. Additionally, the chloroplast ultrastructure was altered by the expression of VcMIR156a and VcSPL12. These findings provide a novel insight into the functional roles of miR156-SPLs in plants, especially in blueberry fruit coloration

    Magnetic resonance-guided focused ultrasound for essential tremor: a prospective, single center, single-arm study

    No full text
    [INLINE:1] The safety and effectiveness of magnetic resonance-guided focused ultrasound thalamotomy has been broadly established and validated for the treatment of essential tremor. In 2018, the first magnetic resonance-guided focused ultrasound system in Chinese mainland was installed at the First Medical Center of the PLA General Hospital. This prospective, single center, open-label, single-arm study was part of a worldwide prospective multicenter clinical trial (ClinicalTrials.gov Identifier: NCT03253991) conducted to confirm the safety and efficacy of magnetic resonance-guided focused ultrasound for treating essential tremor in the local population. From 2019 to 2020, 10 patients with medication refractory essential tremor were recruited into this open-label, single arm study. The treatment efficacy was determined using the Clinical Rating Scale for Tremor. Safety was evaluated according to the incidence and severity of adverse events. All of the subjects underwent a unilateral thalamotomy targeting the ventral intermediate nucleus. At the baseline assessment, the estimated marginal mean of the Clinical Rating Scale for Tremor total score was 58.3 ± 3.6, and this improved after treatment to 23.1 ± 6.4 at a 12-month follow-up assessment. A total of 50 adverse events were recorded, and 2 were defined as serious. The most common intraoperative adverse events were nausea and headache. The most frequent postoperative adverse events were paresthesia and equilibrium disorder. Most of the adverse events were mild and usually disappeared within a few days. Our findings suggest that magnetic resonance-guided focused ultrasound for the treatment of essential tremor is effective, with a good safety profile, for patients in Chinese mainland

    Aplp1 interacts with Lag3 to facilitate transmission of pathologic α-synuclein

    No full text
    Abstract Pathologic α-synuclein (α-syn) spreads from cell-to-cell, in part, through binding to the lymphocyte-activation gene 3 (Lag3). Here we report that amyloid ÎČ precursor-like protein 1 (Aplp1) interacts with Lag3 that facilitates the binding, internalization, transmission, and toxicity of pathologic α-syn. Deletion of both Aplp1 and Lag3 eliminates the loss of dopaminergic neurons and the accompanying behavioral deficits induced by α-syn preformed fibrils (PFF). Anti-Lag3 prevents the internalization of α-syn PFF by disrupting the interaction of Aplp1 and Lag3, and blocks the neurodegeneration induced by α-syn PFF in vivo. The identification of Aplp1 and the interplay with Lag3 for α-syn PFF induced pathology deepens our insight about molecular mechanisms of cell-to-cell transmission of pathologic α-syn and provides additional targets for therapeutic strategies aimed at preventing neurodegeneration in Parkinson’s disease and related α-synucleinopathies
    corecore