Reprogramming Audio-driven Talking Face Synthesis into Text-driven

In this paper, we propose a method to reprogram pre-trained audio-driven talking face synthesis models to be able to operate with text inputs. As the audio-driven talking face synthesis model takes speech audio as inputs, in order to generate a talking avatar with the desired speech content, speech recording needs to be performed in advance. However, this is burdensome to record audio for every video to be generated. In order to alleviate this problem, we propose a novel method that embeds input text into the learned audio latent space of the pre-trained audio-driven model. To this end, we design a Text-to-Audio Embedding Module (TAEM) which is guided to learn to map a given text input to the audio latent features. Moreover, to model the speaker characteristics lying in the audio features, we propose to inject visual speaker embedding into the TAEM, which is obtained from a single face image. After training, we can synthesize talking face videos with either text or speech audio

Simultaneous VLBI Astrometry of H2O and SiO Masers toward the Semiregular Variable R Crateris

We obtained, for the first time, astrometrically registered maps of the 22.2 GHz H2O and 42.8, 43.1, and 86.2 GHz SiO maser emission toward the semiregular b-type variable (SRb) R Crateris, at three epochs (2015 May 21, and 2016 January 7 and 26) using the Korean Very-long-baseline Interferometry Network. The SiO masers show a ring-like spatial structure, while the H2O maser shows a very asymmetric one-side outflow structure, which is located at the southern part of the ring-like SiO maser feature. We also found that the 86.2 GHz SiO maser spots are distributed in an inner region, compared to those of the 43.1 GHz SiO maser, which is different from all previously known distributions of the 86.2 GHz SiO masers in variable stars. The different distribution of the 86.2 GHz SiO maser seems to be related to the complex dynamics caused by the overtone pulsation mode of the SRb R Crateris. Furthermore, we estimated the position of the central star based on the ring fitting of the SiO masers, which is essential for interpreting the morphology and kinematics of a circumstellar envelope. The estimated stellar coordinate corresponds well to the position measured by Gaia

"Direct" grafting of linear macromolecular "wedges" to the edge of pristine graphite to prepare edge-functionalized graphene-based polymer composites

The edges of pristine graphite were covalently grafted with para-poly(ether-ketone) (pPEK) in a mildly acidic polyphosphoric acid (PPA)/phosphorus pentoxide (P(2)O(5)) medium. The resulting pPEK grafted graphite (pPEK-g-graphite) showed that the pristine graphite had been exfoliated into a few layers of graphene platelets (graphene-like sheets), which were uniformly dispersed into a pPEK matrix. As a result, the tensile properties of pPEK-g-graphite films were greatly improved compared to those of controlled pPEK films. The origins of these enhanced mechanical properties were deduced from scanning electron microscope (SEM) images of fracture surfaces. Upon tracing wide-angle X-ray scattering (WAXS) patterns of the film under strain, the graphene-like sheets were further exfoliated by an applied shear force, suggesting that a toughening mechanism for the pPEK-g-graphite film occurred. This approach envisions that the "direct'' edge grafting of pristine graphite without pre-treatments such as corrosive oxidation and/or destructive sonication is a simple and efficient method to prepare graphene-based polymer composites with enhanced mechanical properties.close161

IRT5 Probiotics Changes Immune Modulatory Protein Expression in the Extraorbital Lacrimal Glands of an Autoimmune Dry Eye Mouse Model

PURPOSE. While the association between the gut microbiome and the immune system has been studied in autoimmune disorders, little is known about ocular disease. Previously we reported that IRT5, a mixture of five probiotic strains, could suppress autoimmune dry eye. In this study, we investigated the mechanism by which IRT5 performs its immunomodulatory function in a mouse model of autoimmune dry eye. METHODS. NOD.B10.H2b mice were used as an autoimmune dry eye model. Either IRT5 or PBS was gavaged orally for 3 weeks, with or without 5 days of antibiotic pretreatment. The effects on clinical features, extraorbital lacrimal gland and spleen proteins, and fecal microbiota were analyzed. RESULTS. The ocular staining score was lower, and tear secretion was higher, in the IRT5-treated groups than in the PBS-treated groups. After IRT5 treatment, the downregulated lacrimal gland proteins were enriched in the biological processes of defense response and immune system process. The relative abundances of 33 operational taxonomic units were higher, and 53 were lower, in the feces of the IRT5-treated groups than in those of the PBS-treated groups. IRT5 administration without antibiotic pretreatment also showed immunomodulatory functions with increases in the Lactobacillus helveticus group and Lactobacillus hamsteri. Additional proteomic assays revealed a decrease of proteins related to antigen-presenting processes in the CD11b(+) and CD11c(+) cells of spleen in the IRT5-treated groups. CONCLUSIONS. Changes in the gut microbiome after IRT5 treatment improved clinical manifestations in the autoimmune dry eye model via the downregulation of antigen-presenting processes in immune networks.11Ysciescopu

SyncTalkFace: Talking Face Generation with Precise Lip-Syncing via Audio-Lip Memory

The challenge of talking face generation from speech lies in aligning two different modal information, audio and video, such that the mouth region corresponds to input audio. Previous methods either exploit audio-visual representation learning or leverage intermediate structural information such as landmarks and 3D models. However, they struggle to synthesize fine details of the lips varying at the phoneme level as they do not sufficiently provide visual information of the lips at the video synthesis step. To overcome this limitation, our work proposes Audio-Lip Memory that brings in visual information of the mouth region corresponding to input audio and enforces fine-grained audio-visual coherence. It stores lip motion features from sequential ground truth images in the value memory and aligns them with corresponding audio features so that they can be retrieved using audio input at inference time. Therefore, using the retrieved lip motion features as visual hints, it can easily correlate audio with visual dynamics in the synthesis step. By analyzing the memory, we demonstrate that unique lip features are stored in each memory slot at the phoneme level, capturing subtle lip motion based on memory addressing. In addition, we introduce visual-visual synchronization loss which can enhance lip-syncing performance when used along with audio-visual synchronization loss in our model. Extensive experiments are performed to verify that our method generates high-quality video with mouth shapes that best align with the input audio, outperforming previous state-of-the-art methods.Comment: Accepted at AAAI 2022 (Oral

Hybrid XML Data Model Architecture for Efficient Document Management

XML has been known as a document standard in representation and exchange of data on the Internet, and is also used as a standard language for the search and reuse of scattered documents on the Internet. The issues related to XML are how to model data on effective and efficient management of semi-structured data and how to actually store the modeled data when implementing a XML contents management system. Previous researches on XML have limitations in (1) reproduction of XML documents from the stored data, (2) retrieval of XML sub-graph from search, (3) supporting only top-down search, not full-search, and (4) dependency of data structure on XML documents. The purpose of this paper is to present a hybrid XML data model architecture for the storage and search of XML document data. By representing both data and structure views of XML documents, this new XML data model technique overcomes the limitations of previous researches on data model for XML documents as well as the existing database systems such as relational and object-oriented data model

miRNA regulation of cytotoxic effects in mouse Sertoli cells exposed to nonylphenol

Background: It is known that some environmental chemicals affect the human endocrine system. The harmful effects of endocrine disrupting chemical (EDC) nonylphenol (NP) have been studied since the 1980s. It is known that NP adversely affects physiological functions by mimicking the natural hormone 17 beta-estradiol. In the present study, we analyzed the expression of miRNAs and their target genes in mouse Sertoli TM4 cells to better understand the regulatory roles of miRNAs on Sertoli cells after NP exposure. Methods: Mouse TM4 Sertoli cells were treated with NP for 3 or 24 h, and global gene and miRNA expression were analyzed using Agilent mouse whole genome and mouse miRNA v13 arrays. Results: We identified genes that were > 2-fold differentially expressed in NP-treated cells and control cells (P < 0.05) and analyzed their functions through Gene Ontology analysis. We also identified miRNAs that were differentially expressed in NP-treated and control cells. Of the 186 miRNAs the expression of which differed between NP-treated and control cells, 59 and 147 miRNAs exhibited 1.3-fold increased or decreased expression at 3 and 24 h, respectively. Network analysis of deregulated miRNAs suggested that Ppara may regulate the expression of certain miRNAs, including miR-378, miR-125a-3p miR-20a, miR-203, and miR-101a, after exposure to NP. Additionally, comprehensive analysis of predicted target genes for miRNAs showed that the expression of genes with roles in cell proliferation, the cell cycle, and cell death were regulated by miRNA in NP-treated TM4 cells. Levels of expression of the miRNAs miR-135a* and miR-199a-5p were validated by qRT-PCR. Finally, miR-135a* target gene analysis suggests that the generation of reactive oxygen species (ROS) following exposure to NP exposure may be mediated by miR-135a* through regulation of the Wnt/beta-catenin signaling pathway. Conclusions: Collectively, these data help to determine NP's actions on mouse TM4 Sertoli cells and increase our understanding of the molecular mechanisms underlying the adverse effects of xenoestrogens on the reproductive system.This work was supported an Eco-Technopia 21 project grant from the Ministry of Environment (Development of Decision Method of Chromosomal Abnormality in Reproductive System by Toxic Substances at the Korea Institute of Toxicology)

A Comparison of Dimensional Standard of Several Nickel-Titanium Rotary Files

Objectives The aim of this study was to compare the dimensional standard of several nickel-titanium (Ni-Ti) rotary files and verify the size conformity. Materials and Methods ProFile (Dentsply Maillefer), RaCe (FKG Dentaire), and TF file (SybronEndo) #25 with a 0.04 and 0.06 taper were investigated, with 10 in each group for a total of 60 files. Digital images of Ni-Ti files were captured under light microscope (SZX16, Olympus) at 32×. Taper and diameter at D1 to D16 of each files were calculated digitally with AnalySIS TS Materials (OLYMPUS Soft Imaging Solutions). Differences in taper, the diameter of each level (D1 to D16) at 1 mm interval from (ANSI/ADA) specification No. 101 were statistically analyzed using one-way ANOVA and Scheffe\u27s post-hoc test at 95% confidence level. Results TF was the only group not conform to the nominal taper in both tapers (p \u3c 0.05). All groups except 0.06 taper ProFile showed significant difference from the nominal diameter (p \u3c 0.05). Conclusions Actual size of Ni-Ti file, especially TF, was different from the manufacturer\u27s statements