Text-based Editing of Talking-head Video

Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis

Super-resolution far-field ghost imaging via compressive sampling

Much more image details can be resolved by improving the system's imaging resolution and enhancing the resolution beyond the system's Rayleigh diffraction limit is generally called super-resolution. By combining the sparse prior property of images with the ghost imaging method, we demonstrated experimentally that super-resolution imaging can be nonlocally achieved in the far field even without looking at the object. Physical explanation of super-resolution ghost imaging via compressive sampling and its potential applications are also discussed.Comment: 4pages,4figure

Tiling groupoids and Bratteli diagrams

Let T be an aperiodic and repetitive tiling of R^d with finite local complexity. Let O be its tiling space with canonical transversal X. The tiling equivalence relation R_X is the set of pairs of tilings in X which are translates of each others, with a certain (etale) topology. In this paper R_X is reconstructed as a generalized "tail equivalence" on a Bratteli diagram, with its standard AF-relation as a subequivalence relation. Using a generalization of the Anderson-Putnam complex, O is identified with the inverse limit of a sequence of finite CW-complexes. A Bratteli diagram B is built from this sequence, and its set of infinite paths dB is homeomorphic to X. The diagram B is endowed with a horizontal structure: additional edges that encode the adjacencies of patches in T. This allows to define an etale equivalence relation R_B on dB which is homeomorphic to R_X, and contains the AF-relation of "tail equivalence".Comment: 34 pages, 4 figure

Reproductive Safety of Trazodone After Maternal Exposure in Early Pregnancy: A Comparative ENTIS Cohort Study.

Trazodone is indicated for the treatment of major depressive disorder, but more frequently prescribed off-label at lower doses for insomnia in women of childbearing age. The aim of this study was to assess the risks linked to trazodone exposure during pregnancy for which limited safety data are available. This multicenter, observational prospective cohort study compared pregnancy outcomes in women exposed to trazodone in early pregnancy against those in a reference group of women exposed to a selective serotonin reuptake inhibitors (SSRIs) between 1996 and 2021. The sample included 221 trazodone and 869 SSRI-exposed pregnancies. Exposure to trazodone in the first trimester was not associated with a significant difference in the risk of major congenital anomalies (trazodone [1/169, 0.6%]; SSRI [19/730, 2.6%]; adjusted odds ratio, 0.2; 95% confidence interval, 0.03-1.77). The cumulative incidences of live birth were 61% and 73% in the trazodone and reference group, respectively (25% vs 18% for pregnancy loss and 14% vs 10% for pregnancy termination). Trazodone exposure was not associated with a significantly increased risk of pregnancy termination and pregnancy loss. The rate of small for gestational age infants did not differ between the groups. This study did not reveal a significant difference in the risk of major congenital anomalies after first trimester exposure to trazodone, compared with SSRI exposure. Although this study is the largest so far, these results call for confirmation through further studies

State of the Art on Neural Rendering

Efficient rendering of photo-realistic virtual worlds is a long standing effort of computer graphics. Modern graphics techniques have succeeded in synthesizing photo-realistic images from hand-crafted scene representations. However, the automatic generation of shape, materials, lighting, and other aspects of scenes remains a challenging problem that, if solved, would make photo-realistic computer graphics more widely accessible. Concurrently, progress in computer vision and machine learning have given rise to a new approach to image synthesis and editing, namely deep generative models. Neural rendering is a new and rapidly emerging field that combines generative machine learning techniques with physical knowledge from computer graphics, e.g., by the integration of differentiable rendering into network training. With a plethora of applications in computer graphics and vision, neural rendering is poised to become a new area in the graphics community, yet no survey of this emerging field exists. This state-of-the-art report summarizes the recent trends and applications of neural rendering. We focus on approaches that combine classic computer graphics techniques with deep generative models to obtain controllable and photo-realistic outputs. Starting with an overview of the underlying computer graphics and machine learning concepts, we discuss critical aspects of neural rendering approaches. This state-of-the-art report is focused on the many important use cases for the described algorithms such as novel view synthesis, semantic photo manipulation, facial and body reenactment, relighting, free-viewpoint video, and the creation of photo-realistic avatars for virtual and augmented reality telepresence. Finally, we conclude with a discussion of the social implications of such technology and investigate open research problems

Sparsity-based single-shot sub-wavelength coherent diffractive imaging

We present the experimental reconstruction of sub-wavelength features from the far-field intensity of sparse optical objects: sparsity-based sub-wavelength imaging combined with phase-retrieval. As examples, we demonstrate the recovery of random and ordered arrangements of 100 nm features with the resolution of 30 nm, with an illuminating wavelength of 532 nm. Our algorithmic technique relies on minimizing the number of degrees of freedom; it works in real-time, requires no scanning, and can be implemented in all existing microscopes - optical and non-optical

Improving Data Collection in Pregnancy Safety Studies: Towards Standardisation of Data Elements in Pregnancy Reports from Public and Private Partners, A Contribution from the ConcePTION Project

\ua9 2023, The Author(s).Introduction and Objective: The ConcePTION project aims to improve the way medication use during pregnancy is studied. This includes exploring the possibility of developing a distributed data processing and analysis infrastructure using a common data model that could form a foundational platform for future surveillance and research. A prerequisite would be that data from various data access providers (DAPs) can be harmonised according to an agreed set of standard rules concerning the structure and content of the data. To do so, a reference framework of core data elements (CDEs) recommended for primary data studies on drug safety during pregnancy was previously developed. The aim of this study was to assess the ability of several public and private DAPs using different primary data sources focusing on multiple sclerosis, as a pilot, to map their respective data variables and definitions with the CDE recommendations framework. Methods: Four pregnancy registries (Gilenya, Novartis; Aubagio, Sanofi; the Organization of Teratology Information Specialists [OTIS]; Aubagio, Sanofi; the Dutch Pregnancy Drug Register, Lareb), two enhanced pharmacovigilance programmes (Gilenya PRIM, Novartis; MAPLE-MS, Merck Healthcare KGaA) and four Teratology Information Services (UK TIS, Jerusalem TIS, Zerifin TIS, Swiss TIS) participated in the study. The ConcePTION primary data source CDE includes 51 items covering administrative functions, the description of pregnancy, maternal medical history, maternal illnesses arising in pregnancy, delivery details, and pregnancy and infant outcomes. For each variable in the CDE, the DAPs identified whether their variables were: identical to the one mentioned in the CDE; derived; similar but with a divergent definition; or not available. Results: The majority of the DAP data variables were either directly taken (85%, n = 305/357, range 73–94% between DAPs) or derived by combining different variables (12%, n = 42/357, range 0–24% between DAPs) to conform to the CDE variables and definitions. For very few of the DAP variables, alignment with the CDE items was not possible, either because of divergent definitions (1%, n = 3/357, range 0–2% between DAPs) or because the variables were not available (2%, n = 7/357, range 0–4% between DAPs). Conclusions: Data access providers participating in this study presented a very high proportion of variables matching the CDE items, indicating that alignment of definitions and harmonisation of data analysis by different stakeholders to accelerate and strengthen pregnancy pharmacovigilance safety data analyses could be feasible