Geometry Aligned Variational Transformer for Image-conditioned Layout Generation

Layout generation is a novel task in computer vision, which combines the challenges in both object localization and aesthetic appraisal, widely used in advertisements, posters, and slides design. An accurate and pleasant layout should consider both the intra-domain relationship within layout elements and the inter-domain relationship between layout elements and the image. However, most previous methods simply focus on image-content-agnostic layout generation, without leveraging the complex visual information from the image. To this end, we explore a novel paradigm entitled image-conditioned layout generation, which aims to add text overlays to an image in a semantically coherent manner. Specifically, we propose an Image-Conditioned Variational Transformer (ICVT) that autoregressively generates various layouts in an image. First, self-attention mechanism is adopted to model the contextual relationship within layout elements, while cross-attention mechanism is used to fuse the visual information of conditional images. Subsequently, we take them as building blocks of conditional variational autoencoder (CVAE), which demonstrates appealing diversity. Second, in order to alleviate the gap between layout elements domain and visual domain, we design a Geometry Alignment module, in which the geometric information of the image is aligned with the layout representation. In addition, we construct a large-scale advertisement poster layout designing dataset with delicate layout and saliency map annotations. Experimental results show that our model can adaptively generate layouts in the non-intrusive area of the image, resulting in a harmonious layout design.Comment: To be published in ACM MM 202

TextPainter: Multimodal Text Image Generation with Visual-harmony and Text-comprehension for Poster Design

Text design is one of the most critical procedures in poster design, as it relies heavily on the creativity and expertise of humans to design text images considering the visual harmony and text-semantic. This study introduces TextPainter, a novel multimodal approach that leverages contextual visual information and corresponding text semantics to generate text images. Specifically, TextPainter takes the global-local background image as a hint of style and guides the text image generation with visual harmony. Furthermore, we leverage the language model and introduce a text comprehension module to achieve both sentence-level and word-level style variations. Besides, we construct the PosterT80K dataset, consisting of about 80K posters annotated with sentence-level bounding boxes and text contents. We hope this dataset will pave the way for further research on multimodal text image generation. Extensive quantitative and qualitative experiments demonstrate that TextPainter can generate visually-and-semantically-harmonious text images for posters.Comment: Accepted to ACM MM 2023. Dataset Link: https://tianchi.aliyun.com/dataset/16003

Dense Air Quality Sensor Networks: Validation, Analysis and Benefits

Air pollution is known to be harmful for human health and environments. The official air quality monitoring stations have been established across many smart cities around the world. Unfortunately, these monitoring stations are sparsely located and consequently do not provide high resolution spatio- temporal air quality information. This paper demonstrates how a dense sensor network deployment offers significant advantages in providing better and more detailed air quality information. We use data from a dense sensor network consisting of 126 low- cost sensors (LCSs) deployed in a highly populated district in Nanjing downtown, China. Using data obtained from 13 existing reference stations installed in the same district, we propose three LCSs validation methods to evaluate the performance of LCSs in the network. The methods assess the reliability, accuracy tests, and failure and anomaly detection performance. We also demonstrate how the reliable data generated from the sensor network provides deep insights into air pollution information at a higher spatio-temporal resolution. We further discuss potential improvements and applications derived from dense deployment of LCSs in cities.Peer reviewe

Investigation of seasonal changes in lipid synthesis and metabolism-related genes in the oviduct of Chinese brown frog (<em>Rana dybowskii</em>)

A peculiar physiological characteristic of the Chinese brown frog (Rana dybowskii) is that its oviduct dilates during pre-brumation rather than during the breeding season. This research aimed to examine the expression of genes connected with lipid synthesis and metabolism in the oviduct of R. dybowskii during both the breeding season and pre-brumation. We observed significant changes in the weight and size of the oviduct between the breeding season and pre-brumation. Furthermore, compared to the breeding season, pre-brumation exhibited significantly lower triglyceride content and a marked increase in free fatty acid content. Immunohistochemical results revealed the spatial distribution of triglyceride synthase (Dgat1), triglyceride hydrolase (Lpl and Hsl), fatty acid synthase (Fasn), and fatty acid oxidases (Cpt1a, Acadl, and Hadh) in oviductal glandular cells and epithelial cells during both the breeding season and pre-brumation. While the mRNA levels of triglycerides and free fatty acid synthesis genes (dgat1 and fasn) did not show a significant difference between the breeding season and pre-brumation, the mRNA levels of genes involved in triglycerides and free fatty acid metabolism (lpl, cpt1a, acadl, acox and hadh) were considerably higher during pre-brumation. Furthermore, the R. dybowskii oviduct's transcriptomic and metabolomic data confirmed differential expression of genes and metabolites enriched in lipid metabolism signaling pathways during both the breeding season and pre-brumation. Overall, these results suggest that alterations in lipid synthesis and metabolism during pre-brumation may potentially influence the expanding size of the oviduct, contributing to the successful overwintering of R. dybowskii

Volatility of mixed atmospheric humic-like substances and ammonium sulfate particles

The volatility of organic aerosols remains poorly understood due to the complexity of speciation and multiphase processes. In this study, we extracted humic-like substances (HULIS) from four atmospheric aerosol samples collected at the SORPES station in Nanjing, eastern China, and investigated the volatility behavior of particles at different sizes using a Volatility Tandem Differential Mobility Analyzer (VTDMA). In spite of the large differences in particle mass concentrations, the extracted HULIS from the four samples all revealed very high-oxidation states (O : C > 0.95), indicating secondary formation as the major source of HULIS in Yangtze River Delta (YRD). An overall low volatility was identified for the extracted HULIS, with the volume fraction remaining (VFR) higher than 55% for all the regenerated HULIS particles at the temperature of 280 degrees C. A kinetic mass transfer model was applied to the thermodenuder (TD) data to interpret the observed evaporation pattern of HULIS, and to derive the mass fractions of semi-volatile (SVOC), low-volatility (LVOC) and extremely low-volatility components (ELVOC). The results showed that LVOC and ELVOC dominated (more than 80 %) the total volume of HULIS. Atomizing processes led to a size-dependent evaporation of regenerated HULIS particles, and resulted in more ELVOC in smaller particles. In order to understand the role of interaction between inorganic salts and atmospheric organic mixtures in the volatility of an organic aerosol, the evaporation of mixed samples of ammonium sulfate (AS) and HULIS was measured. The results showed a significant but nonlinear influence of ammonium sulfate on the volatility of HULIS. The estimated fraction of ELVOC in the organic part of the largest particles (145 nm) increased from 26 %, in pure HULIS samples, to 93% in 1 : 3 (mass ratio of HULIS : AS) mixed samples, to 45% in 2 : 2 mixed samples, and to 70% in 3 : 1 mixed samples, suggesting that the interaction with ammonium sulfate tends to decrease the volatility of atmospheric organic compounds. Our results demonstrate that HULIS are important low-volatility, or even extremely low-volatility, compounds in the organic-aerosol phase. As important formation pathways of atmospheric HULIS, multiphase processes, including oxidation, oligomerization, polymerization and interaction with inorganic salts, are indicated to be important sources of low-volatility and extremely low-volatility species of organic aerosols.Peer reviewe

The Association Between Diabetic Retinopathy and the Prevalence of Age-Related Macular Degeneration—The Kailuan Eye Study

This study aimed to investigate the prevalence of age-related macular degeneration (AMD) in patients with diabetes mellitus (DM) and diabetic retinopathy (DR) and analyze whether DR is a risk factor for AMD. This population-based epidemiological study included 14,440 people from the Kailuan Eye Study in 2016, of whom 1,618 were patients with type 2 DM aged over 50 years, and 409 had DM with DR. We analyzed whether there were differences in the prevalence of AMD between DM with DR and DM without DR, and conducted a hierarchical statistical analysis according to different stages of DR. Using variable regression analysis, we explored whether DR constituted a risk factor for AMD. In the DM population, the prevalence of wet AMD in patients with DM with and without DR was 0. 3 and 0.2%, respectively, with no significant difference (P = 0.607). Meanwhile, the prevalence of dry AMD in patients with DM with and without DR was 20.8 and 16.0%, respectively, with a significant difference. In the subgroup analysis of dry AMD, the prevalence of early, middle, and late dry AMD in DM with DR was 14.4, 5.9, and 0.5%, respectively. In DM without DR, the prevalence of early, middle, and late dry AMD was 10.5, 4.8, and 0.7%, respectively (P = 0.031). In the subgroup analysis of DR staging, statistical analysis could not be performed because of the limited number of patients with PDR. In the variable regression analysis of risk factors for dry AMD, after adjusting for age, sex, body mass index, hypertension, and dyslipidemia, DR constituted the risk factor for dry AMD. In conclusion, DM did not constitute a risk factor for AMD, and the prevalence of wet AMD and dry AMD in patients with DM and DR was higher than that in patients with DM without DR (among which dry AMD was statistically significant). Multivariate regression analysis confirmed that DR is an independent risk factor for dry AMD. Reasonable control of DM and slowing down the occurrence and development of DR may effectively reduce the prevalence of AMD in patients with DM

Finishing the euchromatic sequence of the human genome

The sequence of the human genome encodes the genetic instructions for human physiology, as well as rich information about human evolution. In 2001, the International Human Genome Sequencing Consortium reported a draft sequence of the euchromatic portion of the human genome. Since then, the international collaboration has worked to convert this draft into a genome sequence with high accuracy and nearly complete coverage. Here, we report the result of this finishing process. The current genome sequence (Build 35) contains 2.85 billion nucleotides interrupted by only 341 gaps. It covers ∼99% of the euchromatic genome and is accurate to an error rate of ∼1 event per 100,000 bases. Many of the remaining euchromatic gaps are associated with segmental duplications and will require focused work with new methods. The near-complete sequence, the first for a vertebrate, greatly improves the precision of biological analyses of the human genome including studies of gene number, birth and death. Notably, the human enome seems to encode only 20,000-25,000 protein-coding genes. The genome sequence reported here should serve as a firm foundation for biomedical research in the decades ahead

Reward Versus Nonreward Sensitivity of the Medial Versus Lateral Orbitofrontal Cortex Relates to the Severity of Depressive Symptoms

BackgroundThe orbitofrontal cortex (OFC) is implicated in depression. The hypothesis investigated was whether the OFC sensitivity to reward and nonreward is related to the severity of depressive symptoms.MethodsActivations in the monetary incentive delay task were measured in the IMAGEN cohort at ages 14 years (n = 1877) and 19 years (n = 1140) with a longitudinal design. Clinically relevant subgroups were compared at ages 19 (high-severity group: n = 116; low-severity group: n = 206) and 14.ResultsThe medial OFC exhibited graded activation increases to reward, and the lateral OFC had graded activation increases to nonreward. In this general population, the medial and lateral OFC activations were associated with concurrent depressive symptoms at both ages 14 and 19 years. In a stratified high-severity depressive symptom group versus control group comparison, the lateral OFC showed greater sensitivity for the magnitudes of activations related to nonreward in the high-severity group at age 19 (p = .027), and the medial OFC showed decreased sensitivity to the reward magnitudes in the high-severity group at both ages 14 (p = .002) and 19 (p = .002). In a longitudinal design, there was greater sensitivity to nonreward of the lateral OFC at age 14 for those who exhibited high depressive symptom severity later at age 19 (p = .003).ConclusionsActivations in the lateral OFC relate to sensitivity to not winning, were associated with high depressive symptom scores, and at age 14 predicted the depressive symptoms at ages 16 and 19. Activations in the medial OFC were related to sensitivity to winning, and reduced reward sensitivity was associated with concurrent high depressive symptom scores