PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layout

Content-aware visual-textual presentation layout aims at arranging spatial space on the given canvas for pre-defined elements, including text, logo, and underlay, which is a key to automatic template-free creative graphic design. In practical applications, e.g., poster designs, the canvas is originally non-empty, and both inter-element relationships as well as inter-layer relationships should be concerned when generating a proper layout. A few recent works deal with them simultaneously, but they still suffer from poor graphic performance, such as a lack of layout variety or spatial non-alignment. Since content-aware visual-textual presentation layout is a novel task, we first construct a new dataset named PosterLayout, which consists of 9,974 poster-layout pairs and 905 images, i.e., non-empty canvases. It is more challenging and useful for greater layout variety, domain diversity, and content diversity. Then, we propose design sequence formation (DSF) that reorganizes elements in layouts to imitate the design processes of human designers, and a novel CNN-LSTM-based conditional generative adversarial network (GAN) is presented to generate proper layouts. Specifically, the discriminator is design-sequence-aware and will supervise the "design" process of the generator. Experimental results verify the usefulness of the new benchmark and the effectiveness of the proposed approach, which achieves the best performance by generating suitable layouts for diverse canvases.Comment: Accepted to CVPR 2023. Dataset and code are available at https://github.com/PKU-ICST-MIPL/PosterLayout-CVPR202

Improving Audio-Visual Segmentation with Bidirectional Generation

The aim of audio-visual segmentation (AVS) is to precisely differentiate audible objects within videos down to the pixel level. Traditional approaches often tackle this challenge by combining information from various modalities, where the contribution of each modality is implicitly or explicitly modeled. Nevertheless, the interconnections between different modalities tend to be overlooked in audio-visual modeling. In this paper, inspired by the human ability to mentally simulate the sound of an object and its visual appearance, we introduce a bidirectional generation framework. This framework establishes robust correlations between an object's visual characteristics and its associated sound, thereby enhancing the performance of AVS. To achieve this, we employ a visual-to-audio projection component that reconstructs audio features from object segmentation masks and minimizes reconstruction errors. Moreover, recognizing that many sounds are linked to object movements, we introduce an implicit volumetric motion estimation module to handle temporal dynamics that may be challenging to capture using conventional optical flow methods. To showcase the effectiveness of our approach, we conduct comprehensive experiments and analyses on the widely recognized AVSBench benchmark. As a result, we establish a new state-of-the-art performance level in the AVS benchmark, particularly excelling in the challenging MS3 subset which involves segmenting multiple sound sources. To facilitate reproducibility, we plan to release both the source code and the pre-trained model.Comment: Dawei Hao and Yuxin Mao contribute equality to this paper. Yiran Zhong is the corresponding author. The code will be released at https://github.com/OpenNLPLab/AVS-bidirectiona

Human osteopontin: potential clinical applications in cancer (Review)

Human osteopontin (OPN) is a glycosylated phosphoprotein which is expressed in a variety of tissues in the body. In recent years, accumulating evidence has indicated that the aberrant expression of OPN is closely associated with tumourigensis, progression and most prominently with metastasis in several tumour types. In this review, we present the current knowledge on the expression profiles of OPN and its main splice variants in human cancers, as well as the potential implications in patient outcome. We also discuss its putative clinical application as a cancer biomarker and as a therapeutic target

Follicular regulatory T cells repress cytokine production by follicular helper T cells and optimize IgG responses in mice

Follicular helper T (Tfh) cells provide crucial help to germinal center B (GCB) cells for proper antibody production, and a specialized subset of regulatory T cells, follicular regulatory T (Tfr) cells, modulate this process. However, Tfr-cell function in the GC is not well understood. Here, we define Tfr cells as a CD4(+) Foxp3(+) CXCR5(hi) PD-1(hi) CD25(low) TIGIT(high) T-cell population. Furthermore, we have used a novel mouse model ("Bcl6FC") to delete the Bcl6 gene in Foxp3(+) T cells and thus specifically deplete Tfr cells. Following immunization, Bcl6FC mice develop normal Tfh- and GCB-cell populations. However, Bcl6FC mice produce altered antigen-specific antibody responses, with reduced titers of IgG and significantly increased IgA. Bcl6FC mice also developed IgG antibodies with significantly decreased avidity to antigen in an HIV-1 gp120 "prime-boost" vaccine model. In an autoimmune lupus model, we observed strongly elevated anti-DNA IgA titers in Bcl6FC mice. Additionally, Tfh cells from Bcl6FC mice consistently produce higher levels of Interferon-γ, IL-10 and IL-21. Loss of Tfr cells therefore leads to highly abnormal Tfh-cell and GCB-cell responses. Overall, our study has uncovered unique regulatory roles for Tfr cells in the GC response

Improvement of magnetite adsorption performance for Pb (II) by introducing defects

Surface defect engineering is an efficient strategy to enhance the adsorption properties of materials. After calcination in argon, the adsorption capacity of natural magnetite to Pb (II) is significantly improved. The Rietveld refinement, Mössbauer spectrum, and XPS were used to prove the existence of oxygen and cation vacancies in the crystal structure of magnetite after calcination, and it is found that the vacancy content is linearly related to the adsorption amount of Pb (II). This indicates that the increase in the adsorption performance of magnetite after calcination is determined by the vacancy. The adsorption capacity increases from 8 to 26 mg/g when the calcination temperature reaches 700°C. The equilibrium adsorption process of Pb (II) on magnetite can be well fitted to the Langmuir model, and the kinetic adsorption followed a pseudo-second-order mechanism. The improvement of the adsorption performance of magnetite is mainly due to the change in its structure, which depends on the oxidation degree and surface effect of magnetite in the calcination process. This work also provides a theoretical basis for the broad application of magnetite as environmental material