ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation

Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of vision-language tasks. Prior arts usually focus on how to align visual and textual features, but strategies for improving the robustness of model and speeding up model convergence are left insufficiently explored. In this paper, we propose a novel method ViLTA, comprising of two components to further facilitate the model to learn fine-grained representations among image-text pairs. For Masked Language Modeling (MLM), we propose a cross-distillation method to generate soft labels to enhance the robustness of model, which alleviates the problem of treating synonyms of masked words as negative samples in one-hot labels. For Image-Text Matching (ITM), we leverage the current language encoder to synthesize hard negatives based on the context of language input, encouraging the model to learn high-quality representations by increasing the difficulty of the ITM task. By leveraging the above techniques, our ViLTA can achieve better performance on various vision-language tasks. Extensive experiments on benchmark datasets demonstrate that the effectiveness of ViLTA and its promising potential for vision-language pre-training.Comment: 15 pages, 5 figure

TGFBI promoter hypermethylation correlating with paclitaxel chemoresistance in ovarian cancer

The purpose of this study is to determine the methylation status of Transforming growth factor-beta-inducible gene-h3 (TGFBI) and its correlation with paclitaxel chemoresistance in ovarian cancer. The methylation status of TGFBI was examined in ovarian cancer and control groups by methylation-specific PCR (MSP) and bisulfite sequencing PCR (BSP). The TGFBI expression and cell viability were compared by Quantitative Real-Time PCR, Western Blotting and MTT assay before and after demethylating agent 5-aza-2'-deoxycytidine (5-aza-dc) treatment in 6 cell lines (SKOV3, SKOV3/TR, SKOV3/DDP, A2780, 2780/TR, OVCAR8). In our results, TGFBI methylation was detected in 29/40 (72.5%) of ovarian cancer and 1/10 (10%) of benign ovarian tumors. No methylation was detected in normal ovarian tissues (P < 0.001). No statistical correlation between RUNX3 methylation and clinicopathological characteristics was observed. A significant correlation between TGFBI methylation and loss of TGFBI mRNA expression was found (P < 0.001). The methylation level of TGFBI was significantly higher in paclitaxel resistant cell lines (SKOV3/TR and 2780/TR) than that in the sensitive pairs (P < 0.001). After 5-aza-dc treatment, the relative expression of TGFBI mRNA and protein increased significantly in SKOV3/TR and A2780/TR cells. However, no statistical differences of relative TGFBI mRNA expression and protein were found in other cells (all P > 0.05), which showed that re-expression of TGFBI could reverse paclitaxel chemoresistance. Our results show that TGFBI is frequently methylated and associated with paclitaxel-resistance in ovarian cancer. TGFBI might be a potential therapeutic target for the enhancement of responses to chemotherapy in ovarian cancer patients

A Study of Pulsed Blowing Effect on Flow Separation over Flap

ABSTRACT A model with main wing and flap which is based on NACA0025 airfoil is used in this paper to study the pulsed blowing effect on flow separation over flap. The effects of average blowing momentum coefficient and Stroul number on flow separation over the flap have been discussed at first. Furthermore, thecontrol effect of this pulsed blowing technique under different deflection angle of flap isdiscussed to make sure whether the control effect of pulsed blowing can meet the needs under different deflection angle of flap. All the research works have been finished by numerical simulation method under conditions of 0deg angle of attack of the main wing. NOMENCLATUR

Comparison of the clinical characteristics and prognosis between clear cell carcinomas and high-grade serous ovarian carcinomas

Objectives: To compare the clinical characteristics and prognosis of women with clear cell versus high-grade serous ovarian carcinoma. Material and methods: Retrospective analysis of the clinical data of 50 cases patients with ovarian clear cell carcinoma (OCCC) and 103 cases with high-grade serous ovarian carcinoma (HGSOC), who were initially treated and completed standardized therapy in Affiliated Hospital of Qingdao University from January 2013 to December 2017. Results: There were significant differences in age, gravidity (G &gt; 1), chief complaint, with ovarian endometriosis, tumor diameter, unilateral or bilateral, cystic and solid tumor, CA125, HE4, CA199, lactate dehydrogenase (LDH), and FIGO stage between the two groups. The differences in the prognosis between OCCC patients and HGSOC patients with early stage (FIGO I–II) were not statistically significant. The 5-year overall survival and progression-free survival of OCCC patients were significantly worse than those of HGSOC patients with advanced stage (FIGO III–IV) (p &lt; 0.05). FIGO stage and non-R0 resection were independent risk factors affecting the prognosis of patients with ovarian clear cell carcinoma, screening by Cox regression analysis. FIGO stage, the lowest value of CA125, and non-R0 resection were independent risk factors affecting the prognosis of patients with high-grade serous ovarian cancer. Conclusions: The clinical characteristics and prognosis of OCCC are different from those of HGSOC. Ovarian clear cell carcinoma (OCCC) patients have a significantly worse prognosis than those with HGSOC in the advanced stage (FIGO Ⅲ–Ⅳ). Satisfactory tumor resection is an essential factor related to the prognosis of patients with OCCC and HGSOC

Association of N-nitrosodimethylamine exposure with cognitive impairment based on the clues of mice and humans

N-nitrosodimethylamine (NDMA) is an environmental and food contaminant, but limited data to concern whether NDMA has adverse effects on the brain. This study first determined the concentration of NDMA in foods from aquaculture markets in Shenzhen, then analyzed the effects on C57BL/6 mice and further evaluated on the urine samples of elderly Chinese residents with normal cognition (NC, n = 144), cognitive decline (CD, n = 116) and mild cognitive impairment (MCI, n = 123). The excessive rate of NDMA in foods was 3.32% (27/813), with a exceeding range of 4.78–131.00 μg/kg. Behavioral tests showed that 60 days treatment of mice with 3 mg/kg NDMA reduced cognitive performance. Cognitive impairment in human was significantly associated with sex, educational levels, length of residence in Shenzhen, household registration, passive smoking, rice, fresh vegetables, bacon products. NDMA was detected in 55.4% (212/383) of urine samples, with a median concentration of 0.23 μg/L (1.20 × 10 –7–157.39 μg/L). The median concentration for NC, CD and MCI were 0.32, 0.27, and 0 μg/L, respectively. The urinary NDMA concentration had a strong negative correlation with cognitive impairment (Kendall’s Tau-b = −0.89, P = 0.024). The median estimated daily intake (EDI) of NDMA was determined to be 6.63 ng/kg-bw/day. Taken together, there appears to be an association between NDMA and human and murine cognition, which provides a new clue to Alzheimer’s disease (AD)

Distinct miRNAs associated with various clinical presentations of SARS-CoV-2 infection.

MicroRNAs (miRNAs) have been shown to play important roles in viral infections, but their associations with SARS-CoV-2 infection remain poorly understood. Here, we detected 85 differentially expressed miRNAs (DE-miRNAs) from 2,336 known and 361 novel miRNAs that were identified in 233 plasma samples from 61 healthy controls and 116 patients with COVID-19 using the high-throughput sequencing and computational analysis. These DE-miRNAs were associated with SASR-CoV-2 infection, disease severity, and viral persistence in the patients with COVID-19, respectively. Gene ontology and KEGG pathway analyses of the DE-miRNAs revealed their connections to viral infections, immune responses, and lung diseases. Finally, we established a machine learning model using the DE-miRNAs between various groups for classification of COVID-19 cases with different clinical presentations. Our findings may help understand the contribution of miRNAs to the pathogenesis of COVID-19 and identify potential biomarkers and molecular targets for diagnosis and treatment of SARS-CoV-2 infection

Equilibrium Mean Value of Random Fuzzy Variable and Its Convergence Properties

Abstract The equilibrium measure is a natural extension of both probability and credibility measures. The convergence modes of random fuzzy variables with respect to equilibrium measure is an important issue for research. In this paper, we first introduce several convergence concepts for sequences of random fuzzy variables, including convergence in equilibrium measure and convergence in equilibrium distribution. Then we deal with the properties of the convergence modes of random fuzzy variables. The equilibrium mean value of random fuzzy variable with respect to equilibrium measure is also defined by nonlinear integral. For sequence of integrable random fuzzy variables, we deal with the important monotone convergence theorems as well as dominated convergence theorems. The convergent results obtained in this paper have potential applications in the approximation scheme of equilibrium optimization models

Nose micro-blowing for asymmetric vortices control on blunt-nose slender body at high angle of attack

The asymmetric vortices over blunt-nose slender body at high angles of attack result in random side force. In this paper, a nose micro-blowing technology is used to control the asymmetric flow. Pressure measurement and particle image velocimetry (PIV) experiments are conducted in a low-speed wind tunnel to research effects of jet flow rate on asymmetric vortices over blunt-nose slender body. The angle of attack of the model is fixed at 50° and the Reynolds number for the experiments is 1.6×10 5 based on diameter of aftbody. A blow hole (5 mm in diameter) on the nose is processed at circumferential angle θb= 90° and meridian angle γb= 20° with jet momentum ratio Cμ ranging from 5.30×10-7 to 1.19×10−4. Tests are made under two kinds of perturbations. One is called single perturbation with only blow hole and the other is called combined perturbation consists of blow hole and additional granules set on nose. The results show that whether the model has the single perturbation or the combined one, the sectional side force of x/D = 3 varies in the same direction with the increasement of Cμ and remains stable when Cμ is greater than 3.29×10−6. But the stable force values are different according to various perturbations. The fact proves that the size and direction of the side force of blunt-nose slender body can be controlled by the nose micro-blowing