TiMix: Text-aware Image Mixing for Effective Vision-Language Pre-training

Self-supervised Multi-modal Contrastive Learning (SMCL) remarkably advances modern Vision-Language Pre-training (VLP) models by aligning visual and linguistic modalities. Due to noises in web-harvested text-image pairs, however, scaling up training data volume in SMCL presents considerable obstacles in terms of computational cost and data inefficiency. To improve data efficiency in VLP, we propose Text-aware Image Mixing (TiMix), which integrates mix-based data augmentation techniques into SMCL, yielding significant performance improvements without significantly increasing computational overhead. We provide a theoretical analysis of TiMixfrom a mutual information (MI) perspective, showing that mixed data samples for cross-modal contrastive learning implicitly serve as a regularizer for the contrastive loss. The experimental results demonstrate that TiMix exhibits a comparable performance on downstream tasks, even with a reduced amount of training data and shorter training time, when benchmarked against existing methods. This work empirically and theoretically demonstrates the potential of data mixing for data-efficient and computationally viable VLP, benefiting broader VLP model adoption in practical scenarios.Comment: Accepted on AAAI202

Bis(2-amino-5-methyl-1,3,4-thia­diazole-κN 3)dichloridocobalt(II)

In the monomeric title complex, [CoCl2(C3H5N3S)2], the CoII atom is tetra­coordinated by two chloride anions and two N atoms from two monodentate 2-amino-5-methyl-1,3,4-thia­diazole ligands, giving a slightly distorted tetra­hedral stereochemistry [bond angle range about Co = 105.16 (12)–112.50 (10)°]. In the complex, the dihedral angle between the 1,3,4-thia­diazole planes in the two ligands is 72.8 (1)°. There are two intra­molecular N—H⋯Cl inter­actions in the complex unit, while in the crystal, inter­molecular N—H⋯N and N—H⋯Cl hydrogen bonds link these units into a two-dimensional layered structure parallel to (011)

Effects of endogenous dopamine induced by low concentration atropine eye drops on choroidal neovascularization in high myopia mice

AIM: To evaluate effects of endogenous dopamine induced by low concentration atropine eye drops on choroidal neovascularization (CNV) in high myopia mice. METHODS: The C57BL/6J mice were deprived of the right eye for 4wk, and the high myopia was diagnosed by optometry, the diopter was less than -6.00 D, and CNV was induced by 532 nm laser. The changes of dopamine D1 receptor (DRD1), dopamine D2 receptor (DRD2), and vascular endothelial growth factor A (VEGFA) were detected by Western blot technology at 0.5, 1, 2h, and 7d after 0.01%, 0.05%, and 0.1% atropine eye drops, respectively, the area of CNV was measured. RESULTS: Significant increases were observed on the expression of DRD2 in mouse high myopia model at 0.5, 1, 2h, 7d with 0.05% and 0.1% atropine eye drops (P<0.05). Significant decreases were observed on the expression of DRD1 and VEGFA in mouse high myopia model at 0.5, 1, 2h, 7d with 0.05% and 0.1% atropine eye drops (P<0.05). The area of CNV induced by laser in the drug-treated group was significantly smaller than that in the control group, and the higher the concentration, the more significant the inhibitory effect (P<0.05). CONCLUSION: The 0.01%, 0.05%, 0.1% atropine eye drops can decrease the level of VEGFA and inhibit high myopia CNV indirectly by up-regulating the level of DRD2 and down-regulating the level of DRD1, and the effect of 0.05% and 0.1% atropine eye drops is more significant

Dependence of Molecular Cloud Samples on Angular Resolution, Sensitivity, and Algorithms

In this work, we investigate the observational and algorithmic effects on molecular cloud samples identified from position-position-velocity (PPV) space. By smoothing and cutting off the high quality data of the Milky Way Imaging Scroll Painting (MWISP) survey, we extract various molecular cloud samples from those altered data with the DBSCAN (density-based spatial clustering of applications with noise) algorithm. Those molecular cloud samples are subsequently used to gauge the significance of sensitivity, angular/velocity resolution, and DBSCAN parameters. Two additional surveys, the FCRAO Outer Galaxy Survey (OGS) and the CfA-Chile 1.2 m complete CO (CfA-Chile) survey, are used to verify the MWISP results. We found that molecular cloud catalogs are not unique and the boundary and therefore the number shows strong variation with angular resolution and sensitivity. At low angular resolution (large beam sizes), molecular clouds merge together in PPV space, while low sensitivity (high cutoffs) misses small faint molecular clouds and takes bright parts of large molecular clouds as single ones. At high angular resolution and sensitivity, giant molecular clouds (GMCs) are resolved into individual clouds, and their diffuse components are also revealed. Consequently, GMCs are more appropriately interpreted as clusters or aggregates of molecular clouds, i.e., GMCs represent molecular cloud samples themselves.Comment: 25 pages, 21 figures. Accepted for publication in A