EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE

Building scalable vision-language models to learn from diverse, multimodal data remains an open challenge. In this paper, we introduce an Efficient Vision-languagE foundation model, namely EVE, which is one unified multimodal Transformer pre-trained solely by one unified pre-training task. Specifically, EVE encodes both vision and language within a shared Transformer network integrated with modality-aware sparse Mixture-of-Experts (MoE) modules, which capture modality-specific information by selectively switching to different experts. To unify pre-training tasks of vision and language, EVE performs masked signal modeling on image-text pairs to reconstruct masked signals, i.e., image pixels and text tokens, given visible signals. This simple yet effective pre-training objective accelerates training by 3.5x compared to the model pre-trained with Image-Text Contrastive and Image-Text Matching losses. Owing to the combination of the unified architecture and pre-training task, EVE is easy to scale up, enabling better downstream performance with fewer resources and faster training speed. Despite its simplicity, EVE achieves state-of-the-art performance on various vision-language downstream tasks, including visual question answering, visual reasoning, and image-text retrieval.Comment: Accepted by AAAI 202

Unveiling the roles of Sertoli cells lineage differentiation in reproductive development and disorders: a review

In mammals, gonadal somatic cell lineage differentiation determines the development of the bipotential gonad into either the ovary or testis. Sertoli cells, the only somatic cells in the spermatogenic tubules, support spermatogenesis during gonadal development. During embryonic Sertoli cell lineage differentiation, relevant genes, including WT1, GATA4, SRY, SOX9, AMH, PTGDS, SF1, and DMRT1, are expressed at specific times and in specific locations to ensure the correct differentiation of the embryo toward the male phenotype. The dysregulated development of Sertoli cells leads to gonadal malformations and male fertility disorders. Nevertheless, the molecular pathways underlying the embryonic origin of Sertoli cells remain elusive. By reviewing recent advances in research on embryonic Sertoli cell genesis and its key regulators, this review provides novel insights into sex determination in male mammals as well as the molecular mechanisms underlying the genealogical differentiation of Sertoli cells in the male reproductive ridge

Discovery of potential biomarkers for osteoporosis using LC/GC−MS metabolomic methods

PurposeFor early diagnosis of osteoporosis (OP), plasma metabolomics of OP was studied by untargeted LC/GC−MS in a Chinese elderly population to find possible diagnostic biomarkers.MethodsA total of 379 Chinese community-dwelling older adults aged ≥65 years were recruited for this study. The BMD of the calcaneus was measured using quantitative ultrasound (QUS), and a T value ≤-2.5 was defined as OP. Twenty-nine men and 47 women with OP were screened, and 29 men and 36 women were matched according to age and BMI as normal controls using propensity matching. Plasma from these participants was first analyzed by untargeted LC/GC−MS, followed by FC and P values to screen for differential metabolites and heatmaps and box plots to differentiate metabolites between groups. Finally, metabolic pathway enrichment analysis of differential metabolites was performed based on KEGG, and pathways with P ≤ 0.05 were selected as enrichment pathways.ResultsWe screened metabolites with FC>1.2 or FC<1/1.2 and P<0.05 and found 33 differential metabolites in elderly men and 30 differential metabolites in elderly women that could be potential biomarkers for OP. 2-Aminomuconic acid semialdehyde (AUC=0.72, 95% CI 0.582-0.857, P=0.004) is highly likely to be a biomarker for screening OP in older men. Tetradecanedioic acid (AUC=0.70, 95% CI 0.575-0.818, P=0.004) is highly likely to be a biomarker for screening OP in older women.ConclusionThese findings can be applied to clinical work through further validation studies. This study also shows that metabolomic analysis has great potential for application in the early diagnosis and recurrence monitoring of OP in elderly individuals

Accessibility of DNA polymerases to repair synthesis during nucleotide excision repair in yeast cell-free extracts

Nucleotide excision repair (NER) removes a variety of DNA lesions. Using a yeast cell-free repair system, we have analyzed the repair synthesis step of NER. NER was proficient in yeast mutant cell-free extracts lacking DNA polymerases (Pol) β, ζ or η. Base excision repair was also proficient without Polβ. Repair synthesis of NER was not affected by thermal inactivation of the temperature-sensitive mutant Polα (pol1-17), but was reduced after thermal inactivation of the temperature-sensitive mutant Polδ (pol3-1) or Polɛ (pol2-18). Residual repair synthesis was observed in pol3-1 and pol2-18 mutant extracts, suggesting a repair deficiency rather than a complete repair defect. Deficient NER in pol3-1 and pol2-18 mutant extracts was specifically complemented by purified yeast Polδ and Polɛ, respectively. Deleting the polymerase catalytic domain of Polɛ (pol2-16) also led to a deficient repair synthesis during NER, which was complemented by purified yeast Polɛ, but not by purified yeast Polη. These results suggest that efficient repair synthesis of yeast NER requires both Polδ and Polɛ in vitro, and that the low fidelity Polη is not accessible to repair synthesis during NER

Promising Fungicides from Allelochemicals: Synthesis of Umbelliferone Derivatives and Their Structure–Activity Relationships

Umbelliferone was discovered to be an important allelochemical in our previous study, but the contribution of its activity and structure has not yet been revealed. In this study, a series of analogues were synthesized to determine the skeleton of umbelliferone and examine its fungicidal activity. Furthermore, targeted modifications were conducted with three plant parasitic fungi to examine the lead compounds. Among those tested, compounds 2f and 10 were found to show excellent antifungal activity with an inhibitory rate over 80% at 100 ug/mL. The study proves that umbelliferone can be a promising skeleton for fungicides discovery. In addition, the primary structure⁻activity relationship provides a good guidance for the discovery of novel fungicides based on natural products in the future

Experimental analysis of electric vehicle energy consumption under low temperature and shortened test conditions

With the popularization of electric vehicles, more and more attention has been paid to how to select reasonable test methods to evaluate the driving range of electric vehicles. This paper selects two electric vehicle prototypes with different configurations to test the energy consumption of the shortened test cycle at normal temperature and the standard test cycle at low temperature, and analyzes the constant speed working condition in the shortened method and the CLTC-P working condition at low temperature. The results show that both the 100km/h constant speed working condition and the low temperature working condition will cause a significant increase in the energy consumption of electric vehicles, and the energy consumption difference of repeated cycles under the low temperature test condition will also increase significantly compared with that at room temperature. The relevant results are more A comprehensive understanding and evaluation of the energy consumption characteristics of electric vehicles provides a useful reference

Analysis on the difference of DC energy consumption of electric vehicles under repeat cycles

In order to avoid the problem of too many AC energy consumption cycles and time-consuming for the standard electric vehicle driving range test, the DC energy consumption test can be used to obtain the energy consumption of the test cycle at any time period and estimate the driving range. However, the rationality of intercepting part of the circulating DC energy consumption to estimate the whole process still lacks sufficient experimental support. Therefore, in this paper, two different electric vehicle prototypes were selected, and a complete energy consumption test experiment was carried out according to the standard test process. Through the test of DC energy consumption, the difference characteristics of electric vehicle driving braking energy and energy consumption under repeated cycles were analyzed. The fluctuation range provides data support for the use of DC power to evaluate the energy consumption of electric vehicle