Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive Learning

Recently, multi-modal vision-language foundation models have gained significant attention in the medical field. While these models offer great opportunities, they still face a number of challenges, such as the requirement for fine-grained knowledge understanding in computer-aided diagnosis and capability of utilizing very limited or no task-specific labeled data in real-world clinical applications. In this study, we present MaCo, a novel multi-modal medical foundation model that explores masked contrastive learning to achieve granular alignment and zero-shot learning for a variety of medical imaging tasks. MaCo incorporates a correlation weighting mechanism to adjust the correlation between masked image patches and their corresponding reports, thereby enhancing the representation learning capabilities. We evaluate MaCo on six well-known open-source X-ray datasets, and the experimental results show it outperforms seven state-of-the-art approaches for classification, segmentation, and zero-shot phase grounding, demonstrating its great potential to promote a wide range of medical image analysis tasks

LiSum: Open Source Software License Summarization with Multi-Task Learning

Open source software (OSS) licenses regulate the conditions under which users can reuse, modify, and distribute the software legally. However, there exist various OSS licenses in the community, written in a formal language, which are typically long and complicated to understand. In this paper, we conducted a 661-participants online survey to investigate the perspectives and practices of developers towards OSS licenses. The user study revealed an indeed need for an automated tool to facilitate license understanding. Motivated by the user study and the fast growth of licenses in the community, we propose the first study towards automated license summarization. Specifically, we released the first high quality text summarization dataset and designed two tasks, i.e., license text summarization (LTS), aiming at generating a relatively short summary for an arbitrary license, and license term classification (LTC), focusing on the attitude inference towards a predefined set of key license terms (e.g., Distribute). Aiming at the two tasks, we present LiSum, a multi-task learning method to help developers overcome the obstacles of understanding OSS licenses. Comprehensive experiments demonstrated that the proposed jointly training objective boosted the performance on both tasks, surpassing state-of-the-art baselines with gains of at least 5 points w.r.t. F1 scores of four summarization metrics and achieving 95.13% micro average F1 score for classification simultaneously. We released all the datasets, the replication package, and the questionnaires for the community

OsteoporosAtlas: a human osteoporosis-related gene database

Background Osteoporosis is a common, complex disease of bone with a strong heritable component, characterized by low bone mineral density, microarchitectural deterioration of bone tissue and an increased risk of fracture. Due to limited drug selection for osteoporosis and increasing morbidity, mortality of osteoporotic fractures, osteoporosis has become a major health burden in aging societies. Current researches for identifying specific loci or genes involved in osteoporosis contribute to a greater understanding of the pathogenesis of osteoporosis and the development of better diagnosis, prevention and treatment strategies. However, little is known about how most causal genes work and interact to influence osteoporosis. Therefore, it is greatly significant to collect and analyze the studies involved in osteoporosis-related genes. Unfortunately, the information about all these osteoporosis-related genes is scattered in a large amount of extensive literature. Currently, there is no specialized database for easily accessing relevant information about osteoporosis-related genes and miRNAs. Methods We extracted data from literature abstracts in PubMed by text-mining and manual curation. Moreover, a local MySQL database containing all the data was developed with PHP on a Windows server. Results OsteoporosAtlas (http://biokb.ncpsb.org/osteoporosis/), the first specialized database for easily accessing relevant information such as osteoporosis-related genes and miRNAs, was constructed and served for researchers. OsteoporosAtlas enables users to retrieve, browse and download osteoporosis-related genes and miRNAs. Gene ontology and pathway analyses were integrated into OsteoporosAtlas. It currently includes 617 human encoding genes, 131 human non-coding miRNAs, and 128 functional roles. We think that OsteoporosAtlas will be an important bioinformatics resource to facilitate a better understanding of the pathogenesis of osteoporosis and developing better diagnosis, prevention and treatment strategies

The role of inflammatory biomarkers in the development and progression of pre-eclampsia: a systematic review and meta-analysis

BackgroundPre-eclampsia (PE) is a pregnancy complication associated with maternal and fetal morbidity and mortality. Among the potential pathogenesis discussed, inflammation is considered an essential initiator of PE. Previous studies have compared the levels of various inflammatory biomarkers that indicate the existence of PE; however, the relative levels of pro-inflammatory and anti-inflammatory biomarkers and their dynamic changes during PE progression remain unclear. This knowledge is essential to explain the occurrence and progression of the disease.ObjectiveWe aimed to identify the relationship between inflammatory status and PE using inflammatory biomarkers as indicators. We also discussed the underlying mechanism by which inflammatory imbalance contributes to PE by comparing the relative levels of pro-inflammatory and anti-inflammatory biomarkers. Furthermore, we identified additional risk factors for PE.MethodsWe reviewed PubMed, Embase, and the Cochrane Library for articles published until 15th September 2022. Original articles that investigated inflammatory biomarkers in PE and normal pregnancy were included. We selected healthy pregnant women as controls. The inflammatory biomarkers in the case and control groups were expressed as standardized mean differences and 95% confidence intervals using a random-effects model. Study quality was assessed using the Newcastle-Ottawa Scale. Publication bias was assessed using Egger’s test.ResultsThirteen articles that investigated 2,549 participants were included in this meta-analysis. Patients with PE had significantly higher levels of C-reactive protein (CRP), interleukin (IL)-4, IL-6, IL-8, IL-10, and tumor necrosis factor (TNF) than the controls. CRP and pro-inflammatory cytokine levels were higher than those of anti-inflammatory cytokines. Patients with gestational age > 34 weeks had significantly higher IL-6 and TNF levels. Patients with higher systolic blood pressure had significantly higher IL-8, IL-10, and CRP levels.ConclusionInflammatory imbalance is an independent risk factor for PE development. Impairment of the anti-inflammatory system is a crucial initiating factor for PE development. Failed autoregulation, manifested as prolonged exposure to pro-inflammatory cytokines, leads to PE progression. Higher levels of inflammatory biomarkers suggest more severe symptoms, and pregnant women after 34 weeks of gestation are more susceptible to PE

AllTogether: Investigating the Efficacy of Spliced Prompt for Web Navigation using Large Language Models

Large Language Models (LLMs) have emerged as promising agents for web navigation tasks, interpreting objectives and interacting with web pages. However, the efficiency of spliced prompts for such tasks remains underexplored. We introduces AllTogether, a standardized prompt template that enhances task context representation, thereby improving LLMs' performance in HTML-based web navigation. We evaluate the efficacy of this approach through prompt learning and instruction finetuning based on open-source Llama-2 and API-accessible GPT models. Our results reveal that models like GPT-4 outperform smaller models in web navigation tasks. Additionally, we find that the length of HTML snippet and history trajectory significantly influence performance, and prior step-by-step instructions prove less effective than real-time environmental feedback. Overall, we believe our work provides valuable insights for future research in LLM-driven web agents.Comment: Include wrong information in comment. Should be 7 pages and not published ye

Evaporation Effect on Thickness Distribution for Spin-Coated Films on Rectangular and Circular Substrates

Spin-coating is widely applied in the field of thin-film fabrication due to its simplicity and high film uniformity. To prepare thin films on rectangular substrates by spin-coating, the simulation and experimental methods were used to study the characteristics of the film thickness in this work. The two-phase flow simulations of spin-coating on a rectangular substrate and circular substrate were carried out with the volume of fluid (VOF) method. The simulation results showed that the airflow field and the substrate geometry had little effect on the evolution of spin-coated film thickness. However, in the experimental results, there was a significant difference in the thickness of the spin-coated film on the rectangular substrate and the circular substrate. According to further study, the solvent evaporation that was neglected in the simulation was the dominant factor of the differences. In addition, it was concluded that the non-uniform evaporation caused by the surface tension and edge accumulation in the later spin-coating stage was the main reason for the film accumulation of the windward area on the rectangular substrate. This work is useful to obtain a deeper understanding of the thin-film formation mechanism of spin-coating

Meta-DM: Applications of Diffusion Models on Few-Shot Learning

In the field of few-shot learning (FSL), extensive research has focused on improving network structures and training strategies. However, the role of data processing modules has not been fully explored. Therefore, in this paper, we propose Meta-DM, a generalized data processing module for FSL problems based on diffusion models. Meta-DM is a simple yet effective module that can be easily integrated with existing FSL methods, leading to significant performance improvements in both supervised and unsupervised settings. We provide a theoretical analysis of Meta-DM and evaluate its performance on several algorithms. Our experiments show that combining Meta-DM with certain methods achieves state-of-the-art results

Effect of transverse flow in porous medium on heat exchanger simulation optimization

To improve the accuracy of heat exchanger computational fluid dynamics (CFD) simulations, the transverse resistance coefficient of the cold side and the hot side of the water-cooled charge air cooler (WCCAC) is calculated using the fin element method, and the influence of several common factors on the resistance coefficient of the fin element is analyzed. The transverse resistance coefficient obtained from the simulation of the fin element is substituted into the WCCAC model and compared with experimental data. It was found that the fin element method can simulate the flow field of the WCCAC accurately, and the simulation results were closer to the experimental curve compared with the empirical method. This study provides guidance for the optimal design of the heat exchanger and is helpful to shorten the development time and to save costs.The accepted manuscript in pdf format is listed with the files at the bottom of this page. The presentation of the authors' names and (or) special characters in the title of the manuscript may differ slightly between what is listed on this page and what is listed in the pdf file of the accepted manuscript; that in the pdf file of the accepted manuscript is what was submitted by the author