ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation

Vision-language pre-training (VLP) methods are blossoming recently, and its crucial goal is to jointly learn visual and textual features via a transformer-based architecture, demonstrating promising improvements on a variety of vision-language tasks. Prior arts usually focus on how to align visual and textual features, but strategies for improving the robustness of model and speeding up model convergence are left insufficiently explored. In this paper, we propose a novel method ViLTA, comprising of two components to further facilitate the model to learn fine-grained representations among image-text pairs. For Masked Language Modeling (MLM), we propose a cross-distillation method to generate soft labels to enhance the robustness of model, which alleviates the problem of treating synonyms of masked words as negative samples in one-hot labels. For Image-Text Matching (ITM), we leverage the current language encoder to synthesize hard negatives based on the context of language input, encouraging the model to learn high-quality representations by increasing the difficulty of the ITM task. By leveraging the above techniques, our ViLTA can achieve better performance on various vision-language tasks. Extensive experiments on benchmark datasets demonstrate that the effectiveness of ViLTA and its promising potential for vision-language pre-training.Comment: 15 pages, 5 figure

A family of dual-anion-based sodium superionic conductors for all-solid-state sodium-ion batteries

The sodium (Na) superionic conductor is a key component that could revolutionize the energy density and safety of conventional Na-ion batteries. However, existing Na superionic conductors are primarily based on a single-anion framework, each presenting inherent advantages and disadvantages. Here we introduce a family of amorphous Na-ion conductors (Na2O2-MCly, M = Hf, Zr and Ta) based on the dual-anion framework of oxychloride. Benefiting from a dual-anion chemistry and with the resulting distinctive structures, Na2O2-MCly electrolytes exhibit room-temperature ionic conductivities up to 2.0 mS cm-1, wide electrochemical stability windows and desirable mechanical properties. All-solid-state Na-ion batteries incorporating amorphous Na2O2-HfCl4 electrolyte and a Na0.85Mn0.5Ni0.4Fe0.1O2 cathode exhibit a superior rate capability and long-term cycle stability, with 78% capacity retention after 700 cycles under 0.2 C (1C = 120 mA g-1) at room temperature. The discoveries in this work could trigger a new wave of enthusiasm for exploring new superionic conductors beyond those based on a single-anion framework

Spatial and temporal characterization of critical ecosystem services in China’s terrestrial area, 2000–2020: trade-off synergies, driving mechanisms and functional zoning

Identifying ecosystem service functions, clarifying the spatiotemporal trade-offs and synergies of terrestrial ecosystem services and their driving mechanisms, and exploring differentiated ecological functional zoning are crucial steps in achieving healthy regional ecosystem management, and are conducive to developing diversified ecological restoration strategies, establishing a robust cross-regional collaborative management mechanism, implementing differentiated ecological management strategies, and contributing to the construction of a Beautiful China. This paper, based on the InVEST model, Pearson correlation, GeoDetector, and Spatiotemporal Geographically Weighted Regression models, constructs a spatial quantification model of the trade-offs and synergies among five key ecosystem service functions—habitat quality, soil retention, water conservation, food supply, and carbon sequestration—of China’s terrestrial ecosystems from 2000 to 2020. It explores the influencing factors of terrestrial ecosystem services in China and their spatiotemporal heterogeneity, thereby investigating the future strategies for ecological functional zoning and management of China’s national land space. The results indicate that: (1) during 2000–2020, China’s food supply and soil conservation have increased. However, the habitat quality, water conservation, and carbon sequestration have decreased. (2) Significant spatial and temporal heterogeneities exist in the key ecosystem services of China’s terrestrial ecosystems. (3) Natural, economic, and social factors all impact China’s terrestrial key ecosystem services. Among them, slope, annual average precipitation, land development intensity, and vegetation coverage are the main influencing factors, and different factors exhibit significant spatial heterogeneity. (4) Significant trade-offs/synergy effects among critical terrestrial ecosystem services exist in China. (5) China’s national territory is divided into four ecological protection functional zones: ecological restoration areas, ecological control areas, resilient development areas, and ecological conservation areas, and explores differentiated zoning optimization control paths

CogVLM: Visual Expert for Pretrained Language Models

We introduce CogVLM, a powerful open-source visual language foundation model. Different from the popular shallow alignment method which maps image features into the input space of language model, CogVLM bridges the gap between the frozen pretrained language model and image encoder by a trainable visual expert module in the attention and FFN layers. As a result, CogVLM enables deep fusion of vision language features without sacrificing any performance on NLP tasks. CogVLM-17B achieves state-of-the-art performance on 10 classic cross-modal benchmarks, including NoCaps, Flicker30k captioning, RefCOCO, RefCOCO+, RefCOCOg, Visual7W, GQA, ScienceQA, VizWiz VQA and TDIUC, and ranks the 2nd on VQAv2, OKVQA, TextVQA, COCO captioning, etc., surpassing or matching PaLI-X 55B. Codes and checkpoints are available at https://github.com/THUDM/CogVLM

Use of Traditional Chinese Medicine and Its Impact on Medical Cost among Urban Ischemic Stroke Inpatients in China: A National Cross-Sectional Study

Background. Traditional Chinese medicine (TCM) has long been widely adopted by the Chinese people and has been covered by China’s basic medical insurance schemes to treat ischemic stroke. Previous research has mainly highlighted the therapy effect of TCM on ischemic stroke patients. Some studies have demonstrated that employing TCM can reduce the medical burden on other diseases. But no research has explored whether using TCM could reduce inpatient medical cost for ischemic stroke in mainland China. The purpose of this study is to investigate the impact of the use of TCM on the total inpatient cost of ischemic stroke and to explore whether TCM has played the role of being complementary to, or an alternative for, conventional medicine to treat ischemic stroke. Methods. We conducted a national cross-sectional analysis based on a 5% random sample from claims data of China Urban Employee Basic Medical Insurance (UEBMI) and Urban Resident Basic Medical Insurance (URBMI) schemes in 2015. Mann–Whitney test was used to compare unadjusted total inpatient cost, conventional medication cost, and nonpharmacy cost estimates. Ordinary least square regression analysis was performed to compare demographics-adjusted total inpatient cost and to examine the association between TCM cost and conventional medication cost. Results. A total of 47321 urban inpatients diagnosed with ischemic stroke were identified in our study, with 92.6% (43843) of the patients using TCM in their inpatient treatment. Total inpatient cost for TCM users was significantly higher than TCM nonusers (USD 1217 versus USD 1036, P<0.001). Conventional medication cost was significantly lower for TCM users (USD 335 versus USD 436, P<0.001). The average cost of TCM per patient among TCM users was USD 289. Among TCM users, conventional medication costs were found to be positively associated with TCM cost after adjusting for confounding factors (Coef. = 0.144, P<0.001). Conclusion. Although the use of TCM reduced the cost of conventional medicine compared with TCM nonusers, TCM imposed an extra financial component on the total inpatient cost on TCM users. Our study suggests that TCM mainly played a complementary role to conventional medicine in ischemic stroke treatment in mainland China

Chinese herbal retention enema combined with magnetic vibration magneto-electric therapy: a promising therapeutic strategy for chronic prostatitis/chronic pelvic pain syndrome (CP/CPPS)

Background: Chronic prostatitis/chronic pelvic pain syndrome (CP/CPPS) is a common urological condition characterized by complex etiology, high incidence and limited treatment options. Despite extensive research, its pathogenesis remains poorly understood and high-quality, effective therapies are lacking. Methods: This propensity score-matched study assessed 92 patients by evaluating symptom scores, complications, and prognostic outcomes using the National Institutes of Health Chronic Prostatitis Symptom Index (NIH-CPSI), International Prostate Symptom Score (IPSS), and Hospital Anxiety and Depression Scale (HADS), with patients stratified based on baseline characteristics for outcome comparison. Results: The total clinical effective rate was significantly higher in the combination therapy group (91.30%) compared to the control group (76.09%, p < 0.05); the treatment process was uneventful in both groups, and four weeks after treatment, the total NIH-CPSI score and its subscales were significantly lower in the combination therapy group (−17.24 (6.84) vs. −12.54 (7.18), p < 0.05), with a more pronounced reduction in the IPSS score (−6.70 (2.54) vs. −3.87 (2.03), p < 0.05) and superior improvements in both peak and average urine flow rates—especially the latter—while neither regimen produced a significant improvement in mood scores. Conclusions: The combination of Chinese herbal retention enema and magnetic vibration magneto-electric therapy is more effective than magnetic vibration magneto-electric therapy alone in alleviating the primary symptoms of CP/CPPS, suggesting significant potential for broader clinical application. Clinical Trial registration: This study was registered on itmctr.ccebtcm.org.cn. And the registration number is ITMCTR2024000191

Medical insurance payment schemes and patient medical expenses: a cross-sectional study of lung cancer patients in urban China

BackgroundAs the main cause of cancer death, lung cancer imposes seriously health and economic burdens on individuals, families, and the health system. In China, there is no national study analyzing the hospitalization expenditures of different payment methods by lung cancer inpatients. Based on the 2010-2016 database of insured urban resident lung cancer inpatients from the China Medical Insurance Research Association (CHIRA), this paper aims to investigate the characteristics and cost of hospitalized lung cancer patient, to examine the differences in hospital expenses and patient out-of-pocket (OOP) expenses under four medical insurance payment methods: fee-for-service (FFS), per-diem payments, capitation payments (CAP) and case-based payments, and to explore the medical insurance payment method that can be conducive to controlling the cost of lung cancer.MethodThis is a 2010-2016, 7-year cross-sectional study. CHIRA data are not available to researchers after 2016. The Medical Insurance Database of CHIRA was screened using the international disease classification system to yield 28,200 inpatients diagnosed with lung cancer (ICD-10: C34, C34.0, C34.1, C34.2, C34.3, C34.8, C34.9). The study includes descriptive analysis and regression analysis based on generalized linear models (GLM).ResultsThe average patient age was 63.4 years and the average length of hospital stay (ALOS) was 14.2 day; 60.7% of patients were from tertiary hospitals; and 45% were insured by FFS. The per-diem payment had the lowest hospital expenses (RMB7496.00/US$1176.87), while CAP had the lowest OOP expenses (RMB1328.18/US$208.52). Compared with FFS hospital expenses, per-diem was 21.3% lower (95% CI = -0.265, -0.215) and case-based payment was 8.4% lower (95% CI = -0.151, -0.024). Compared with the FFS, OOP expenses, per-diem payments were 9.2% lower (95% CI = -0.130, -0.063) and CAP was 15.1% lower (95% CI = -0.151, -0.024).ConclusionFor lung cancer patients, per-diem payment generated the lowest hospital expenses, while CAP meant patients bore the lowest OOP costs. Policy makers are suggested to give priority to case-based payments to achieve a tripartite balance among medical insurers, hospitals, and insured members. We also recommend future studies comparing the disparities of various diseases for the cause of different medical insurance schemes

The effects and mechanisms of SLC34A2 in tumorigenesis and progression of human non-small cell lung cancer

BACKGROUND: SLC34A2 with highest expressions in lung, small intestine and kidney encoded a type 2b sodium-dependent phosphate transporter (NaPi-IIb). In lung, SLC34A2 only expressed in the apical membrane of type II alveolar epithelium cells (ATII cells) and played a pivotal role during the fetal lung development and embryonic development. ATII cells acting as multifunctional stem cells might transform into NSCLC after undergoing exogenous or endogenous factors. Increasing evidences showed that the genes performing critical roles during embryogenesis were also expressed during the development of cancer. In addition, recent research found the expression of SLC34A2 had a significant difference between the surgical samples of NSCLC and normal tissues, and SLC34A2 was down-regulated in lung adenocarcinoma cell line A549 and up-regulation expression of SLC34A2 could significantly inhibit cell viability and invasion of A549 in vitro. These results suggested SLC34A2 might play an important role in the development of NSCLC. However, the role of SLC34A2 in tumorigenesis and progression of NSCLC remains unknown. RESULTS: Our study found that SLC34A2 was also significantly down-regulated in 14/15 of examined NSCLC tissues. Moreover, we found that expressions of SLC34A2 were reduced in six NSCLC cell lines for the first time. Our result also revealed a dramatic inhibitory effects of SLC34A2 on cell growth, migration and invasion of several NSCLC cell lines. SLC34A2 also strongly inhibited tumor growth and metastasis ability in A549 subcutaneous tumor model and lung metastasis model, respectively. Further studies found that the suppressive effects of SLC34A2 on tumorigenesis and progression might be associated with the down-regulation of related protein in PI3K/Akt and Ras/Raf/MEK signal pathway. CONCLUSIONS: For the first time, our data indicated that SLC34A2 could exert significantly suppressive effects on tumorigenesis and progression of NSCLC. SLC34A2 might provide new insights for further understanding the early pathogenesis of human NSCLC

A bibliometric and knowledge-map analysis of the glymphatic system from 2012 to 2022

ObjectiveTo explore the development context, research hotspots and frontiers in the glymphatic system (GS) field from 2012 to 2022 by bibliometric analysis.MethodsThe Web of Science Core Collection (WoSCC) database was searched for articles published between 2012 and 2022. Microsoft Excel was used to manage the data. VOSviewer, CiteSpace, GraphPad Prism, the Web of Science, and an online analysis platform for bibliometrics (http://bibliometric.com/) were used to analyze the countries, institutions, journals, and collaboration networks among authors and the types of articles, developmental directions, references, and top keywords of published articles.ResultsA total of 412 articles were retrieved, including 39 countries/regions, 223 research institutes and 171 academic journals. The subject classifications related to the GS were Neuroscience, Clinical Neuroscience and Radiology/Nuclear Medicine/Medical Imaging. The United States has maintained its dominant and most influential position in GS research. Among research institutions and journals, the Univ Rochester and Journal of Cerebral Blood Flow and Metabolism had the highest number of academic articles, respectively. Nedergaard M had the most published article, and Iliff JJ had the most co-citations. The top two keywords with the highest frequency were “glymphatic system” and “cerebrospinal fluid.”ConclusionThis research provides valuable information for the study of the GS. The bibliometric analysis of this area will encourage potential collaborations among researchers, defining its frontiers and directions for development

Sedimentary ancient DNA reveals past ecosystem and biodiversity changes on the Tibetan Plateau: Overview and prospects

Alpine ecosystems on the Tibetan Plateau are being threatened by ongoing climate warming and intensified human activities. Ecological time-series obtained from sedimentary ancient DNA (sedaDNA) are essential for understanding past ecosystem and biodiversity dynamics on the Tibetan Plateau and their responses to climate change at a high taxonomic resolution. Hitherto only few but promising studies have been published on this topic. The potential and limitations of using sedaDNA on the Tibetan Plateau are not fully understood. Here, we (i) provide updated knowledge of and a brief introduction to the suitable archives, region-specific taphonomy, state-of-the-art methodologies, and research questions of sedaDNA on the Tibetan Plateau; (ii) review published and ongoing sedaDNA studies from the Tibetan Plateau; and (iii) give some recommendations for future sedaDNA study designs. Based on the current knowledge of taphonomy, we infer that deep glacial lakes with freshwater and high clay sediment input, such as those from the southern and southeastern Tibetan Plateau, may have a high potential for sedaDNA studies. Metabarcoding (for microorganisms and plants), metagenomics (for ecosystems), and hybridization capture (for prehistoric humans) are three primary sedaDNA approaches which have been successfully applied on the Tibetan Plateau, but their power is still limited by several technical issues, such as PCR bias and incompleteness of taxonomic reference databases. Setting up high-quality and open-access regional taxonomic reference databases for the Tibetan Plateau should be given priority in the future. To conclude, the archival, taphonomic, and methodological conditions of the Tibetan Plateau are favorable for performing sedaDNA studies. More research should be encouraged to address questions about long-term ecological dynamics at ecosystem scale and to bring the paleoecology of the Tibetan Plateau into a new era