Delving into Multimodal Prompting for Fine-grained Visual Classification

Fine-grained visual classification (FGVC) involves categorizing fine subdivisions within a broader category, which poses challenges due to subtle inter-class discrepancies and large intra-class variations. However, prevailing approaches primarily focus on uni-modal visual concepts. Recent advancements in pre-trained vision-language models have demonstrated remarkable performance in various high-level vision tasks, yet the applicability of such models to FGVC tasks remains uncertain. In this paper, we aim to fully exploit the capabilities of cross-modal description to tackle FGVC tasks and propose a novel multimodal prompting solution, denoted as MP-FGVC, based on the contrastive language-image pertaining (CLIP) model. Our MP-FGVC comprises a multimodal prompts scheme and a multimodal adaptation scheme. The former includes Subcategory-specific Vision Prompt (SsVP) and Discrepancy-aware Text Prompt (DaTP), which explicitly highlights the subcategory-specific discrepancies from the perspectives of both vision and language. The latter aligns the vision and text prompting elements in a common semantic space, facilitating cross-modal collaborative reasoning through a Vision-Language Fusion Module (VLFM) for further improvement on FGVC. Moreover, we tailor a two-stage optimization strategy for MP-FGVC to fully leverage the pre-trained CLIP model and expedite efficient adaptation for FGVC. Extensive experiments conducted on four FGVC datasets demonstrate the effectiveness of our MP-FGVC.Comment: The first two authors contributed equally to this wor

How to Learn Item Representation for Cold-Start Multimedia Recommendation?

10.1145/3394171.3413628ACM Multimedia 202

Efficient reversible CO/CO2 conversion in solid oxide cells with a phase-transformed fuel electrode

The reversible solid oxide cell (RSOC) is an attractive technology to mutually convert power and chemicals at elevated temperatures. However, its development has been hindered mainly due to the absence of a highly active and durable fuel electrode. Here, we report a phase-transformed CoFe-Sr3Fe1.25Mo0.75O7−δ (CoFe-SFM) fuel electrode consisting of CoFe nanoparticles and Ruddlesden-Popper-layered Sr3Fe1.25Mo0.75O7−δ (SFM) from a Sr2Fe7/6Mo0.5Co1/3O6−δ (SFMCo) perovskite oxide after annealing in hydrogen and apply it to reversible CO/CO2 conversion in RSOC. The CoFe-SFM fuel electrode shows improved catalytic activity by accelerating oxygen diffusion and surface kinetics towards the CO/CO2 conversion as demonstrated by the distribution of relaxation time (DRT) study and equivalent circuit model fitting analysis. Furthermore, an electrolyte-supported single cell is evaluated in the 2:1 CO-CO2 atmosphere at 800°C, which shows a peak power density of 259 mW cm−2 for CO oxidation and a current density of −0.453 A cm−2 at 1.3 V for CO2 reduction, which correspond to 3.079 and 3.155 mL min−1 cm−2 for the CO and CO2 conversion rates, respectively. More importantly, the reversible conversion is successfully demonstrated over 20 cyclic electrolysis and fuel cell switching test modes at 1.3 and 0.6 V. This work provides a useful guideline for designing a fuel electrode through a surface/interface exsolution process for RSOC towards efficient CO-CO2 reversible conversion

Exploring the therapeutic potential of isoorientin in the treatment of osteoporosis: a study using network pharmacology and experimental validation

Abstract Background Isoorientin (ISO) is a glycosylated flavonoid with antitumor, anti-inflammatory, and antioxidant properties. However, its effects on bone metabolism remain largely unknown. Methods In this study, we aimed to investigate the effects of ISO on receptor activator of nuclear factor-κB ligand (RANKL)-induced osteoclast formation in vitro and bone loss in post-ovariectomy (OVX) rats, as well as to elucidate the underlying mechanism. First, network pharmacology analysis indicated that MAPK1 and AKT1 may be potential therapeutic targets of ISO and that ISO has potential regulatory effects on the mitogen-activated protein kinase (MAPK) and phosphoinositide 3-kinase (PI3K)/protein kinase B (AKT) pathways, as well as oxidative stress. ISO was added to RAW264.7 cells stimulated by RANKL, and its effects on osteoclast differentiation were evaluated using tartrate‐resistant acid phosphatase (TRAP) staining, TRAP activity measurement, and F-actin ring analysis. Reactive oxygen species (ROS) production in osteoclasts was detected using a ROS assay kit. The effects of ISO on RANKL-triggered molecular cascade response were further investigated by Western blotting, quantitative real-time polymerase chain reaction, and immunofluorescence staining. In addition, the therapeutic effects of ISO were evaluated in vivo. Results ISO inhibited osteoclastogenesis in a time- and concentration-dependent manner. Mechanistically, ISO downregulated the expression of the main transcription factor for osteoclast differentiation by inhibiting MAPK and PI3K/AKT1 signaling pathways. Moreover, ISO exhibited protective effects in OVX-induced bone loss rats. This was consistent with the results derived from network pharmacology. Conclusion Our findings suggest a potential therapeutic utility of ISO in the management of osteoclast-associated bone diseases, including osteoporosis

Predictive Factors for Bone Cement Displacement following Percutaneous Vertebral Augmentation in Kümmell’s Disease

Objective: To investigate the independent influencing factors of bone cement displacement following percutaneous vertebral augmentation (PVA) in patients with stage I and stage II Kümmell’s disease. Methods: We retrospectively reviewed the records of 824 patients with stage Ⅰ and stage Ⅱ Kümmell’s disease treated with percutaneous vertebroplasty (PVP) or percutaneous vertebroplasty (PKP) from January 2016 to June 2022. Patients were divided into the postoperative bone cement displacement group (n = 150) and the bone cement non-displacement group (n = 674) according to the radiographic inspection results. The following data were collected: age, gender, body mass index (BMI), underlying disease, bone mineral density (BMD), involved vertebral segment, Kümmell’s disease staging, anterior height, local Cobb angle, the integrity of anterior vertebral cortex, the integrity of endplate in surgical vertebrae, surgical method, surgical approach, the volume of cement, distribution of cement, the viscosity of cement, cement leakage, and postoperative anti-osteoporosis treatment. Binary logistic regression analysis was performed to determine the independent influencing factors of bone cement displacement. The discrimination ability was evaluated using the area under the curve (AUC) of the receiver operating characteristic (ROC). Results: The results of logistic regression analysis revealed that thoracolumbar junction (odds ratio (OR) = 3.23, 95% confidence interval (CI) 2.12–4.50, p = 0.011), Kümmell’s disease staging (OR = 2.23, 95% CI 1.81–3.41, p < 0.001), anterior cortex defect (OR = 5.34, 95% CI 3.53–7.21, p < 0.001), vertebral endplates defect (OR = 0.54, 95% CI 0.35–0.71, p < 0.001), cement distribution (OR = 2.86, 95% CI 2.03–3.52, p = 0.002), cement leakage (OR = 4.59, 95% CI 3.85–5.72, p < 0.001), restoration of local Cobb angle (OR = 3.17, 95% CI 2.40–5.73, p = 0.024), and postoperative anti-osteoporosis treatment (OR = 0.48, 95% CI 0.18–0.72, p = 0.025) were independently associated with the bone cement displacement. The results of the ROC curve analysis showed that the AUC was 0.816 (95% CI 0.747–0.885), the sensitivity was 0.717, and the specificity was 0.793. Conclusion: Thoracolumbar fracture, stage Ⅱ Kümmell’s disease, anterior cortex defect, uneven cement distribution, cement leakage, and high restoration of the local Cobb angle were risk factors for cement displacement after PVA in Kümmell’s disease, while vertebral endplates defect and postoperative anti-osteoporosis treatment are protective factors

Identification of signature genes for renal ischemia‒reperfusion injury based on machine learning and WGCNA

Background: As an inevitable event after kidney transplantation, ischemia‒reperfusion injury (IRI) can lead to a decrease in kidney transplant success. The search for signature genes of renal ischemia‒reperfusion injury (RIRI) is helpful in improving the diagnosis and guiding clinical treatment. Methods: We first downloaded 3 datasets from the GEO database. Then, differentially expressed genes (DEGs) were identified and applied for functional enrichment analysis. After that, we performed three machine learning methods, including random forest (RF), Lasso regression analysis, and support vector machine recursive feature elimination (SVM-RFE), to further predict candidate genes. WGCNA was also executed to screen candidate genes from DEGs. Then, we took the intersection of candidate genes to obtain the signature genes of RIRI. Receiver operating characteristic (ROC) analysis was conducted to measure the predictive ability of the signature genes. Kaplan‒Meier analysis was used for association analysis between signature genes and graft survival. Verifying the expression of signature genes in the ischemia cell model. Results: A total of 117 DEGs were screened out. Subsequently, RF, Lasso regression analysis, SVM-RFE and WGCNA identified 17, 25, 18 and 74 candidate genes, respectively. Finally, 3 signature genes (DUSP1, FOS, JUN) were screened out through the intersection of candidate genes. ROC analysis suggested that the 3 signature genes could well diagnose and predict RIRI. Kaplan‒Meier analysis indicated that patients with low FOS or JUN expression had a longer OS than those with high FOS or JUN expression. Finally, we validated using the ischemia cell model that compared to the control group, the expression level of JUN increased under hypoxic conditions. Conclusions: Three signature genes (DUSP1, FOS, JUN) offer a good prediction for RIRI outcome and may serve as potential therapeutic targets for RIRI intervention, especially JUN. The prediction of graft survival by FOS and JUN may improve graft survival in patients with RIRI

Genome-wide identification and analysis of WD40 proteins reveal that NtTTG1 enhances drought tolerance in tobacco (Nicotiana tabacum)

Abstract Background WD40 proteins, which are highly prevalent in eukaryotes, play important roles in plant development and stress responses. However, systematic identification and exploration of WD40 proteins in tobacco have not yet been conducted. Results In this study, a total of 399 WD40 regulatory genes were identified in common tobacco (Nicotiana tabacum). Gene structure and motif analysis revealed structural and functional diversity among different clades of tobacco WD40 regulatory genes. The expansion of tobacco WD40 regulatory genes was mainly driven by segmental duplication and purifying selection. A potential regulatory network of NtWD40s suggested that NtWD40s might be regulated by miRNAs and transcription factors in various biological processes. Expression pattern analysis via transcriptome analysis and qRT-PCR revealed that many NtWD40s exhibited tissue-specific expression patterns and might be involved in various biotic and abiotic stresses. Furthermore, we have validated the critical role of NtTTG1, which was located in the nuclei of trichome cells, in enhancing the drought tolerance of tobacco plants. Conclusions Our study provides comprehensive information to better understand the evolution of WD40 regulatory genes and their roles in different stress responses in tobacco

Additional file 1 of Genome-wide identification and analysis of WD40 proteins reveal that NtTTG1 enhances drought tolerance in tobacco (Nicotiana tabacum)

Additional file 1