43 research outputs found

    Boosting Multi-Modal E-commerce Attribute Value Extraction via Unified Learning Scheme and Dynamic Range Minimization

    Full text link
    With the prosperity of e-commerce industry, various modalities, e.g., vision and language, are utilized to describe product items. It is an enormous challenge to understand such diversified data, especially via extracting the attribute-value pairs in text sequences with the aid of helpful image regions. Although a series of previous works have been dedicated to this task, there remain seldomly investigated obstacles that hinder further improvements: 1) Parameters from up-stream single-modal pretraining are inadequately applied, without proper jointly fine-tuning in a down-stream multi-modal task. 2) To select descriptive parts of images, a simple late fusion is widely applied, regardless of priori knowledge that language-related information should be encoded into a common linguistic embedding space by stronger encoders. 3) Due to diversity across products, their attribute sets tend to vary greatly, but current approaches predict with an unnecessary maximal range and lead to more potential false positives. To address these issues, we propose in this paper a novel approach to boost multi-modal e-commerce attribute value extraction via unified learning scheme and dynamic range minimization: 1) Firstly, a unified scheme is designed to jointly train a multi-modal task with pretrained single-modal parameters. 2) Secondly, a text-guided information range minimization method is proposed to adaptively encode descriptive parts of each modality into an identical space with a powerful pretrained linguistic model. 3) Moreover, a prototype-guided attribute range minimization method is proposed to first determine the proper attribute set of the current product, and then select prototypes to guide the prediction of the chosen attributes. Experiments on the popular multi-modal e-commerce benchmarks show that our approach achieves superior performance over the other state-of-the-art techniques

    MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model

    Full text link
    Multimodal semantic understanding often has to deal with uncertainty, which means the obtained messages tend to refer to multiple targets. Such uncertainty is problematic for our interpretation, including inter- and intra-modal uncertainty. Little effort has studied the modeling of this uncertainty, particularly in pre-training on unlabeled datasets and fine-tuning in task-specific downstream datasets. In this paper, we project the representations of all modalities as probabilistic distributions via a Probability Distribution Encoder (PDE) by utilizing sequence-level interactions. Compared to the existing deterministic methods, such uncertainty modeling can convey richer multimodal semantic information and more complex relationships. Furthermore, we integrate uncertainty modeling with popular pre-training frameworks and propose suitable pre-training tasks: Distribution-based Vision-Language Contrastive learning (D-VLC), Distribution-based Masked Language Modeling (D-MLM), and Distribution-based Image-Text Matching (D-ITM). The fine-tuned models are applied to challenging downstream tasks, including image-text retrieval, visual question answering, visual reasoning, and visual entailment, and achieve state-of-the-art results.Comment: CVPR 2023 accep

    Lung dendritic cells induce migration of protective T cells to the gastrointestinal tract

    Get PDF
    Developing efficacious vaccines against enteric diseases is a global challenge that requires a better understanding of cellular recruitment dynamics at the mucosal surfaces. The current paradigm of T cell homing to the gastrointestinal (GI) tract involves the induction of alpha 4 beta 7 and CCR9 by Peyer's patch and mesenteric lymph node (MLN) dendritic cells (DCs) in a retinoic acid-dependent manner. This paradigm, however, cannot be reconciled with reports of GI T cell responses after intranasal (i.n.) delivery of antigens that do not directly target the GI lymphoid tissue. To explore alternative pathways of cellular migration, we have investigated the ability of DCs from mucosal and nonmucosal tissues to recruit lymphocytes to the GI tract. Unexpectedly, we found that lung DCs, like CD103(+) MLN DCs, up-regulate the gut-homing integrin alpha 4 beta 7 in vitro and in vivo, and induce T cell migration to the GI tract in vivo. Consistent with a role for this pathway in generating mucosal immune responses, lung DC targeting by i.n. immunization induced protective immunity against enteric challenge with a highly pathogenic strain of Salmonella. The present report demonstrates novel functional evidence of mucosal cross talk mediated by DCs, which has the potential to inform the design of novel vaccines against mucosal pathogens.open8

    5-Fluorouracil targets thymidylate synthase in the selective suppression of TH17 cell differentiation

    Get PDF
    While it is well established that treatment of cancer patients with 5-Fluorouracil (5-FU) can result in immune suppression, the exact function of 5-FU in the modulation of immune cells has not been fully established. We found that low dose 5-FU selectively suppresses TH17 and TH1 cell differentiation without apparent effect on Treg, TH2, and significantly suppresses thymidylate synthase (TS) expression in TH17 and TH1 cells but has a lesser effect in tumor cells and macrophages. Interestingly, the basal expression of TS varies significantly between T helper phenotypes and knockdown of TS significantly impairs TH17 and TH1 cell differentiation without affecting the differentiation of either Treg or TH2 cells. Finally, low dose 5-FU is effective in ameliorating colitis development by suppressing TH17 and TH1 cell development in a T cell transfer colitis model. Taken together, the results highlight the importance of the anti-inflammatory functions of low dose 5-FU by selectively suppressing TH17 and TH1 immune responses

    BRD4 Inhibitor Inhibits Colorectal Cancer Growth and Metastasis

    Get PDF
    Post-translational modifications have been identified to be of great importance in cancers and lysine acetylation, which can attract the multifunctional transcription factor BRD4, has been identified as a potential therapeutic target. In this paper, we identify that BRD4 has an important role in colorectal cancer; and that its inhibition substantially wipes out tumor cells. Treatment with inhibitor MS417 potently affects cancer cells, although such effects were not always outright necrosis or apoptosis. We report that BRD4 inhibition also limits distal metastasis by regulating several key proteins in the progression of epithelial-to-mesenchymal transition (EMT). This effect of BRD4 inhibitor is demonstrated via liver metastasis in animal model as well as migration and invasion experiments in vitro. Together, our results demonstrate a new application of BRD4 inhibitor that may be of clinical use by virtue of its ability to limit metastasis while also being tumorcidal

    Robust estimation of bacterial cell count from optical density

    Get PDF
    Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data

    Protein-Losing Enteropathy in Ulcerative Colitis

    No full text
    Protein-losing enteropathy (PLE) is a debilitating potential complication of ulcerative colitis (UC). We report a case of PLE in a 26-year-old male patient with UC. The patient lost 50 pounds in the setting of a UC flare and was found to have an albumin level of 1.2 g/dl. Although the patient’s UC was clinically controlled with steroids, the weight loss and hypoalbuminemia persisted with the patient’s course complicated by development of deep vein thrombosis and pulmonary embolism. The diagnosis of PLE was confirmed with measurement of stool alpha-1-antitrypsin clearance. The patient’s condition significantly improved following procto-colectomy
    corecore