43 research outputs found
Boosting Multi-Modal E-commerce Attribute Value Extraction via Unified Learning Scheme and Dynamic Range Minimization
With the prosperity of e-commerce industry, various modalities, e.g., vision
and language, are utilized to describe product items. It is an enormous
challenge to understand such diversified data, especially via extracting the
attribute-value pairs in text sequences with the aid of helpful image regions.
Although a series of previous works have been dedicated to this task, there
remain seldomly investigated obstacles that hinder further improvements: 1)
Parameters from up-stream single-modal pretraining are inadequately applied,
without proper jointly fine-tuning in a down-stream multi-modal task. 2) To
select descriptive parts of images, a simple late fusion is widely applied,
regardless of priori knowledge that language-related information should be
encoded into a common linguistic embedding space by stronger encoders. 3) Due
to diversity across products, their attribute sets tend to vary greatly, but
current approaches predict with an unnecessary maximal range and lead to more
potential false positives. To address these issues, we propose in this paper a
novel approach to boost multi-modal e-commerce attribute value extraction via
unified learning scheme and dynamic range minimization: 1) Firstly, a unified
scheme is designed to jointly train a multi-modal task with pretrained
single-modal parameters. 2) Secondly, a text-guided information range
minimization method is proposed to adaptively encode descriptive parts of each
modality into an identical space with a powerful pretrained linguistic model.
3) Moreover, a prototype-guided attribute range minimization method is proposed
to first determine the proper attribute set of the current product, and then
select prototypes to guide the prediction of the chosen attributes. Experiments
on the popular multi-modal e-commerce benchmarks show that our approach
achieves superior performance over the other state-of-the-art techniques
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model
Multimodal semantic understanding often has to deal with uncertainty, which
means the obtained messages tend to refer to multiple targets. Such uncertainty
is problematic for our interpretation, including inter- and intra-modal
uncertainty. Little effort has studied the modeling of this uncertainty,
particularly in pre-training on unlabeled datasets and fine-tuning in
task-specific downstream datasets. In this paper, we project the
representations of all modalities as probabilistic distributions via a
Probability Distribution Encoder (PDE) by utilizing sequence-level
interactions. Compared to the existing deterministic methods, such uncertainty
modeling can convey richer multimodal semantic information and more complex
relationships. Furthermore, we integrate uncertainty modeling with popular
pre-training frameworks and propose suitable pre-training tasks:
Distribution-based Vision-Language Contrastive learning (D-VLC),
Distribution-based Masked Language Modeling (D-MLM), and Distribution-based
Image-Text Matching (D-ITM). The fine-tuned models are applied to challenging
downstream tasks, including image-text retrieval, visual question answering,
visual reasoning, and visual entailment, and achieve state-of-the-art results.Comment: CVPR 2023 accep
Lung dendritic cells induce migration of protective T cells to the gastrointestinal tract
Developing efficacious vaccines against enteric diseases is a global challenge that requires a better understanding of cellular recruitment dynamics at the mucosal surfaces. The current paradigm of T cell homing to the gastrointestinal (GI) tract involves the induction of alpha 4 beta 7 and CCR9 by Peyer's patch and mesenteric lymph node (MLN) dendritic cells (DCs) in a retinoic acid-dependent manner. This paradigm, however, cannot be reconciled with reports of GI T cell responses after intranasal (i.n.) delivery of antigens that do not directly target the GI lymphoid tissue. To explore alternative pathways of cellular migration, we have investigated the ability of DCs from mucosal and nonmucosal tissues to recruit lymphocytes to the GI tract. Unexpectedly, we found that lung DCs, like CD103(+) MLN DCs, up-regulate the gut-homing integrin alpha 4 beta 7 in vitro and in vivo, and induce T cell migration to the GI tract in vivo. Consistent with a role for this pathway in generating mucosal immune responses, lung DC targeting by i.n. immunization induced protective immunity against enteric challenge with a highly pathogenic strain of Salmonella. The present report demonstrates novel functional evidence of mucosal cross talk mediated by DCs, which has the potential to inform the design of novel vaccines against mucosal pathogens.open8
Recommended from our members
T cell–derived inducible nitric oxide synthase switches off TH17 cell differentiation
RORγt is necessary for the generation of TH17 cells but the molecular mechanisms for the regulation of TH17 cells are still not fully understood. We show that activation of CD4+ T cells results in the expression of inducible nitric oxide synthase (iNOS). iNOS-deficient mice displayed enhanced TH17 cell differentiation but without major effects on either TH1 or TH2 cell lineages, whereas endothelial NOS (eNOS) or neuronal NOS (nNOS) mutant mice showed comparable TH17 cell differentiation compared with wild-type control mice. The addition of N6-(1-iminoethyl)-l-lysine dihydrochloride (L-NIL), the iNOS inhibitor, significantly enhanced TH17 cell differentiation, and S-nitroso-N-acetylpenicillamine (SNAP), the NO donor, dose-dependently reduced the percentage of IL-17–producing CD4+ T cells. NO mediates nitration of tyrosine residues in RORγt, leading to the suppression of RORγt-induced IL-17 promoter activation, indicating that NO regulates IL-17 expression at the transcriptional level. Finally, studies of an experimental model of colitis showed that iNOS deficiency results in more severe inflammation with an enhanced TH17 phenotype. These results suggest that NO derived from iNOS in activated T cells plays a negative role in the regulation of TH17 cell differentiation and highlight the importance of intrinsic programs for the control of TH17 immune responses
5-Fluorouracil targets thymidylate synthase in the selective suppression of TH17 cell differentiation
While it is well established that treatment of cancer patients with 5-Fluorouracil (5-FU) can result in immune suppression, the exact function of 5-FU in the modulation of immune cells has not been fully established. We found that low dose 5-FU selectively suppresses TH17 and TH1 cell differentiation without apparent effect on Treg, TH2, and significantly suppresses thymidylate synthase (TS) expression in TH17 and TH1 cells but has a lesser effect in tumor cells and macrophages. Interestingly, the basal expression of TS varies significantly between T helper phenotypes and knockdown of TS significantly impairs TH17 and TH1 cell differentiation without affecting the differentiation of either Treg or TH2 cells. Finally, low dose 5-FU is effective in ameliorating colitis development by suppressing TH17 and TH1 cell development in a T cell transfer colitis model. Taken together, the results highlight the importance of the anti-inflammatory functions of low dose 5-FU by selectively suppressing TH17 and TH1 immune responses
BRD4 Inhibitor Inhibits Colorectal Cancer Growth and Metastasis
Post-translational modifications have been identified to be of great importance in cancers and lysine acetylation, which can attract the multifunctional transcription factor BRD4, has been identified as a potential therapeutic target. In this paper, we identify that BRD4 has an important role in colorectal cancer; and that its inhibition substantially wipes out tumor cells. Treatment with inhibitor MS417 potently affects cancer cells, although such effects were not always outright necrosis or apoptosis. We report that BRD4 inhibition also limits distal metastasis by regulating several key proteins in the progression of epithelial-to-mesenchymal transition (EMT). This effect of BRD4 inhibitor is demonstrated via liver metastasis in animal model as well as migration and invasion experiments in vitro. Together, our results demonstrate a new application of BRD4 inhibitor that may be of clinical use by virtue of its ability to limit metastasis while also being tumorcidal
Robust estimation of bacterial cell count from optical density
Optical density (OD) is widely used to estimate the density of cells in liquid culture, but cannot be compared between instruments without a standardized calibration protocol and is challenging to relate to actual cell count. We address this with an interlaboratory study comparing three simple, low-cost, and highly accessible OD calibration protocols across 244 laboratories, applied to eight strains of constitutive GFP-expressing E. coli. Based on our results, we recommend calibrating OD to estimated cell count using serial dilution of silica microspheres, which produces highly precise calibration (95.5% of residuals <1.2-fold), is easily assessed for quality control, also assesses instrument effective linear range, and can be combined with fluorescence calibration to obtain units of Molecules of Equivalent Fluorescein (MEFL) per cell, allowing direct comparison and data fusion with flow cytometry measurements: in our study, fluorescence per cell measurements showed only a 1.07-fold mean difference between plate reader and flow cytometry data
Protein-Losing Enteropathy in Ulcerative Colitis
Protein-losing enteropathy (PLE) is a debilitating potential complication of ulcerative colitis (UC). We report a case of PLE in a 26-year-old male patient with UC. The patient lost 50 pounds in the setting of a UC flare and was found to have an albumin level of 1.2 g/dl. Although the patient’s UC was clinically controlled with steroids, the weight loss and hypoalbuminemia persisted with the patient’s course complicated by development of deep vein thrombosis and pulmonary embolism. The diagnosis of PLE was confirmed with measurement of stool alpha-1-antitrypsin clearance. The patient’s condition significantly improved following procto-colectomy