Devil in the Number: Towards Robust Multi-modality Data Filter

In order to appropriately filter multi-modality data sets on a web-scale, it becomes crucial to employ suitable filtering methods to boost performance and reduce training costs. For instance, LAION papers employs the CLIP score filter to select data with CLIP scores surpassing a certain threshold. On the other hand, T-MARS achieves high-quality data filtering by detecting and masking text within images and then filtering by CLIP score. Through analyzing the dataset, we observe a significant proportion of redundant information, such as numbers, present in the textual content. Our experiments on a subset of the data unveil the profound impact of these redundant elements on the CLIP scores. A logical approach would involve reevaluating the CLIP scores after eliminating these influences. Experimentally, our text-based CLIP filter outperforms the top-ranked method on the ``small scale" of DataComp (a data filtering benchmark) on ImageNet distribution shifts, achieving a 3.6% performance improvement. The results also demonstrate that our proposed text-masked filter outperforms the original CLIP score filter when selecting the top 40% of the data. The impact of numbers on CLIP and their handling provide valuable insights for improving the effectiveness of CLIP training, including language rewrite techniques.Comment: ICCV 2023 Workshop: TNGCV-DataCom

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

Recently, integrating video foundation models and large language models to build a video understanding system can overcome the limitations of specific pre-defined vision tasks. Yet, existing systems can only handle videos with very few frames. For long videos, the computation complexity, memory cost, and long-term temporal connection impose additional challenges. Taking advantage of the Atkinson-Shiffrin memory model, with tokens in Transformers being employed as the carriers of memory in combination with our specially designed memory mechanism, we propose the MovieChat to overcome these challenges. MovieChat achieves state-of-the-art performance in long video understanding, along with the released MovieChat-1K benchmark with 1K long video and 14K manual annotations for validation of the effectiveness of our method.Comment: CVPR 2024. First three authors contribute equally to this work. Project Website https://rese1f.github.io/MovieChat

Identify optimal HAP series scores for unresectable HCC patients undergoing TACE plus sorafenib: A Chinese multicenter observational study

BackgroundHepatoma arterial-embolization prognostic (HAP) series scores have been proposed for prognostic prediction in patients with unresectable hepatocellular carcinoma (uHCC) undergoing transarterial chemoembolization (TACE). However, their prognostic value in TACE plus sorafenib (TACE-S) remains unknown. Here, we aim to evaluate their prognostic performance in such conditions and identify the best model for this combination therapy.MethodsBetween January 2012 and December 2018, consecutive patients with uHCC receiving TACE-S were recruited from 15 tertiary hospitals in China. Cox regression analyses were used to investigate the prognostic values of baseline factors and every scoring system. Their prognostic performance and discriminatory performance were evaluated and confirmed in subgroup analyses.ResultsA total of 404 patients were enrolled. In the whole cohort, the median follow-up period was 44.2 (interquartile range (IQR), 33.2–60.7) months, the median overall survival (OS) time was 13.2 months, and 336 (83.2%) patients died at the end of the follow-up period. According to multivariate analyses, HAP series scores were independent prognostic indicators of OS. In addition, the C-index, Akaike information criterion (AIC) values, and time-dependent area under the receiver operating characteristic (ROC) curve (AUC) indicated that modified HAP (mHAP)-III had the best predictive performance. Furthermore, the results remained consistent in most subsets of patients.ConclusionHAP series scores exhibited good predictive ability in uHCC patients accepting TACE-S, and the mHAP-III score was found to be superior to the other HAP series scores in predicting OS. Future prospective high-quality studies should be conducted to confirm our results and help with treatment decision-making

Potential candidates for liver resection in liver-confined advanced HCC: a Chinese multicenter observational study

BackgroundAdvanced hepatocellular carcinoma (HCC) is characterized as symptomatic tumors [performance status (PS) score of 1-2], vascular invasion and extrahepatic spread, but patients with PS1 alone may be eliminated from this stage. Although liver resection is used for liver-confined HCC, its role in patients with PS1 alone remains controversial. Therefore, we aimed to explore its application in such patients and identify potential candidates.MethodsEligible liver-confined HCC patients undergoing liver resection were retrospectively screened in 15 Chinese tertiary hospitals, with limited tumor burden, liver function and PS scores. Cox-regression survival analysis was used to investigate the prognostic factors and develop a risk-scoring system, according to which patients were substratified using fitting curves and the predictive values of PS were explored in each stratification.ResultsFrom January 2010 to October 2021, 1535 consecutive patients were selected. In the whole cohort, PS, AFP, tumor size and albumin were correlated with survival (adjusted P<0.05), based on which risk scores of every patient were calculated and ranged from 0 to 18. Fitting curve analysis demonstrated that the prognostic abilities of PS varied with risk scores and that the patients should be divided into three risk stratifications. Importantly, in the low-risk stratification, PS lost its prognostic value, and patients with PS1 alone achieved a satisfactory 5-year survival rate of 78.0%, which was comparable with that PS0 patients (84.6%).ConclusionSelected patients with PS1 alone and an ideal baseline condition may benefit from liver resection and may migrate forward to BCLC stage A

Transarterial chemoembolization plus sorafenib for the management of unresectable hepatocellular carcinoma: a systematic review and meta-analysis

Abstract Background Transarterial chemoembolization (TACE) is the recommended treatment for hepatocellular carcinoma (HCC) patients at Barcelona Clinic Liver Cancer (BCLC) B-stage, whereas sorafenib is an orally administered small molecule target drug for BCLC C-stage. This updated systemic review and meta-analysis focuses on identifying the efficacy of the combination of TACE with sorafenib, which remains controversial despite years of exploration. Methods PubMed, EMBASE, Scopus and the Cochrane Library were systematically reviewed to search for studies published from January 1990 to May 2017. Studies focusing on the efficacy of combination therapy for unresectable HCC were eligible. The hazard ratio (HR) with 95% confidence intervals (95% CIs) for time to progression (TTP), overall survival (OS), disease control rate (DCR) and aetiology were collected. The data were then analysed through fixed/random effects meta-analysis models with STATA 13.0. The incidence and severity of treatment-related adverse events (AEs) were also evaluated. Results Twenty-seven studies were included. Thirteen non-comparative studies reported median OS (ranging from 18.5 to 20.4 months), median TTP (ranging from 7 to 13.9 months) and DCR (ranging from 18.4 to 95%). Fourteen comparative studies provided median OS (ranging from 7.0 to 29.7 months) and median TTP (ranging from 2.6 to 10.2 months). Five comparative studies provided DCR (ranging from 32 to 97.2%). Forest plots showed that combination therapy significantly improved TTP (HR = 0.66, 95% CI 0.50–0.81, P = 0.002) rather than OS (HR = 0.63, 95% CI 0.55–0.71, P = 0.058), compared to TACE alone. DCR increased significantly in the combination therapy group (OR = 2.93, 95% CI 1.59–5.41, P = 0.005). Additional forest plots were drawn and no significant differences were observed with regard to survival outcome among various aetiologies. Forest plots for separate analysis of regions showed the HR for TTP was 0.62 (95% CI 0.45–0.79, P = 0.002) in the Asian countries group, and 0.82 (95% CI 0.59–1.05, P = 0.504)) in western countries. The HR for OS was 0.61 (95% CI 0.48–0.75, P = 0.050) in the Asian countries group and was 0.88 (95% CI 0.56–1.20, P = 0.845) in western countries. These data may indicate positive TTP outcome in Asian patients but not in European patients while no positive findings regarding OS were observed in either region. The most common AEs included fatigue, hand-foot skin reaction, diarrhoea and hypertension. Conclusions Combination therapy may benefit unresectable HCC patients in terms of prolonged TTP and DCR. More well-designed studies are needed to investigate its superiority for OS

Effects of High Temperature Pretreatment and Inoculation of Bacillus coagulans on Promoting Aerobic Composting of Chicken Manure

Effects of high temperature pretreatment and inoculation of Bacillus coagulans were determined relative to the physicochemical properties and bacterial community of aerobic composting of chicken manure. Chicken manure was pretreated with high temperature for 0 h (CJ), 0.5 h (T-0.5h), 1.0 h (T-1.0h), 1.5 h (T-1.5h), and 2.0 h (T-2.0h) and then inoculated with B. coagulans. Chicken manure without high temperature pretreatment was included as control (CK). The results showed that the temperature of manure in CJ, T-0.5h, T-1.0h, T-1.5h, and T-2.0h groups was 2.2 to 8.4 °C higher than the chicken manure in CK within 1 day. On day 3, the chicken manure temperature reached a peak, which was 1.5 to 7.7 °C higher than that in the CK (56.8 °C). Both inoculation of B. coagulans and high temperature pretreatment increased the abundance and diversity of the bacterial community. The abundance of Firmicutes in T-1.5h was significantly higher than that in CJ. In the temperature decreasing period, the abundance of Bacillus in T-1.5h group was significantly higher than that in the CK and CJ. Overall, it was concluded that high temperature pretreatment and B. coagulans inoculation can accelerate the temperature elevation, increase the temperature of compost, and regulate the structure of bacterial community

Effects of High Temperature Pretreatment and Inoculation of Bacillus coagulans on Promoting Aerobic Composting of Chicken Manure

Effects of high temperature pretreatment and inoculation of Bacillus coagulans were determined relative to the physicochemical properties and bacterial community of aerobic composting of chicken manure. Chicken manure was pretreated with high temperature for 0 h (CJ), 0.5 h (T-0.5h), 1.0 h (T-1.0h), 1.5 h (T-1.5h), and 2.0 h (T-2.0h) and then inoculated with B. coagulans. Chicken manure without high temperature pretreatment was included as control (CK). The results showed that the temperature of manure in CJ, T-0.5h, T-1.0h, T-1.5h, and T-2.0h groups was 2.2 to 8.4 °C higher than the chicken manure in CK within 1 day. On day 3, the chicken manure temperature reached a peak, which was 1.5 to 7.7 °C higher than that in the CK (56.8 °C). Both inoculation of B. coagulans and high temperature pretreatment increased the abundance and diversity of the bacterial community. The abundance of Firmicutes in T-1.5h was significantly higher than that in CJ. In the temperature decreasing period, the abundance of Bacillus in T-1.5h group was significantly higher than that in the CK and CJ. Overall, it was concluded that high temperature pretreatment and B. coagulans inoculation can accelerate the temperature elevation, increase the temperature of compost, and regulate the structure of bacterial community

Reverse-D-4F Increases the Number of Endothelial Progenitor Cells and Improves Endothelial Progenitor Cell Dysfunctions in High Fat Diet Mice

<div><p>Although high density lipoprotein (HDL) improves the functions of endothelial progenitor cells (EPCs), the effect of HDL ApoAI mimetic peptide reverse-D-4F (Rev-D4F) on EPC mobilization and repair of EPC dysfunctions remains to be studied. In this study, we investigated the effects of Rev-D4F on peripheral blood cell subpopulations in C57 mice treated with a high fat diet and the mechanism of Rev-D4F in improving the function of EPCs impaired by tumor necrosis factor-α (TNF-α). The high fat diet significantly decreased the number of EPCs, EPC migratory functions, and the percentage of lymphocytes in the white blood cells. However, it significantly increased the number of white blood cells, the percentage of monocytes in the white blood cells, and the level of vascular endothelial growth factor (VEGF) and TNF-α in the plasma. Rev-D4F clearly inhibited the effect of the high fat diet on the quantification of peripheral blood cell subpopulations and cytokine levels, and increased stromal cell derived factor 1α (SDF-1α) in the plasma. We provided in vitro evidence that TNF-α impaired EPC proliferation, migration, and tube formation through inactive AKT and eNOS, which was restored by Rev-D4F treatment. In contrast, both the PI3-kinase (PI3K) inhibitor (LY294002) and AKT inhibitor (perifosine) obviously inhibited the restoration of Rev-4F on EPCs impaired by TNF-α. Our results suggested that Rev-D4F increases the quantity of endothelial progenitor cells through increasing the SDF-1α levels and decreasing the TNF-α level of peripheral blood in high fat diet-induced C57BL/6J mice, and restores TNF-α induced dysfunctions of EPCs partly through stimulating the PI3K/AKT signal pathway.</p></div