424 research outputs found

    GeoLayoutLM: Geometric Pre-training for Visual Information Extraction

    Full text link
    Visual information extraction (VIE) plays an important role in Document Intelligence. Generally, it is divided into two tasks: semantic entity recognition (SER) and relation extraction (RE). Recently, pre-trained models for documents have achieved substantial progress in VIE, particularly in SER. However, most of the existing models learn the geometric representation in an implicit way, which has been found insufficient for the RE task since geometric information is especially crucial for RE. Moreover, we reveal another factor that limits the performance of RE lies in the objective gap between the pre-training phase and the fine-tuning phase for RE. To tackle these issues, we propose in this paper a multi-modal framework, named GeoLayoutLM, for VIE. GeoLayoutLM explicitly models the geometric relations in pre-training, which we call geometric pre-training. Geometric pre-training is achieved by three specially designed geometry-related pre-training tasks. Additionally, novel relation heads, which are pre-trained by the geometric pre-training tasks and fine-tuned for RE, are elaborately designed to enrich and enhance the feature representation. According to extensive experiments on standard VIE benchmarks, GeoLayoutLM achieves highly competitive scores in the SER task and significantly outperforms the previous state-of-the-arts for RE (\eg, the F1 score of RE on FUNSD is boosted from 80.35\% to 89.45\%). The code and models are publicly available at https://github.com/AlibabaResearch/AdvancedLiterateMachinery/tree/main/DocumentUnderstanding/GeoLayoutLMComment: CVPR 2023 Highligh

    Vision Grid Transformer for Document Layout Analysis

    Full text link
    Document pre-trained models and grid-based models have proven to be very effective on various tasks in Document AI. However, for the document layout analysis (DLA) task, existing document pre-trained models, even those pre-trained in a multi-modal fashion, usually rely on either textual features or visual features. Grid-based models for DLA are multi-modality but largely neglect the effect of pre-training. To fully leverage multi-modal information and exploit pre-training techniques to learn better representation for DLA, in this paper, we present VGT, a two-stream Vision Grid Transformer, in which Grid Transformer (GiT) is proposed and pre-trained for 2D token-level and segment-level semantic understanding. Furthermore, a new dataset named D4^4LA, which is so far the most diverse and detailed manually-annotated benchmark for document layout analysis, is curated and released. Experiment results have illustrated that the proposed VGT model achieves new state-of-the-art results on DLA tasks, e.g. PubLayNet (95.7%95.7\%β†’\rightarrow96.2%96.2\%), DocBank (79.6%79.6\%β†’\rightarrow84.1%84.1\%), and D4^4LA (67.7%67.7\%β†’\rightarrow68.8%68.8\%). The code and models as well as the D4^4LA dataset will be made publicly available ~\url{https://github.com/AlibabaResearch/AdvancedLiterateMachinery}.Comment: Accepted by ICCV202

    Effects of magnetic field on thermo-hydraulic performance of Fe3O4-water nanofluids in a corrugated tube

    Get PDF
    Β© 2018 Elsevier Ltd An experimental system is established to investigate the thermo-hydraulic performance of Fe3O4-water nanofluids in a corrugated tube under various magnetic fields. The influences of magnetic induction intensities (B = 0 G, 100 G, 200 G, 300 G), nanoparticle mass fractions (Ο‰ = 0.0%, 0.1%, 0.3%, 0.5%), electromagnet arrangement modes (one-side electromagnet and two-side staggered electromagnet), kinds of tubes (smooth tube and corrugated tube), Reynolds numbers (Re = 800–12,000) on flow and heat transfer characteristics are discussed. It is obtained that the augmentation of heat transfer is more sensitive to high nanoparticle mass fraction, high magnetic induction intensity, two-side staggered electromagnet and corrugated tube. A Comprehensive evaluation index is applied to estimate the thermo-hydraulic performance. It can be discovered that the comprehensive evaluation index increases with the increasing Reynolds number at first and then decreases, and the rough surface of corrugated tube delays the appearance of critical Reynolds number

    Experimental study on the flow and heat transfer characteristics of nanofluids in double-tube heat exchangers based on thermal efficiency assessment

    Get PDF
    Thermal performance and pressure drop of TiO2-H2O nanofluids in double-tube heat exchangers are investigated. The influence of the thermal fluid (water) volume flow rates (qvβ€―=β€―1–5β€―L/min), nanoparticle mass frictions (Ο‰β€―=β€―0.0%, 0.1%, 0.3% and 0.5%), nanofluids locations (shell-side and tube-side), Reynolds numbers of nanofluids (Reβ€―=β€―3000–12000), and the structures of inner tubes (smooth tube and corrugated tube) is analyzed. Results indicate that nanofluids (Ο‰β€―=β€―0.1%, 0.3% and 0.5%) can improve the heat transfer rate by 10.8%, 13.4% and 14.8% at best compared with deionized water respectively, and the number of transfer units (NTU) and effectiveness are all improved. The pressure drop can be increased by 51.9% (tube-side) and 40.7% (shell-side) at best under the condition of using both nanofluids and corrugated inner tube. When the nanofluids flow in the shell-side of the corrugated double-tube heat exchanger, the comprehensive performance of nanofluids-side is better than that of the smooth double-tube heat exchanger

    Effect of rotating twisted tape on thermo-hydraulic performances of nanofluids in heat-exchanger systems

    Get PDF
    Stable TiO2-H2O nanofluids are prepared and their stabilities are studied. An experimental set for studying the heat transfer and flow characteristics of nanofluids is established. Heat transfer and flow characteristics of TiO2-H2O nanofluids in a circular tube with rotating and static built-in twisted tapes are experimentally investigated and compared. An innovative performance evaluation plot of exergy efficiency is developed and the exergy efficiency of tube with rotating and static built-in twisted tapes filled with nanofluids is analyzed in this paper. The results indicate that the combination of rotating built-in twisted tape and TiO2-H2O nanofluids shows an excellent enhancement in heat transfer, which can increase the heat transfer by 101.6% compared with that of in a circular tube. The effects of nanoparticle mass fractions (Ο‰= 0.1%, 0.3% and 0.5%) and Reynolds numbers (Reβ€―=β€―600–7000) on the heat transfer and flow characteristics of TiO2-H2O nanofluids are discussed. It is found that there is a critical Reynolds number (Reβ€―=β€―4500) for the maximum value of relative heat transfer enhancement ratio. The comprehensive performance of the experimental system is analyzed. It can be found that the comprehensive performance index of the experimental system firstly increases and then reduces with Reynolds number, and it can reach 1.519 at best. However, for the performance evaluation of exergy efficiency, the coupling of rotating twisted tape and nanofluids deteriorates the exergy efficiency. Also, it can be found that the exergy efficiency of the circular tube with twisted tape is greater than that of circular tube under the same pumping power and pressure drop, but it shows deterioration under the same mass flow rate

    Targeting Tumor-Associated Fibroblasts for Therapeutic Delivery in Desmoplastic Tumors

    Get PDF
    The off-target distribution of anticancer nanoparticles to fibroblasts creates a barrier to the effective treatment of desmoplastic tumors. However, we hypothesized that this nanoparticle detriment might be exploited to target the expression of secreted cytotoxic proteins from tumor-associated fibroblasts (TAF) as an anticancer strategy. In addressing this hypothesis, plasmids encoding the secretable TNF-related factor sTRAIL were loaded into lipid-coated protamine DNA complexes and administered by infusion in a murine xenograft model of human desmoplastic bladder carcinoma. Three doses were sufficient to generate approximately 70% of TAFs as sTRAIL-producing cells. sTRAIL triggered apoptosis in tumor cell nests adjacent to TAFs. Furthermore, it reverted residual fibroblasts to a quiescent state due to insufficient activation, further compromising tumor growth and remodeling the microenvironment to favor second-wave nanotherapy. We confirmed the efficacy of this strategy in an orthotopic xenograft model of human pancreatic cancer, where the desmoplastic stroma is well known to be a major barrier to the delivery of therapeutic nanoparticles. Collectively, our results offer a proof of concept for the use of nanoparticles to modify TAFs as an effective strategy to treat desmoplastic cancers. Cancer Res; 77(3); 719-31. Β©2016 AACR

    The effect of anti-PD-1/PD-L1 antibodies combined with VEGF receptor tyrosine kinase inhibitors versus bevacizumab in unresectable hepatocellular carcinoma

    Get PDF
    IntroductionImmune checkpoint inhibition (ICI) plus bevacizumab (BEV) is the standard first-line treatment for unresectable hepatocellular carcinoma (uHCC). We aimed to assess the efficacy and safety of ICI plus bevacizumab and ICI plus receptor tyrosine kinase inhibitor (TKI) in this patient population.MethodsThis retrospective single-institution study enrolled 94 patients with uHCC who received ICI plus TKI or bevacizumab as the first-line treatment. Progression-free survival (PFS), overall survival (OS), objective response rate (ORR), and disease control rate (DCR) were used to evaluate treatment efficacy. RECIST v1.1 criteria were used to calculate the objective clinical response. Common Terminology Criteria for Adverse Events were used to report and categorize adverse events.ResultsBy the last follow-up interview on May 15, 2022, there were 57 deaths, and 19 patients did not develop disease progression. Thirty patients received sintilimab/atezolizumab plus bevacizumab (ICI + BEV group), and 64 received ICI plus TKI (ICI + TKI group). The median OS was 430 days (95% CI, 266-NA) in the ICI+TKI group and 498 days (95% CI, 349-NA) in the ICI+BEV group (HR, 1.20; 95% CI, 0.69-2.07; P = 0.52). There was no significant difference between the two groups in the median PFS (182 vs. 221 days, P=0.67). In the ICI+TKI group, the ORR and DCR were 28.1% and 67.2%, respectively. In the ICI+BEV group, the ORR and DCR were 26.7% and 66.7%, respectively. The overall incidence of adverse events was similar between the two groups. Palmar-plantar erythrodysesthesia syndrome (23[36%]) occurred only in the ICI + TKI group. Patients who received ICI+BEV were more prone to upper gastrointestinal bleeding (2 [7%]), with one patient with grade 4 requiring emergency DSA treatment.ConclusionThis study found that ICI+TKI and ICI+BEV as first-line treatments were similar in OS, PFS, and tumor response in uHCC. Different populations are suitable for different regimens because of the different adverse events

    T Cell Chemo-Vaccination Effects after Repeated Mucosal SHIV Exposures and Oral Pre-Exposure Prophylaxis

    Get PDF
    Pre-exposure prophylaxis (PrEP) with anti-viral drugs is currently in clinical trials for the prevention of HIV infection. Induction of adaptive immune responses to virus exposures during anti-viral drug administration, i.e., a β€œchemo-vaccination” effect, could contribute to PrEP efficacy. To study possible chemo-vaccination, we monitored humoral and cellular immune responses in nine rhesus macaques undergoing up to 14 weekly, low-dose SHIVSF162P3 rectal exposures. Six macaques concurrently received PrEP with intermittent, oral Truvada; three were no-PrEP controls. PrEP protected 4 macaques from infection. Two of the four showed evidence of chemo-vaccination, because they developed anti-SHIV CD4+ and CD8+ T cells; SHIV-specific antibodies were not detected. Control macaques showed no anti-SHIV immune responses before infection. Chemo-vaccination-induced T cell responses were robust (up to 3,940 SFU/106 PBMCs), predominantly central memory cells, short-lived (≀22 weeks), and appeared intermittently and with changing specificities. The two chemo-vaccinated macaques were virus-challenged again after 28 weeks of rest, after T cell responses had waned. One macaque was not protected from infection. The other macaque concurrently received additional PrEP. It remained uninfected and T cell responses were boosted during the additional virus exposures. In summary, we document and characterize PrEP-induced T cell chemo-vaccination. Although not protective after subsiding in one macaque, chemo-vaccination-induced T cells warrant more comprehensive analysis during peak responses for their ability to prevent or to control infections after additional exposures. Our findings highlight the importance of monitoring these responses in clinical PrEP trials and suggest that a combination of vaccines and PrEP potentially might enhance efficacy
    • …
    corecore