424 research outputs found
GeoLayoutLM: Geometric Pre-training for Visual Information Extraction
Visual information extraction (VIE) plays an important role in Document
Intelligence. Generally, it is divided into two tasks: semantic entity
recognition (SER) and relation extraction (RE). Recently, pre-trained models
for documents have achieved substantial progress in VIE, particularly in SER.
However, most of the existing models learn the geometric representation in an
implicit way, which has been found insufficient for the RE task since geometric
information is especially crucial for RE. Moreover, we reveal another factor
that limits the performance of RE lies in the objective gap between the
pre-training phase and the fine-tuning phase for RE. To tackle these issues, we
propose in this paper a multi-modal framework, named GeoLayoutLM, for VIE.
GeoLayoutLM explicitly models the geometric relations in pre-training, which we
call geometric pre-training. Geometric pre-training is achieved by three
specially designed geometry-related pre-training tasks. Additionally, novel
relation heads, which are pre-trained by the geometric pre-training tasks and
fine-tuned for RE, are elaborately designed to enrich and enhance the feature
representation. According to extensive experiments on standard VIE benchmarks,
GeoLayoutLM achieves highly competitive scores in the SER task and
significantly outperforms the previous state-of-the-arts for RE (\eg, the F1
score of RE on FUNSD is boosted from 80.35\% to 89.45\%). The code and models
are publicly available at
https://github.com/AlibabaResearch/AdvancedLiterateMachinery/tree/main/DocumentUnderstanding/GeoLayoutLMComment: CVPR 2023 Highligh
Vision Grid Transformer for Document Layout Analysis
Document pre-trained models and grid-based models have proven to be very
effective on various tasks in Document AI. However, for the document layout
analysis (DLA) task, existing document pre-trained models, even those
pre-trained in a multi-modal fashion, usually rely on either textual features
or visual features. Grid-based models for DLA are multi-modality but largely
neglect the effect of pre-training. To fully leverage multi-modal information
and exploit pre-training techniques to learn better representation for DLA, in
this paper, we present VGT, a two-stream Vision Grid Transformer, in which Grid
Transformer (GiT) is proposed and pre-trained for 2D token-level and
segment-level semantic understanding. Furthermore, a new dataset named DLA,
which is so far the most diverse and detailed manually-annotated benchmark for
document layout analysis, is curated and released. Experiment results have
illustrated that the proposed VGT model achieves new state-of-the-art results
on DLA tasks, e.g. PubLayNet (), DocBank
(), and DLA ().
The code and models as well as the DLA dataset will be made publicly
available ~\url{https://github.com/AlibabaResearch/AdvancedLiterateMachinery}.Comment: Accepted by ICCV202
Effects of magnetic field on thermo-hydraulic performance of Fe3O4-water nanofluids in a corrugated tube
Β© 2018 Elsevier Ltd An experimental system is established to investigate the thermo-hydraulic performance of Fe3O4-water nanofluids in a corrugated tube under various magnetic fields. The influences of magnetic induction intensities (B = 0 G, 100 G, 200 G, 300 G), nanoparticle mass fractions (Ο = 0.0%, 0.1%, 0.3%, 0.5%), electromagnet arrangement modes (one-side electromagnet and two-side staggered electromagnet), kinds of tubes (smooth tube and corrugated tube), Reynolds numbers (Re = 800β12,000) on flow and heat transfer characteristics are discussed. It is obtained that the augmentation of heat transfer is more sensitive to high nanoparticle mass fraction, high magnetic induction intensity, two-side staggered electromagnet and corrugated tube. A Comprehensive evaluation index is applied to estimate the thermo-hydraulic performance. It can be discovered that the comprehensive evaluation index increases with the increasing Reynolds number at first and then decreases, and the rough surface of corrugated tube delays the appearance of critical Reynolds number
Experimental study on the flow and heat transfer characteristics of nanofluids in double-tube heat exchangers based on thermal efficiency assessment
Thermal performance and pressure drop of TiO2-H2O nanofluids in double-tube heat exchangers are investigated. The influence of the thermal fluid (water) volume flow rates (qvβ―=β―1β5β―L/min), nanoparticle mass frictions (Οβ―=β―0.0%, 0.1%, 0.3% and 0.5%), nanofluids locations (shell-side and tube-side), Reynolds numbers of nanofluids (Reβ―=β―3000β12000), and the structures of inner tubes (smooth tube and corrugated tube) is analyzed. Results indicate that nanofluids (Οβ―=β―0.1%, 0.3% and 0.5%) can improve the heat transfer rate by 10.8%, 13.4% and 14.8% at best compared with deionized water respectively, and the number of transfer units (NTU) and effectiveness are all improved. The pressure drop can be increased by 51.9% (tube-side) and 40.7% (shell-side) at best under the condition of using both nanofluids and corrugated inner tube. When the nanofluids flow in the shell-side of the corrugated double-tube heat exchanger, the comprehensive performance of nanofluids-side is better than that of the smooth double-tube heat exchanger
Effect of rotating twisted tape on thermo-hydraulic performances of nanofluids in heat-exchanger systems
Stable TiO2-H2O nanofluids are prepared and their stabilities are studied. An experimental set for studying the heat transfer and flow characteristics of nanofluids is established. Heat transfer and flow characteristics of TiO2-H2O nanofluids in a circular tube with rotating and static built-in twisted tapes are experimentally investigated and compared. An innovative performance evaluation plot of exergy efficiency is developed and the exergy efficiency of tube with rotating and static built-in twisted tapes filled with nanofluids is analyzed in this paper. The results indicate that the combination of rotating built-in twisted tape and TiO2-H2O nanofluids shows an excellent enhancement in heat transfer, which can increase the heat transfer by 101.6% compared with that of in a circular tube. The effects of nanoparticle mass fractions (Ο= 0.1%, 0.3% and 0.5%) and Reynolds numbers (Reβ―=β―600β7000) on the heat transfer and flow characteristics of TiO2-H2O nanofluids are discussed. It is found that there is a critical Reynolds number (Reβ―=β―4500) for the maximum value of relative heat transfer enhancement ratio. The comprehensive performance of the experimental system is analyzed. It can be found that the comprehensive performance index of the experimental system firstly increases and then reduces with Reynolds number, and it can reach 1.519 at best. However, for the performance evaluation of exergy efficiency, the coupling of rotating twisted tape and nanofluids deteriorates the exergy efficiency. Also, it can be found that the exergy efficiency of the circular tube with twisted tape is greater than that of circular tube under the same pumping power and pressure drop, but it shows deterioration under the same mass flow rate
Targeting Tumor-Associated Fibroblasts for Therapeutic Delivery in Desmoplastic Tumors
The off-target distribution of anticancer nanoparticles to fibroblasts creates a barrier to the effective treatment of desmoplastic tumors. However, we hypothesized that this nanoparticle detriment might be exploited to target the expression of secreted cytotoxic proteins from tumor-associated fibroblasts (TAF) as an anticancer strategy. In addressing this hypothesis, plasmids encoding the secretable TNF-related factor sTRAIL were loaded into lipid-coated protamine DNA complexes and administered by infusion in a murine xenograft model of human desmoplastic bladder carcinoma. Three doses were sufficient to generate approximately 70% of TAFs as sTRAIL-producing cells. sTRAIL triggered apoptosis in tumor cell nests adjacent to TAFs. Furthermore, it reverted residual fibroblasts to a quiescent state due to insufficient activation, further compromising tumor growth and remodeling the microenvironment to favor second-wave nanotherapy. We confirmed the efficacy of this strategy in an orthotopic xenograft model of human pancreatic cancer, where the desmoplastic stroma is well known to be a major barrier to the delivery of therapeutic nanoparticles. Collectively, our results offer a proof of concept for the use of nanoparticles to modify TAFs as an effective strategy to treat desmoplastic cancers. Cancer Res; 77(3); 719-31. Β©2016 AACR
The effect of anti-PD-1/PD-L1 antibodies combined with VEGF receptor tyrosine kinase inhibitors versus bevacizumab in unresectable hepatocellular carcinoma
IntroductionImmune checkpoint inhibition (ICI) plus bevacizumab (BEV) is the standard first-line treatment for unresectable hepatocellular carcinoma (uHCC). We aimed to assess the efficacy and safety of ICI plus bevacizumab and ICI plus receptor tyrosine kinase inhibitor (TKI) in this patient population.MethodsThis retrospective single-institution study enrolled 94 patients with uHCC who received ICI plus TKI or bevacizumab as the first-line treatment. Progression-free survival (PFS), overall survival (OS), objective response rate (ORR), and disease control rate (DCR) were used to evaluate treatment efficacy. RECIST v1.1 criteria were used to calculate the objective clinical response. Common Terminology Criteria for Adverse Events were used to report and categorize adverse events.ResultsBy the last follow-up interview on May 15, 2022, there were 57 deaths, and 19 patients did not develop disease progression. Thirty patients received sintilimab/atezolizumab plus bevacizumab (ICI + BEV group), and 64 received ICI plus TKI (ICI + TKI group). The median OS was 430 days (95% CI, 266-NA) in the ICI+TKI group and 498 days (95% CI, 349-NA) in the ICI+BEV group (HR, 1.20; 95% CI, 0.69-2.07; P = 0.52). There was no significant difference between the two groups in the median PFS (182 vs. 221 days, P=0.67). In the ICI+TKI group, the ORR and DCR were 28.1% and 67.2%, respectively. In the ICI+BEV group, the ORR and DCR were 26.7% and 66.7%, respectively. The overall incidence of adverse events was similar between the two groups. Palmar-plantar erythrodysesthesia syndrome (23[36%]) occurred only in the ICI + TKI group. Patients who received ICI+BEV were more prone to upper gastrointestinal bleeding (2 [7%]), with one patient with grade 4 requiring emergency DSA treatment.ConclusionThis study found that ICI+TKI and ICI+BEV as first-line treatments were similar in OS, PFS, and tumor response in uHCC. Different populations are suitable for different regimens because of the different adverse events
T Cell Chemo-Vaccination Effects after Repeated Mucosal SHIV Exposures and Oral Pre-Exposure Prophylaxis
Pre-exposure prophylaxis (PrEP) with anti-viral drugs is currently in clinical trials for the prevention of HIV infection. Induction of adaptive immune responses to virus exposures during anti-viral drug administration, i.e., a βchemo-vaccinationβ effect, could contribute to PrEP efficacy. To study possible chemo-vaccination, we monitored humoral and cellular immune responses in nine rhesus macaques undergoing up to 14 weekly, low-dose SHIVSF162P3 rectal exposures. Six macaques concurrently received PrEP with intermittent, oral Truvada; three were no-PrEP controls. PrEP protected 4 macaques from infection. Two of the four showed evidence of chemo-vaccination, because they developed anti-SHIV CD4+ and CD8+ T cells; SHIV-specific antibodies were not detected. Control macaques showed no anti-SHIV immune responses before infection. Chemo-vaccination-induced T cell responses were robust (up to 3,940 SFU/106 PBMCs), predominantly central memory cells, short-lived (β€22 weeks), and appeared intermittently and with changing specificities. The two chemo-vaccinated macaques were virus-challenged again after 28 weeks of rest, after T cell responses had waned. One macaque was not protected from infection. The other macaque concurrently received additional PrEP. It remained uninfected and T cell responses were boosted during the additional virus exposures. In summary, we document and characterize PrEP-induced T cell chemo-vaccination. Although not protective after subsiding in one macaque, chemo-vaccination-induced T cells warrant more comprehensive analysis during peak responses for their ability to prevent or to control infections after additional exposures. Our findings highlight the importance of monitoring these responses in clinical PrEP trials and suggest that a combination of vaccines and PrEP potentially might enhance efficacy
Recommended from our members
Point Process Analysis of Noise in Early Invertebrate Vision
Noise is a prevalent and sometimes even dominant aspect of many biological processes. While many natural systems have adapted to attenuate or even usefully integrate noise, the variability it introduces often still delimits the achievable precision across biological functions. This is particularly so for visual phototransduction, the process responsible for converting photons of light into usable electrical signals (quantum bumps). Here, randomness of both the photon inputs (regarded as extrinsic noise) and the conversion process (intrinsic noise) are seen as two distinct, independent and significant limitations on visual reliability. Past research has attempted to quantify the relative effects of these noise sources by using approximate methods that do not fully account for the discrete, point process and time ordered nature of the problem. As a result the conclusions drawn from these different approaches have led to inconsistent expositions of phototransduction noise performance. This paper provides a fresh and complete analysis of the relative impact of intrinsic and extrinsic noise in invertebrate phototransduction using minimum mean squared error reconstruction techniques based on Bayesian point process (Snyder) filters. An integrate-fire based algorithm is developed to reliably estimate photon times from quantum bumps and Snyder filters are then used to causally estimate random light intensities both at the front and back end of the phototransduction cascade. Comparison of these estimates reveals that the dominant noise source transitions from extrinsic to intrinsic as light intensity increases. By extending the filtering techniques to account for delays, it is further found that among the intrinsic noise components, which include bump latency (mean delay and jitter) and shape (amplitude and width) variance, it is the mean delay that is critical to noise performance. Consequently, if one wants to increase visual fidelity, reducing the photoconversion lag is much more important than improving the regularity of the electrical signal.This work was supported by the Gates Cambridge Trust (PhD studentship for research) https://www.gatescambridge.org/. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript
- β¦