70 research outputs found

    EnsNet: Ensconce Text in the Wild

    Full text link
    A new method is proposed for removing text from natural images. The challenge is to first accurately localize text on the stroke-level and then replace it with a visually plausible background. Unlike previous methods that require image patches to erase scene text, our method, namely ensconce network (EnsNet), can operate end-to-end on a single image without any prior knowledge. The overall structure is an end-to-end trainable FCN-ResNet-18 network with a conditional generative adversarial network (cGAN). The feature of the former is first enhanced by a novel lateral connection structure and then refined by four carefully designed losses: multiscale regression loss and content loss, which capture the global discrepancy of different level features; texture loss and total variation loss, which primarily target filling the text region and preserving the reality of the background. The latter is a novel local-sensitive GAN, which attentively assesses the local consistency of the text erased regions. Both qualitative and quantitative sensitivity experiments on synthetic images and the ICDAR 2013 dataset demonstrate that each component of the EnsNet is essential to achieve a good performance. Moreover, our EnsNet can significantly outperform previous state-of-the-art methods in terms of all metrics. In addition, a qualitative experiment conducted on the SMBNet dataset further demonstrates that the proposed method can also preform well on general object (such as pedestrians) removal tasks. EnsNet is extremely fast, which can preform at 333 fps on an i5-8600 CPU device.Comment: 8 pages, 8 figures, 2 tables, accepted to appear in AAAI 201

    Towards Robust Visual Information Extraction in Real World: New Dataset and Novel Solution

    Full text link
    Visual information extraction (VIE) has attracted considerable attention recently owing to its various advanced applications such as document understanding, automatic marking and intelligent education. Most existing works decoupled this problem into several independent sub-tasks of text spotting (text detection and recognition) and information extraction, which completely ignored the high correlation among them during optimization. In this paper, we propose a robust visual information extraction system (VIES) towards real-world scenarios, which is a unified end-to-end trainable framework for simultaneous text detection, recognition and information extraction by taking a single document image as input and outputting the structured information. Specifically, the information extraction branch collects abundant visual and semantic representations from text spotting for multimodal feature fusion and conversely, provides higher-level semantic clues to contribute to the optimization of text spotting. Moreover, regarding the shortage of public benchmarks, we construct a fully-annotated dataset called EPHOIE (https://github.com/HCIILAB/EPHOIE), which is the first Chinese benchmark for both text spotting and visual information extraction. EPHOIE consists of 1,494 images of examination paper head with complex layouts and background, including a total of 15,771 Chinese handwritten or printed text instances. Compared with the state-of-the-art methods, our VIES shows significant superior performance on the EPHOIE dataset and achieves a 9.01% F-score gain on the widely used SROIE dataset under the end-to-end scenario.Comment: 8 pages, 5 figures, to be published in AAAI 202

    A lightweight path consistency verification based on INT in SDN

    Get PDF
    The existing path consistency verification solutions in software-defined networking (SDN) were implemented by proactive injecting large number of probing packets or by embedding linear-scale tags as the path lengthens, which incurred significant bandwidth and communication overhead. A lightweight path consistency validation mechanism based on in-band network telemetry (INT) in SDN is proposed. Based on INT, in the scheme, the ingress switch inserts a telemetry instruction header with probability, each subsequent switch updates the telemetry data using a uniform sampling algorithm and only carries partial path information in INT packet to keep the head space size constant, the egress switch reports the final sampled telemetry data to the controller to verify the path compliance according to aggregated telemetry data. A heuristic flow selection algorithm is proposed to implement network-level path consistency validation. The proposed scheme was implemented and evaluated. The analyses and experiments demonstrate the proposed mechanism effectively limits the packet head overhead and introduces less than 7% of additional forwarding delays and 6% of throughput degradation at most

    Assessing water and energy fluxes in a regional hydrosystem: case study of the Seine basin

    Get PDF
    While it is well accepted that climate change and growing water needs affect long-term sustainable water resources management, performing accurate simulations of water cycle and energy balance dynamics at regional scale remains a challenging task.Traditional Soil-Vegetation-Atmosphere-Transfer (SVAT) models are used for numerical surface water and energy simulations. These models, by conception, do not account for the groundwater lower boundary that permits a full hydrosystem representation. Conversely, while addressing important features such as subsurface heterogeneity and river–aquifer exchanges, groundwater models often integrate overly simplified upper boundary conditions ignoring soil heating and the impacts of vegetation processes on radiation fluxes and root-zone uptakes. In this paper, one of the first attempts to jointly model water and energy fluxes with a special focus on both surface and groundwater at the regional scale is proposed on the Seine hydrosystem (78,650 km2^{2}), which overlays one of the main multi-aquifer systems of Europe.This study couples the SVAT model ORCHIDEE and the process-based hydrological–hydrogeological model CaWaQS, which describes water fluxes, via a one-way coupling approach from ORCHIDEE toward CaWaQS based on the blueprint published by [de Marsily et al., 1978]. An original transport library based on the resolution of the diffusion/advection transport equation was developed in order to simulate heat transfer in both 1D-river networks and pseudo-3D aquifer systems. In addition, an analytical solution is used to simulate heat transport through aquitards and streambeds. Simulated ORCHIDEE surface water and energy fluxes feed fast surface runoff and slow recharge respectively and then is used as CaWaQS forcings to compute river discharges, hydraulic heads and temperature dynamics through space and time, within each of the hydrosystem compartments. The tool makes it possible to establish a fully consistent water and energy budget over a period of 17 years. It also simulates temperature evolution in each aquifer and evaluates that river thermal regulation mostly relies by order of importance on short wave radiations (109.3 W{\cdot }m2^{-2}), groundwater fluxes (48.1 W{\cdot }m2^{-2}) and surface runoff (22.7 W{\cdot }m2^{-2})
    corecore