OVSNet : Towards One-Pass Real-Time Video Object Segmentation

Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent approaches have largely solved them by using backforth re-identification and bi-directional mask propagation. However, their methods are extremely slow and only support offline inference, which in principle cannot be applied in real time. Motivated by this observation, we propose a efficient detection-based paradigm for video object segmentation. We propose an unified One-Pass Video Segmentation framework (OVS-Net) for modeling spatial-temporal representation in a unified pipeline, which seamlessly integrates object detection, object segmentation, and object re-identification. The proposed framework lends itself to one-pass inference that effectively and efficiently performs video object segmentation. Moreover, we propose a maskguided attention module for modeling the multi-scale object boundary and multi-level feature fusion. Experiments on the challenging DAVIS 2017 demonstrate the effectiveness of the proposed framework with comparable performance to the state-of-the-art, and the great efficiency about 11.5 FPS towards pioneering real-time work to our knowledge, more than 5 times faster than other state-of-the-art methods.Comment: 10 pages, 6 figure

A natural framework for arbitrary multi-scale computer science and systems biology efficient computational modeling

The aim of the present paper is to provide the first concise overview of a natural framework for arbitrary multi-scale computer science and systems biology computational modeling. To grasp a more reliable representation of reality and to get more effective modeling techniques, researchers and scientists need two intelligently articulated hands: both stochastic and combinatorial approaches synergically articulated by natural coupling. After a brief introduction about traditional modeling vs. fresh QFT approach, we go to the root of the problem directly. We present key points solution to arbitrary multi-scale modeling problems. The first attempt to identify basic principles to get stronger modeling solution for scientific application has been developing at Politecnico di Milano University since the 1990s. The fundamental principles on computational information conservation theory (CICT), for arbitrary multi-scale system modeling from basic generator and relation through discrete paths denser and denser to one another, towards a never ending 'blending quantum continuum,' are recalled. A computational example is presented and discussed. This paper is a relevant contribute towards arbitrary multi-scale computer science and systems biology modeling, to show how computational information conservation approach can offer stronger and more effective system modeling algorithms for more reliable simulation

Evaluating Precipitation Features and Rainfall Characteristics in a Multi-scale Modeling Framework

Cloud and precipitation systems over the tropics and subtropics are simulated with a multi-scale modeling framework (MMF) and compared against the TRMM radar precipitation features (RPFs) product. A methodology, in close analogy to the TRMM RPFs, is developed to analyze simulated cloud precipitating structures from the embedded two-dimensional cloud-resolving models (CRMs) within an MMF. Despite the two-dimensionality of the CRMs, the simulated RPFs population distribution, and horizontal and vertical structure are in good agreement with TRMM observations. However, some deficits are also found in the model simulations. The model tends to overestimate mean convective precipitation rates for RPFs with a size less than 100 km, contributing to the excessive precipitation biases in the warm pool and western Pacific, western and northern India Ocean, and eastern Pacific commonly found in most MMFs. For large features with a size greater than 150 km, both convective and stratiform rain rates are underestimated. The distribution of maximum radar echo top heights as a function of RPF size is well simulated except the model tends to underestimate the occurrence frequency of maximum heights greater than 15 km. The maximum echo top heights for convective cells embedded within large RPFs with a size greater than 150 km are also underestimated. The cyclic lateral boundary with a limited model domain generates artificial occurrences for RPFs with a size close to the model domain size, producing a significant contribution to the total rainfall due to their sizes. This cyclic lateral boundary effect can be easily identified and quantified in both probability and cumulative distribution functions of RPFs. The geophysical distribution of the population of the largest RPFs in the control experiment shows they are mainly located in the Subtropics but also partially contribute to the common MMF biases of excessive precipitation in the Tropics. Sensitivity experiments using CRMs with different domain sizes and different grid spacings show larger domains (higher resolution) tend to shift the RPFs distribution to large (small) sizes. The cyclic lateral boundary biases increase as CRM domain size decreases. The impacts of model horizontal and vertical resolution on simulated convective systems are also investigated

Deep Optical Flow Estimation Via Multi-Scale Correspondence Structure Learning

As an important and challenging problem in computer vision, learning based optical flow estimation aims to discover the intrinsic correspondence structure between two adjacent video frames through statistical learning. Therefore, a key issue to solve in this area is how to effectively model the multi-scale correspondence structure properties in an adaptive end-to-end learning fashion. Motivated by this observation, we propose an end-to-end multi-scale correspondence structure learning (MSCSL) approach for optical flow estimation. In principle, the proposed MSCSL approach is capable of effectively capturing the multi-scale inter-image-correlation correspondence structures within a multi-level feature space from deep learning. Moreover, the proposed MSCSL approach builds a spatial Conv-GRU neural network model to adaptively model the intrinsic dependency relationships among these multi-scale correspondence structures. Finally, the above procedures for correspondence structure learning and multi-scale dependency modeling are implemented in a unified end-to-end deep learning framework. Experimental results on several benchmark datasets demonstrate the effectiveness of the proposed approach.Comment: 7 pages, 3 figures, 2 table

Microphysics in Multi-scale Modeling System with Unified Physics

Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (1) a cloud-resolving model (Goddard Cumulus Ensemble model, GCE model), (2) a regional scale model (a NASA unified weather research and forecast, WRF), (3) a coupled CRM and global model (Goddard Multi-scale Modeling Framework, MMF), and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer and land processes and the explicit cloud-radiation, and cloud-land surface interactive processes are applied in this multi-scale modeling system. This modeling system has been coupled with a multi-satellite simulator to use NASA high-resolution satellite data to identify the strengths and weaknesses of cloud and precipitation processes simulated by the model. In this talk, a review of developments and applications of the multi-scale modeling system will be presented. In particular, the microphysics development and its performance for the multi-scale modeling system will be presented

Quantum Impurity in Luttinger Liquid: Universal Conductance with Entanglement Renormalization

We study numerically the universal conductance of Luttinger liquids wire with a single impurity via the Muti-scale Entanglement Renormalization Ansatz (MERA). The scale invariant MERA provides an efficient way to extract scaling operators and scaling dimensions for both the bulk and the boundary conformal field theories. By utilizing the key relationship between the conductance tensor and ground-state correlation function, the universal conductance can be evaluated within the framework of the boundary MERA. We construct the boundary MERA to compute the correlation functions and scaling dimensions for the Kane-Fisher fixed points by modeling the single impurity as a junction (weak link) of two interacting wires. We show that the universal behavior of the junction can be easily identified within the MERA and argue that the boundary MERA framework has tremendous potential to classify the fixed points in general multi-wire junctions.Comment: 14 pages, 18 figure

Microphysics in the Multi-Scale Modeling Systems with Unified Physics

In recent years, exponentially increasing computer power has extended Cloud Resolving Model (CRM) integrations from hours to months, the number of computational grid points from less than a thousand to close to ten million. Three-dimensional models are now more prevalent. Much attention is devoted to precipitating cloud systems where the crucial 1-km scales are resolved in horizontal domains as large as 10,000 km in two-dimensions, and 1,000 x 1,000 km2 in three-dimensions. Cloud resolving models now provide statistical information useful for developing more realistic physically based parameterizations for climate models and numerical weather prediction models. It is also expected that NWP and mesoscale model can be run in grid size similar to cloud resolving model through nesting technique. Recently, a multi-scale modeling system with unified physics was developed at NASA Goddard. It consists of (l) a cloud-resolving model (Goddard Cumulus Ensemble model, GCE model), (2) a regional scale model (a NASA unified weather research and forecast, WRF), (3) a coupled CRM and global model (Goddard Multi-scale Modeling Framework, MMF), and (4) a land modeling system. The same microphysical processes, long and short wave radiative transfer and land processes and the explicit cloud-radiation, and cloud-surface interactive processes are applied in this multi-scale modeling system. This modeling system has been coupled with a multi-satellite simulator to use NASA high-resolution satellite data to identify the strengths and weaknesses of cloud and precipitation processes simulated by the model. In this talk, the microphysics developments of the multi-scale modeling system will be presented. In particular, the results from using multi-scale modeling system to study the heavy precipitation processes will be presented