20,967 research outputs found

    Depth map compression via 3D region-based representation

    Get PDF
    In 3D video, view synthesis is used to create new virtual views between encoded camera views. Errors in the coding of the depth maps introduce geometry inconsistencies in synthesized views. In this paper, a new 3D plane representation of the scene is presented which improves the performance of current standard video codecs in the view synthesis domain. Two image segmentation algorithms are proposed for generating a color and depth segmentation. Using both partitions, depth maps are segmented into regions without sharp discontinuities without having to explicitly signal all depth edges. The resulting regions are represented using a planar model in the 3D world scene. This 3D representation allows an efficient encoding while preserving the 3D characteristics of the scene. The 3D planes open up the possibility to code multiview images with a unique representation.Postprint (author's final draft

    Plane-Based Optimization of Geometry and Texture for RGB-D Reconstruction of Indoor Scenes

    Full text link
    We present a novel approach to reconstruct RGB-D indoor scene with plane primitives. Our approach takes as input a RGB-D sequence and a dense coarse mesh reconstructed by some 3D reconstruction method on the sequence, and generate a lightweight, low-polygonal mesh with clear face textures and sharp features without losing geometry details from the original scene. To achieve this, we firstly partition the input mesh with plane primitives, simplify it into a lightweight mesh next, then optimize plane parameters, camera poses and texture colors to maximize the photometric consistency across frames, and finally optimize mesh geometry to maximize consistency between geometry and planes. Compared to existing planar reconstruction methods which only cover large planar regions in the scene, our method builds the entire scene by adaptive planes without losing geometry details and preserves sharp features in the final mesh. We demonstrate the effectiveness of our approach by applying it onto several RGB-D scans and comparing it to other state-of-the-art reconstruction methods.Comment: in International Conference on 3D Vision 2018; Models and Code: see https://github.com/chaowang15/plane-opt-rgbd. arXiv admin note: text overlap with arXiv:1905.0885

    Subaru Weak Lensing Study of Seven Merging Clusters: Distributions of Mass and Baryons

    Get PDF
    We present and compare projected distributions of mass, galaxies, and the intracluster medium (ICM) for a sample of merging clusters of galaxies based on the joint weak-lensing, optical photometric, and X-ray analysis. Our sample comprises seven nearby Abell clusters, for which we have conducted systematic, deep imaging observations with Suprime-Cam on Subaru telescope. Our seven target clusters, representing various merging stages and conditions, allow us to investigate in details the physical interplay between dark matter, ICM, and galaxies associated with cluster formation and evolution. A1750 and A1758 are binary systems consisting of two cluster-sized components, A520, A754, A1758N, A1758S, and A1914 are on-going cluster mergers, and A2034 and A2142 are cold-front clusters. In the binary clusters, the projected mass, optical light, and X-ray distributions are overall similar and regular without significant substructures. On-going and cold-front merging clusters, on the other hand, reveal highly irregular mass distributions. Overall the mass distribution appears to be similar to the galaxy luminosity distribution, whereas their distributions are quite different from the ICM distribution in a various ways. We also measured for individual targets the global cluster parameters such as the cluster mass,the mass-to-light ratio, and the ICM temperature. A comparison of the ICM and virial temperatures of merging clusters from X-ray and weak-lensing analyses, respectively, shows that the ICM temperature of on-going and cold-front clusters is significantly higher than the cluster virial temperature by a factor of 2\sim 2. This temperature excess in the ICM could be explained by the effects of merger boosts.Comment: "High-resolution pictures available at http://www.astr.tohoku.ac.jp/~okabe/files/7merger_color.pdf". The published version is available on-line free of charge by the end of 2008 at http://pasj.asj.or.jp/v60/n2/600223/600223.pd

    JigsawNet: Shredded Image Reassembly using Convolutional Neural Network and Loop-based Composition

    Full text link
    This paper proposes a novel algorithm to reassemble an arbitrarily shredded image to its original status. Existing reassembly pipelines commonly consist of a local matching stage and a global compositions stage. In the local stage, a key challenge in fragment reassembly is to reliably compute and identify correct pairwise matching, for which most existing algorithms use handcrafted features, and hence, cannot reliably handle complicated puzzles. We build a deep convolutional neural network to detect the compatibility of a pairwise stitching, and use it to prune computed pairwise matches. To improve the network efficiency and accuracy, we transfer the calculation of CNN to the stitching region and apply a boost training strategy. In the global composition stage, we modify the commonly adopted greedy edge selection strategies to two new loop closure based searching algorithms. Extensive experiments show that our algorithm significantly outperforms existing methods on solving various puzzles, especially those challenging ones with many fragment pieces

    MC2^2: Subaru and Hubble Space Telescope Weak-Lensing Analysis of the Double Radio Relic Galaxy Cluster PLCK G287.0+32.9

    Full text link
    The second most significant detection of the Planck Sunyaev Zel'dovich survey, PLCK~G287.0+32.9 (z=0.385z=0.385) boasts two similarly bright radio relics and a radio halo. One radio relic is located 400\sim 400 kpc northwest of the X-ray peak and the other 2.8\sim 2.8 Mpc to the southeast. This large difference suggests that a complex merging scenario is required. A key missing puzzle for the merging scenario reconstruction is the underlying dark matter distribution in high resolution. We present a joint Subaru Telescope and {\it Hubble Space Telescope} weak-lensing analysis of the cluster. Our analysis shows that the mass distribution features four significant substructures. Of the substructures, a primary cluster of mass $M_{200\text{c}}=1.59^{+0.25}_{-0.22}\times 10^{15} \ h^{-1}_{70} \ \text{M}_{\odot}dominatestheweaklensingsignal.Thisclusterislikelytobeundergoingamergerwithone(ormore)subclusterwhosemassisapproximatelyafactorof10lower.Onecandidateisthesubclusterofmass dominates the weak-lensing signal. This cluster is likely to be undergoing a merger with one (or more) subcluster whose mass is approximately a factor of 10 lower. One candidate is the subcluster of mass M_{200\text{c}}=1.16^{+0.15}_{-0.13}\times 10^{14} \ h^{-1}_{70} \ \text{M}_{\odot}located located \sim 400kpctothesoutheast.ThelocationofthissubclustersuggeststhatitsinteractionwiththeprimaryclustercouldbethesourceoftheNWradiorelic.Anothersubclusterisdetected kpc to the southeast. The location of this subcluster suggests that its interaction with the primary cluster could be the source of the NW radio relic. Another subcluster is detected \sim 2MpctotheSEoftheXraypeakwithmass Mpc to the SE of the X-ray peak with mass M_{200\text{c}}=1.68^{+0.22}_{-0.20}\times 10^{14} \ h^{-1}_{70} \ \text{M}_{\odot}.ThisSEsubclusterisinthevicinityoftheSEradiorelicandmayhavecreatedtheSEradiorelicduringapastmergerwiththeprimarycluster.Thefourthsubcluster,. This SE subcluster is in the vicinity of the SE radio relic and may have created the SE radio relic during a past merger with the primary cluster. The fourth subcluster, M_{200\text{c}}=1.87^{+0.24}_{-0.22}\times 10^{14} \ h^{-1}_{70} \ \text{M}_{\odot}$, is northwest of the X-ray peak and beyond the NW radio relic.Comment: 19 pages, 14 figures; Accepted to Ap

    Self-correction of 3D reconstruction from multi-view stereo images

    Get PDF
    We present a self-correction approach to improving the 3D reconstruction of a multi-view 3D photogrammetry system. The self-correction approach has been able to repair the reconstructed 3D surface damaged by depth discontinuities. Due to self-occlusion, multi-view range images have to be acquired and integrated into a watertight nonredundant mesh model in order to cover the extended surface of an imaged object. The integrated surface often suffers from “dent” artifacts produced by depth discontinuities in the multi-view range images. In this paper we propose a novel approach to correcting the 3D integrated surface such that the dent artifacts can be repaired automatically. We show examples of 3D reconstruction to demonstrate the improvement that can be achieved by the self-correction approach. This self-correction approach can be extended to integrate range images obtained from alternative range capture devices
    corecore