Large-Scale Light Field Capture and Reconstruction

This thesis discusses approaches and techniques to convert Sparsely-Sampled Light Fields (SSLFs) into Densely-Sampled Light Fields (DSLFs), which can be used for visualization on 3DTV and Virtual Reality (VR) devices. Exemplarily, a movable 1D large-scale light field acquisition system for capturing SSLFs in real-world environments is evaluated. This system consists of 24 sparsely placed RGB cameras and two Kinect V2 sensors. The real-world SSLF data captured with this setup can be leveraged to reconstruct real-world DSLFs. To this end, three challenging problems require to be solved for this system: (i) how to estimate the rigid transformation from the coordinate system of a Kinect V2 to the coordinate system of an RGB camera; (ii) how to register the two Kinect V2 sensors with a large displacement; (iii) how to reconstruct a DSLF from a SSLF with moderate and large disparity ranges. To overcome these three challenges, we propose: (i) a novel self-calibration method, which takes advantage of the geometric constraints from the scene and the cameras, for estimating the rigid transformations from the camera coordinate frame of one Kinect V2 to the camera coordinate frames of 12-nearest RGB cameras; (ii) a novel coarse-to-fine approach for recovering the rigid transformation from the coordinate system of one Kinect to the coordinate system of the other by means of local color and geometry information; (iii) several novel algorithms that can be categorized into two groups for reconstructing a DSLF from an input SSLF, including novel view synthesis methods, which are inspired by the state-of-the-art video frame interpolation algorithms, and Epipolar-Plane Image (EPI) inpainting methods, which are inspired by the Shearlet Transform (ST)-based DSLF reconstruction approaches

Optimized reference picture selection for light field image coding

This paper proposes a new reference picture selection method for light field image coding using the pseudo-video sequence (PVS) format. State-of-the-art solutions to encode light field images using the PVS format rely on video coding standards to exploit the inter-view redundancy between each sub-aperture image (SAI) that composes the light field. However, the PVS scanning order is not usually considered by the video codec. The proposed solution signals the PVS scanning order to the decoder, enabling implicit optimized reference picture selection for each specific scanning order. With the proposed method each reference picture is selected by minimizing the Euclidean distance to the current SAI being encoded. Experimental results show that, for the same PVS scanning order, the proposed optimized reference picture selection codec outperforms HEVC video coding standard for light field image coding, up to 50% in terms of bitrate savings.info:eu-repo/semantics/acceptedVersio

Uncovered diversity of a predominantly andean butterfly clade in the brazilian atlantic forest : a revision of the genus praepedaliodes forster (Lepidoptera: Nymphalidae, Satyrinae, Satyrini)

The genus Praepedaliodes Forster, 1964, the only representative of the mega-diverse mostly Andean Pedaliodes complex lineage in the Brazilian Atlantic Forest, is revised. Prior to this study, four species were known, P. phanias (Hewitson, 1862), P. granulata (Butler, 1868), P. amussis (Thieme, 1905) and P. exul (Thieme, 1905). Here, a further six are described, all from SE Brazil, expanding to 10 the number of species in this genus. Lectotypes are designated for P. phanias, P. granulata and P. amussis. The genus is most diverse in the Serra da Mantiqueira (São Paulo, Rio de Janeiro, Minas Gerais) and in the Serra Geral (Paraná, Santa Catarina) with seven species occurring in both ranges. Praepedaliodes phanias is the most widespread species and the only one found in the western part of the Atlantic Forest; only this species and P. duartei Dias, Dolibaina & Pyrcz n. sp. occurring to near sea level. Other species, P. zaccae Dolibaina, Dias & Pyrcz n. sp., P. francinii Freitas & Pyrcz n. sp., P. sequeirae Pyrcz, Dias & Dolbaina n. sp., P. landryi Pyrcz & Freitas n. sp. and P. pawlaki Pyrcz & Boyer n. sp. are strictly montane and the highest species richness is reached at 1400–1800 m. One species, P. sequeirae n. sp., is a narrow endemic found only at timberline in the Agulhas Negras massif above 2300 m. Immature stages are described for two species, P. phanias and P. landryi n. sp. Molecular data (barcode region of cytochrome oxidase, subunit I) and adult morphology, including male and female genitalia, support the genus as monophyletic, belonging to a predominantly Andean clade of the Pedaliodes Butler, 1867 complex. Morphological evidences, in particular female genitalia comparative analysis, indicate the genera Physcopedaliodes Forster, 1964 and Panyapedaliodes Forster, 1964 as possibly the closest relatives to Praepedaliodes. Molecular data are inconclusive in this respect472211255CONSELHO NACIONAL DE DESENVOLVIMENTO CIENTÍFICO E TECNOLÓGICO - CNPQCOORDENAÇÃO DE APERFEIÇOAMENTO DE PESSOAL DE NÍVEL SUPERIOR - CAPESFUNDAÇÃO DE AMPARO À PESQUISA DO ESTADO DE SÃO PAULO - FAPESP302585/2011-7, 303834/2015-3; 563332/2010-7; 41143/2009-6; 150542/2013-5; 308247/2013-2; 304639/2014-1Não tem2016/15873-8; 2011/50225-3; 2013/50297-0We would like to express our gratitude the following persons who contributed at different stages in the elaboration of this paper: Alfred Moser (Porto Alegre), Ronaldo Francini (UNISANTOS) and André Tacioli, Junia Y. O. Carreira, Jessie P. Santos and Ana K. Silva (Unicamp) for logistical help in the field, comparison material and hosting Tamara M. C. Aguiar spread most of the adult DNA vouchers and the old material collected by K. S. Brown Jr. The following people helped by sending material and information: Roberto R. Greve (Foz do Iguaçu), Richard Raby (Serra da Bocaina), Augusto H. B. Rosa (Mantiqueira region), Geanne C. N. Pereira (Serra do Cipó) and Keith S. Brown Jr. (several places in SE Brazil). The authors also thank the ICMBio for the permits (#10438-1, #26712-4 and #10802-9), the CNPq by aproving our Scientific Expedition (portaria N° 240, de 11 de março de 2014) and all managers of the Conservation Unities visited during the development of the present study, in special Waldomiro P. Lopes (Parque Nacional do Caparaó), Léo Nascimento (Parque Nacional do Itatiaia), Mara P. Pais (Parque Nacional da Serra da Bocaina), Ingo Grantsau (Paranapiacaba) and Cecilia Cronemberger (Parque Nacional da Serra dos Órgãos). EPB thanks Fundação de Amparo à Pesquisa no Estado de São Paulo (FAPESP) for a Post-doc fellowship (2016/15873-8). AVLF thanks the CNPq (fellowships 302585/2011-7, 303834/2015-3 and SISBIOTABrasil/CNPq - 563332/2010-7), the National Science Foundation (DEB-1256742), the “Rede Nacional de Identificação Molecular da Biodiversidade - BR-BoL” (MCT/CNPq/FNDCT 50/2010) and the BIOTA-FAPESP Program (2011/50225-3 and 2013/50297-0). Kim Garwood kindly provided the photographs of two species of Praepedaliodes in their natural habitat. Keith Willmott read the manuscript and added several valuable suggestions. Carlos Prieto provided the photograph of the syntype of Praepedaliodes amussis. TWP field work in SE Brazil was supported by MZ/IZ/UJ internal grants. FMSD, DRD, OHHM and MMC thank Coordenação de Aperfeiçoamento de Pessoal de Nível Superior (CAPES, Edital 15/2014 CAPES/EMBRAPA) and Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq, 141143/2009-6, 150542/2013-5, 308247/2013-2, 304639/2014-1), for the fellowships granted to the author

Light field image coding based on hybrid data representation

This paper proposes a novel efficient light field coding approach based on a hybrid data representation. Current state-of-the-art light field coding solutions either operate on micro-images or sub-aperture images. Consequently, the intrinsic redundancy that exists in light field images is not fully exploited, as is demonstrated. This novel hybrid data representation approach allows to simultaneously exploit four types of redundancies: i) sub-aperture image intra spatial redundancy, ii) sub-aperture image inter-view redundancy, iii) intra-micro-image redundancy, and iv) inter-micro-image redundancy between neighboring micro-images. The proposed light field coding solution allows flexibility for several types of baselines, by adaptively exploiting the most predominant type of redundancy on a coding block basis. To demonstrate the efficiency of using a hybrid representation, this paper proposes a set of efficient pixel prediction methods combined with a pseudo-video sequence coding approach, based on the HEVC standard. Experimental results show consistent average bitrate savings when the proposed codec is compared to relevant state-of-the-art benchmarks. For lenslet light field content, the proposed coding algorithm outperforms the HEVC-based pseudo-video sequence coding benchmark by an average bitrate savings of 23%. It is shown for the same light field content that the proposed solution outperforms JPEG Pleno verification models MuLE and WaSP, as these codecs are only able to achieve 11% and -14% bitrate savings over the same HEVC-based benchmark, respectively. The performance of the proposed coding approach is also validated for light fields with wider baselines, captured with high-density camera arrays, being able to outperform both the HEVC-based benchmark, as well as MuLE and WaSP.info:eu-repo/semantics/publishedVersio

Methods for 3D Geometry Processing in the Cultural Heritage Domain

This thesis presents methods for 3D geometry processing under the aspects of cultural heritage applications. After a short overview over the relevant basics in 3D geometry processing, the present thesis investigates the digital acquisition of 3D models. A particular challenge in this context are on the one hand difficult surface or material properties of the model to be captured. On the other hand, the fully automatic reconstruction of models even with suitable surface properties that can be captured with Laser range scanners is not yet completely solved. This thesis presents two approaches to tackle these challenges. One exploits a thorough capture of the object’s appearance and a coarse reconstruction for a concise and realistic object representation even for objects with problematic surface properties like reflectivity and transparency. The other method concentrates on digitisation via Laser-range scanners and exploits 2D colour images that are typically recorded with the range images for a fully automatic registration technique. After reconstruction, the captured models are often still incomplete, exhibit holes and/or regions of insufficient sampling. In addition to that, holes are often deliberately introduced into a registered model to remove some undesired or defective surface part. In order to produce a visually appealing model, for instance for visualisation purposes, for prototype or replica production, these holes have to be detected and filled. Although completion is a well-established research field in 2D image processing and many approaches do exist for image completion, surface completion in 3D is a fairly new field of research. This thesis presents a hierarchical completion approach that employs and extends successful exemplar-based 2D image processing approaches to 3D and fills in detail-equipped surface patches into missing surface regions. In order to identify and construct suitable surface patches, selfsimilarity and coherence properties of the surface context of the hole are exploited. In addition to the reconstruction and repair, the present thesis also investigates methods for a modification of captured models via interactive modelling. In this context, modelling is regarded as a creative process, for instance for animation purposes. On the other hand, it is also demonstrated how this creative process can be used to introduce human expertise into the otherwise automatic completion process. This way, reconstructions are feasible even of objects where already the data source, the object itself, is incomplete due to corrosion, demolition, or decay.Methoden zur 3D-Geometrieverarbeitung im Kulturerbesektor In dieser Arbeit werden Methoden zur Bearbeitung von digitaler 3D-Geometrie unter besonderer Berücksichtigung des Anwendungsbereichs im Kulturerbesektor vorgestellt. Nach einem kurzen Überblick über die relevanten Grundlagen der dreidimensionalen Geometriebehandlung wird zunächst die digitale Akquise von dreidimensionalen Objekten untersucht. Eine besondere Herausforderung stellen bei der Erfassung einerseits ungünstige Oberflächen- oder Materialeigenschaften der Objekte dar (wie z.B. Reflexivität oder Transparenz), andererseits ist auch die vollautomatische Rekonstruktion von solchen Modellen, die sich verhältnismäßig problemlos mit Laser-Range Scannern erfassen lassen, immer noch nicht vollständig gelöst. Daher bilden zwei neuartige Verfahren, die diesen Herausforderungen begegnen, den Anfang. Auch nach der Registrierung sind die erfassten Datensätze in vielen Fällen unvollständig, weisen Löcher oder nicht ausreichend abgetastete Regionen auf. Darüber hinaus werden in vielen Anwendungen auch, z.B. durch Entfernen unerwünschter Oberflächenregionen, Löcher gewollt hinzugefügt. Für eine optisch ansprechende Rekonstruktion, vor allem zu Visualisierungszwecken, im Bildungs- oder Unterhaltungssektor oder zur Prototyp- und Replik-Erzeugung müssen diese Löcher zunächst automatisch detektiert und anschließend geschlossen werden. Obwohl dies im zweidimensionalen Fall der Bildbearbeitung bereits ein gut untersuchtes Forschungsfeld darstellt und vielfältige Ansätze zur automatischen Bildvervollständigung existieren, ist die Lage im dreidimensionalen Fall anders, und die Übertragung von zweidimensionalen Ansätzen in den 3D stellt vielfach eine große Herausforderung dar, die bislang keine zufriedenstellenden Lösungen erlaubt hat. Nichtsdestoweniger wird in dieser Arbeit ein hierarchisches Verfahren vorgestellt, das beispielbasierte Konzepte aus dem 2D aufgreift und Löcher in Oberflächen im 3D unter Ausnutzung von Selbstähnlichkeiten und Kohärenzeigenschaften des Oberflächenkontextes schließt. Um plausible Oberflächen zu erzeugen werden die Löcher dabei nicht nur glatt gefüllt, sondern auch feinere Details aus dem Kontext rekonstruiert. Abschließend untersucht die vorliegende Arbeit noch die Modifikation der vervollständigten Objekte durch Freiformmodellierung. Dies wird dabei zum einen als kreativer Prozess z.B. zu Animationszwecken betrachtet. Zum anderen wird aber auch untersucht, wie dieser kreative Prozess benutzt werden kann, um etwaig vorhandenes Expertenwissen in die ansonsten automatische Vervollständigung mit einfließen zu lassen. Auf diese Weise werden auch Rekonstruktionen ermöglicht von Objekten, bei denen schon die Datenquelle, also das Objekt selbst z.B. durch Korrosion oder mutwillige Zerstörung unvollständig ist