Semantic 3D Reconstruction with Finite Element Bases

We propose a novel framework for the discretisation of multi-label problems on arbitrary, continuous domains. Our work bridges the gap between general FEM discretisations, and labeling problems that arise in a variety of computer vision tasks, including for instance those derived from the generalised Potts model. Starting from the popular formulation of labeling as a convex relaxation by functional lifting, we show that FEM discretisation is valid for the most general case, where the regulariser is anisotropic and non-metric. While our findings are generic and applicable to different vision problems, we demonstrate their practical implementation in the context of semantic 3D reconstruction, where such regularisers have proved particularly beneficial. The proposed FEM approach leads to a smaller memory footprint as well as faster computation, and it constitutes a very simple way to enable variable, adaptive resolution within the same model

Texture Segregation By Visual Cortex: Perceptual Grouping, Attention, and Learning

A neural model is proposed of how laminar interactions in the visual cortex may learn and recognize object texture and form boundaries. The model brings together five interacting processes: region-based texture classification, contour-based boundary grouping, surface filling-in, spatial attention, and object attention. The model shows how form boundaries can determine regions in which surface filling-in occurs; how surface filling-in interacts with spatial attention to generate a form-fitting distribution of spatial attention, or attentional shroud; how the strongest shroud can inhibit weaker shrouds; and how the winning shroud regulates learning of texture categories, and thus the allocation of object attention. The model can discriminate abutted textures with blurred boundaries and is sensitive to texture boundary attributes like discontinuities in orientation and texture flow curvature as well as to relative orientations of texture elements. The model quantitatively fits a large set of human psychophysical data on orientation-based textures. Object boundar output of the model is compared to computer vision algorithms using a set of human segmented photographic images. The model classifies textures and suppresses noise using a multiple scale oriented filterbank and a distributed Adaptive Resonance Theory (dART) classifier. The matched signal between the bottom-up texture inputs and top-down learned texture categories is utilized by oriented competitive and cooperative grouping processes to generate texture boundaries that control surface filling-in and spatial attention. Topdown modulatory attentional feedback from boundary and surface representations to early filtering stages results in enhanced texture boundaries and more efficient learning of texture within attended surface regions. Surface-based attention also provides a self-supervising training signal for learning new textures. Importance of the surface-based attentional feedback in texture learning and classification is tested using a set of textured images from the Brodatz micro-texture album. Benchmark studies vary from 95.1% to 98.6% with attention, and from 90.6% to 93.2% without attention.Air Force Office of Scientific Research (F49620-01-1-0397, F49620-01-1-0423); National Science Foundation (SBE-0354378); Office of Naval Research (N00014-01-1-0624

Controls on early‐rift geometry: new perspectives from the Bilila‐Mtakataka fault, Malawi

We use the ~110 km long Bilila‐Mtakataka fault in the amagmatic southern East African Rift, Malawi, to investigate the controls on early‐rift geometry at the scale of a major border fault. Morphological variations along the 14±8 m high scarp define six 10‐40 km long segments, which are either foliation parallel, or oblique to both foliation and the current regional extension direction. As the scarp is neither consistently parallel to foliation, nor well oriented for the current regional extension direction, we suggest the segmented surface expression is related to the local reactivation of well oriented weak shallow fabrics above a broadly continuous structure at depth. Using a geometrical model, the geometry of the best‐fitting subsurface structure is consistent with the local strain field from recent seismicity. In conclusion, within this early‐rift, pre‐existing weaknesses only locally control border fault geometry at subsurface

A step towards understanding paper documents

This report focuses on analysis steps necessary for a paper document processing. It is divided in three major parts: a document image preprocessing, a knowledge-based geometric classification of the image, and a expectation-driven text recognition. It first illustrates the several low level image processing procedures providing the physical document structure of a scanned document image. Furthermore, it describes a knowledge-based approach, developed for the identification of logical objects (e.g., sender or the footnote of a letter) in a document image. The logical identifiers provide a context-restricted consideration of the containing text. While using specific logical dictionaries, a expectation-driven text recognition is possible to identify text parts of specific interest. The system has been implemented for the analysis of single-sided business letters in Common Lisp on a SUN 3/60 Workstation. It is running for a large population of different letters. The report also illustrates and discusses examples of typical results obtained by the system

Oblique Longwave Infrared Atmospheric Compensation

This research introduces two novel oblique longwave infrared atmospheric compensation techniques for hyperspectral imagery, Oblique In-Scene Atmospheric Compensation (OISAC) and Radiance Detrending (RD). Current atmospheric compensation algorithms have been developed for nadir-viewing geometries which assume that every pixel in the scene is affected by the atmosphere in nearly the same manner. However, this assumption is violated in oblique imaging conditions where the transmission and path radiance vary continuously as a function of object-sensor range, negatively impacting current algorithms in their ability to compensate for the atmosphere. The techniques presented here leverage the changing viewing conditions to improve rather than hinder atmospheric compensation performance. Initial analyses of both synthetic and measured hyperspectral images suggest improved performance in oblique viewing conditions compared to standard techniques. OISAC is an extension of ISAC, a technique that has been used extensively for LWIR AC applications for over 15 years, that has been developed to incorporate the range-dependence of atmospheric transmission and path radiance in identification of the atmospheric state. Similar to ISAC, OISAC requires the existence of near blackbody-like materials over the 11.73 micrometer water band. RD is a newer technique which features unsupervised classification of materials and identifies the atmospheric state which best detrends the observed radiance across all classes of materials, including those of low emissivity

Earthquake‐induced landslide scenarios for seismic microzonation. Application to the Accumoli area (Rieti, Italy)

Scenarios of earthquake-induced landslides are necessary for seismic microzonation (SM) studies since they must be integrated with the mapping of instability areas. The PARSIFAL (Probabilistic Approach to pRovide Scenarios of earthquake‐Induced slope FAiLures) approach provides extensive analyses, over tens to thousands of square kilometers, and is designed as a fully comprehensive methodology to output expected scenarios which depend on seismic input and saturation conditions. This allows to attribute a rating, in terms of severity level, to the landslide-prone slope areas in view of future engineering studies and designs. PARSIFAL takes into account first-time rock- and earth-slides as well as re-activations of existing landslides performing slope stability analyses of different failure mechanisms. The results consist of mapping earthquake-induced landslide scenarios in terms of exceedance probability of critical threshold values of co-seismic displacements (P[D≥Dc|a(t),ay]). PARSIFAL was applied in the framework of level 3 SM studies over the municipality area of Accumoli (Rieti, Italy), strongly struck by the 2016 seismic sequence of Central Apennines. The use of the PARSIFAL was tested for the first time to screen the Susceptibility Zones (ZSFR) from the Attention Zones (ZAFR) in the category of the unstable areas, according to the guidelines by Italian Civil Protection. The results obtained were in a GIS-based mapping representing the possibility for a landslide to be induced by an earthquake (with a return period of 475 years) in three different saturation scenarios (i.e. dry, average, full). Only 41% of the landslide-prone areas in the Municipality of Accumoli are existing events, while the remaining 59% is characterized by first-time earth- or rock-slides. In dry conditions, unstable conditions or P[D≥Dc|a(t),ay]>0 were for 54% of existing landslides, 17% of first-time rock-slides and 1% of first-time earth- slides. In full saturation conditions, the findings are much more severe since unstable conditions or P[D≥Dc|a(t),ay]>0 were found for 58% of the existing landslides and for more than 80% of first-time rock- and earth-slides. Moreover, comparison of the total area of the ZAFR versus ZSFR, resulted in PARSIFAL screening reducing of 22% of the mapped ZAFR

Morphological and multi-level geometrical descriptor analysis in CT and MRI volumes for automatic pancreas segmentation

Automatic pancreas segmentation in 3D radiological scans is a critical, yet challenging task. As a prerequisite for computer-aided diagnosis (CADx) systems, accurate pancreas segmentation could generate both quantitative and qualitative information towards establishing the severity of a condition, and thus provide additional guidance for therapy planning. Since the pancreas is an organ of high inter-patient anatomical variability, previous segmentation approaches report lower quantitative accuracy scores in comparison to abdominal organs such as the liver or kidneys. This paper presents a novel approach for automatic pancreas segmentation in magnetic resonance imaging (MRI) and computer tomography (CT) scans. This method exploits 3D segmentation that, when coupled with geometrical and morphological characteristics of abdominal tissue, classifies distinct contours in tight pixel-range proximity as “pancreas” or “non-pancreas”. There are three main stages to this approach: (1) identify a major pancreas region and apply contrast enhancement to differentiate between pancreatic and surrounding tissue; (2) perform 3D segmentation via continuous max-flow and min-cuts approach, structured forest edge detection, and a training dataset of annotated pancreata; (3) eliminate non-pancreatic contours from resultant segmentation via morphological operations on area, structure and connectivity between distinct contours. The proposed method is evaluated on a dataset containing 82 CT image volumes, achieving mean Dice Similarity coefficient (DSC) of 79.3 ± 4.4%. Two MRI datasets containing 216 and 132 image volumes are evaluated, achieving mean DSC 79.6 ± 5.7% and 81.6 ± 5.1% respectively. This approach is statistically stable, reflected by lower metrics in standard deviation in comparison to state-of-the-art approaches