A supervised hierarchical segmentation of remote-sensing images using a committee of multi-scale convolutional neural networks

This paper presents a supervised, hierarchical remote-sensing image segmentation technique using a committee of multi-scale convolutional neural networks. With existing techniques, segmentation is achieved through fine-tuning a set of predefined feature detectors. However, such a solution is not robust since the introduction of new sensors or applications would require novel features and techniques to be developed. Conversely, the proposed method achieves segmentation through a set of learnt feature detectors. In order to learn feature detectors, the proposed method exploits a committee of convolutional neural networks that perform multi-scale analysis on each band in order to derive individual confidence maps on region boundaries. Confidence maps are then inter-fused in order to produce a fused confidence map. Furthermore, the fused map is intra-fused using a morphological scheme into a hierarchical segmentation map. The proposed method is quantitatively compared to baseline techniques on a publicly available data set. The results presented in this paper highlight the improved accuracy of the proposed method

Information Extraction and Modeling from Remote Sensing Images: Application to the Enhancement of Digital Elevation Models

To deal with high complexity data such as remote sensing images presenting metric resolution over large areas, an innovative, fast and robust image processing system is presented. The modeling of increasing level of information is used to extract, represent and link image features to semantic content. The potential of the proposed techniques is demonstrated with an application to enhance and regularize digital elevation models based on information collected from RS images

Automatic road network extraction from high resolution satellite imagery using spectral classification methods

Road networks play an important role in a number of geospatial applications, such as cartographic, infrastructure planning and traffic routing software. Automatic and semi-automatic road network extraction techniques have significantly increased the extraction rate of road networks. Automated processes still yield some erroneous and incomplete results and costly human intervention is still required to evaluate results and correct errors. With the aim of improving the accuracy of road extraction systems, three objectives are defined in this thesis: Firstly, the study seeks to develop a flexible semi-automated road extraction system, capable of extracting roads from QuickBird satellite imagery. The second objective is to integrate a variety of algorithms within the road network extraction system. The benefits of using each of these algorithms within the proposed road extraction system, is illustrated. Finally, a fully automated system is proposed by incorporating a number of the algorithms investigated throughout the thesis. CopyrightDissertation (MSc)--University of Pretoria, 2010.Computer Scienceunrestricte

Processing of optic and radar images.Application in satellite remote sensing of snow, ice and glaciers

Ce document présente une synthèse de mes activités de recherche depuis la soutenance de ma thèse en 1999. L'activité rapportée ici est celle d'un ingénieur de recherche, et donc s'est déroulée en parallèle d'une activité ``technique'' comprenant des taches d'instrumentation en laboratoire, d'instrumentation de plateformes en montagne, de raids scientifiques sur les calottes polaires, d'élaboration de projets scientifiques, d'organisation d'équipes ou d'ordre administratif. Je suis Ingénieur de recherche CNRS depuis 2004 affecté au laboratoire Gipsa-lab, une unité mixte de recherche du CNRS, de Grenoble-INP, de l'université Joseph Fourier et de l'université Stendhal. Ce laboratoire (d'environ 400 personnes), conventionné avec l'INRIA, l'Observatoire de Grenoble et l'université Pierre Mendès France, est pluridisciplinaire et développe des recherches fondamentales et finalisées sur les signaux et les systèmes complexes.}Lors de la préparation de ma thèse (mi-temps 1995-99) au LGGE, je me suis intéressé au traitement des images de microstructures de la neige, du névé et de la glace. C'est assez naturellement que j'ai rejoint le laboratoire LIS devenu Gipsa-lab pour y développer des activités de traitement des images Radar à Synthèse d'Ouverture (RSO) appliqué aux milieux naturels neige, glace et glaciers. Etant le premier à générer un interférogramme différentiel des glaciers des Alpes, j'ai continué à travailler sur la phase interférométrique pour extraire des informations de déplacement et valider ces méthodes sur le glacier d'Argentière (massif du Mont-Blanc) qui présente l'énorme avantage de se déplacer de quelques centimètres par jour. Ces activités m'ont amené à développer, en collaboration avec les laboratoires LISTIC, LTCI et IETR, des méthodes plus générales pour extraire des informations dans les images RSO.Ma formation initiale en électronique, puis de doctorat en physique m'ont amené à mettre à profit mes connaissances en traitement d'images et des signaux, en électromagnétisme, en calcul numérique, en informatique et en physique de la neige et de la glace pour étudier les problèmes de traitement des images RSO appliqués à la glace, aux glaciers et à la neige

Development of Mining Sector Applications for Emerging Remote Sensing and Deep Learning Technologies

This thesis uses neural networks and deep learning to address practical, real-world problems in the mining sector. The main focus is on developing novel applications in the area of object detection from remotely sensed data. This area has many potential mining applications and is an important part of moving towards data driven strategic decision making across the mining sector. The scientific contributions of this research are twofold; firstly, each of the three case studies demonstrate new applications which couple remote sensing and neural network based technologies for improved data driven decision making. Secondly, the thesis presents a framework to guide implementation of these technologies in the mining sector, providing a guide for researchers and professionals undertaking further studies of this type. The first case study builds a fully connected neural network method to locate supporting rock bolts from 3D laser scan data. This method combines input features from the remote sensing and mobile robotics research communities, generating accuracy scores up to 22% higher than those found using either feature set in isolation. The neural network approach also is compared to the widely used random forest classifier and is shown to outperform this classifier on the test datasets. Additionally, the algorithms’ performance is enhanced by adding a confusion class to the training data and by grouping the output predictions using density based spatial clustering. The method is tested on two datasets, gathered using different laser scanners, in different types of underground mines which have different rock bolting patterns. In both cases the method is found to be highly capable of detecting the rock bolts with recall scores of 0.87-0.96. The second case study investigates modern deep learning for LiDAR data. Here, multiple transfer learning strategies and LiDAR data representations are examined for the task of identifying historic mining remains. A transfer learning approach based on a Lunar crater detection model is used, due to the task similarities between both the underlying data structures and the geometries of the objects to be detected. The relationship between dataset resolution and detection accuracy is also examined, with the results showing that the approach is capable of detecting pits and shafts to a high degree of accuracy with precision and recall scores between 0.80-0.92, provided the input data is of sufficient quality and resolution. Alongside resolution, different LiDAR data representations are explored, showing that the precision-recall balance varies depending on the input LiDAR data representation. The third case study creates a deep convolutional neural network model to detect artisanal scale mining from multispectral satellite data. This model is trained from initialisation without transfer learning and demonstrates that accurate multispectral models can be built from a smaller training dataset when appropriate design and data augmentation strategies are adopted. Alongside the deep learning model, novel mosaicing algorithms are developed both to improve cloud cover penetration and to decrease noise in the final prediction maps. When applied to the study area, the results from this model provide valuable information about the expansion, migration and forest encroachment of artisanal scale mining in southwestern Ghana over the last four years. Finally, this thesis presents an implementation framework for these neural network based object detection models, to generalise the findings from this research to new mining sector deep learning tasks. This framework can be used to identify applications which would benefit from neural network approaches; to build the models; and to apply these algorithms in a real world environment. The case study chapters confirm that the neural network models are capable of interpreting remotely sensed data to a high degree of accuracy on real world mining problems, while the framework guides the development of new models to solve a wide range of related challenges

Global Monitoring for Security and Stability (GMOSS) - Integrated Scientific and Technological Research Supporting Security Aspects of the European Union

This report is a collection of scientific activities and achievements of members of the GMOSS Network of Excellence during the period March 2004 to November 2007. Exceeding the horizon of classical remote-sensing-focused projects, GMOSS is characterized by the integration of political and social aspects of security with the assessment of remote sensing capabilities and end-users support opportunities. The report layout reflects the work breakdown structure of GMOSS and is divided into four parts. Part I Concepts and Integration addresses the political background of European Security Policy and possibilities for Earth Observation technologies for a contribution. Besides it illustrates integration activities just as the GMOSS Gender Action Plan or a description of the GMOSS testcases. Part II of this book presents various Application activities conducted by the network partners. The contributions vary from pipeline sabotage analysis in Iraq to GIS studies about groundwater vulnerability in Gaza Strip, from Population Monitoring in Zimbabwe to Post-Conflict Urban Reconstruction Assessments and many more. Part III focuses on the research and development of image processing methods and Tools. The themes range from SAR interferometry for the measurement of Surface Displacement to Robust Satellite Techniques for monitoring natural hazards like volcanoes and earthquakes. Further subjects are the 3D detection of buildings in VHR imagery or texture analysis techniques on time series of satellite images with variable illumination and many other more. The report closes with Part IV. In the chapter ¿The Way Forward¿ a review on four years of integrated work is done. Challenges and achievements during this period are depicted. It ends with an outlook about a possible way forward for integrated European security research.JRC.G.2-Support to external securit

Deep Learning Methods for Remote Sensing

Remote sensing is a field where important physical characteristics of an area are exacted using emitted radiation generally captured by satellite cameras, sensors onboard aerial vehicles, etc. Captured data help researchers develop solutions to sense and detect various characteristics such as forest fires, flooding, changes in urban areas, crop diseases, soil moisture, etc. The recent impressive progress in artificial intelligence (AI) and deep learning has sparked innovations in technologies, algorithms, and approaches and led to results that were unachievable until recently in multiple areas, among them remote sensing. This book consists of sixteen peer-reviewed papers covering new advances in the use of AI for remote sensing