Gas Plume Detection and Tracking in Hyperspectral Video Sequences using Binary Partition Trees

International audienceThanks to the fast development of sensors, it is now possible to acquire sequences of hyperspectral images. Those hyperspectral video sequences are particularly suited for the detection and tracking of chemical gas plumes. However, the processing of this new type of video sequences with the additional spectral diversity, is challenging and requires the design of advanced image processing algorithms. In this paper, we present a novel method for the segmentation and tracking of a chemical gas plume diffusing in the atmosphere, recorded in a hyperspectral video sequence. In the proposed framework, the position of the plume is first estimated, using the temporal redundancy of two consecutive frames. Second, a Binary Partition Tree is built and pruned according to the previous estimate, in order to retrieve the real location and extent of the plume in the frame. The proposed method is validated on a real hyperspectral video sequence and compared with a state-of-the-art method

Analyse hiérarchique d'images multimodales

There is a growing interest in the development of adapted processing tools for multimodal images (several images acquired over the same scene with different characteristics). Allowing a more complete description of the scene, multimodal images are of interest in various image processing fields, but their optimal handling and exploitation raise several issues. This thesis extends hierarchical representations, a powerful tool for classical image analysis and processing, to multimodal images in order to better exploit the additional information brought by the multimodality and improve classical image processing techniques. %when applied to real applications. This thesis focuses on three different multimodalities frequently encountered in the remote sensing field. We first investigate the spectral-spatial information of hyperspectral images. Based on an adapted construction and processing of the hierarchical representation, we derive a segmentation which is optimal with respect to the spectral unmixing operation. We then focus on the temporal multimodality and sequences of hyperspectral images. Using the hierarchical representation of the frames in the sequence, we propose a new method to achieve object tracking and apply it to chemical gas plume tracking in thermal infrared hyperspectral video sequences. Finally, we study the sensorial multimodality, being images acquired with different sensors. Relying on the concept of braids of partitions, we propose a novel methodology of image segmentation, based on an energetic minimization framework.Il y a un intérêt grandissant pour le développement d’outils de traitements adaptés aux images multimodales (plusieurs images de la même scène acquises avec différentes caractéristiques). Permettant une représentation plus complète de la scène, ces images multimodales ont de l'intérêt dans plusieurs domaines du traitement d'images, mais les exploiter et les manipuler de manière optimale soulève plusieurs questions. Cette thèse étend les représentations hiérarchiques, outil puissant pour le traitement et l’analyse d’images classiques, aux images multimodales afin de mieux exploiter l’information additionnelle apportée par la multimodalité et améliorer les techniques classiques de traitement d’images. Cette thèse se concentre sur trois différentes multimodalités fréquemment rencontrées dans le domaine de la télédétection. Nous examinons premièrement l’information spectrale-spatiale des images hyperspectrales. Une construction et un traitement adaptés de la représentation hiérarchique nous permettent de produire une carte de segmentation de l'image optimale vis-à-vis de l'opération de démélange spectrale. Nous nous concentrons ensuite sur la multimodalité temporelle, traitant des séquences d’images hyperspectrales. En utilisant les représentations hiérarchiques des différentes images de la séquence, nous proposons une nouvelle méthode pour effectuer du suivi d’objet et l’appliquons au suivi de nuages de gaz chimique dans des séquences d’images hyperspectrales dans le domaine thermique infrarouge. Finalement, nous étudions la multimodalité sensorielle, c’est-à-dire les images acquises par différents capteurs. Nous appuyant sur le concept des tresses de partitions, nous proposons une nouvelle méthodologie de segmentation se basant sur un cadre de minimisation d’énergie

Dynamical spectral unmixing of multitemporal hyperspectral images

In this paper, we consider the problem of unmixing a time series of hyperspectral images. We propose a dynamical model based on linear mixing processes at each time instant. The spectral signatures and fractional abundances of the pure materials in the scene are seen as latent variables, and assumed to follow a general dynamical structure. Based on a simplified version of this model, we derive an efficient spectral unmixing algorithm to estimate the latent variables by performing alternating minimizations. The performance of the proposed approach is demonstrated on synthetic and real multitemporal hyperspectral images.Comment: 13 pages, 10 figure

Stochastic Block Models are a Discrete Surface Tension

Networks, which represent agents and interactions between them, arise in myriad applications throughout the sciences, engineering, and even the humanities. To understand large-scale structure in a network, a common task is to cluster a network's nodes into sets called "communities", such that there are dense connections within communities but sparse connections between them. A popular and statistically principled method to perform such clustering is to use a family of generative models known as stochastic block models (SBMs). In this paper, we show that maximum likelihood estimation in an SBM is a network analog of a well-known continuum surface-tension problem that arises from an application in metallurgy. To illustrate the utility of this relationship, we implement network analogs of three surface-tension algorithms, with which we successfully recover planted community structure in synthetic networks and which yield fascinating insights on empirical networks that we construct from hyperspectral videos.Comment: to appear in Journal of Nonlinear Scienc

UAVs for the Environmental Sciences

This book gives an overview of the usage of UAVs in environmental sciences covering technical basics, data acquisition with different sensors, data processing schemes and illustrating various examples of application

Remote Sensing

This dual conception of remote sensing brought us to the idea of preparing two different books; in addition to the first book which displays recent advances in remote sensing applications, this book is devoted to new techniques for data processing, sensors and platforms. We do not intend this book to cover all aspects of remote sensing techniques and platforms, since it would be an impossible task for a single volume. Instead, we have collected a number of high-quality, original and representative contributions in those areas

ADAPTIVE PROCESSING ARCHITECTURE OF MULTISENSOR SIGNALS FOR LOW-IMPACT TREATMENTS OF PLANT DISEASES.

Intelligent sensing for production of high-value crops Scientific and technical quality This thesis has been realized within the CROPS project. CROPS will develop scientific know-how for a highly configurable, modular and clever carrier platform that includes modular parallel manipulators and intelligent tools (sensors, algorithms, sprayers, grippers) that can be easily installed onto the carrier and are capable of adapting to new tasks and conditions. Several technological demonstrators will be developed for high value crops like greenhouse vegetables, fruits in orchards, and grapes for premium wines. The CROPS robotic platform will be capable of site-specific spraying (targets spray only towards foliage and selective targets) and selective harvesting of fruit (detects the fruit, determines its ripeness, moves towards the fruit, grasps it and softly detaches it). Another objective of CROPS is to develop techniques for reliable detection and classification of obstacles and other objects to enable successful autonomous navigation and operation in plantations and forests. The agricultural and forestry applications share many research areas, primarily regarding sensing and learning capabilities. The project started in October 2010 and will run for 48 month. The aim of this thesis is to lay the foundations, suggesting the guidelines, of one task addressed by the CROPS project, in particular, the aim of this work is to study the application of a VIS-NIR imaging approach (intelligent sensing), based on a relatively simple algorithm, to detect symptoms of powdery mildew and downy mildew disease at early stages of infection (sustainable production of high-value crops). Also a preliminary work for botrytis detection will be shown. Concept and objectives Many site-specific agricultural and forestry tasks, such as cultivating, transplanting, spraying, trimming, selective harvesting, and transportation, could be performed more efficiently if carried out by robotic systems. However, to date, agriculture and forestry robots are still not available, partly due to the complex, and often contradictory, demands for developing such systems. On the one hand, agro-forestry robots must be of reasonable cost, but on the other, they must be able to deal with complex, dynamic, and partly changing tasks. Addressing problems such as continuously changing conditions (e.g., rain and illumination), high variability in both the products (size, and shape) and the environment (location and soil properties), the delicate nature of the products, and hostile environmental conditions (e.g. dust, dirt, extreme temperature and humidity) requires advanced sensing, manipulation, and control. Since it is impossible to model a-priori all environments and task conditions, the robot must be able to learn new tasks and new working conditions. The solution to these demands lies in a modular and configurable design that will keep costs to a minimum by applying a basic configuration to a range of agricultural applications. At least a 95% yield rate is necessary for economical feasibility of an agro-forestry robotic system. Objectives An objective of CROPS project is to develop an \u201cintelligent tools\u201d (sensors, algorithms, sprayers) that can easily be installed onto a modular and clever carrier platform. The CROPS robotic platform will be capable of site-specific spraying (targeted spraying only on foliage and selected targets). Research efforts To achieve the novel systems described above, we will focus on intelligent sensing of disease detection on crop canopy (investigating different types and/or multiple sensors with decision making models). Technology evaluation Technology evaluation of the developed systems will include the performance evaluation of the different components (e.g., capacities, success rates/misses). Progress beyond the state-of-the-art Despite the extensive research conducted to date in applying robots to a variety of agriculture and forestry tasks (e.g., transplanting, spraying, trimming, selective harvesting), limited operating efficiencies (speeds, success rates) and lack of economic justification have severely limited commercialization. The few commercial autonomous agriculture and forestry robots that are available on the market include a cow milking robot, a robot for cutting roses (RomboMatic), and various remote-controlled forest harvesters. These robots either have a low level of autonomy or are able to perform only simple operations in structured and static environments (e.g. dairy farms and plant breeding facilities). Developing capabilities for robots operating in unstructured outdoor environments or dealing with the highly variable objects that exist in agriculture and forestry is still open-ended, and one of CROPS aims is to address this problem. Current state-of-the-art Field trials have routinely shown that most crop damage due to diseases and pests can be efficiently controlled when treatments are applied timely and accurately by hand to susceptible targets (i.e., by intelligent spraying). Site-specific spraying targeted solely to trees and/or to infected areas can reduce pesticide use by 20\u201340%. An issue of relevance to targeted agriculture is the detection of diseases in field crops. Since such events often have a visual manifestation, state-of-the-art methods for achieving this goal include fluorescence imaging or the analysis of spectral reflectance in carefully selected spectral bands. While reports of these methods used separately achieved performance at 75\u201390% accuracy, attempts to combine them have boosted disease discrimination accuracy to 95%. We must note here, however, that despite these promising results, very little research has been conducted on in-field disease detection. Expected progress The diseased detection approach for precision pesticide spraying will be developed investigating image processing techniques (after a laboratory spectral evaluation and greenhouse testing) for high-precision close-range targeted spraying to selectively and precisely apply chemicals solely to targets susceptible to specific diseases/pests, with a mean 90% success rate. Local changes in spectral reflection of parts of the canopy will be used as an indication of disease. \u201cSoft-sensor\u201d for detection of ripeness and diseases (noncontact rapid sensing system) will be developed by multispectral sensor (multispectral spectral camera). These \u201csoft sensor\u201d can be used as a decision model for targeted spraying

Advances in Computational Intelligence Applications in the Mining Industry

This book captures advancements in the applications of computational intelligence (artificial intelligence, machine learning, etc.) to problems in the mineral and mining industries. The papers present the state of the art in four broad categories: mine operations, mine planning, mine safety, and advances in the sciences, primarily in image processing applications. Authors in the book include both researchers and industry practitioners