Multi-source hierarchical conditional random field model for feature fusion of remote sensing images and LiDAR data

Feature fusion of remote sensing images and LiDAR points cloud data, which have strong complementarity, can effectively play the advantages of multi-class features to provide more reliable information support for the remote sensing applications, such as object classification and recognition. In this paper, we introduce a novel multi-source hierarchical conditional random field (MSHCRF) model to fuse features extracted from remote sensing images and LiDAR data for image classification. Firstly, typical features are selected to obtain the interest regions from multi-source data, then MSHCRF model is constructed to exploit up the features, category compatibility of images and the category consistency of multi-source data based on the regions, and the outputs of the model represents the optimal results of the image classification. Competitive results demonstrate the precision and robustness of the proposed method

Nouvelle Méthode en Cascade pour la Classification Hiérarchique Multi-Temporelle ou Multi-Capteur d'Images Satellitaires Haute Résolution

International audienceThis paper describes a method dedicated to multi-resolution, multi-date and eventually multi-sensor classification based on explicit statistical modeling through hierarchical Markov random field modeling based on quad-tree. The proposed approach consists of a supervised Bayesian classifier that combines a joint class-conditional statistical model for pixelwise information and a hierarchical Markov random field for spatio-temporal and multiresolution contextual information fusion based on the Marginal Posterior Mode (MPM). The aim is to recursively maximize the posterior marginal at each pixel, which associates the most probable class label given the entire input information. Within this framework, an interesting novel element of the proposed approach is the use of multiple quadtrees in cascade, each associated with a new image in the available set in order to characterize the correlations associated with distinct images in the data set.Ce papier présente un modèle de classification multi-résolution, multi-date et éventuellement multi-capteur fondé sur une modélisation statistique explicite au travers d'un modèle hiérarchique de champs de Markov construit sur une structure quad-arbre. L'approche proposée consiste en un classifieur bayésien supervisé qui combine un modèle statistique condi-tionnel par classe et un champ de Markov hiérarchique fusionnant l'information spatio-temporelle et multi-résolution. La méthode proposée intégre des informations pixel par pixel à la même résolution. Cela en se basant sur le critère des Modes Marginales a Posteriori (MPM en anglais), qui vise à affecter à chaque pixel l'étiquette optimale en maximisant récursivement la probabilité marginale a posteriori, étant donné l'ensemble des observations multi-temporelles ou multi-capteur. Une des originalités de l'approche proposée est l'utilisation en cascade de plusieurs quad-arbres, chacun étant associé à une nouvelle image disponible, en vue de caractériser les corrélations associées à des images distinctes