Interpretation of Forest Resources at the Individual Tree Level at Purple Mountain, Nanjing City, China, Using WorldView-2 Imagery by Combining GPS, RS and GIS Technologies

This study attempted to measure forest resources at the individual tree level using high-resolution images by combining GPS, RS, and Geographic Information System (GIS) technologies. The images were acquired by the WorldView-2 satellite with a resolution of 0.5 m in the panchromatic band and 2.0 m in the multispectral bands. Field data of 90 plots were used to verify the interpreted accuracy. The tops of trees in three groups, namely 10 cm, 15 cm, and 20 cm DBH (diameter at breast height), were extracted by the individual tree crown (ITC) approach using filters with moving windows of 3 x 3 pixels, 5 x 5 pixels and 7 x 7 pixels, respectively. In the study area, there were 1,203,970 trees of DBH over 10 cm, and the interpreted accuracy was 73.68 +/- 15.14% averaged over the 90 plots. The numbers of the trees that were 15 cm and 20 cm DBH were 727,887 and 548,919, with an average accuracy of 68.74 +/- 17.21% and 71.92 +/- 18.03%, respectively. The pixel-based classification showed that the classified accuracies of the 16 classes obtained using the eight multispectral bands were higher than those obtained using only the four standard bands. The increments ranged from 0.1% for the water class to 17.0% for Metasequoia glyptostroboides, with an average value of 4.8% for the 16 classes. In addition, to overcome the mixed pixels problem, a crown-based supervised classification, which can improve the classified accuracy of both dominant species and smaller classes, was used for generating a thematic map of tree species. The improvements of the crown- to pixel-based classification ranged from -1.6% for the open forest class to 34.3% for Metasequoia glyptostroboides, with an average value of 20.3% for the 10 classes. All tree tops were then annotated with the species attributes from the map, and a tree count of different species indicated that the forest of Purple Mountain is mainly dominated by Quercus acutissima, Liquidambar formosana and Pinus massoniana. The findings from this study lead to the recommendation of using the crown-based instead of the pixel-based classification approach in classifying mixed forests.ArticleREMOTE SENSING. 6(1):87-110 (2014)journal articl

Effect of Annotation Errors on Drone Detection with YOLOv3

Following the recent advances in deep networks, object detection and tracking algorithms with deep learning backbones have been improved significantly; however, this rapid development resulted in the necessity of large amounts of annotated labels. Even if the details of such semi-automatic annotation processes for most of these datasets are not known precisely, especially for the video annotations, some automated labeling processes are usually employed. Unfortunately, such approaches might result with erroneous annotations. In this work, different types of annotation errors for object detection problem are simulated and the performance of a popular state-of-the-art object detector, YOLOv3, with erroneous annotations during training and testing stages is examined. Moreover, some inevitable annotation errors in CVPR-2020 Anti-UAV Challenge dataset is also examined in this manner, while proposing a solution to correct such annotation errors of this valuable data set.Comment: Best Paper Award at The 1st Anti-UAV Workshop & Challenge - CVPR Workshops, 202

Visual Analytics and Interactive Machine Learning for Human Brain Data

Indiana University-Purdue University Indianapolis (IUPUI)This study mainly focuses on applying visualization techniques on human brain data for data exploration, quality control, and hypothesis discovery. It mainly consists of two parts: multi-modal data visualization and interactive machine learning. For multi-modal data visualization, a major challenge is how to integrate structural, functional and connectivity data to form a comprehensive visual context. We develop a new integrated visualization solution for brain imaging data by combining scientific and information visualization techniques within the context of the same anatomic structure. For interactive machine learning, we propose a new visual analytics approach to interactive machine learning. In this approach, multi-dimensional data visualization techniques are employed to facilitate user interactions with the machine learning process. This allows dynamic user feedback in different forms, such as data selection, data labeling, and data correction, to enhance the efficiency of model building

Advances towards behaviour-based indoor robotic exploration

215 p.The main contributions of this research work remain in object recognition by computer vision, by one side, and in robot localisation and mapping by the other. The first contribution area of the research address object recognition in mobile robots. In this area, door handle recognition is of great importance, as it help the robot to identify doors in places where the camera is not able to view the whole door. In this research, a new two step algorithm is presented based on feature extraction that aimed at improving the extracted features to reduce the superfluous keypoints to be compared at the same time that it increased its efficiency by improving accuracy and reducing the computational time. Opposite to segmentation based paradigms, the feature extraction based two-step method can easily be generalized to other types of handles or even more, to other type of objects such as road signals. Experiments have shown very good accuracy when tested in real environments with different kind of door handles. With respect to the second contribution, a new technique to construct a topological map during the exploration phase a robot would perform on an unseen office-like environment is presented. Firstly a preliminary approach proposed to merge the Markovian localisation in a distributed system, which requires low storage and computational resources and is adequate to be applied in dynamic environments. In the same area, a second contribution to terrain inspection level behaviour based navigation concerned to the development of an automatic mapping method for acquiring the procedural topological map. The new approach is based on a typicality test called INCA to perform the so called loop-closing action. The method was integrated in a behaviour-based control architecture and tested in both, simulated and real robot/environment system. The developed system proved to be useful also for localisation purpose

Landslide mapping from multi-sensor data through improved change detection-based Markov random field

Abstract Accurate landslide inventory mapping is essential for quantitative hazard and risk assessment. Although multi-temporal change detection techniques have contributed greatly to landslide inventory preparation, it is still challenging to generate quality change detection images (CDIs) for accurate landslide mapping. The recently proposed change detection-based Markov random field (CDMRF) provides an effective approach for rapid mapping of landslides with minimum user interventions. However, when CDI is generated by change vector analysis (CVA) alone, the CDMRF method may suffer from noise especially when the pre- and post-event remote sensing images are acquired under different atmospheric, illumination, and phenological conditions. This paper improved such CDMRF approach by integrating normalized difference vegetation index (NDVI), principal component analysis (PCA), and independent component analysis (ICA) generated CDIs with MRF for landslide inventory mapping from multi-sensor data. To justify the effectiveness and applicability, the improved methods were applied to map rainfall-, typhoon-, and earthquake-triggered landslides from the pre- and post-event satellite images acquired by very high resolution QuickBird, high resolution FORMOSAT-2, and moderate resolution Sentinel-2. Moreover, they were tested on pre-event Landsat-8 and post-event Sentinel-2 datasets, indicating that they are operational for landslide inventory mapping from combined multi-temporal and multi-sensor data. The results demonstrate that the improved δNDVI-, PCA-, and ICA-based approaches perform much better than CVA-based CDMRF in terms of completeness, correctness, Kappa coefficient, and F-measures. To the best of our knowledge, it is the first time that NDVI, PCA, and ICA are integrated with MRF for landslide inventory mapping from multi-sensor data. It is anticipated that this research can be a starting point for developing new change detection techniques that can readily generate quality CDI and for applying advanced machine learning algorithms (e.g., deep learning) to automatic detection of natural hazards from multi-sensor time series data

Artificial Neural Networks and Evolutionary Computation in Remote Sensing

Artificial neural networks (ANNs) and evolutionary computation methods have been successfully applied in remote sensing applications since they offer unique advantages for the analysis of remotely-sensed images. ANNs are effective in finding underlying relationships and structures within multidimensional datasets. Thanks to new sensors, we have images with more spectral bands at higher spatial resolutions, which clearly recall big data problems. For this purpose, evolutionary algorithms become the best solution for analysis. This book includes eleven high-quality papers, selected after a careful reviewing process, addressing current remote sensing problems. In the chapters of the book, superstructural optimization was suggested for the optimal design of feedforward neural networks, CNN networks were deployed for a nanosatellite payload to select images eligible for transmission to ground, a new weight feature value convolutional neural network (WFCNN) was applied for fine remote sensing image segmentation and extracting improved land-use information, mask regional-convolutional neural networks (Mask R-CNN) was employed for extracting valley fill faces, state-of-the-art convolutional neural network (CNN)-based object detection models were applied to automatically detect airplanes and ships in VHR satellite images, a coarse-to-fine detection strategy was employed to detect ships at different sizes, and a deep quadruplet network (DQN) was proposed for hyperspectral image classification

Coronal loop detection from solar images and extraction of salient contour groups from cluttered images.

This dissertation addresses two different problems: 1) coronal loop detection from solar images: and 2) salient contour group extraction from cluttered images. In the first part, we propose two different solutions to the coronal loop detection problem. The first solution is a block-based coronal loop mining method that detects coronal loops from solar images by dividing the solar image into fixed sized blocks, labeling the blocks as Loop or Non-Loop , extracting features from the labeled blocks, and finally training classifiers to generate learning models that can classify new image blocks. The block-based approach achieves 64% accuracy in IO-fold cross validation experiments. To improve the accuracy and scalability, we propose a contour-based coronal loop detection method that extracts contours from cluttered regions, then labels the contours as Loop and Non-Loop , and extracts geometric features from the labeled contours. The contour-based approach achieves 85% accuracy in IO-fold cross validation experiments, which is a 20% increase compared to the block-based approach. In the second part, we propose a method to extract semi-elliptical open curves from cluttered regions. Our method consists of the following steps: obtaining individual smooth contours along with their saliency measures; then starting from the most salient contour, searching for possible grouping options for each contour; and continuing the grouping until an optimum solution is reached. Our work involved the design and development of a complete system for coronal loop mining in solar images, which required the formulation of new Gestalt perceptual rules and a systematic methodology to select and combine them in a fully automated judicious manner using machine learning techniques that eliminate the need to manually set various weight and threshold values to define an effective cost function. After finding salient contour groups, we close the gaps within the contours in each group and perform B-spline fitting to obtain smooth curves. Our methods were successfully applied on cluttered solar images from TRACE and STEREO/SECCHI to discern coronal loops. Aerial road images were also used to demonstrate the applicability of our grouping techniques to other contour-types in other real applications