Iterative Training Sample Expansion to Increase and Balance the Accuracy of Land Classification from VHR Imagery

© 1980-2012 IEEE. Imbalanced training sets are known to produce suboptimal maps for supervised classification. Therefore, one challenge in mapping land cover is acquiring training data that will allow classification with high overall accuracy (OA) in which each class is also mapped onto similar user's accuracy. To solve this problem, we integrated local adaptive region and box-and-whisker plot (BP) techniques into an iterative algorithm to expand the size of the training sample for selected classes in this article. The major steps of the proposed algorithm are as follows. First, a very small initial training sample (ITS) for each class set is labeled manually. Second, potential new training samples are found within an adaptive region by conducting local spectral variation analysis. Lastly, three new training samples are acquired to capture information regarding intraclass variation; these samples lie in the lower, median, and upper quartiles of BP. After adding these new training samples to the ITS, classification is retrained and the process is continued iteratively until termination. The proposed approach was applied to three very high-resolution (VHR) remote-sensing images and compared with a set of cognate methods. The comparison demonstrated that the proposed approach produced the best result in terms of OA and exhibited superiority in balancing user's accuracy. For example, the proposed approach was typically 2%-10% more accurate than the compared methods in terms of OA and it generally yielded the most balanced classification

Service robotics and machine learning for close-range remote sensing

L'abstract è presente nell'allegato / the abstract is in the attachmen

Multimodal image super-resolution via joint sparse representations induced by coupled dictionaries

Real-world data processing problems often involve various image modalities associated with a certain scene, including RGB images, infrared images, or multispectral images. The fact that different image modalities often share certain attributes, such as edges, textures, and other structure primitives, represents an opportunity to enhance various image processing tasks. This paper proposes a new approach to construct a high-resolution (HR) version of a low-resolution (LR) image, given another HR image modality as guidance, based on joint sparse representations induced by coupled dictionaries. The proposed approach captures complex dependency correlations, including similarities and disparities, between different image modalities in a learned sparse feature domain in lieu of the original image domain. It consists of two phases: coupled dictionary learning phase and coupled superresolution phase. The learning phase learns a set of dictionaries from the training dataset to couple different image modalities together in the sparse feature domain. In turn, the super-resolution phase leverages such dictionaries to construct an HR version of the LR target image with another related image modality for guidance. In the advanced version of our approach, multistage strategy and neighbourhood regression concept are introduced to further improve the model capacity and performance. Extensive guided image super-resolution experiments on real multimodal images demonstrate that the proposed approach admits distinctive advantages with respect to the state-of-the-art approaches, for example, overcoming the texture copying artifacts commonly resulting from inconsistency between the guidance and target images. Of particular relevance, the proposed model demonstrates much better robustness than competing deep models in a range of noisy scenarios

Algorithms for Fault Detection and Diagnosis

Due to the increasing demand for security and reliability in manufacturing and mechatronic systems, early detection and diagnosis of faults are key points to reduce economic losses caused by unscheduled maintenance and downtimes, to increase safety, to prevent the endangerment of human beings involved in the process operations and to improve reliability and availability of autonomous systems. The development of algorithms for health monitoring and fault and anomaly detection, capable of the early detection, isolation, or even prediction of technical component malfunctioning, is becoming more and more crucial in this context. This Special Issue is devoted to new research efforts and results concerning recent advances and challenges in the application of “Algorithms for Fault Detection and Diagnosis”, articulated over a wide range of sectors. The aim is to provide a collection of some of the current state-of-the-art algorithms within this context, together with new advanced theoretical solutions

A Survey on Visual Mamba

State space models (SSM) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently shown significant potential in long-sequence modeling. Since the complexity of transformers’ self-attention mechanism is quadratic with image size, as well as increasing computational demands, researchers are currently exploring how to adapt Mamba for computer vision tasks. This paper is the first comprehensive survey that aims to provide an in-depth analysis of Mamba models within the domain of computer vision. It begins by exploring the foundational concepts contributing to Mamba’s success, including the SSM framework, selection mechanisms, and hardware-aware design. Then, we review these vision Mamba models by categorizing them into foundational models and those enhanced with techniques including convolution, recurrence, and attention to improve their sophistication. Furthermore, we investigate the widespread applications of Mamba in vision tasks, which include their use as a backbone in various levels of vision processing. This encompasses general visual tasks, medical visual tasks (e.g., 2D/3D segmentation, classification, image registration, etc.), and remote sensing visual tasks. In particular, we introduce general visual tasks from two levels: high/mid-level vision (e.g., object detection, segmentation, video classification, etc.) and low-level vision (e.g., image super-resolution, image restoration, visual generation, etc.). We hope this endeavor will spark additional interest within the community to address current challenges and further apply Mamba models in computer vision

Text Similarity Between Concepts Extracted from Source Code and Documentation

Context: Constant evolution in software systems often results in its documentation losing sync with the content of the source code. The traceability research field has often helped in the past with the aim to recover links between code and documentation, when the two fell out of sync. Objective: The aim of this paper is to compare the concepts contained within the source code of a system with those extracted from its documentation, in order to detect how similar these two sets are. If vastly different, the difference between the two sets might indicate a considerable ageing of the documentation, and a need to update it. Methods: In this paper we reduce the source code of 50 software systems to a set of key terms, each containing the concepts of one of the systems sampled. At the same time, we reduce the documentation of each system to another set of key terms. We then use four different approaches for set comparison to detect how the sets are similar. Results: Using the well known Jaccard index as the benchmark for the comparisons, we have discovered that the cosine distance has excellent comparative powers, and depending on the pre-training of the machine learning model. In particular, the SpaCy and the FastText embeddings offer up to 80% and 90% similarity scores. Conclusion: For most of the sampled systems, the source code and the documentation tend to contain very similar concepts. Given the accuracy for one pre-trained model (e.g., FastText), it becomes also evident that a few systems show a measurable drift between the concepts contained in the documentation and in the source code.</p

Robust density modelling using the student's t-distribution for human action recognition

The extraction of human features from videos is often inaccurate and prone to outliers. Such outliers can severely affect density modelling when the Gaussian distribution is used as the model since it is highly sensitive to outliers. The Gaussian distribution is also often used as base component of graphical models for recognising human actions in the videos (hidden Markov model and others) and the presence of outliers can significantly affect the recognition accuracy. In contrast, the Student's t-distribution is more robust to outliers and can be exploited to improve the recognition rate in the presence of abnormal data. In this paper, we present an HMM which uses mixtures of t-distributions as observation probabilities and show how experiments over two well-known datasets (Weizmann, MuHAVi) reported a remarkable improvement in classification accuracy. © 2011 IEEE

Determining estuarine seagrass density measures from low altitude multispectral imagery flown by remotely piloted aircraft

Seagrass is the subject of significant conservation research. Seagrass is ecologically important and of significant value to human interests. Many seagrass species are thought to be in decline. Degradation of seagrass populations are linked to anthropogenic environmental issues. Effective management requires robust monitoring that is affordable at large scale. Remote sensing methods using satellite and aircraft imagery enable mapping of seagrass populations at landscape scale. Aerial monitoring of a seagrass population can require imagery of high spatial and/or spectral resolution for successful feature extraction across all levels of seagrass density. Remotely piloted aircraft (RPA) can operate close to the ground under precise flight control enabling repeated surveys in high detail with accurate revisit-positioning. This study evaluates a method for assessing intertidal estuarine seagrass (Zostera muelleri) presence/absence and coverage density using multispectral imagery collected by a remotely piloted aircraft (RPA) flying at 30 m above the estuary surface (2.7 cm ground sampling distance). The research was conducted at Wharekawa Harbour on the eastern coast of the Coromandel Peninsula, North Island, New Zealand. Differential drainage of residual ebb waters from the surface of an estuary at low tide creates a mosaic of drying sediment, draining surface and static shallow pooling that has potential to interfere with spectral observations. The field surveys demonstrated that despite minor shifts in the spectral coordinates of seagrass and other surface material, there was no apparent difference in image classification outcome from the time of bulk tidal water clearance to the time of returning tidal flood. For the survey specification tested, classification accuracy increased with decreasing segmentation scale. Pixel-based image analysis (PBIA) achieved higher classification accuracy than object-based image analysis (OBIA) assessed at a range of segmentation scales. Contaminating objects such as shells and detritus can become aggregated within polygon objects when OBIA is applied but remain as isolated objects under PBIA at this image resolution. There was clear separability of spectra for seagrass and sediment, but shell and detritus confounded the classification of seagrass density in some situations. High density seagrass was distinct from sediment, but classification error arose for sparse seagrass. Three classifiers (linear discriminant analysis, support vector machine and random forest) and three feature selection options (no selection, collinearity reduction and recursive feature elimination) were assessed for effect on classification performance. The random forest classifier yielded the highest classification accuracy, with no accuracy benefit gained from collinearity reduction or recursive feature elimination. Spectral vegetation indices and texture layers substantially improved classification accuracy. Object geometry made a negligible contribution to classification accuracy using mean-shift segmentation at this image-scale. The method achieved classification of seagrass density with up to 84% accuracy on a three-tier end-member class scale (low, medium, and high density) when using training data formed using visual interpretation of ground reference photography, and up to 93% accuracy using precisely measured seagrass leaf-area. Visual interpretation agreed with precisely measured seagrass leaf area 88% of the time with some misattribution at mid-density. Visual interpretation was substantially faster to apply than measuring the leaf area. A decile class scale for seagrass density correlated with actual leaf area measures more than the three-tier scale, however, was less accurate for absolute class attribution. The research demonstrates that seagrass feature extraction from RPA-flown imagery is a feasible and repeatable option for seagrass population monitoring and environmental reporting. Further calibration is required for whole- and multi-estuary application