39 research outputs found

    Improving Hyperspectral Pixel Classification With Unsupervised Training Data Selection

    Get PDF
    An unsupervised method for selecting training data is suggested here. The method is tested by applying it to hyperspectral land-use classification. The data set is reduced using an unsupervised band selection method and then clustered with a nonparametric cluster technique. The cluster technique provides centers of the clusters, and those are the samples selected to compose the training set. Both the band selection and the clustering are unsupervised techniques. Afterward, an expert labels those samples, and the rest of unlabeled data can be classified. The inclusion of the selection step, although unsupervised, allows to select automatically the most suitable pixels to build the classifier. This reduces the expert effort because less pixels need to be labeled. However, the classification results are significantly improved in comparison with the results obtained by a random selection of training samples, in particular for very small training sets

    Intelligent thermal image-based sensor for affordable measurement of crop canopy temperature

    Get PDF
    Crop canopy temperature measurement is necessary for monitoring water stress indicators such as the Crop Water Stress Index (CWSI). Water stress indicators are very useful for irrigation strategies management in the precision agriculture context. For this purpose, one of the techniques used is thermography, which allows remote temperature measurement. However, the applicability of these techniques depends on being affordable, allowing continuous monitoring over multiple field measurement. In this article, the development of a sensor capable of automatically measuring the crop canopy temperature by means of a low-cost thermal camera and the implementation of artificial intelligence-based image segmentation models is presented. In addition, we provide results on almond trees comparing our system with a commercial thermal camera, in which an R-squared of 0.75 is obtained.This research was funded by the Agencia Estatal de Investigación (AEI) under project numbers: AGL2016-77282-C3-3-R, and PID2019-106226-C22 AEI/https://doi.org//10.13039/501100011033. FPU17/05155, FPU19/00020 have been granted by Ministerio de Educación y Formación Profesional. The authors would like to acknowledge the support of Miriam Montoya Gómez in language assistance

    Rich probabilistic models for semantic labeling

    Get PDF
    Das Ziel dieser Monographie ist es die Methoden und Anwendungen des semantischen Labelings zu erforschen. Unsere Beiträge zu diesem sich rasch entwickelten Thema sind bestimmte Aspekte der Modellierung und der Inferenz in probabilistischen Modellen und ihre Anwendungen in den interdisziplinären Bereichen der Computer Vision sowie medizinischer Bildverarbeitung und Fernerkundung

    Efficient Nonlinear Dimensionality Reduction for Pixel-wise Classification of Hyperspectral Imagery

    Get PDF
    Classification, target detection, and compression are all important tasks in analyzing hyperspectral imagery (HSI). Because of the high dimensionality of HSI, it is often useful to identify low-dimensional representations of HSI data that can be used to make analysis tasks tractable. Traditional linear dimensionality reduction (DR) methods are not adequate due to the nonlinear distribution of HSI data. Many nonlinear DR methods, which are successful in the general data processing domain, such as Local Linear Embedding (LLE) [1], Isometric Feature Mapping (ISOMAP) [2] and Kernel Principal Components Analysis (KPCA) [3], run very slowly and require large amounts of memory when applied to HSI. For example, applying KPCA to the 512×217 pixel, 204-band Salinas image using a modern desktop computer (AMD FX-6300 Six-Core Processor, 32 GB memory) requires more than 5 days of computing time and 28GB memory! In this thesis, we propose two different algorithms for significantly improving the computational efficiency of nonlinear DR without adversely affecting the performance of classification task: Simple Linear Iterative Clustering (SLIC) superpixels and semi-supervised deep autoencoder networks (SSDAN). SLIC is a very popular algorithm developed for computing superpixels in RGB images that can easily be extended to HSI. Each superpixel includes hundreds or thousands of pixels based on spatial and spectral similarities and is represented by the mean spectrum and spatial position of all of its component pixels. Since the number of superpixels is much smaller than the number of pixels in the image, they can be used as input for nonlinearDR, which significantly reduces the required computation time and memory versus providing all of the original pixels as input. After nonlinear DR is performed using superpixels as input, an interpolation step can be used to obtain the embedding of each original image pixel in the low dimensional space. To illustrate the power of using superpixels in an HSI classification pipeline,we conduct experiments on three widely used and publicly available hyperspectral images: Indian Pines, Salinas and Pavia. The experimental results for all three images demonstrate that for moderately sized superpixels, the overall accuracy of classification using superpixel-based nonlinear DR matches and sometimes exceeds the overall accuracy of classification using pixel-based nonlinear DR, with a computational speed that is two-three orders of magnitude faster. Even though superpixel-based nonlinear DR shows promise for HSI classification, it does have disadvantages. First, it is costly to perform out-of-sample extensions. Second, it does not generalize to handle other types of data that might not have spatial information. Third, the original input pixels cannot approximately be recovered, as is possible in many DR algorithms.In order to overcome these difficulties, a new autoencoder network - SSDAN is proposed. It is a fully-connected semi-supervised autoencoder network that performs nonlinear DR in a manner that enables class information to be integrated. Features learned from SSDAN will be similar to those computed via traditional nonlinear DR, and features from the same class will be close to each other. Once the network is trained well with training data, test data can be easily mapped to the low dimensional embedding. Any kind of data can be used to train a SSDAN,and the decoder portion of the SSDAN can easily recover the initial input with reasonable loss.Experimental results on pixel-based classification in the Indian Pines, Salinas and Pavia images show that SSDANs can approximate the overall accuracy of nonlinear DR while significantly improving computational efficiency. We also show that transfer learning can be use to finetune features of a trained SSDAN for a new HSI dataset. Finally, experimental results on HSI compression show a trade-off between Overall Accuracy (OA) of extracted features and PeakSignal to Noise Ratio (PSNR) of the reconstructed image

    Nuclei & Glands Instance Segmentation in Histology Images: A Narrative Review

    Full text link
    Instance segmentation of nuclei and glands in the histology images is an important step in computational pathology workflow for cancer diagnosis, treatment planning and survival analysis. With the advent of modern hardware, the recent availability of large-scale quality public datasets and the community organized grand challenges have seen a surge in automated methods focusing on domain specific challenges, which is pivotal for technology advancements and clinical translation. In this survey, 126 papers illustrating the AI based methods for nuclei and glands instance segmentation published in the last five years (2017-2022) are deeply analyzed, the limitations of current approaches and the open challenges are discussed. Moreover, the potential future research direction is presented and the contribution of state-of-the-art methods is summarized. Further, a generalized summary of publicly available datasets and a detailed insights on the grand challenges illustrating the top performing methods specific to each challenge is also provided. Besides, we intended to give the reader current state of existing research and pointers to the future directions in developing methods that can be used in clinical practice enabling improved diagnosis, grading, prognosis, and treatment planning of cancer. To the best of our knowledge, no previous work has reviewed the instance segmentation in histology images focusing towards this direction.Comment: 60 pages, 14 figure

    Optical and hyperspectral image analysis for image-guided surgery

    Get PDF

    Optical and hyperspectral image analysis for image-guided surgery

    Get PDF

    Improved robustness and efficiency for automatic visual site monitoring

    Get PDF
    Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2009.This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.Cataloged from student-submitted PDF version of thesis.Includes bibliographical references (p. 219-228).Knowing who people are, where they are, what they are doing, and how they interact with other people and things is valuable from commercial, security, and space utilization perspectives. Video sensors backed by computer vision algorithms are a natural way to gather this data. Unfortunately, key technical issues persist in extracting features and models that are simultaneously efficient to compute and robust to issues such as adverse lighting conditions, distracting background motions, appearance changes over time, and occlusions. In this thesis, we present a set of techniques and model enhancements to better handle these problems, focusing on contributions in four areas. First, we improve background subtraction so it can better handle temporally irregular dynamic textures. This allows us to achieve a 5.5% drop in false positive rate on the Wallflower waving trees video. Secondly, we adapt the Dalal and Triggs Histogram of Oriented Gradients pedestrian detector to work on large-scale scenes with dense crowds and harsh lighting conditions: challenges which prevent us from easily using a background subtraction solution. These scenes contain hundreds of simultaneously visible people. To make using the algorithm computationally feasible, we have produced a novel implementation that runs on commodity graphics hardware and is up to 76 faster than our CPU-only implementation. We demonstrate the utility of this detector by modeling scene-level activities with a Hierarchical Dirichlet Process.(cont.) Third, we show how one can improve the quality of pedestrian silhouettes for recognizing individual people. We combine general appearance information from a large population of pedestrians with semi-periodic shape information from individual silhouette sequences. Finally, we show how one can combine a variety of detection and tracking techniques to robustly handle a variety of event detection scenarios such as theft and left-luggage detection. We present the only complete set of results on a standardized collection of very challenging videos.by Gerald Edwin Dalley.Ph.D

    Determining estuarine seagrass density measures from low altitude multispectral imagery flown by remotely piloted aircraft

    Get PDF
    Seagrass is the subject of significant conservation research. Seagrass is ecologically important and of significant value to human interests. Many seagrass species are thought to be in decline. Degradation of seagrass populations are linked to anthropogenic environmental issues. Effective management requires robust monitoring that is affordable at large scale. Remote sensing methods using satellite and aircraft imagery enable mapping of seagrass populations at landscape scale. Aerial monitoring of a seagrass population can require imagery of high spatial and/or spectral resolution for successful feature extraction across all levels of seagrass density. Remotely piloted aircraft (RPA) can operate close to the ground under precise flight control enabling repeated surveys in high detail with accurate revisit-positioning. This study evaluates a method for assessing intertidal estuarine seagrass (Zostera muelleri) presence/absence and coverage density using multispectral imagery collected by a remotely piloted aircraft (RPA) flying at 30 m above the estuary surface (2.7 cm ground sampling distance). The research was conducted at Wharekawa Harbour on the eastern coast of the Coromandel Peninsula, North Island, New Zealand. Differential drainage of residual ebb waters from the surface of an estuary at low tide creates a mosaic of drying sediment, draining surface and static shallow pooling that has potential to interfere with spectral observations. The field surveys demonstrated that despite minor shifts in the spectral coordinates of seagrass and other surface material, there was no apparent difference in image classification outcome from the time of bulk tidal water clearance to the time of returning tidal flood. For the survey specification tested, classification accuracy increased with decreasing segmentation scale. Pixel-based image analysis (PBIA) achieved higher classification accuracy than object-based image analysis (OBIA) assessed at a range of segmentation scales. Contaminating objects such as shells and detritus can become aggregated within polygon objects when OBIA is applied but remain as isolated objects under PBIA at this image resolution. There was clear separability of spectra for seagrass and sediment, but shell and detritus confounded the classification of seagrass density in some situations. High density seagrass was distinct from sediment, but classification error arose for sparse seagrass. Three classifiers (linear discriminant analysis, support vector machine and random forest) and three feature selection options (no selection, collinearity reduction and recursive feature elimination) were assessed for effect on classification performance. The random forest classifier yielded the highest classification accuracy, with no accuracy benefit gained from collinearity reduction or recursive feature elimination. Spectral vegetation indices and texture layers substantially improved classification accuracy. Object geometry made a negligible contribution to classification accuracy using mean-shift segmentation at this image-scale. The method achieved classification of seagrass density with up to 84% accuracy on a three-tier end-member class scale (low, medium, and high density) when using training data formed using visual interpretation of ground reference photography, and up to 93% accuracy using precisely measured seagrass leaf-area. Visual interpretation agreed with precisely measured seagrass leaf area 88% of the time with some misattribution at mid-density. Visual interpretation was substantially faster to apply than measuring the leaf area. A decile class scale for seagrass density correlated with actual leaf area measures more than the three-tier scale, however, was less accurate for absolute class attribution. The research demonstrates that seagrass feature extraction from RPA-flown imagery is a feasible and repeatable option for seagrass population monitoring and environmental reporting. Further calibration is required for whole- and multi-estuary application
    corecore