Superpixels: An Evaluation of the State-of-the-Art

Superpixels group perceptually similar pixels to create visually meaningful entities while heavily reducing the number of primitives for subsequent processing steps. As of these properties, superpixel algorithms have received much attention since their naming in 2003. By today, publicly available superpixel algorithms have turned into standard tools in low-level vision. As such, and due to their quick adoption in a wide range of applications, appropriate benchmarks are crucial for algorithm selection and comparison. Until now, the rapidly growing number of algorithms as well as varying experimental setups hindered the development of a unifying benchmark. We present a comprehensive evaluation of 28 state-of-the-art superpixel algorithms utilizing a benchmark focussing on fair comparison and designed to provide new insights relevant for applications. To this end, we explicitly discuss parameter optimization and the importance of strictly enforcing connectivity. Furthermore, by extending well-known metrics, we are able to summarize algorithm performance independent of the number of generated superpixels, thereby overcoming a major limitation of available benchmarks. Furthermore, we discuss runtime, robustness against noise, blur and affine transformations, implementation details as well as aspects of visual quality. Finally, we present an overall ranking of superpixel algorithms which redefines the state-of-the-art and enables researchers to easily select appropriate algorithms and the corresponding implementations which themselves are made publicly available as part of our benchmark at davidstutz.de/projects/superpixel-benchmark/

Extensive Soot Compaction by Cloud Processing from Laboratory and Field Observations

Soot particles form during combustion of carbonaceous materials and impact climate and air quality. When freshly emitted, they are typically fractal-like aggregates. After atmospheric aging, they can act as cloud condensation nuclei, and water condensation or evaporation restructure them to more compact aggregates, affecting their optical, aerodynamic, and surface properties. Here we survey the morphology of ambient soot particles from various locations and different environmental and aging conditions. We used electron microscopy and show extensive soot compaction after cloud processing. We further performed laboratory experiments to simulate atmospheric cloud processing under controlled conditions. We find that soot particles sampled after evaporating the cloud droplets, are significantly more compact than freshly emitted and interstitial soot, confirming that cloud processing, not just exposure to high humidity, compacts soot. Our findings have implications for how the radiative, surface, and aerodynamic properties, and the fate of soot particles are represented in numerical models.Peer reviewe

Extensive soot compaction by cloud processing from laboratory and field observations

Soot particles form during combustion of carbonaceous materials and impact climate and air quality. When freshly emitted, they are typically fractal-like aggregates. After atmospheric aging, they can act as cloud condensation nuclei, and water condensation or evaporation restructure them to more compact aggregates, affecting their optical, aerodynamic, and surface properties. Here we survey the morphology of ambient soot particles from various locations and different environmental and aging conditions. We used electron microscopy and show extensive soot compaction after cloud processing. We further performed laboratory experiments to simulate atmospheric cloud processing under controlled conditions. We find that soot particles sampled after evaporating the cloud droplets, are significantly more compact than freshly emitted and interstitial soot, confirming that cloud processing, not just exposure to high humidity, compacts soot. Our findings have implications for how the radiative, surface, and aerodynamic properties, and the fate of soot particles are represented in numerical models

The aging and impacts of atmospheric soot: closing the gap between experiments and models

The main goal of this dissertation is to generate data and parameterizations to accurately represent soot aerosols in atmospheric models. Soot from incomplete combustion of fossil fuels and biomass burning is a major air pollutant and a significant contributor to climate warming. The environmental impacts of soot are strongly dependent on the particle morphology and mixing state, which evolve continuously during atmospheric transport via a process known as aging. To make predictions of soot impacts on the environment, most atmospheric models adopt simplifications of particle structure and mixing state, which lead to substantial uncertainties. Using an experimentally constrained modeling approach, this dissertation aims to improve the predictive capabilities of atmospheric models regarding the impacts of soot. Accordingly, the study objectives are to: (1) conduct experiments and simulations to investigate how soot properties evolve during aging; (2) develop physical parameterizations between soot particle properties and aging environment using established relationships; (3) incorporate the parameterizations in a particle-resolved aerosol model. Experiments to investigate morphological changes are conducted by exposing airborne aggregates of well-defined mass, size, and composition to vapors of chemicals condensable at atmospheric conditions. The underlying mechanisms that lead to structural change are then identified and applied in theoretical calculations for soot aging. Optical experiments are conducted to measure light absorption and scattering by soot and compared against literature reported values to resolve differences. Additionally, rigorous optical calculations are performed with morphological data from aging experiments to investigate the contributions of morphology and mixing state to parameters of interest in atmospheric models. This work has developed a novel analytical framework for predicting the morphological mixing state and extent of restructuring of soot aggregates during atmospheric aging. The framework is validated by experimental measurements for a wide range of condensing vapors in realistic multicomponent systems, and is based on a single dimensionless parameter χ. The χ-parameter is controlled by coating material properties of vapor supersaturation and wettability for a specified soot monomer diameter. In the course of this study, the roles of vapor condensation and coating evaporation on aggregate restructuring are also found to be influenced by coating wettability. Based on rigorous optical calculations, the differences in measured and modeled optical properties of soot are resolved by varying monomer size and introducing necking material, between monomers. Additionally, the effect of the morphological mixing state on soot optical properties is found to depend strongly on the compactness of the aggregate. A simplified representation of χ-framework is incorporated into the particle resolved aerosol model, PartMC-MOSAIC and successfully tested on soot particles in an idealized urban air parcel. This demonstrates the suitability of this approach in facilitating accurate predictions of morphology-dependent soot properties in PartMC-MOSAIC. Overall, the findings of this dissertation represent a significant advancement in understanding the processes governing the transformations and environmental impacts of soot that will benefit the atmospheric experimental and modeling research communities

Cluster analysis by order statistics

The problem of unsupervised pattern classification can be tackled by detecting the modes of the underlying probability density function of the data . In this paper, we show how the modes can be detected by adaptive transformations based on order statistics . Finally, experimental results are presented to show the robustness of these transformations .Le problème de la classification automatique non supervisée peut être abordé en détectant les modes de la fonction de densité de probabilité sous-jacente à la distribution des observations disponibles. Dans cet article, on montre comment ces modes peuvent être mis en évidence par des transformations adaptatives basées sur les statistiques d'ordre. Des résultats expérimentaux sont présentés en dernier lieu pour montrer la robustesse de ces transformations de statistiques d'ordre

Fundamental Study of Photoluminescence-Shape Relationship of Fluorescent Nanodiamonds using Machine Learning Assisted Correlative Transmission Electron Microscopy and Photoluminescence Microscopy Method

Luminescent nanoparticles have shown wide applications ranging from lighting, display, sensors, and biomedical diagnostics and imaging. Among these, fluorescent nanodiamonds (FNDs) containing nitrogen-vacancy (NV) color centers are posed as emerging materials particularly in biomedical and biological imaging applications due to their room-temperature emission, excellent photo- and chemical- stability, high bio-compatibility, and versatile functionalization potentials. The shape variation of nanoparticles has a decisive influence on their fluorescence. However, current relative studies are limited by the lack of reliable statistical analysis of nanoparticle shape and the difficulty of achieving a precise correlation between shape/structure and optical measurements of large numbers of individual nanoparticles. Therefore, new methods are urgently needed to overcome these challenges to assist in nanoparticle synthesis control and fluorescence performance optimization. In this thesis a new correlative TEM and photoluminescence (PL) microscopy (TEMPL) method has been developed that combines the measurements of the optical properties and the materials structure at the exact same particle and sample area, so that accurate correlation can be established to statistically study the FND morphology/structure and PL properties, at the single nanoparticle level. Moreover, machine learning based methods have been developed for categorizing the 2D and 3D shapes of a large number of nanoparticles generated in TEMPL method. This ML-assisted TEMPL method has been applied to understand the PL correlation with the size and shape of FNDs at the single particle level. In this thesis, a strong correlation between particle morphology and NV fluorescence in FND particles has been revealed: thin, flake-like particles produce enhanced fluorescence. The robustness of this trend is proven in FND with different surface oxidation treatments. This finding offers guidance for fluorescence-optimized sensing applications of FND, by controlling the shape of the particles in fabrication. Overall the TEMPL methodology developed in the thesis provides a versatile and general way to study the shape and fluorescence relationship of various nanoparticles and opens up the possibility of correlation methods between other characterisation techniques

Morphological quantitation software in breast MRI: application to neoadjuvant chemotherapy patients

The work in this thesis examines the use of texture analysis techniques and shape descriptors to analyse MR images of the breast and their application as a potential quantitative tool for prognostic indication.Textural information is undoubtedly very heavily used in a radiologist’s decision making process. However, subtle variations in texture are often missed, thus by quantitatively analysing MR images the textural properties that would otherwise be impossible to discern by simply visually inspecting the image can be obtained. Texture analysis is commonly used in image classification of aerial and satellite photography, studies have also focussed on utilising texture in MRI especially in the brain. Recent research has focussed on other organs such as the breast wherein lesion morphology is known to be an important diagnostic and prognostic indicator. Recent work suggests benefits in assessing lesion texture in dynamic contrast-enhanced (DCE) images, especially with regards to changes during the initial enhancement and subsequent washout phases. The commonest form of analysis is the spatial grey-level dependence matrix method, but there is no direct evidence concerning the most appropriate pixel separation and number of grey levels to utilise in the required co-occurrence matrix calculations. The aim of this work is to systematically assess the efficacy of DCE-MRI based textural analysis in predicting response to chemotherapy in a cohort of breast cancer patients. In addition an attempt was made to use shape parameters in order to assess tumour surface irregularity, and as a predictor of response to chemotherapy.In further work this study aimed to texture map DCE MR images of breast patients utilising the co-occurrence method but on a pixel by pixel basis in order to determine threshold values for normal, benign and malignant tissue and ultimately creating functionality within the in house developed software to highlight hotspots outlining areas of interest (possible lesions). Benign and normal data was taken from MRI screening data and malignant data from patients referred with known malignancies.This work has highlighted that textural differences between groups (based on response, nodal status, triple negative and biopsy grade groupings) are apparent and appear to be most evident 1-3 minutes post-contrast administration. Whilst the large number of statistical tests undertaken necessitates a degree of caution in interpreting the results, the fact that significant differences for certain texture parameters and groupings are consistently observed is encouraging.With regards to shape analysis this thesis has highlighted that some differences between groups were seen in shape descriptors but that shape may be limited as a prognostic indicator. Using textural analysis gave a higher proportion of significant differences whilst shape analysis results showed inconsistency across time points.With regards to the mapping this work successfully analysed the texture maps for each case and established lesion detection is possible. The study successfully highlighted hotspots in the breast patients data post texture mapping, and has demonstrated the relationship between sensitivity and false positive rate via hotspot thresholding

Site Characterization Using Integrated Imaging Analysis Methods on Satellite Data of the Islamabad, Pakistan, Region

We develop an integrated digital imaging analysis approach to produce a first-approximation site characterization map for Islamabad, Pakistan, based on remote-sensing data. We apply both pixel-based and object-oriented digital imaging analysis methods to characterize detailed (1:50,000) geomorphology and geology from Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) satellite imagery. We use stereo-correlated relative digital elevation models (rDEMs) derived from ASTER data, as well as spectra in the visible near-infrared (VNIR) to thermal infrared (TIR) domains. The resulting geomorphic units in the study area are classified as mountain (including the Margala Hills and the Khairi Murat Ridge), piedmont, and basin terrain units. The local geologic units are classified as limestone in the Margala Hills and the Khairi Murat Ridge and sandstone rock types for the piedmonts and basins. Shear-wave velocities for these units are assigned in ranges based on established correlations in California. These ranges include Vs30-values to be greater than 500 m/sec for mountain units, 200–600 m/sec for piedmont units, and less than 300 m/sec for basin units. While the resulting map provides the basis for incorporating site response in an assessment of seismic hazard for Islamabad, it also demonstrates the potential use of remote-sensing data for site characterization in regions where only limited conventional mapping has been done

Plants Detection, Localization and Discrimination using 3D Machine Vision for Robotic Intra-row Weed Control

Weed management is vitally important in crop production systems. However, conventional herbicide-based weed control can lead to negative environmental impacts. Manual weed control is laborious and impractical for large scale production. Robotic weeding offers a possibility of controlling weeds precisely, particularly for weeds growing close to or within crop rows. The fusion of two-dimensional textural images and three-dimensional spatial images to recognize and localize crop plants at different growth stages were investigated. Images of different crop plants at different growth stages with weeds were acquired. Feature extraction algorithms were developed, and different features were extracted and used to train plant and background classifiers, which also addressed the problems of canopy occlusion and leaf damage. Then, the efficacy and accuracy of the proposed methods in classification were demonstrated by experiments. Currently, the algorithms were only developed and tested for broccoli and lettuce. For broccoli plants, the crop plants detection true positive rate was 93.1%, and the false discover rate was 1.1%, with the average crop-plant-localization error of 15.9 mm. For lettuce plants, the crop plants detection true positive rate was 92.3%, and the false discover rate was 4.0%, with the average crop-plant-localization error of 8.5 mm. The results have shown that 3D imaging based plant recognition algorithms are effective and reliable for crop/weed differentiation