Learned versus Hand-Designed Feature Representations for 3d Agglomeration

For image recognition and labeling tasks, recent results suggest that machine learning methods that rely on manually specified feature representations may be outperformed by methods that automatically derive feature representations based on the data. Yet for problems that involve analysis of 3d objects, such as mesh segmentation, shape retrieval, or neuron fragment agglomeration, there remains a strong reliance on hand-designed feature descriptors. In this paper, we evaluate a large set of hand-designed 3d feature descriptors alongside features learned from the raw data using both end-to-end and unsupervised learning techniques, in the context of agglomeration of 3d neuron fragments. By combining unsupervised learning techniques with a novel dynamic pooling scheme, we show how pure learning-based methods are for the first time competitive with hand-designed 3d shape descriptors. We investigate data augmentation strategies for dramatically increasing the size of the training set, and show how combining both learned and hand-designed features leads to the highest accuracy

High resolution spatial variability in spring snowmelt for an Arctic shrub-tundra watershed

Arctic tundra environments are characterized by spatially heterogeneous end-of-winter snow cover because of high winds that erode, transport and deposit snow over the winter. This spatially variable end-of-winter snow cover subsequently influences the spatial and temporal variability of snowmelt and results in a patchy snowcover over the melt period. Documenting changes in both snow cover area (SCA) and snow water equivalent (SWE) during the spring melt is essential for understanding hydrological systems, but the lack of high-resolution SCA and SWE datasets that accurately capture micro-scale changes are not commonly available, and do not exist for the Canadian Arctic. This study applies high-resolution remote sensing measurements of SCA and SWE using a fixed-wing Unmanned Aerial System (UAS) to document snowcover changes over the snowmelt period for an Arctic tundra headwater catchment. Repeat measurements of SWE and SCA were obtained for four dominant land cover types (tundra, short shrub, tall shrub, and topographic drift) to provide observations of spatially distributed snowmelt patterns and basin-wide declines in SWE. High-resolution analysis of snowcover conditions over the melt reveal a strong relationship between land cover type, snow distribution, and snow ablation rates whereby shallow snowpacks found in tundra and short shrub regions feature rapid declines in SWE and SCA and became snow-free approximately 10 days earlier than deeper snowpacks. In contrast, tall shrub patches and topographic drift regions were characterized by large initial SWE values and featured a slow decline in SCA. Analysis of basin-wide declines in SCA and SWE reveal three distinct melt phases characterized by 1) low melt rates across a large area resulting in a minor change in SCA, but a very large decline in SWE with, 2) high melt rates resulting in drastic declines in both SCA and SWE, and 3) low melt rates over a small portion of the basin, resulting in little change to either SCA or SWE. The ability to capture high-resolution spatio-temporal changes to tundra snow cover furthers our understanding of the relative importance of various land cover types on the snowmelt timing and amount of runoff available to the hydrological system during the spring freshet

Real-Time analysis and visualization for single-molecule based super-resolution microscopy

Accurate multidimensional localization of isolated fluorescent emitters is a time consuming process in single-molecule based super-resolution microscopy. We demonstrate a functional method for real-time reconstruction with automatic feedback control, without compromising the localization accuracy. Compatible with high frame rates of EM-CCD cameras, it relies on a wavelet segmentation algorithm, together with a mix of CPU/GPU implementation. A combination with Gaussian fitting allows direct access to 3D localization. Automatic feedback control ensures optimal molecule density throughout the acquisition process. With this method, we significantly improve the efficiency and feasibility of localization-based super-resolution microscopy

An Integrative Remote Sensing Application of Stacked Autoencoder for Atmospheric Correction and Cyanobacteria Estimation Using Hyperspectral Imagery

Hyperspectral image sensing can be used to effectively detect the distribution of harmful cyanobacteria. To accomplish this, physical- and/or model-based simulations have been conducted to perform an atmospheric correction (AC) and an estimation of pigments, including phycocyanin (PC) and chlorophyll-a (Chl-a), in cyanobacteria. However, such simulations were undesirable in certain cases, due to the difficulty of representing dynamically changing aerosol and water vapor in the atmosphere and the optical complexity of inland water. Thus, this study was focused on the development of a deep neural network model for AC and cyanobacteria estimation, without considering the physical formulation. The stacked autoencoder (SAE) network was adopted for the feature extraction and dimensionality reduction of hyperspectral imagery. The artificial neural network (ANN) and support vector regression (SVR) were sequentially applied to achieve AC and estimate cyanobacteria concentrations (i.e., SAE-ANN and SAE-SVR). Further, the ANN and SVR models without SAE were compared with SAE-ANN and SAE-SVR models for the performance evaluations. In terms of AC performance, both SAE-ANN and SAE-SVR displayed reasonable accuracy with the Nash???Sutcliffe efficiency (NSE) > 0.7. For PC and Chl-a estimation, the SAE-ANN model showed the best performance, by yielding NSE values > 0.79 and > 0.77, respectively. SAE, with fine tuning operators, improved the accuracy of the original ANN and SVR estimations, in terms of both AC and cyanobacteria estimation. This is primarily attributed to the high-level feature extraction of SAE, which can represent the spatial features of cyanobacteria. Therefore, this study demonstrated that the deep neural network has a strong potential to realize an integrative remote sensing application

Visual-hint Boundary to Segment Algorithm for Image Segmentation

Image segmentation has been a very active research topic in image analysis area. Currently, most of the image segmentation algorithms are designed based on the idea that images are partitioned into a set of regions preserving homogeneous intra-regions and inhomogeneous inter-regions. However, human visual intuition does not always follow this pattern. A new image segmentation method named Visual-Hint Boundary to Segment (VHBS) is introduced, which is more consistent with human perceptions. VHBS abides by two visual hint rules based on human perceptions: (i) the global scale boundaries tend to be the real boundaries of the objects; (ii) two adjacent regions with quite different colors or textures tend to result in the real boundaries between them. It has been demonstrated by experiments that, compared with traditional image segmentation method, VHBS has better performance and also preserves higher computational efficiency.Comment: 45 page

Temporal stability of soil moisture and radar backscatter observed by the advanced Synthetic Aperture Radar (ASAR)

The high spatio-temporal variability of soil moisture is the result of atmospheric forcing and redistribution processes related to terrain, soil, and vegetation characteristics. Despite this high variability, many field studies have shown that in the temporal domain soil moisture measured at specific locations is correlated to the mean soil moisture content over an area. Since the measurements taken by Synthetic Aperture Radar (SAR) instruments are very sensitive to soil moisture it is hypothesized that the temporally stable soil moisture patterns are reflected in the radar backscatter measurements. To verify this hypothesis 73 Wide Swath (WS) images have been acquired by the ENVISAT Advanced Synthetic Aperture Radar (ASAR) over the REMEDHUS soil moisture network located in the Duero basin, Spain. It is found that a time-invariant linear relationship is well suited for relating local scale (pixel) and regional scale (50 km) backscatter. The observed linear model coefficients can be estimated by considering the scattering properties of the terrain and vegetation and the soil moisture scaling properties. For both linear model coefficients, the relative error between observed and modelled values is less than 5 % and the coefficient of determination (R-2) is 86 %. The results are of relevance for interpreting and downscaling coarse resolution soil moisture data retrieved from active (METOP ASCAT) and passive (SMOS, AMSR-E) instruments

Salient region detection using contrast-based saliency and watershed segmentation

Salient region detection is useful for many applications such as image segmentation, compression, image retrieval, object tracking, and machine vision systems.In this paper, an approach to detect salient regions in a visual scene using contrast-based saliency and watershed segmentation is presented.The approach allows salient objects to be detected and extracted for analysis while preserving the actual boundaries of the salient objects. The approach can be executed in parallel making it efficient for real time applications

Assessing the utility of geospatial technologies to investigate environmental change within lake systems

Over 50% of the world's population live within 3. km of rivers and lakes highlighting the on-going importance of freshwater resources to human health and societal well-being. Whilst covering c. 3.5% of the Earth's non-glaciated land mass, trends in the environmental quality of the world's standing waters (natural lakes and reservoirs) are poorly understood, at least in comparison with rivers, and so evaluation of their current condition and sensitivity to change are global priorities. Here it is argued that a geospatial approach harnessing existing global datasets, along with new generation remote sensing products, offers the basis to characterise trajectories of change in lake properties e.g., water quality, physical structure, hydrological regime and ecological behaviour. This approach furthermore provides the evidence base to understand the relative importance of climatic forcing and/or changing catchment processes, e.g. land cover and soil moisture data, which coupled with climate data provide the basis to model regional water balance and runoff estimates over time. Using examples derived primarily from the Danube Basin but also other parts of the World, we demonstrate the power of the approach and its utility to assess the sensitivity of lake systems to environmental change, and hence better manage these key resources in the future