8,478 research outputs found
Composite Kernel Local Angular Discriminant Analysis for Multi-Sensor Geospatial Image Analysis
With the emergence of passive and active optical sensors available for
geospatial imaging, information fusion across sensors is becoming ever more
important. An important aspect of single (or multiple) sensor geospatial image
analysis is feature extraction - the process of finding "optimal" lower
dimensional subspaces that adequately characterize class-specific information
for subsequent analysis tasks, such as classification, change and anomaly
detection etc. In recent work, we proposed and developed an angle-based
discriminant analysis approach that projected data onto subspaces with maximal
"angular" separability in the input (raw) feature space and Reproducible Kernel
Hilbert Space (RKHS). We also developed an angular locality preserving variant
of this algorithm. In this letter, we advance this work and make it suitable
for information fusion - we propose and validate a composite kernel local
angular discriminant analysis projection, that can operate on an ensemble of
feature sources (e.g. from different sources), and project the data onto a
unified space through composite kernels where the data are maximally separated
in an angular sense. We validate this method with the multi-sensor University
of Houston hyperspectral and LiDAR dataset, and demonstrate that the proposed
method significantly outperforms other composite kernel approaches to sensor
(information) fusion
Tensor Representations via Kernel Linearization for Action Recognition from 3D Skeletons (Extended Version)
In this paper, we explore tensor representations that can compactly capture
higher-order relationships between skeleton joints for 3D action recognition.
We first define RBF kernels on 3D joint sequences, which are then linearized to
form kernel descriptors. The higher-order outer-products of these kernel
descriptors form our tensor representations. We present two different kernels
for action recognition, namely (i) a sequence compatibility kernel that
captures the spatio-temporal compatibility of joints in one sequence against
those in the other, and (ii) a dynamics compatibility kernel that explicitly
models the action dynamics of a sequence. Tensors formed from these kernels are
then used to train an SVM. We present experiments on several benchmark datasets
and demonstrate state of the art results, substantiating the effectiveness of
our representations
IDNet: Smartphone-based Gait Recognition with Convolutional Neural Networks
Here, we present IDNet, a user authentication framework from
smartphone-acquired motion signals. Its goal is to recognize a target user from
their way of walking, using the accelerometer and gyroscope (inertial) signals
provided by a commercial smartphone worn in the front pocket of the user's
trousers. IDNet features several innovations including: i) a robust and
smartphone-orientation-independent walking cycle extraction block, ii) a novel
feature extractor based on convolutional neural networks, iii) a one-class
support vector machine to classify walking cycles, and the coherent integration
of these into iv) a multi-stage authentication technique. IDNet is the first
system that exploits a deep learning approach as universal feature extractors
for gait recognition, and that combines classification results from subsequent
walking cycles into a multi-stage decision making framework. Experimental
results show the superiority of our approach against state-of-the-art
techniques, leading to misclassification rates (either false negatives or
positives) smaller than 0.15% with fewer than five walking cycles. Design
choices are discussed and motivated throughout, assessing their impact on the
user authentication performance
Learning Power Spectrum Maps from Quantized Power Measurements
Power spectral density (PSD) maps providing the distribution of RF power
across space and frequency are constructed using power measurements collected
by a network of low-cost sensors. By introducing linear compression and
quantization to a small number of bits, sensor measurements can be communicated
to the fusion center with minimal bandwidth requirements. Strengths of data-
and model-driven approaches are combined to develop estimators capable of
incorporating multiple forms of spectral and propagation prior information
while fitting the rapid variations of shadow fading across space. To this end,
novel nonparametric and semiparametric formulations are investigated. It is
shown that PSD maps can be obtained using support vector machine-type solvers.
In addition to batch approaches, an online algorithm attuned to real-time
operation is developed. Numerical tests assess the performance of the novel
algorithms.Comment: Submitted Jun. 201
Dependent Mat\'ern Processes for Multivariate Time Series
For the challenging task of modeling multivariate time series, we propose a
new class of models that use dependent Mat\'ern processes to capture the
underlying structure of data, explain their interdependencies, and predict
their unknown values. Although similar models have been proposed in the
econometric, statistics, and machine learning literature, our approach has
several advantages that distinguish it from existing methods: 1) it is flexible
to provide high prediction accuracy, yet its complexity is controlled to avoid
overfitting; 2) its interpretability separates it from black-box methods; 3)
finally, its computational efficiency makes it scalable for high-dimensional
time series. In this paper, we use several simulated and real data sets to
illustrate these advantages. We will also briefly discuss some extensions of
our model.Comment: 10 page
Big Data Analytics in Future Internet of Things
Current research on Internet of Things (IoT) mainly focuses on how to enable
general objects to see, hear, and smell the physical world for themselves, and
make them connected to share the observations. In this paper, we argue that
only connected is not enough, beyond that, general objects should have the
capability to learn, think, and understand both the physical world by
themselves. On the other hand, the future IoT will be highly populated by large
numbers of heterogeneous networked embedded devices, which are generating
massive or big data in an explosive fashion. Although there is a consensus
among almost everyone on the great importance of big data analytics in IoT, to
date, limited results, especially the mathematical foundations, are obtained.
These practical needs impels us to propose a systematic tutorial on the
development of effective algorithms for big data analytics in future IoT, which
are grouped into four classes: 1) heterogeneous data processing, 2) nonlinear
data processing, 3) high-dimensional data processing, and 4) distributed and
parallel data processing. We envision that the presented research is offered as
a mere baby step in a potentially fruitful research direction. We hope that
this article, with interdisciplinary perspectives, will stimulate more
interests in research and development of practical and effective algorithms for
specific IoT applications, to enable smart resource allocation, automatic
network operation, and intelligent service provisioning
Adaptive Graph via Multiple Kernel Learning for Nonnegative Matrix Factorization
Nonnegative Matrix Factorization (NMF) has been continuously evolving in
several areas like pattern recognition and information retrieval methods. It
factorizes a matrix into a product of 2 low-rank non-negative matrices that
will define parts-based, and linear representation of nonnegative data.
Recently, Graph regularized NMF (GrNMF) is proposed to find a compact
representation,which uncovers the hidden semantics and simultaneously respects
the intrinsic geometric structure. In GNMF, an affinity graph is constructed
from the original data space to encode the geometrical information. In this
paper, we propose a novel idea which engages a Multiple Kernel Learning
approach into refining the graph structure that reflects the factorization of
the matrix and the new data space. The GrNMF is improved by utilizing the graph
refined by the kernel learning, and then a novel kernel learning method is
introduced under the GrNMF framework. Our approach shows encouraging results of
the proposed algorithm in comparison to the state-of-the-art clustering
algorithms like NMF, GrNMF, SVD etc.Comment: This paper has been withdrawn by the author due to the terrible
writin
Burst Denoising with Kernel Prediction Networks
We present a technique for jointly denoising bursts of images taken from a
handheld camera. In particular, we propose a convolutional neural network
architecture for predicting spatially varying kernels that can both align and
denoise frames, a synthetic data generation approach based on a realistic noise
formation model, and an optimization guided by an annealed loss function to
avoid undesirable local minima. Our model matches or outperforms the
state-of-the-art across a wide range of noise levels on both real and synthetic
data.Comment: To appear in CVPR 2018 (spotlight). Project page:
http://people.eecs.berkeley.edu/~bmild/kpn
Visual Closed-Loop Control for Pouring Liquids
Pouring a specific amount of liquid is a challenging task. In this paper we
develop methods for robots to use visual feedback to perform closed-loop
control for pouring liquids. We propose both a model-based and a model-free
method utilizing deep learning for estimating the volume of liquid in a
container. Our results show that the model-free method is better able to
estimate the volume. We combine this with a simple PID controller to pour
specific amounts of liquid, and show that the robot is able to achieve an
average 38ml deviation from the target amount. To our knowledge, this is the
first use of raw visual feedback to pour liquids in robotics.Comment: To appear at ICRA 201
Country-wide high-resolution vegetation height mapping with Sentinel-2
Sentinel-2 multi-spectral images collected over periods of several months
were used to estimate vegetation height for Gabon and Switzerland. A deep
convolutional neural network (CNN) was trained to extract suitable spectral and
textural features from reflectance images and to regress per-pixel vegetation
height. In Gabon, reference heights for training and validation were derived
from airborne LiDAR measurements. In Switzerland, reference heights were taken
from an existing canopy height model derived via photogrammetric surface
reconstruction. The resulting maps have a mean absolute error (MAE) of 1.7 m in
Switzerland and 4.3 m in Gabon (a root mean square error (RMSE) of 3.4 m and
5.6 m, respectively), and correctly estimate vegetation heights up to >50 m.
They also show good qualitative agreement with existing vegetation height maps.
Our work demonstrates that, given a moderate amount of reference data (i.e.,
2000 km in Gabon and 5800 km in Switzerland), high-resolution
vegetation height maps with 10 m ground sampling distance (GSD) can be derived
at country scale from Sentinel-2 imagery
- …