2 research outputs found
On Hyperspectral Classification in the Compressed Domain
In this paper, we study the problem of hyperspectral pixel classification
based on the recently proposed architectures for compressive whisk-broom
hyperspectral imagers without the need to reconstruct the complete data cube. A
clear advantage of classification in the compressed domain is its suitability
for real-time on-site processing of the sensed data. Moreover, it is assumed
that the training process also takes place in the compressed domain, thus,
isolating the classification unit from the recovery unit at the receiver's
side. We show that, perhaps surprisingly, using distinct measurement matrices
for different pixels results in more accuracy of the learned classifier and
consistent classification performance, supporting the role of information
diversity in learning
Towards Image Understanding from Deep Compression without Decoding
Motivated by recent work on deep neural network (DNN)-based image compression
methods showing potential improvements in image quality, savings in storage,
and bandwidth reduction, we propose to perform image understanding tasks such
as classification and segmentation directly on the compressed representations
produced by these compression methods. Since the encoders and decoders in
DNN-based compression methods are neural networks with feature-maps as internal
representations of the images, we directly integrate these with architectures
for image understanding. This bypasses decoding of the compressed
representation into RGB space and reduces computational cost. Our study shows
that accuracies comparable to networks that operate on compressed RGB images
can be achieved while reducing the computational complexity up to .
Furthermore, we show that synergies are obtained by jointly training
compression networks with classification networks on the compressed
representations, improving image quality, classification accuracy, and
segmentation performance. We find that inference from compressed
representations is particularly advantageous compared to inference from
compressed RGB images for aggressive compression rates.Comment: ICLR 2018 conference pape