14 research outputs found
BLADE: Filter Learning for General Purpose Computational Photography
The Rapid and Accurate Image Super Resolution (RAISR) method of Romano,
Isidoro, and Milanfar is a computationally efficient image upscaling method
using a trained set of filters. We describe a generalization of RAISR, which we
name Best Linear Adaptive Enhancement (BLADE). This approach is a trainable
edge-adaptive filtering framework that is general, simple, computationally
efficient, and useful for a wide range of problems in computational
photography. We show applications to operations which may appear in a camera
pipeline including denoising, demosaicing, and stylization
Content Authentication for Neural Imaging Pipelines: End-to-end Optimization of Photo Provenance in Complex Distribution Channels
Forensic analysis of digital photo provenance relies on intrinsic traces left
in the photograph at the time of its acquisition. Such analysis becomes
unreliable after heavy post-processing, such as down-sampling and
re-compression applied upon distribution in the Web. This paper explores
end-to-end optimization of the entire image acquisition and distribution
workflow to facilitate reliable forensic analysis at the end of the
distribution channel. We demonstrate that neural imaging pipelines can be
trained to replace the internals of digital cameras, and jointly optimized for
high-fidelity photo development and reliable provenance analysis. In our
experiments, the proposed approach increased image manipulation detection
accuracy from 45% to over 90%. The findings encourage further research towards
building more reliable imaging pipelines with explicit provenance-guaranteeing
properties.Comment: Camera ready + supplement, CVPR'1
ezDPS: An Efficient and Zero-Knowledge Machine Learning Inference Pipeline
Machine Learning as a service (MLaaS) permits resource-limited clients to
access powerful data analytics services ubiquitously. Despite its merits, MLaaS
poses significant concerns regarding the integrity of delegated computation and
the privacy of the server's model parameters. To address this issue, Zhang et
al. (CCS'20) initiated the study of zero-knowledge Machine Learning (zkML). Few
zkML schemes have been proposed afterward; however, they focus on sole ML
classification algorithms that may not offer satisfactory accuracy or require
large-scale training data and model parameters, which may not be desirable for
some applications. We propose ezDPS, a new efficient and zero-knowledge ML
inference scheme. Unlike prior works, ezDPS is a zkML pipeline in which the
data is processed in multiple stages for high accuracy. Each stage of ezDPS is
harnessed with an established ML algorithm that is shown to be effective in
various applications, including Discrete Wavelet Transformation, Principal
Components Analysis, and Support Vector Machine. We design new gadgets to prove
ML operations effectively. We fully implemented ezDPS and assessed its
performance on real datasets. Experimental results showed that ezDPS achieves
one-to-three orders of magnitude more efficient than the generic circuit-based
approach in all metrics while maintaining more desirable accuracy than single
ML classification approaches.Comment: This paper is to appear in Privacy-Enhancing Technologies Symposium
(PETS) 202