Scalable Compression of Deep Neural Networks

Deep neural networks generally involve some layers with mil- lions of parameters, making them difficult to be deployed and updated on devices with limited resources such as mobile phones and other smart embedded systems. In this paper, we propose a scalable representation of the network parameters, so that different applications can select the most suitable bit rate of the network based on their own storage constraints. Moreover, when a device needs to upgrade to a high-rate network, the existing low-rate network can be reused, and only some incremental data are needed to be downloaded. We first hierarchically quantize the weights of a pre-trained deep neural network to enforce weight sharing. Next, we adaptively select the bits assigned to each layer given the total bit budget. After that, we retrain the network to fine-tune the quantized centroids. Experimental results show that our method can achieve scalable compression with graceful degradation in the performance.Comment: 5 pages, 4 figures, ACM Multimedia 201

Squashed States of Light: Theory and Applications to Quantum Spectroscopy

Using a feedback loop it is possible to reduce the fluctuations in one quadrature of an in-loop field without increasing the fluctuations in the other. This effect has been known for a long time, and has recently been called ``squashing'' [B.C. Buchler et al., Optics Letters {\bf 24}, 259 (1999)], as opposed to the ``squeezing'' of a free field in which the conjugate fluctuations are increased. In this paper I present a general theory of squashing, including simultaneous squashing of both quadratures and simultaneous squeezing and squashing. I show that a two-level atom coupled to the in-loop light feels the effect of the fluctuations as calculated by the theory. In the ideal limit of light squeezed in one quadrature and squashed in the other, the atomic decay can be completely suppressed.Comment: 8 pages plus one figure. Submitted to JEOS-B for Dan Walls Special Issu

A bio-inspired image coder with temporal scalability

We present a novel bio-inspired and dynamic coding scheme for static images. Our coder aims at reproducing the main steps of the visual stimulus processing in the mammalian retina taking into account its time behavior. The main novelty of this work is to show how to exploit the time behavior of the retina cells to ensure, in a simple way, scalability and bit allocation. To do so, our main source of inspiration will be the biologically plausible retina model called Virtual Retina. Following a similar structure, our model has two stages. The first stage is an image transform which is performed by the outer layers in the retina. Here it is modelled by filtering the image with a bank of difference of Gaussians with time-delays. The second stage is a time-dependent analog-to-digital conversion which is performed by the inner layers in the retina. Thanks to its conception, our coder enables scalability and bit allocation across time. Also, our decoded images do not show annoying artefacts such as ringing and block effects. As a whole, this article shows how to capture the main properties of a biological system, here the retina, in order to design a new efficient coder.Comment: 12 pages; Advanced Concepts for Intelligent Vision Systems (ACIVS 2011

Systematic Parameterization, Storage, and Representation of Volumetric DICOM Data

Tomographic medical imaging systems produce hundreds to thousands of slices, enabling three-dimensional (3D) analysis. Radiologists process these images through various tools and techniques in order to generate 3D renderings for various applications, such as surgical planning, medical education, and volumetric measurements. To save and store these visualizations, current systems use snapshots or video exporting, which prevents further optimizations and requires the storage of significant additional data. The Grayscale Softcopy Presentation State extension of the Digital Imaging and Communications in Medicine (DICOM) standard resolves this issue for two-dimensional (2D) data by introducing an extensive set of parameters, namely 2D Presentation States (2DPR), that describe how an image should be displayed. 2DPR allows storing these parameters instead of storing parameter applied images, which cause unnecessary duplication of the image data. Since there is currently no corresponding extension for 3D data, in this study, a DICOM-compliant object called 3D presentation states (3DPR) is proposed for the parameterization and storage of 3D medical volumes. To accomplish this, the 3D medical visualization process is divided into four tasks, namely pre-processing, segmentation, post-processing, and rendering. The important parameters of each task are determined. Special focus is given to the compression of segmented data, parameterization of the rendering process, and DICOM-compliant implementation of the 3DPR object. The use of 3DPR was tested in a radiology department on three clinical cases, which require multiple segmentations and visualizations during the workflow of radiologists. The results show that 3DPR can effectively simplify the workload of physicians by directly regenerating 3D renderings without repeating intermediate tasks, increase efficiency by preserving all user interactions, and provide efficient storage as well as transfer of visualized data. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1007/s40846-015-0097-5) contains supplementary material, which is available to authorized users

My School? Critiquing the abstraction and quantification of education

This paper draws upon and critiques the Australian federal government's website My School as an archetypal example of the current tendency to abstract and quantify educational practice. Arguing in favour of a moral philosophical account of educational practice, the paper reveals how the My School website reduces complex educational practices to simple, supposedly objective, measures of student attainment, reflecting the broader 'audit' society/culture within which it is located. By revealing just how extensively the My School website reduces educational practices to numbers, the paper argues that we are in danger of losing sight of the 'internal' goods of Education which cannot be readily and simply codified, and that the teacher learning encouraged by the site marginalises more active and collective approaches. While having the potential to serve some beneficial diagnostic purposes, the My School website reinforces a view of teachers as passive consumers of information generated beyond their everyday practice

Feedback-control of quantum systems using continuous state-estimation

We present a formulation of feedback in quantum systems in which the best estimates of the dynamical variables are obtained continuously from the measurement record, and fed back to control the system. We apply this method to the problem of cooling and confining a single quantum degree of freedom, and compare it to current schemes in which the measurement signal is fed back directly in the manner usually considered in existing treatments of quantum feedback. Direct feedback may be combined with feedback by estimation, and the resulting combination, performed on a linear system, is closely analogous to classical LQG control theory with residual feedback.Comment: 12 pages, multicol revtex, revised and extende

Progress Report on Frequency - Modulated Differential Absorption Lidar

Modeling done at Pacific Northwest National Laboratory (PNNL) in FY2000 predicted improved sensitivity for remote chemical detection by differential absorption lidar (DIAL) if frequency-modulated (FM) lasers were used. This improved sensitivity results from faster averaging away of speckle noise and the recently developed quantum cascade (QC) lasers offer the first practical method for implementing this approach in the molecular fingerprint region of the infrared. To validate this model prediction, a simple laboratory bench FM-DIAL system was designed, assembled, tested, and laboratory-scale experiments were carried out during FY2001. Preliminary results of the FM DIAL experiments confirm the speckle averaging advantages predicted by the models. In addition, experiments were performed to explore the use of hybrid QC - CO2 lasers for achieving sufficient frequency-modulated laser power to enable field experiments at longer ranges (up to one kilometer or so). This approach will allow model validation at realistic ranges much sooner than would be possible if one had to first develop master oscillator - power amplifier systems utilizing only QC devices. Amplification of a QC laser with a CO2 laser was observed in the first hybrid laser experiments, but the low gain and narrow linewidth of the CO2 laser available for these experiments prevented production of a high-power FM laser beam

Information, disturbance and Hamiltonian quantum feedback control

We consider separating the problem of designing Hamiltonian quantum feedback control algorithms into a measurement (estimation) strategy and a feedback (control) strategy, and consider optimizing desirable properties of each under the minimal constraint that the available strength of both is limited. This motivates concepts of information extraction and disturbance which are distinct from those usually considered in quantum information theory. Using these concepts we identify an information trade-off in quantum feedback control.Comment: 13 pages, multicol Revtex, 2 eps figure