194 research outputs found
On rate-distortion with mixed types of side information
In this correspondence, we consider rate-distortion examples in the presence of side information. For a system with some side information known at both the encoder and decoder, and some known only at the decoder, we evaluate the rate distortion function for both Gaussian and binary sources. While the Gaussian example is a straightforward generalization of the corresponding result by Wyner, the binary example proves more difficult and is solved using a multidimensional optimization approach. Leveraging the insights gained from the binary example, we then solve the more complicated binary Heegard and Berger problem of decoding when side information may be present. The results demonstrate the existence of a new type of successive refinement in which the refinement information is decoded together with side information that is not available for the initial description
On Zero-Error Source Coding with Feedback
We consider the problem of zero error source coding with limited feedback
when side information is present at the receiver. First, we derive an
achievable rate region for arbitrary joint distributions on the source and the
side information. When all source pairs of source and side information symbols
are observable with non-zero probability, we show that this characterization
gives the entire rate region. Next, we demonstrate a class of sources for which
asymptotically zero feedback suffices to achieve zero-error coding at the rate
promised by the Slepian-Wolf bound for asymptotically lossless coding. Finally,
we illustrate these results with the aid of three simple examples
A vector quantization approach to universal noiseless coding and quantization
A two-stage code is a block code in which each block of data is coded in two stages: the first stage codes the identity of a block code among a collection of codes, and the second stage codes the data using the identified code. The collection of codes may be noiseless codes, fixed-rate quantizers, or variable-rate quantizers. We take a vector quantization approach to two-stage coding, in which the first stage code can be regarded as a vector quantizer that “quantizes” the input data of length n to one of a fixed collection of block codes. We apply the generalized Lloyd algorithm to the first-stage quantizer, using induced measures of rate and distortion, to design locally optimal two-stage codes. On a source of medical images, two-stage variable-rate vector quantizers designed in this way outperform standard (one-stage) fixed-rate vector quantizers by over 9 dB. The tail of the operational distortion-rate function of the first-stage quantizer determines the optimal rate of convergence of the redundancy of a universal sequence of two-stage codes. We show that there exist two-stage universal noiseless codes, fixed-rate quantizers, and variable-rate quantizers whose per-letter rate and distortion redundancies converge to zero as (k/2)n -1 log n, when the universe of sources has finite dimension k. This extends the achievability part of Rissanen's theorem from universal noiseless codes to universal quantizers. Further, we show that the redundancies converge as O(n-1) when the universe of sources is countable, and as O(n-1+ϵ) when the universe of sources is infinite-dimensional, under appropriate conditions
Optimality in Quantum Data Compression using Dynamical Entropy
In this article we study lossless compression of strings of pure quantum
states of indeterminate-length quantum codes which were introduced by
Schumacher and Westmoreland. Past work has assumed that the strings of quantum
data are prepared to be encoded in an independent and identically distributed
way. We introduce the notion of quantum stochastic ensembles, allowing us to
consider strings of quantum states prepared in a more general way. For any
identically distributed quantum stochastic ensemble we define an associated
quantum Markov chain and prove that the optimal average codeword length via
lossless coding is equal to the quantum dynamical entropy of the associated
quantum Markov chain
- …