11,417 research outputs found
Rate-distance tradeoff for codes above graph capacity
The capacity of a graph is defined as the rate of exponential growth of
independent sets in the strong powers of the graph. In the strong power an edge
connects two sequences if at each position their letters are equal or adjacent.
We consider a variation of the problem where edges in the power graphs are
removed between sequences which differ in more than a fraction of
coordinates. The proposed generalization can be interpreted as the problem of
determining the highest rate of zero undetected-error communication over a link
with adversarial noise, where only a fraction of symbols can be
perturbed and only some substitutions are allowed.
We derive lower bounds on achievable rates by combining graph homomorphisms
with a graph-theoretic generalization of the Gilbert-Varshamov bound. We then
give an upper bound, based on Delsarte's linear programming approach, which
combines Lov\'asz' theta function with the construction used by McEliece et al.
for bounding the minimum distance of codes in Hamming spaces.Comment: 5 pages. Presented at 2016 IEEE International Symposium on
Information Theor
Algorithmic Aspects of Optimal Channel Coding
A central question in information theory is to determine the maximum success
probability that can be achieved in sending a fixed number of messages over a
noisy channel. This was first studied in the pioneering work of Shannon who
established a simple expression characterizing this quantity in the limit of
multiple independent uses of the channel. Here we consider the general setting
with only one use of the channel. We observe that the maximum success
probability can be expressed as the maximum value of a submodular function.
Using this connection, we establish the following results:
1. There is a simple greedy polynomial-time algorithm that computes a code
achieving a (1-1/e)-approximation of the maximum success probability. Moreover,
for this problem it is NP-hard to obtain an approximation ratio strictly better
than (1-1/e).
2. Shared quantum entanglement between the sender and the receiver can
increase the success probability by a factor of at most 1/(1-1/e). In addition,
this factor is tight if one allows an arbitrary non-signaling box between the
sender and the receiver.
3. We give tight bounds on the one-shot performance of the meta-converse of
Polyanskiy-Poor-Verdu.Comment: v2: 16 pages. Added alternate proof of main result with random codin
Correcting a Fraction of Errors in Nonbinary Expander Codes with Linear Programming
A linear-programming decoder for \emph{nonbinary} expander codes is
presented. It is shown that the proposed decoder has the maximum-likelihood
certificate properties. It is also shown that this decoder corrects any pattern
of errors of a relative weight up to approximately 1/4 \delta_A \delta_B (where
\delta_A and \delta_B are the relative minimum distances of the constituent
codes).Comment: Part of this work was presented at the IEEE International Symposium
on Information Theory 2009, Seoul, Kore
Joint source-channel coding with feedback
This paper quantifies the fundamental limits of variable-length transmission
of a general (possibly analog) source over a memoryless channel with noiseless
feedback, under a distortion constraint. We consider excess distortion, average
distortion and guaranteed distortion (-semifaithful codes). In contrast to
the asymptotic fundamental limit, a general conclusion is that allowing
variable-length codes and feedback leads to a sizable improvement in the
fundamental delay-distortion tradeoff. In addition, we investigate the minimum
energy required to reproduce source samples with a given fidelity after
transmission over a memoryless Gaussian channel, and we show that the required
minimum energy is reduced with feedback and an average (rather than maximal)
power constraint.Comment: To appear in IEEE Transactions on Information Theor
- …