11,889 research outputs found
Source and Channel Polarization over Finite Fields and Reed-Solomon Matrices
Polarization phenomenon over any finite field with size
being a power of a prime is considered. This problem is a generalization of the
original proposal of channel polarization by Arikan for the binary field, as
well as its extension to a prime field by Sasoglu, Telatar, and Arikan. In this
paper, a necessary and sufficient condition of a matrix over a finite field
is shown under which any source and channel are polarized.
Furthermore, the result of the speed of polarization for the binary alphabet
obtained by Arikan and Telatar is generalized to arbitrary finite field. It is
also shown that the asymptotic error probability of polar codes is improved by
using the Reed-Solomon matrix, which can be regarded as a natural
generalization of the binary matrix used in the original proposal
by Arikan.Comment: 17 pages, 3 figures, accepted for publication in the IEEE
Transactions on Information Theor
Countably Infinite Multilevel Source Polarization for Non-Stationary Erasure Distributions
Polar transforms are central operations in the study of polar codes. This
paper examines polar transforms for non-stationary memoryless sources on
possibly infinite source alphabets. This is the first attempt of source
polarization analysis over infinite alphabets. The source alphabet is defined
to be a Polish group, and we handle the Ar{\i}kan-style two-by-two polar
transform based on the group. Defining erasure distributions based on the
normal subgroup structure, we give recursive formulas of the polar transform
for our proposed erasure distributions. As a result, the recursive formulas
lead to concrete examples of multilevel source polarization with countably
infinite levels when the group is locally cyclic. We derive this result via
elementary techniques in lattice theory.Comment: 12 pages, 1 figure, a short version has been accepted by the 2019
IEEE International Symposium on Information Theory (ISIT2019
Universal Source Polarization and an Application to a Multi-User Problem
We propose a scheme that universally achieves the smallest possible
compression rate for a class of sources with side information, and develop an
application of this result for a joint source channel coding problem over a
broadcast channel.Comment: to be presented at Allerton 201
General Strong Polarization
Arikan's exciting discovery of polar codes has provided an altogether new way
to efficiently achieve Shannon capacity. Given a (constant-sized) invertible
matrix , a family of polar codes can be associated with this matrix and its
ability to approach capacity follows from the {\em polarization} of an
associated -bounded martingale, namely its convergence in the limit to
either or . Arikan showed polarization of the martingale associated with
the matrix to get
capacity achieving codes. His analysis was later extended to all matrices
that satisfy an obvious necessary condition for polarization.
While Arikan's theorem does not guarantee that the codes achieve capacity at
small blocklengths, it turns out that a "strong" analysis of the polarization
of the underlying martingale would lead to such constructions. Indeed for the
martingale associated with such a strong polarization was shown in two
independent works ([Guruswami and Xia, IEEE IT '15] and [Hassani et al., IEEE
IT '14]), resolving a major theoretical challenge of the efficient attainment
of Shannon capacity.
In this work we extend the result above to cover martingales associated with
all matrices that satisfy the necessary condition for (weak) polarization. In
addition to being vastly more general, our proofs of strong polarization are
also simpler and modular. Specifically, our result shows strong polarization
over all prime fields and leads to efficient capacity-achieving codes for
arbitrary symmetric memoryless channels. We show how to use our analyses to
achieve exponentially small error probabilities at lengths inverse polynomial
in the gap to capacity. Indeed we show that we can essentially match any error
probability with lengths that are only inverse polynomial in the gap to
capacity.Comment: 73 pages, 2 figures. The final version appeared in JACM. This paper
combines results presented in preliminary form at STOC 2018 and RANDOM 201
Polarization of the Renyi Information Dimension with Applications to Compressed Sensing
In this paper, we show that the Hadamard matrix acts as an extractor over the
reals of the Renyi information dimension (RID), in an analogous way to how it
acts as an extractor of the discrete entropy over finite fields. More
precisely, we prove that the RID of an i.i.d. sequence of mixture random
variables polarizes to the extremal values of 0 and 1 (corresponding to
discrete and continuous distributions) when transformed by a Hadamard matrix.
Further, we prove that the polarization pattern of the RID admits a closed form
expression and follows exactly the Binary Erasure Channel (BEC) polarization
pattern in the discrete setting. We also extend the results from the single- to
the multi-terminal setting, obtaining a Slepian-Wolf counterpart of the RID
polarization. We discuss applications of the RID polarization to Compressed
Sensing of i.i.d. sources. In particular, we use the RID polarization to
construct a family of deterministic -valued sensing matrices for
Compressed Sensing. We run numerical simulations to compare the performance of
the resulting matrices with that of random Gaussian and random Hadamard
matrices. The results indicate that the proposed matrices afford competitive
performances while being explicitly constructed.Comment: 12 pages, 2 figure
- …