1,096 research outputs found
Concentration of Measure Inequalities in Information Theory, Communications and Coding (Second Edition)
During the last two decades, concentration inequalities have been the subject
of exciting developments in various areas, including convex geometry,
functional analysis, statistical physics, high-dimensional statistics, pure and
applied probability theory, information theory, theoretical computer science,
and learning theory. This monograph focuses on some of the key modern
mathematical tools that are used for the derivation of concentration
inequalities, on their links to information theory, and on their various
applications to communications and coding. In addition to being a survey, this
monograph also includes various new recent results derived by the authors. The
first part of the monograph introduces classical concentration inequalities for
martingales, as well as some recent refinements and extensions. The power and
versatility of the martingale approach is exemplified in the context of codes
defined on graphs and iterative decoding algorithms, as well as codes for
wireless communication. The second part of the monograph introduces the entropy
method, an information-theoretic technique for deriving concentration
inequalities. The basic ingredients of the entropy method are discussed first
in the context of logarithmic Sobolev inequalities, which underlie the
so-called functional approach to concentration of measure, and then from a
complementary information-theoretic viewpoint based on transportation-cost
inequalities and probability in metric spaces. Some representative results on
concentration for dependent random variables are briefly summarized, with
emphasis on their connections to the entropy method. Finally, we discuss
several applications of the entropy method to problems in communications and
coding, including strong converses, empirical distributions of good channel
codes, and an information-theoretic converse for concentration of measure.Comment: Foundations and Trends in Communications and Information Theory, vol.
10, no 1-2, pp. 1-248, 2013. Second edition was published in October 2014.
ISBN to printed book: 978-1-60198-906-
Information-Theoretic Foundations of Mismatched Decoding
Shannon's channel coding theorem characterizes the maximal rate of
information that can be reliably transmitted over a communication channel when
optimal encoding and decoding strategies are used. In many scenarios, however,
practical considerations such as channel uncertainty and implementation
constraints rule out the use of an optimal decoder. The mismatched decoding
problem addresses such scenarios by considering the case that the decoder
cannot be optimized, but is instead fixed as part of the problem statement.
This problem is not only of direct interest in its own right, but also has
close connections with other long-standing theoretical problems in information
theory. In this monograph, we survey both classical literature and recent
developments on the mismatched decoding problem, with an emphasis on achievable
random-coding rates for memoryless channels. We present two widely-considered
achievable rates known as the generalized mutual information (GMI) and the LM
rate, and overview their derivations and properties. In addition, we survey
several improved rates via multi-user coding techniques, as well as recent
developments and challenges in establishing upper bounds on the mismatch
capacity, and an analogous mismatched encoding problem in rate-distortion
theory. Throughout the monograph, we highlight a variety of applications and
connections with other prominent information theory problems.Comment: Published in Foundations and Trends in Communications and Information
Theory (Volume 17, Issue 2-3
Downlink Spectral Efficiency of Cell-Free Massive MIMO with Full-Pilot Zero-Forcing
Cell-free Massive multiple-input multiple-output (MIMO) ensures ubiquitous
communication at high spectral efficiency (SE) thanks to increased
macro-diversity as compared cellular communications. However, system
scalability and performance are limited by fronthauling traffic and
interference. Unlike conventional precoding schemes that only suppress
intra-cell interference, full-pilot zero-forcing (fpZF), introduced in [1],
actively suppresses also inter-cell interference, without sharing channel state
information (CSI) among the access points (APs). In this study, we derive a new
closed-form expression for the downlink (DL) SE of a cell-free Massive MIMO
system with multi-antenna APs and fpZF precoding, under imperfect CSI and pilot
contamination. The analysis also includes max-min fairness DL power
optimization. Numerical results show that fpZF significantly outperforms
maximum ratio transmission scheme, without increasing the fronthauling
overhead, as long as the system is sufficiently distributed.Comment: Paper published in 2018 IEEE Global Conference on Signal and
Information Processing (GlobalSIP). {\copyright} 2019 IEEE. Personal use of
this material is permitted. Permission from IEEE must be obtained for all
other use
- …