354 research outputs found
A General Framework for Transmission with Transceiver Distortion and Some Applications
A general theoretical framework is presented for analyzing information
transmission over Gaussian channels with memoryless transceiver distortion,
which encompasses various nonlinear distortion models including transmit-side
clipping, receive-side analog-to-digital conversion, and others. The framework
is based on the so-called generalized mutual information (GMI), and the
analysis in particular benefits from the setup of Gaussian codebook ensemble
and nearest-neighbor decoding, for which it is established that the GMI takes a
general form analogous to the channel capacity of undistorted Gaussian
channels, with a reduced "effective" signal-to-noise ratio (SNR) that depends
on the nominal SNR and the distortion model. When applied to specific
distortion models, an array of results of engineering relevance is obtained.
For channels with transmit-side distortion only, it is shown that a
conventional approach, which treats the distorted signal as the sum of the
original signal part and a uncorrelated distortion part, achieves the GMI. For
channels with output quantization, closed-form expressions are obtained for the
effective SNR and the GMI, and related optimization problems are formulated and
solved for quantizer design. Finally, super-Nyquist sampling is analyzed within
the general framework, and it is shown that sampling beyond the Nyquist rate
increases the GMI for all SNR. For example, with a binary symmetric output
quantization, information rates exceeding one bit per channel use are
achievable by sampling the output at four times the Nyquist rate.Comment: 32 pages (including 4 figures, 5 tables, and auxiliary materials);
submitted to IEEE Transactions on Communication
Optimization of Information Rate Upper and Lower Bounds for Channels with Memory
We consider the problem of minimizing upper bounds and maximizing lower
bounds on information rates of stationary and ergodic discrete-time channels
with memory. The channels we consider can have a finite number of states, such
as partial response channels, or they can have an infinite state-space, such as
time-varying fading channels. We optimize recently-proposed information rate
bounds for such channels, which make use of auxiliary finite-state machine
channels (FSMCs). Our main contribution in this paper is to provide iterative
expectation-maximization (EM) type algorithms to optimize the parameters of the
auxiliary FSMC to tighten these bounds. We provide an explicit, iterative
algorithm that improves the upper bound at each iteration. We also provide an
effective method for iteratively optimizing the lower bound. To demonstrate the
effectiveness of our algorithms, we provide several examples of partial
response and fading channels, where the proposed optimization techniques
significantly tighten the initial upper and lower bounds. Finally, we compare
our results with an improved variation of the \emph{simplex} local optimization
algorithm, called \emph{Soblex}. This comparison shows that our proposed
algorithms are superior to the Soblex method, both in terms of robustness in
finding the tightest bounds and in computational efficiency. Interestingly,
from a channel coding/decoding perspective, optimizing the lower bound is
related to increasing the achievable mismatched information rate, i.e., the
information rate of a communication system where the decoder at the receiver is
matched to the auxiliary channel, and not to the original channel.Comment: Submitted to IEEE Transactions on Information Theory, November 24,
200
Probabilistic Shaping for Finite Blocklengths: Distribution Matching and Sphere Shaping
In this paper, we provide for the first time a systematic comparison of
distribution matching (DM) and sphere shaping (SpSh) algorithms for short
blocklength probabilistic amplitude shaping. For asymptotically large
blocklengths, constant composition distribution matching (CCDM) is known to
generate the target capacity-achieving distribution. As the blocklength
decreases, however, the resulting rate loss diminishes the efficiency of CCDM.
We claim that for such short blocklengths and over the additive white Gaussian
channel (AWGN), the objective of shaping should be reformulated as obtaining
the most energy-efficient signal space for a given rate (rather than matching
distributions). In light of this interpretation, multiset-partition DM (MPDM),
enumerative sphere shaping (ESS) and shell mapping (SM), are reviewed as
energy-efficient shaping techniques. Numerical results show that MPDM and SpSh
have smaller rate losses than CCDM. SpSh--whose sole objective is to maximize
the energy efficiency--is shown to have the minimum rate loss amongst all. We
provide simulation results of the end-to-end decoding performance showing that
up to 1 dB improvement in power efficiency over uniform signaling can be
obtained with MPDM and SpSh at blocklengths around 200. Finally, we present a
discussion on the complexity of these algorithms from the perspective of
latency, storage and computations.Comment: 18 pages, 10 figure
Generalized Nearest Neighbor Decoding
It is well known that for Gaussian channels, a nearest neighbor decoding
rule, which seeks the minimum Euclidean distance between a codeword and the
received channel output vector, is the maximum likelihood solution and hence
capacity-achieving. Nearest neighbor decoding remains a convenient and yet
mismatched solution for general channels, and the key message of this paper is
that the performance of the nearest neighbor decoding can be improved by
generalizing its decoding metric to incorporate channel state dependent output
processing and codeword scaling. Using generalized mutual information, which is
a lower bound to the mismatched capacity under independent and identically
distributed codebook ensemble, as the performance measure, this paper
establishes the optimal generalized nearest neighbor decoding rule, under
Gaussian channel input. Several {restricted forms of the} generalized nearest
neighbor decoding rule are also derived and compared with existing solutions.
The results are illustrated through several case studies for fading channels
with imperfect receiver channel state information and for channels with
quantization effects.Comment: 30 pages, 8 figure
- …