7 research outputs found
Mutual Information and Minimum Mean-square Error in Gaussian Channels
This paper deals with arbitrarily distributed finite-power input signals
observed through an additive Gaussian noise channel. It shows a new formula
that connects the input-output mutual information and the minimum mean-square
error (MMSE) achievable by optimal estimation of the input given the output.
That is, the derivative of the mutual information (nats) with respect to the
signal-to-noise ratio (SNR) is equal to half the MMSE, regardless of the input
statistics. This relationship holds for both scalar and vector signals, as well
as for discrete-time and continuous-time noncausal MMSE estimation. This
fundamental information-theoretic result has an unexpected consequence in
continuous-time nonlinear estimation: For any input signal with finite power,
the causal filtering MMSE achieved at SNR is equal to the average value of the
noncausal smoothing MMSE achieved with a channel whose signal-to-noise ratio is
chosen uniformly distributed between 0 and SNR
Minimum Energy to Send k Bits Through the Gaussian Channel With and Without Feedback
The minimum achievable energy per bit over memoryless Gaussian channels has been previously addressed in the limit when the number of information bits goes to infinity, in which case it is known that the availability of noiseless feedback does not lower the minimum energy per bit, which is -1.59 dB below the noise level. This paper analyzes the behavior of the minimum energy per bit for memoryless Gaussian channels as a function of k, the number of information bits. It is demonstrated that in this nonasymptotic regime, noiseless feedback leads to significantly better energy efficiency. In particular, without feedback achieving energy per bit of -1.57 dB requires coding over at least k=10[superscript 6] information bits, while we construct a feedback scheme that transmits a single information bit with energy -1.59 dB and zero error. We also show that unless k is very small, approaching the minimal energy per bit does not require using the feedback link except to signal that transmission should stop.National Science Foundation (U.S.) (Grant CCF-06-35154)National Science Foundation (U.S.) (grant CNS-09-05398
Optimization of communication data rates under fading conditions
Imperial Users onl
Communication utilizing feedback channels.
Massachusetts Institute of Technology. Dept. of Electrical Engineering. Thesis. 1969. Ph.D.MICROFICHE COPY ALSO AVAILABLE IN BARKER ENGINEERING LIBRARY.Vita.Bibliography: leaves 169-171.Ph.D