A paradox concerning rate of information

A natural definition of the rate of transmission of information is given, arising out of the usual theory. We call it the “Riemannian” rate of transmission. It is shown that the definition leads to a paradox if taken in conjunction with the notion of (time-unlimited) band-limited white noise. A mathematical model can hardly contain both these notions at the same time. The Riemannian rate of transmission does however lead to sensible results if used in conjunction with periodic band-limited white noise. In particular it leads to the Hartley-Wiener-Tuller-Sullivan-Shannon formula without the necessity of introducing Shannon's notion of “dimension rate.” The discussion refers to matrix signal-to-noise ratios and to the entropy of singular multivariate normal distributions

Paradoxes related to the rate of transmission of information

This paper discusses paradoxes related to the possibility of infinite information capacity of certain types of channels. First, a paradox of this type is derived which shows that such paradoxes are not necessarily dependent on the assumption of Gaussian statistics.Next, in the case where signal and noise are assumed to be Gaussian, a different example of this type of paradox is derived; also, a necessary and sufficient condition for the avoidance of this form of the paradox is derived. This condition is shown to be satisfied in a class of plausible physical situations

Processing and Transmission of Information

Contains reports on three research projects.Lincoln Laboratory, Purchase Order DDL B-00283U. S. ArmyU. S. NavyU. S. Air Force under Air Force Contract AF 19(604)-5200Office of Naval Research under Contract Nonr-1841(57

A bibliography of research on behavioral decision processes to 1968

Bibliography of research of human behavioral decision making processes to Jan. 196

The role of zero crossings in speech recognition and processing

Imperial Users onl