6,233 research outputs found
A Generalized Typicality for Abstract Alphabets
A new notion of typicality for arbitrary probability measures on standard
Borel spaces is proposed, which encompasses the classical notions of weak and
strong typicality as special cases. Useful lemmas about strong typical sets,
including conditional typicality lemma, joint typicality lemma, and packing and
covering lemmas, which are fundamental tools for deriving many inner bounds of
various multi-terminal coding problems, are obtained in terms of the proposed
notion. This enables us to directly generalize lots of results on finite
alphabet problems to general problems involving abstract alphabets, without any
complicated additional arguments. For instance, quantization procedure is no
longer necessary to achieve such generalizations. Another fundamental lemma,
Markov lemma, is also obtained but its scope of application is quite limited
compared to others. Yet, an alternative theory of typical sets for Gaussian
measures, free from this limitation, is also developed. Some remarks on a
possibility to generalize the proposed notion for sources with memory are also
given.Comment: 44 pages; submitted to IEEE Transactions on Information Theor
Large deviations of the empirical flow for continuous time Markov chains
We consider a continuous time Markov chain on a countable state space and
prove a joint large deviation principle for the empirical measure and the
empirical flow, which accounts for the total number of jumps between pairs of
states. We give a direct proof using tilting and an indirect one by contraction
from the empirical process.Comment: Minor revision, to appear on Annales de l'Institut Henri Poincare (B)
Probability and Statistic
- …