6 research outputs found
Computable Lower Bounds for Capacities of Input-Driven Finite-State Channels
This paper studies the capacities of input-driven finite-state channels,
i.e., channels whose current state is a time-invariant deterministic function
of the previous state and the current input. We lower bound the capacity of
such a channel using a dynamic programming formulation of a bound on the
maximum reverse directed information rate. We show that the dynamic
programming-based bounds can be simplified by solving the corresponding Bellman
equation explicitly. In particular, we provide analytical lower bounds on the
capacities of -runlength-limited input-constrained binary symmetric and
binary erasure channels. Furthermore, we provide a single-letter lower bound
based on a class of input distributions with memory.Comment: 9 pages, 8 figures, submitted to International Symposium on
Information Theory, 202
The Duality Upper Bound for Finite-State Channels with Feedback
This paper investigates the capacity of finite-state channels (FSCs) with
feedback. We derive an upper bound on the feedback capacity of FSCs by
extending the duality upper bound method from mutual information to the case of
directed information. The upper bound is expressed as a multi-letter expression
that depends on a test distribution on the sequence of channel outputs. For any
FSC, we show that if the test distribution is structured on a -graph, the
upper bound can be formulated as a Markov decision process (MDP) whose state
being a belief on the channel state. In the case of FSCs and states that are
either unifilar or have a finite memory, the MDP state simplifies to take
values in a finite set. Consequently, the MDP consists of a finite number of
states, actions, and disturbances. This finite nature of the MDP is of
significant importance, as it ensures that dynamic programming algorithms can
solve the associated Bellman equation to establish analytical upper bounds,
even for channels with large alphabets. We demonstrate the simplicity of
computing bounds by establishing the capacity of a broad family of Noisy Output
is the State (NOST) channels as a simple closed-form analytical expression.
Furthermore, we introduce novel, nearly optimal analytical upper bounds on the
capacity of the Noisy Ising channel