73 research outputs found
Computable Lower Bounds for Capacities of Input-Driven Finite-State Channels
This paper studies the capacities of input-driven finite-state channels,
i.e., channels whose current state is a time-invariant deterministic function
of the previous state and the current input. We lower bound the capacity of
such a channel using a dynamic programming formulation of a bound on the
maximum reverse directed information rate. We show that the dynamic
programming-based bounds can be simplified by solving the corresponding Bellman
equation explicitly. In particular, we provide analytical lower bounds on the
capacities of -runlength-limited input-constrained binary symmetric and
binary erasure channels. Furthermore, we provide a single-letter lower bound
based on a class of input distributions with memory.Comment: 9 pages, 8 figures, submitted to International Symposium on
Information Theory, 202
Finite-State Channels with Feedback and State Known at the Encoder
We consider finite state channels (FSCs) with feedback and state information
known causally at the encoder. This setting is quite general and includes: a
memoryless channel with i.i.d. state (the Shannon strategy), Markovian states
that include look-ahead (LA) access to the state and energy harvesting. We
characterize the feedback capacity of the general setting as the directed
information between auxiliary random variables with memory to the channel
outputs. We also propose two methods for computing the feedback capacity: (i)
formulating an infinite-horizon average-reward dynamic program; and (ii) a
single-letter lower bound based on auxiliary directed graphs called -graphs.
We demonstrate our computation methods on several examples. In the first
example, we introduce a channel with LA and derive a closed-form, analytic
lower bound on its feedback capacity. Furthermore, we show that the mentioned
methods achieve the feedback capacity of known unifilar FSCs such as the
trapdoor channel, the Ising channel and the input-constrained erasure channel.
Finally, we analyze the feedback capacity of a channel whose state is
stochastically dependent on the input.Comment: 39 pages, 10 figures. The material in this paper was presented in
part at the 56th Annual Allerton Conference on Communication, Control, and
Computing, Monticello, IL, USA, October 2018, and at the IEEE International
Symposium on Information Theory, Los Angeles, CA, USA, June 202
Achievable Rates and Low-Complexity Encoding of Posterior Matching for the BSC
Horstein, Burnashev, Shayevitz and Feder, Naghshvar et al. and others have
studied sequential transmission of a K-bit message over the binary symmetric
channel (BSC) with full, noiseless feedback using posterior matching. Yang et
al. provide an improved lower bound on the achievable rate using martingale
analysis that relies on the small-enough difference (SED) partitioning
introduced by Naghshvar et al. SED requires a relatively complex encoder and
decoder. To reduce complexity, this paper replaces SED with relaxed constraints
that admit the small enough absolute difference (SEAD) partitioning rule. The
main analytical results show that achievable-rate bounds higher than those
found by Yang et al. are possible even under the new constraints, which are
less restrictive than SED. The new analysis does not use martingale theory for
the confirmation phase and applies a surrogate channel technique to tighten the
results. An initial systematic transmission further increases the achievable
rate bound. The simplified encoder associated with SEAD has a complexity below
order O(K^2) and allows simulations for message sizes of at least 1000 bits.
For example, simulations achieve 99% of of the channel's 0.50-bit capacity with
an average block size of 200 bits for a target codeword error rate of 10^(-3).Comment: This paper consists of 26 pages and contains 6 figures. An earlier
version of the algorithm included in this paper was published at the 2020
IEEE International Symposium on Information Theory (ISIT), (DOI:
10.1109/ISIT44484.2020.9174232
Digital Filters and Signal Processing
Digital filters, together with signal processing, are being employed in the new technologies and information systems, and are implemented in different areas and applications. Digital filters and signal processing are used with no costs and they can be adapted to different cases with great flexibility and reliability. This book presents advanced developments in digital filters and signal process methods covering different cases studies. They present the main essence of the subject, with the principal approaches to the most recent mathematical models that are being employed worldwide
- …