265 research outputs found
Survey propagation for the cascading Sourlas code
We investigate how insights from statistical physics, namely survey
propagation, can improve decoding of a particular class of sparse error
correcting codes. We show that a recently proposed algorithm, time averaged
belief propagation, is in fact intimately linked to a specific survey
propagation for which Parisi's replica symmetry breaking parameter is set to
zero, and that the latter is always superior to belief propagation in the high
connectivity limit. We briefly look at further improvements available by going
to the second level of replica symmetry breaking.Comment: 14 pages, 5 figure
Error-correcting code on a cactus: a solvable model
An exact solution to a family of parity check error-correcting codes is
provided by mapping the problem onto a Husimi cactus. The solution obtained in
the thermodynamic limit recovers the replica symmetric theory results and
provides a very good approximation to finite systems of moderate size. The
probability propagation decoding algorithm emerges naturally from the analysis.
A phase transition between decoding success and failure phases is found to
coincide with an information-theoretic upper bound. The method is employed to
compare Gallager and MN codes.Comment: 7 pages, 3 figures, with minor correction
Analysis of common attacks in LDPCC-based public-key cryptosystems
We analyze the security and reliability of a recently proposed class of
public-key cryptosystems against attacks by unauthorized parties who have
acquired partial knowledge of one or more of the private key components and/or
of the plaintext. Phase diagrams are presented, showing critical partial
knowledge levels required for unauthorized decryptionComment: 14 pages, 6 figure
Typical Performance of Gallager-type Error-Correcting Codes
The performance of Gallager's error-correcting code is investigated via
methods of statistical physics. In this approach, the transmitted codeword
comprises products of the original message bits selected by two
randomly-constructed sparse matrices; the number of non-zero row/column
elements in these matrices constitutes a family of codes. We show that
Shannon's channel capacity is saturated for many of the codes while slightly
lower performance is obtained for others which may be of higher practical
relevance. Decoding aspects are considered by employing the TAP approach which
is identical to the commonly used belief-propagation-based decoding.Comment: 6 pages, latex, 1 figur
The Statistical Physics of Regular Low-Density Parity-Check Error-Correcting Codes
A variation of Gallager error-correcting codes is investigated using
statistical mechanics. In codes of this type, a given message is encoded into a
codeword which comprises Boolean sums of message bits selected by two randomly
constructed sparse matrices. The similarity of these codes to Ising spin
systems with random interaction makes it possible to assess their typical
performance by analytical methods developed in the study of disordered systems.
The typical case solutions obtained via the replica method are consistent with
those obtained in simulations using belief propagation (BP) decoding. We
discuss the practical implications of the results obtained and suggest a
computationally efficient construction for one of the more practical
configurations.Comment: 35 pages, 4 figure
Cryptographical Properties of Ising Spin Systems
The relation between Ising spin systems and public-key cryptography is
investigated using methods of statistical physics. The insight gained from the
analysis is used for devising a matrix-based cryptosystem whereby the
ciphertext comprises products of the original message bits; these are selected
by employing two predetermined randomly-constructed sparse matrices. The
ciphertext is decrypted using methods of belief-propagation. The analyzed
properties of the suggested cryptosystem show robustness against various
attacks and competitive performance to modern cyptographical methods.Comment: 4 pages, 2 figure
Secure and linear cryptosystems using error-correcting codes
A public-key cryptosystem, digital signature and authentication procedures
based on a Gallager-type parity-check error-correcting code are presented. The
complexity of the encryption and the decryption processes scale linearly with
the size of the plaintext Alice sends to Bob. The public-key is pre-corrupted
by Bob, whereas a private-noise added by Alice to a given fraction of the
ciphertext of each encrypted plaintext serves to increase the secure channel
and is the cornerstone for digital signatures and authentication. Various
scenarios are discussed including the possible actions of the opponent Oscar as
an eavesdropper or as a disruptor
Statistical Physics of Irregular Low-Density Parity-Check Codes
Low-density parity-check codes with irregular constructions have been
recently shown to outperform the most advanced error-correcting codes to date.
In this paper we apply methods of statistical physics to study the typical
properties of simple irregular codes.
We use the replica method to find a phase transition which coincides with
Shannon's coding bound when appropriate parameters are chosen.
The decoding by belief propagation is also studied using statistical physics
arguments; the theoretical solutions obtained are in good agreement with
simulations. We compare the performance of irregular with that of regular codes
and discuss the factors that contribute to the improvement in performance.Comment: 20 pages, 9 figures, revised version submitted to JP
Parallel vs. Sequential Belief Propagation Decoding of LDPC Codes over GF(q) and Markov Sources
A sequential updating scheme (SUS) for belief propagation (BP) decoding of
LDPC codes over Galois fields, , and correlated Markov sources is
proposed, and compared with the standard parallel updating scheme (PUS). A
thorough experimental study of various transmission settings indicates that the
convergence rate, in iterations, of the BP algorithm (and subsequently its
complexity) for the SUS is about one half of that for the PUS, independent of
the finite field size . Moreover, this 1/2 factor appears regardless of the
correlations of the source and the channel's noise model, while the error
correction performance remains unchanged. These results may imply on the
'universality' of the one half convergence speed-up of SUS decoding
Perceptron capacity revisited: classification ability for correlated patterns
In this paper, we address the problem of how many randomly labeled patterns
can be correctly classified by a single-layer perceptron when the patterns are
correlated with each other. In order to solve this problem, two analytical
schemes are developed based on the replica method and Thouless-Anderson-Palmer
(TAP) approach by utilizing an integral formula concerning random rectangular
matrices. The validity and relevance of the developed methodologies are shown
for one known result and two example problems. A message-passing algorithm to
perform the TAP scheme is also presented
- …