2 research outputs found
The theoretical capacity of the Parity Source Coder
The Parity Source Coder is a protocol for data compression which is based on
a set of parity checks organized in a sparse random network. We consider here
the case of memoryless unbiased binary sources. We show that the theoretical
capacity saturate the Shannon limit at large K. We also find that the first
corrections to the leading behavior are exponentially small, so that the
behavior at finite K is very close to the optimal one.Comment: Added references, minor change
Focused Local Search for Random 3-Satisfiability
A local search algorithm solving an NP-complete optimisation problem can be
viewed as a stochastic process moving in an 'energy landscape' towards
eventually finding an optimal solution. For the random 3-satisfiability
problem, the heuristic of focusing the local moves on the presently
unsatisfiedclauses is known to be very effective: the time to solution has been
observed to grow only linearly in the number of variables, for a given
clauses-to-variables ratio sufficiently far below the critical
satisfiability threshold . We present numerical results
on the behaviour of three focused local search algorithms for this problem,
considering in particular the characteristics of a focused variant of the
simple Metropolis dynamics. We estimate the optimal value for the
``temperature'' parameter for this algorithm, such that its linear-time
regime extends as close to as possible. Similar parameter
optimisation is performed also for the well-known WalkSAT algorithm and for the
less studied, but very well performing Focused Record-to-Record Travel method.
We observe that with an appropriate choice of parameters, the linear time
regime for each of these algorithms seems to extend well into ratios -- much further than has so far been generally assumed. We discuss the
statistics of solution times for the algorithms, relate their performance to
the process of ``whitening'', and present some conjectures on the shape of
their computational phase diagrams.Comment: 20 pages, lots of figure