322 research outputs found
Kolmogorov complexity and computably enumerable sets
We study the computably enumerable sets in terms of the: (a) Kolmogorov
complexity of their initial segments; (b) Kolmogorov complexity of finite
programs when they are used as oracles. We present an extended discussion of
the existing research on this topic, along with recent developments and open
problems. Besides this survey, our main original result is the following
characterization of the computably enumerable sets with trivial initial segment
prefix-free complexity. A computably enumerable set is -trivial if and
only if the family of sets with complexity bounded by the complexity of is
uniformly computable from the halting problem
Kolmogorov Complexity in perspective. Part I: Information Theory and Randomnes
We survey diverse approaches to the notion of information: from Shannon
entropy to Kolmogorov complexity. Two of the main applications of Kolmogorov
complexity are presented: randomness and classification. The survey is divided
in two parts in the same volume. Part I is dedicated to information theory and
the mathematical formalization of randomness based on Kolmogorov complexity.
This last application goes back to the 60's and 70's with the work of
Martin-L\"of, Schnorr, Chaitin, Levin, and has gained new impetus in the last
years.Comment: 40 page
Algorithmic Identification of Probabilities
TThe problem is to identify a probability associated with a set of natural
numbers, given an infinite data sequence of elements from the set. If the given
sequence is drawn i.i.d. and the probability mass function involved (the
target) belongs to a computably enumerable (c.e.) or co-computably enumerable
(co-c.e.) set of computable probability mass functions, then there is an
algorithm to almost surely identify the target in the limit. The technical tool
is the strong law of large numbers. If the set is finite and the elements of
the sequence are dependent while the sequence is typical in the sense of
Martin-L\"of for at least one measure belonging to a c.e. or co-c.e. set of
computable measures, then there is an algorithm to identify in the limit a
computable measure for which the sequence is typical (there may be more than
one such measure). The technical tool is the theory of Kolmogorov complexity.
We give the algorithms and consider the associated predictions.Comment: 19 pages LaTeX.Corrected errors and rewrote the entire paper. arXiv
admin note: text overlap with arXiv:1208.500
Generic algorithms for halting problem and optimal machines revisited
The halting problem is undecidable --- but can it be solved for "most"
inputs? This natural question was considered in a number of papers, in
different settings. We revisit their results and show that most of them can be
easily proven in a natural framework of optimal machines (considered in
algorithmic information theory) using the notion of Kolmogorov complexity. We
also consider some related questions about this framework and about asymptotic
properties of the halting problem. In particular, we show that the fraction of
terminating programs cannot have a limit, and all limit points are Martin-L\"of
random reals. We then consider mass problems of finding an approximate solution
of halting problem and probabilistic algorithms for them, proving both positive
and negative results. We consider the fraction of terminating programs that
require a long time for termination, and describe this fraction using the busy
beaver function. We also consider approximate versions of separation problems,
and revisit Schnorr's results about optimal numberings showing how they can be
generalized.Comment: a preliminary version was presented at the ICALP 2015 conferenc
On Resource-bounded versions of the van Lambalgen theorem
The van Lambalgen theorem is a surprising result in algorithmic information
theory concerning the symmetry of relative randomness. It establishes that for
any pair of infinite sequences and , is Martin-L\"of random and
is Martin-L\"of random relative to if and only if the interleaved sequence
is Martin-L\"of random. This implies that is relative random
to if and only if is random relative to \cite{vanLambalgen},
\cite{Nies09}, \cite{HirschfeldtBook}. This paper studies the validity of this
phenomenon for different notions of time-bounded relative randomness.
We prove the classical van Lambalgen theorem using martingales and Kolmogorov
compressibility. We establish the failure of relative randomness in these
settings, for both time-bounded martingales and time-bounded Kolmogorov
complexity. We adapt our classical proofs when applicable to the time-bounded
setting, and construct counterexamples when they fail. The mode of failure of
the theorem may depend on the notion of time-bounded randomness
- …