3,904 research outputs found
Logic Programming and Logarithmic Space
We present an algebraic view on logic programming, related to proof theory
and more specifically linear logic and geometry of interaction. Within this
construction, a characterization of logspace (deterministic and
non-deterministic) computation is given via a synctactic restriction, using an
encoding of words that derives from proof theory.
We show that the acceptance of a word by an observation (the counterpart of a
program in the encoding) can be decided within logarithmic space, by reducing
this problem to the acyclicity of a graph. We show moreover that observations
are as expressive as two-ways multi-heads finite automata, a kind of pointer
machines that is a standard model of logarithmic space computation
Efficient Classification for Metric Data
Recent advances in large-margin classification of data residing in general
metric spaces (rather than Hilbert spaces) enable classification under various
natural metrics, such as string edit and earthmover distance. A general
framework developed for this purpose by von Luxburg and Bousquet [JMLR, 2004]
left open the questions of computational efficiency and of providing direct
bounds on generalization error.
We design a new algorithm for classification in general metric spaces, whose
runtime and accuracy depend on the doubling dimension of the data points, and
can thus achieve superior classification performance in many common scenarios.
The algorithmic core of our approach is an approximate (rather than exact)
solution to the classical problems of Lipschitz extension and of Nearest
Neighbor Search. The algorithm's generalization performance is guaranteed via
the fat-shattering dimension of Lipschitz classifiers, and we present
experimental evidence of its superiority to some common kernel methods. As a
by-product, we offer a new perspective on the nearest neighbor classifier,
which yields significantly sharper risk asymptotics than the classic analysis
of Cover and Hart [IEEE Trans. Info. Theory, 1967].Comment: This is the full version of an extended abstract that appeared in
Proceedings of the 23rd COLT, 201
The Complexity of Approximately Counting Stable Roommate Assignments
We investigate the complexity of approximately counting stable roommate
assignments in two models: (i) the -attribute model, in which the preference
lists are determined by dot products of "preference vectors" with "attribute
vectors" and (ii) the -Euclidean model, in which the preference lists are
determined by the closeness of the "positions" of the people to their
"preferred positions". Exactly counting the number of assignments is
#P-complete, since Irving and Leather demonstrated #P-completeness for the
special case of the stable marriage problem. We show that counting the number
of stable roommate assignments in the -attribute model () and the
3-Euclidean model() is interreducible, in an approximation-preserving
sense, with counting independent sets (of all sizes) (#IS) in a graph, or
counting the number of satisfying assignments of a Boolean formula (#SAT). This
means that there can be no FPRAS for any of these problems unless NP=RP. As a
consequence, we infer that there is no FPRAS for counting stable roommate
assignments (#SR) unless NP=RP. Utilizing previous results by the authors, we
give an approximation-preserving reduction from counting the number of
independent sets in a bipartite graph (#BIS) to counting the number of stable
roommate assignments both in the 3-attribute model and in the 2-Euclidean
model. #BIS is complete with respect to approximation-preserving reductions in
the logically-defined complexity class #RH\Pi_1. Hence, our result shows that
an FPRAS for counting stable roommate assignments in the 3-attribute model
would give an FPRAS for all of #RH\Pi_1. We also show that the 1-attribute
stable roommate problem always has either one or two stable roommate
assignments, so the number of assignments can be determined exactly in
polynomial time
Factored Bandits
We introduce the factored bandits model, which is a framework for learning
with limited (bandit) feedback, where actions can be decomposed into a
Cartesian product of atomic actions. Factored bandits incorporate rank-1
bandits as a special case, but significantly relax the assumptions on the form
of the reward function. We provide an anytime algorithm for stochastic factored
bandits and up to constants matching upper and lower regret bounds for the
problem. Furthermore, we show that with a slight modification the proposed
algorithm can be applied to utility based dueling bandits. We obtain an
improvement in the additive terms of the regret bound compared to state of the
art algorithms (the additive terms are dominating up to time horizons which are
exponential in the number of arms)
- …