5,658 research outputs found
Learning optimization models in the presence of unknown relations
In a sequential auction with multiple bidding agents, it is highly
challenging to determine the ordering of the items to sell in order to maximize
the revenue due to the fact that the autonomy and private information of the
agents heavily influence the outcome of the auction.
The main contribution of this paper is two-fold. First, we demonstrate how to
apply machine learning techniques to solve the optimal ordering problem in
sequential auctions. We learn regression models from historical auctions, which
are subsequently used to predict the expected value of orderings for new
auctions. Given the learned models, we propose two types of optimization
methods: a black-box best-first search approach, and a novel white-box approach
that maps learned models to integer linear programs (ILP) which can then be
solved by any ILP-solver. Although the studied auction design problem is hard,
our proposed optimization methods obtain good orderings with high revenues.
Our second main contribution is the insight that the internal structure of
regression models can be efficiently evaluated inside an ILP solver for
optimization purposes. To this end, we provide efficient encodings of
regression trees and linear regression models as ILP constraints. This new way
of using learned models for optimization is promising. As the experimental
results show, it significantly outperforms the black-box best-first search in
nearly all settings.Comment: 37 pages. Working pape
Composable and Efficient Mechanisms
We initiate the study of efficient mechanism design with guaranteed good
properties even when players participate in multiple different mechanisms
simultaneously or sequentially. We define the class of smooth mechanisms,
related to smooth games defined by Roughgarden, that can be thought of as
mechanisms that generate approximately market clearing prices. We show that
smooth mechanisms result in high quality outcome in equilibrium both in the
full information setting and in the Bayesian setting with uncertainty about
participants, as well as in learning outcomes. Our main result is to show that
such mechanisms compose well: smoothness locally at each mechanism implies
efficiency globally.
For mechanisms where good performance requires that bidders do not bid above
their value, we identify the notion of a weakly smooth mechanism. Weakly smooth
mechanisms, such as the Vickrey auction, are approximately efficient under the
no-overbidding assumption. Similar to smooth mechanisms, weakly smooth
mechanisms behave well in composition, and have high quality outcome in
equilibrium (assuming no overbidding) both in the full information setting and
in the Bayesian setting, as well as in learning outcomes.
In most of the paper we assume participants have quasi-linear valuations. We
also extend some of our results to settings where participants have budget
constraints
Classification with Costly Features using Deep Reinforcement Learning
We study a classification problem where each feature can be acquired for a
cost and the goal is to optimize a trade-off between the expected
classification error and the feature cost. We revisit a former approach that
has framed the problem as a sequential decision-making problem and solved it by
Q-learning with a linear approximation, where individual actions are either
requests for feature values or terminate the episode by providing a
classification decision. On a set of eight problems, we demonstrate that by
replacing the linear approximation with neural networks the approach becomes
comparable to the state-of-the-art algorithms developed specifically for this
problem. The approach is flexible, as it can be improved with any new
reinforcement learning enhancement, it allows inclusion of pre-trained
high-performance classifier, and unlike prior art, its performance is robust
across all evaluated datasets.Comment: AAAI 201
- …