20,529 research outputs found
Rational bidding using reinforcement learning: an application in automated resource allocation
The application of autonomous agents by the provisioning and usage of computational resources is an attractive research field. Various methods and technologies in the area of artificial intelligence, statistics and economics are playing together to achieve i) autonomic resource provisioning and usage of computational resources, to invent ii) competitive bidding strategies for widely used market mechanisms and to iii) incentivize consumers and providers to use such market-based systems.
The contributions of the paper are threefold. First, we present a framework for supporting consumers and providers in technical and economic preference elicitation and the generation of bids. Secondly, we introduce a consumer-side reinforcement learning bidding strategy which enables rational behavior by the generation and selection of bids. Thirdly, we evaluate and compare this bidding strategy against a truth-telling bidding strategy for two kinds of market mechanisms â one centralized and one decentralized
Q-Strategy: A Bidding Strategy for Market-Based Allocation of Grid Services
The application of autonomous agents by the provisioning and usage of computational services is an attractive research field. Various methods and technologies in the area of artificial intelligence, statistics and economics are playing together to achieve i) autonomic service provisioning and usage of Grid services, to invent ii) competitive bidding strategies for widely used market mechanisms and to iii) incentivize consumers and providers to use such market-based systems.
The contributions of the paper are threefold. First, we present a bidding agent framework for implementing artificial bidding agents, supporting consumers and providers in technical and economic preference elicitation as well as automated bid generation by the requesting and provisioning of Grid services. Secondly, we introduce a novel consumer-side bidding strategy, which enables a goal-oriented and strategic behavior by the generation and submission of consumer service requests and selection of provider offers. Thirdly, we evaluate and compare the Q-strategy, implemented within the presented framework, against the Truth-Telling bidding strategy in three mechanisms â a centralized CDA, a decentralized on-line machine scheduling and a FIFO-scheduling mechanisms
Hybridizing data stream mining and technical indicators in automated trading systems
Automated trading systems for financial markets can use data mining techniques for future price movement prediction. However, classifier accuracy is only one important component in such a system: the other is a decision procedure utilizing the prediction in order to be long, short or out of the market. In this paper, we investigate the use of technical indicators as a means of deciding when to trade in the direction of a classifierâs prediction. We compare this âhybridâ technical/data stream mining-based system with a naive system that always trades in the direction of predicted price movement. We are able to show via evaluations across five financial market datasets that our novel hybrid technique frequently outperforms the naive system. To strengthen our conclusions, we also include in our evaluation several âsimpleâ trading strategies without any data mining component that provide a much stronger baseline for comparison than traditional buy-and-hold or sell-and-hold strategies
Deep Learning can Replicate Adaptive Traders in a Limit-Order-Book Financial Market
We report successful results from using deep learning neural networks (DLNNs)
to learn, purely by observation, the behavior of profitable traders in an
electronic market closely modelled on the limit-order-book (LOB) market
mechanisms that are commonly found in the real-world global financial markets
for equities (stocks & shares), currencies, bonds, commodities, and
derivatives. Successful real human traders, and advanced automated algorithmic
trading systems, learn from experience and adapt over time as market conditions
change; our DLNN learns to copy this adaptive trading behavior. A novel aspect
of our work is that we do not involve the conventional approach of attempting
to predict time-series of prices of tradeable securities. Instead, we collect
large volumes of training data by observing only the quotes issued by a
successful sales-trader in the market, details of the orders that trader is
executing, and the data available on the LOB (as would usually be provided by a
centralized exchange) over the period that the trader is active. In this paper
we demonstrate that suitably configured DLNNs can learn to replicate the
trading behavior of a successful adaptive automated trader, an algorithmic
system previously demonstrated to outperform human traders. We also demonstrate
that DLNNs can learn to perform better (i.e., more profitably) than the trader
that provided the training data. We believe that this is the first ever
demonstration that DLNNs can successfully replicate a human-like, or
super-human, adaptive trader operating in a realistic emulation of a real-world
financial market. Our results can be considered as proof-of-concept that a DLNN
could, in principle, observe the actions of a human trader in a real financial
market and over time learn to trade equally as well as that human trader, and
possibly better.Comment: 8 pages, 4 figures. To be presented at IEEE Symposium on
Computational Intelligence in Financial Engineering (CIFEr), Bengaluru; Nov
18-21, 201
Evolutionary Optimization of ZIP60: A Controlled Explosion in Hyperspace
The âZIPâ adaptive trading algorithm has been demonstrated to out-perform human traders in experimental studies of continuous double auction (CDA) markets. The original ZIP algorithm requires the values of eight control parameters to be set correctly. A new extension of the ZIP algorithm, called ZIP60, requires the values of 60 parameters to be set correctly. ZIP60 is shown here to produce significantly better results than the original ZIP (called âZIP8â hereafter), for negligable additional computational costs. A genetic algorithm (GA) is used to search the 60-dimensional ZIP60 parameter space, and it finds parameter vectors that yield ZIP60 traders with mean scores significantly better than those of ZIP8s. This paper shows that the optimizing evolutionary search works best when the GA itself controls the dimensionality of the search-space, so that the search commences in an 8-d space and thereafter the dimensionality of the search-space is gradually increased by the GA until it is exploring a 60-d space. Furthermore, the results from ZIP60 cast some doubt on prior ZIP8 results concerning the evolution of new âhybridâ auction mechanisms that appeared to be better than the CDA
A Grey-Box Approach to Automated Mechanism Design
Auctions play an important role in electronic commerce, and have been used to
solve problems in distributed computing. Automated approaches to designing
effective auction mechanisms are helpful in reducing the burden of traditional
game theoretic, analytic approaches and in searching through the large space of
possible auction mechanisms. This paper presents an approach to automated
mechanism design (AMD) in the domain of double auctions. We describe a novel
parametrized space of double auctions, and then introduce an evolutionary
search method that searches this space of parameters. The approach evaluates
auction mechanisms using the framework of the TAC Market Design Game and
relates the performance of the markets in that game to their constituent parts
using reinforcement learning. Experiments show that the strongest mechanisms we
found using this approach not only win the Market Design Game against known,
strong opponents, but also exhibit desirable economic properties when they run
in isolation.Comment: 18 pages, 2 figures, 2 tables, and 1 algorithm. Extended abstract to
appear in the proceedings of AAMAS'201
Evolution of a supply chain management game for the trading agent competition
TAC SCM is a supply chain management game for the Trading Agent Competition (TAC). The purpose of TAC is to spur high quality research into realistic trading agent problems. We discuss TAC and TAC SCM: game and competition design, scientific impact, and lessons learnt
- âŠ