Rational bidding using reinforcement learning: an application in automated resource allocation

The application of autonomous agents by the provisioning and usage of computational resources is an attractive research field. Various methods and technologies in the area of artificial intelligence, statistics and economics are playing together to achieve i) autonomic resource provisioning and usage of computational resources, to invent ii) competitive bidding strategies for widely used market mechanisms and to iii) incentivize consumers and providers to use such market-based systems. The contributions of the paper are threefold. First, we present a framework for supporting consumers and providers in technical and economic preference elicitation and the generation of bids. Secondly, we introduce a consumer-side reinforcement learning bidding strategy which enables rational behavior by the generation and selection of bids. Thirdly, we evaluate and compare this bidding strategy against a truth-telling bidding strategy for two kinds of market mechanisms – one centralized and one decentralized

Online Auctions

The economic literature on online auctions is rapidly growing because of the enormous amount of freely available field data. Moreover, numerous innovations in auction-design features on platforms such as eBay have created excellent research opportunities. In this article, we survey the theoretical, empirical, and experimental research on bidder strategies (including the timing of bids and winner's-curse effects) and seller strategies (including reserve-price policies and the use of buy-now options) in online auctions, as well as some of the literature dealing with online-auction design (including stopping rules and multi-object pricing rules).

Why Every Economist Should Learn Some Auction Theory

This is an Invited paper for the World Congress of the Econometric Society held in Seattle in August 2000. We discuss the strong connections between auction theory and "standard" economic theory, and argue that auction-theoretic tools and intuitions can provide useful arguments and insights in a broad range of mainstream economic settings that do not, at first sight, look like auctions. We also discuss some more obvious applications, especially to industrial organization.Auctions, Bidding, Auction Theory, Private Values, Common Values, Mechanism Design, Litigation, Stock Markets, Queues, Financial Crashes, Brand Loyalty, War of Attrition, Bertrand, Perfect Competition, E-Commerce, Spectrum Auctions, Treasury Auctions, Electricity

Reducing energy demand: a review of issues, challenges and approaches

Most commentators expect improved energy efficiency and reduced energy demand to provide the dominant contribution to tackling global climate change. But at the global level, the correlation between increased wealth and increased energy consumption is very strong and the impact of policies to reduce energy demand is both limited and contested. Different academic disciplines approach energy demand reduction in different ways: emphasising some mechanisms and neglecting others, being more or less optimistic about the potential for reducing energy demand and providing insights that are more or less useful for policymakers. This article provides an overview of the main issues and challenges associated with energy demand reduction, summarises how this challenge is ‘framed’ by key academic disciplines, indicates how these can provide complementary insights for policymakers and argues that a ‘sociotechnical’ perspective can provide a deeper understanding of the nature of this challenge and the processes through which it can be achieved. The article integrates ideas from the natural sciences, economics, psychology, innovation studies and sociology but does not give equal weight to each. It argues that reducing energy demand will prove more difficult than is commonly assumed and current approaches will be insufficient to deliver the transformation required

Are neighbors welcome ? e-buyer search, price competition and coalition strategy in the Internet retailing

On étudie les forces qui régissent l'agrégation des sites Web marchands (B-to-C) en concurrence sur un marché électronique différencié, où le coût de recherche pour les consommateurs est indépendant du coût d'adaptation/transport supporté lorsque le bien trouvé ne correspond pas à leur préférence. On s'intéresse à la possibilité pour les sites Internet de se coaliser, ce qui se traduit par une réduction du coût de recherche pour trouver d'autres sites à l'intérieur de la coalition. On effectue la statique comparative des structures de coalitions (en fonction du degré de différenciation de ses partenaires) lorsque les sites se font une concurrence en prix. On montre qu'un site préfère se coaliser avec un partenaire fortement différencié et fixe dans ce cas un prix unique plus bas.En vendant au détail;Coûts de recherche;Coalition

Smart Microgrids: Overview and Outlook

The idea of changing our energy system from a hierarchical design into a set of nearly independent microgrids becomes feasible with the availability of small renewable energy generators. The smart microgrid concept comes with several challenges in research and engineering targeting load balancing, pricing, consumer integration and home automation. In this paper we first provide an overview on these challenges and present approaches that target the problems identified. While there exist promising algorithms for the particular field, we see a missing integration which specifically targets smart microgrids. Therefore, we propose an architecture that integrates the presented approaches and defines interfaces between the identified components such as generators, storage, smart and \dq{dumb} devices.Comment: presented at the GI Informatik 2012, Braunschweig Germany, Smart Grid Worksho

Spurious complexity and common standards in markets for consumer goods

It has been argued that cognitively constrained consumers respond sub-optimally to complex decision problems, and that firms can exploit these limitations by introducing spurious complexity into tariff structures, weakening price competition. We model a countervailing force. Restricting one's choices to the most easily comparable options is a psychologically well-attested heuristic. Consumers who use this heuristic favour firms that follow common conventions about tariff structures. Because a 'common standard' promotes price competition, a firm's use of it signals that it offers value for money, validating the heuristic. This allows an equilibrium in which firms use common standards and set competitive prices.common standard, spurious complexity, cognitive limitations

Competition Between Auctions

Even though auctions are capturing an increasing share of commerce, they are typically treated in the theoretical economics literature as isolated. That is, an auction is typically treated as a single seller facing multiple buyers or as a single buyer facing multiple sellers. In this paper, we review the state of the art of competition between auctions. We consider three different types of competition: competition between auctions, competition between formats, and competition between auctioneers vying for auction traffic. We highlight the newest experimental, statistical and analytical methods in the analysis of competition between auctions.auctions, bidding, competition, auction formats, auction houses

Q-Strategy: A Bidding Strategy for Market-Based Allocation of Grid Services

The application of autonomous agents by the provisioning and usage of computational services is an attractive research field. Various methods and technologies in the area of artificial intelligence, statistics and economics are playing together to achieve i) autonomic service provisioning and usage of Grid services, to invent ii) competitive bidding strategies for widely used market mechanisms and to iii) incentivize consumers and providers to use such market-based systems. The contributions of the paper are threefold. First, we present a bidding agent framework for implementing artificial bidding agents, supporting consumers and providers in technical and economic preference elicitation as well as automated bid generation by the requesting and provisioning of Grid services. Secondly, we introduce a novel consumer-side bidding strategy, which enables a goal-oriented and strategic behavior by the generation and submission of consumer service requests and selection of provider offers. Thirdly, we evaluate and compare the Q-strategy, implemented within the presented framework, against the Truth-Telling bidding strategy in three mechanisms – a centralized CDA, a decentralized on-line machine scheduling and a FIFO-scheduling mechanisms

Welfare and Revenue Guarantees for Competitive Bundling Equilibrium

We study equilibria of markets with $m$ heterogeneous indivisible goods and $n$ consumers with combinatorial preferences. It is well known that a competitive equilibrium is not guaranteed to exist when valuations are not gross substitutes. Given the widespread use of bundling in real-life markets, we study its role as a stabilizing and coordinating device by considering the notion of \emph{competitive bundling equilibrium}: a competitive equilibrium over the market induced by partitioning the goods for sale into fixed bundles. Compared to other equilibrium concepts involving bundles, this notion has the advantage of simulatneous succinctness ($O(m)$ prices) and market clearance. Our first set of results concern welfare guarantees. We show that in markets where consumers care only about the number of goods they receive (known as multi-unit or homogeneous markets), even in the presence of complementarities, there always exists a competitive bundling equilibrium that guarantees a logarithmic fraction of the optimal welfare, and this guarantee is tight. We also establish non-trivial welfare guarantees for general markets, two-consumer markets, and markets where the consumer valuations are additive up to a fixed budget (budget-additive). Our second set of results concern revenue guarantees. Motivated by the fact that the revenue extracted in a standard competitive equilibrium may be zero (even with simple unit-demand consumers), we show that for natural subclasses of gross substitutes valuations, there always exists a competitive bundling equilibrium that extracts a logarithmic fraction of the optimal welfare, and this guarantee is tight. The notion of competitive bundling equilibrium can thus be useful even in markets which possess a standard competitive equilibrium