Statistical Arbitrage Mining for Display Advertising

We study and formulate arbitrage in display advertising. Real-Time Bidding (RTB) mimics stock spot exchanges and utilises computers to algorithmically buy display ads per impression via a real-time auction. Despite the new automation, the ad markets are still informationally inefficient due to the heavily fragmented marketplaces. Two display impressions with similar or identical effectiveness (e.g., measured by conversion or click-through rates for a targeted audience) may sell for quite different prices at different market segments or pricing schemes. In this paper, we propose a novel data mining paradigm called Statistical Arbitrage Mining (SAM) focusing on mining and exploiting price discrepancies between two pricing schemes. In essence, our SAMer is a meta-bidder that hedges advertisers' risk between CPA (cost per action)-based campaigns and CPM (cost per mille impressions)-based ad inventories; it statistically assesses the potential profit and cost for an incoming CPM bid request against a portfolio of CPA campaigns based on the estimated conversion rate, bid landscape and other statistics learned from historical data. In SAM, (i) functional optimisation is utilised to seek for optimal bidding to maximise the expected arbitrage net profit, and (ii) a portfolio-based risk management solution is leveraged to reallocate bid volume and budget across the set of campaigns to make a risk and return trade-off. We propose to jointly optimise both components in an EM fashion with high efficiency to help the meta-bidder successfully catch the transient statistical arbitrage opportunities in RTB. Both the offline experiments on a real-world large-scale dataset and online A/B tests on a commercial platform demonstrate the effectiveness of our proposed solution in exploiting arbitrage in various model settings and market environments.Comment: In the proceedings of the 21st ACM SIGKDD international conference on Knowledge discovery and data mining (KDD 2015

The relevance of index funds for pension investment in equities

The rise of index funds over the past 25 years has been a remarkable phenomenon. The traditional rationale for the success of index funds is market efficiency, net of transaction costs. The authors also focus on the role of agency conflicts between fund managers and investors, which are hard to resolve, given the low power of statistical tests of performance. Most of the empirical evidence about the superiority of index funds comes from the United States. The authors discuss issues associated with the application of index funds in developing countries, as well as policy issues in the financial sector that affect the enabling market infrastructure for index funds. They also apply these ideas to thinking about the relevance of index funds for pension investment. The equity premium provides powerful motivation for equity investment by pension funds. Index funds make it possible to sidestep the complexities of forming contracts and monitoring institutions to govern fund managers. In developing countries that seek to use index funds in pension investment, there are avenues through which policymakers can make index funds more viable. In many countries there are significant avenues for improving construction of the market index as well as market mechanisms used in the equity market.Agricultural Knowledge&Information Systems,Payment Systems&Infrastructure,Economic Theory&Research,Markets and Market Access,Access to Markets

Technical analysis in the foreign exchange market

This article introduces the subject of technical analysis in the foreign exchange market, with emphasis on its importance for questions of market efficiency. Technicians view their craft, the study of price patterns, as exploiting traders’ psychological regularities. The literature on technical analysis has established that simple technical trading rules on dollar exchange rates provided 15 years of positive, risk-adjusted returns during the 1970s and 80s before those returns were extinguished. More recently, more complex and less studied rules have produced more modest returns for a similar length of time. Conventional explanations that rely on risk adjustment and/or central bank intervention are not plausible justifications for the observed excess returns from following simple technical trading rules. Psychological biases, however, could contribute to the profitability of these rules. We view the observed pattern of excess returns to technical trading rules as being consistent with an adaptive markets view of the world.Foreign exchange rates

The virtues and vices of equilibrium and the future of financial economics

The use of equilibrium models in economics springs from the desire for parsimonious models of economic phenomena that take human reasoning into account. This approach has been the cornerstone of modern economic theory. We explain why this is so, extolling the virtues of equilibrium theory; then we present a critique and describe why this approach is inherently limited, and why economics needs to move in new directions if it is to continue to make progress. We stress that this shouldn't be a question of dogma, but should be resolved empirically. There are situations where equilibrium models provide useful predictions and there are situations where they can never provide useful predictions. There are also many situations where the jury is still out, i.e., where so far they fail to provide a good description of the world, but where proper extensions might change this. Our goal is to convince the skeptics that equilibrium models can be useful, but also to make traditional economists more aware of the limitations of equilibrium models. We sketch some alternative approaches and discuss why they should play an important role in future research in economics.Comment: 68 pages, one figur