Prediction market
Also known as information markets, decision markets, idea futures, and virtual markets, prediction markets are speculative (i.e., betting) markets created for the purpose of making predictions. Assets are created whose final cash value is tied to a particular event (e.g., will the next US president be a Republican) or parameter (e.g., total sales next quarter). The current market prices can then be interpreted as predictions of the probability of the event or the expected value of the parameter.
People who buy low and sell high are rewarded for improving the market prediction, while those who buy high and sell low are punished for degrading the market prediction. Evidence so far suggests that prediction markets are at least as accurate as other institutions predicting the same events with a similar pool of participants.
Public examples include the Iowa Electronic Markets, NewsFutures, and the Hollywood Stock Exchange. One of the oldest and most famous is the University of Iowa's Iowa Electronic Market. It has been predicting the results of American presidential elections since 1988 with greater accuracy than polling companies. The Hollywood Stock Exchange, a virtual market game in which players buy and sell prediction shares of movies, actors, directors, and film-related options, correctly predicted 35 of 2002's 40 big-category Oscar nominees.
These markets actually have a long and colorful lineage. Betting on elections was common in the U.S. until at least the 1940s, with formal markets existing on Wall Street in the months leading up to the race. Newspapers reported market conditions to give a sense of the closeness of the contest in this period prior to scientific polling. The markets involved thousands of participants, had millions of dollars in volume in current terms, and had remarkable predictive accuracy. See Paul Rhode and Koleman Strumpf (2004) [1] for additional details.
In July 2003, the U.S. Department of Defense publicized a Policy Analysis Market and on their website speculated that additional topics for markets might include terrorist attacks. A critical backlash quickly denounced the program as a "terrorism futures market" and the Pentagon hastily cancelled the program.
Prediction markets were championed in James Surowiecki's 2004 book The Wisdom of Crowds.
Prediction markets are speculated to be useful decision support tools for corporations.
Commercial interest
- Hewlett-Packard pioneered applications in sales forecasting and now uses prediction markets in several business units. Mentioned in academic publications from HP Labs. Also mentioned in Newsweek [2] (October 2004)
- Several companies, Common Knowledge Markets, Predicom, NewsFutures, Inc, and Net Exchange, are known to specialize in providing application development services to corporations.
- Corning, Eli Lilly, Abbott Labs, Siemens, Masterfoods, Arcelor and other global companies are listed [3] as NewsFutures customers.
- Intel mentioned in Harvard Business Review (April 2003) in relation to managing manufacturing capacity.
- Microsoft is piloting prediction markets in 2004.
- (Rumor) Ford is interested in piloting in 2005.
- France Telecom's Project Destiny has been in use since mid-2004, with very successful predictive behaviour.
- Google has confirmed that it uses a predictive market internally in its official blog.
Theoretical challenges
Some academic research has focused on potential flaws with the prediction market concept. In particular, Dr. Charles F. Manksi of the Northwestern University Department of Economics published a paper in 2004, “Interpreting the Predictions of Prediction Markets”, [4] in which he attempts to show mathematically that under a wide range of assumptions the "predictions" of such markets do not closely correspond to the actual probability beliefs of the market participants unless the market probability is near either 0 or 1. Manski suggests that directly asking a group of participants to estimate probabilities may lead to better results. However, Steven Gjerstad (Purdue) in his paper "Risk Aversion, Beliefs, and Prediction Market Equilibrium" [5] has shown that prediction market prices are typically very close to the mean belief of market participants if the distribution of beliefs is smooth (as with a normal distribution, for example). Justin Wolfers (Wharton) and Eric Zitzewitz (Stanford) have obtained similar results, and also include some analysis of prediction market data, in their paper "Interpreting Prediction Market Prices as Probabilities" [6]. In practice, the prices of binary prediction markets have proven to be closely related to actual frequencies of event in the real world. Relevant data has been published in Pennock et al's "The real power of artificial markets" [7] (Science, 2001) and Servan-Schreiber et al's "Prediction Markets: Does Money Matter?" [8] (Electronic Markets, 2004).
Prediction markets also suffer from the same types of inaccuracy as other kinds of market, i.e. liquidity or other factors not intended to be measured are taken into account as risk factors by the market participants, distorting the market probabilities. There can also be direct attempts to manipulate such markets. In the Tradesports 2004 presidential markets there were clear manipulation efforts (an anonymous trader sold short so many Bush2004 presidential futures contracts that the price was driven to zero, indicating a zero percent chance that Bush would win. The only rational purpose of such a trade would be an attempt to manipulate the market in a strategy called a "bear raid".) As more press attention is paid to prediction markets, it is likely that more groups will be motivated to manipulate them. However, in practice, such attempts at manipulation have always proven to be very short lived. In their forthcoming paper entitled "Information Aggregation and Manipulation in an Experimental Market" (2005) [9], Hanson, Oprea and Porter (George Mason U), show how attempts at market manipulation in fact end up increasing the accuracy of the market because they provide that much more profit incentive to bet against the manipulator.
Prediction markets may also be subject to speculative bubbles. For example in the year 2000 IEM presidential futures markets a flood of new traders in the final week of the election caused the market to gyrate wildly, making its "predictions" useless.
A common belief among economists and the financial community in general is that prediction markets based on play money cannot possibly generate credible predictions. However, the data collected so far disagrees. Pennock et al (Science, 2001) analyzed data from the Hollywood Stock Exchange and the Foresight Exchange and concluded that market prices predicted actual outcomes and/or outcome frequencies in the real world. Servan-Schreiber et al (Electronic Markets, 2004) compared an entire season's worth of NFL predictions from NewsFutures' play-money exchange to those of Tradesports, an equivalent real-money exchange based in Ireland. Both exchanges performed equally well. In this case, using real money did not lead to better predictions.
Some experimental systems are underway to provide data on alternatives to prediction markets that seek to avoid some of the theoretical pitfalls mentioned earlier. For example, polling firm TIPP Online [10] has experimented with "national zeitgeist" questions which ask participants who they think will win rather than who they will vote for personally. This proved to be a more stable and accurate predictor in the 2004 US presidential race than traditional polls. Another experimental system is Owise [11] which directly asks participants to estimate probabilities on a wide range of future events, and rewards accurate performance with status, titles, and small cash prizes. Owise functions as a hive mind or a kind of neural network in which each "neuron" is a human being whose predictions are assigned a weight based on past performance. In fact, this is not so different from what naturally happens in a prediction market where those who make good predictions do profit at the expense of those who make bad predictions, thus progressively increasing their relative influence on the market through how much money they can bring to bear to back up their predictions. There is currently not enough data and history to check how these alternatives will compare to prediction markets in terms of forecasting ability.
External links
Real-money prediction exchanges (a.k.a. "event-driven futures exchanges" in the U.S., "betting exchanges" in the U.K.):
- Iowa Electronic Markets - U.S.A. (no-action letter from CFTC)
- UBC Election Stock Market - Canada
- TradeSports - Ireland, E.U.
- Intrade - Ireland, E.U.
- HedgeStreet - U.S.A. (regulated by CFTC)
- BetFair - U.K., E.U.
- SpreadFair - U.K., E.U. (regulated by UK's Financial Services Authority)
- Betdaq - Ireland, E.U.
Play-money prediction exchanges:
- Foresight Exchange (business, economics, science, society and technology)
- NewsFutures (current events, finance, sports, entertainement)
- Public Gyan (multi-topics)
- Yahoo! Tech Buzz Game (high-tech products, concepts, and trends)
- Hollywood Stock Exchange (movie business)
- Smarkets (Amazon.com products)
Long-term betting:
- The Long Bets Foundation (a long-term bet repository and settler where the winnings go to charity)
Beginner's guides:
- A simple example - by NewsFutures
- How it works - by HedgeStreet
- BetFair Demo - by BetFair
- IEM ~ Trader's Manual - by Iowa Electronic Markets
- Definition of "prediction markets" and of "decision markets" + FAQs with answers - by Chris. F. Masse
- Background reading on prediction markets - by CommerceNet
Directories:
- Policy Futures - by AEI-Brookings (a bipartisan think tank located in Washington, D.C., U.S.A.)
- The vertical portal to prediction markets - The world's most comprehensive directory - by Chris. F. Masse
- del.icio.us / tag / predictionmarkets - by the Internauts
- Press coverage focusing on corporate applications of prediction markets - by NewsFutures
- Most practically useful academic research - by NewsFutures
- Prediction markets links - by CommerceNet
News articles and opinion pieces:
- Wisdom of the crowd - Nature - 2005-11-17
- Market Magic - CFO Magazine - 2005-11-01
- Place your bets! - TIME Magazine - 2005-10-16
- Putting crowd wisdom to work - Official Google Blog - (Internal play-money prediction markets at Google) - 2005-09-21
- How the BBC, Fortune and the New York Times went overboard claiming that the prediction markets had foreseen the name of the new pope! — by Chris. F. Masse - 2005-09-20
- Predicting Closely Held Multi-Horse Events - by Art Hutchinson - 2005-07-25
- How the 2004 U.S. political prediction markets outsmarted a Wall Street pundit, an esteemed economics professor and the commentariat as a whole! - by Chris. F. Masse - 2005-06-18
- Prediction markets facilitate better decision and policy making. - 2005-06-06
- Economist bets on bright future of information markets. - 2005-04-13
- The 2005 DIMACS Workshop on Markets as Predictive Devices (a.k.a. Information Markets) - 2005-02-07
- Chris. F. Masse 2004 Year-End Awards - (Honorary awards to best and worst in prediction markets) - 2004-12-31
- Listen to the People Who Got the Election Right. - Prediction markets are brutally honest and uncannily accurate. - 2004-11-28
- Bettors for Bush - Political futures markets claim they're more accurate than opinion polls. So, how'd they do (on Nov. 2, 2004)? - 2004-11-03
- Opinion market - 2004-11-00
- You Can Bet on Idea Markets, by Ajit Kambil - 2003-12-01
- Economists explore betting markets as prediction tools - 2003-10-18
Academic research papers:
- The Informed Press Favored the Policy Analysis Market - by Robin Hanson - PDF file - 2005-05-05
- Market Efficiency in Person to Person Betting Markets - by David Paton, Michael Smith and Leighton Vaughan Williams - 2005-03-00
- Wolfers & Zitzewitz's response to Manski: "Interpreting Prediction Market Prices as Probabilities" - PDF file - 2005-02-01
- Five Open Questions About Prediction Markets - by Justin Wolfers and Eric Zitzewitz - PDF file - 2005-01-21
- The Iowa Electronic Market: Lessons Learned and Answers Yearned - by Joyce E. Berg and Thomas A. Rietz - PDF file - 2005-01-00
- Analysis of 2004 Political Futures Markets - by Ken Allen, Kevin Daniels, Darby Kopp and Brian Murdock - Dartmouth U. - MS Word .DOC file - 2004-11-09
- Prediction Markets: Does Money Matter? - by Emile Servan-Schreiber, Justin Wolfers, David Pennock & Brian Galebach - PDF file - Fall 2004.
- Prediction Markets - by Justin Wolfers and Eric Zitzewitz - PDF file - 2004-05-00
- Charles F. Manski Paper, "Interpreting the Predictions of Prediction Markets" - PDF file - 2004-02-00
- Historical Prediction Markets: Wagering on Presidential Elections - by Paul W. Rhode and Koleman S. Strumpf - PDF file - 2003-11-10
Software for prediction markets:
- NewsFutures' Prediction Trader - proprietary software
- Zocalo by Commerce.Net - open-source software
- Zocalo @ SourceForge.Net - open-source software
- Idea Futures by Foresight Technologies - open-source software
- Idea Futures @ SourceForge.Net - open-source software
- FreeMarket - open-source software
Consultancy firms:
- NewsFutures - U.S.A.
- Common Knowledge Markets - U.S.A.
- MarTek Systems - U.S.A.
- IntelliMarket Systems - U.S.A.
- IBM - Inside-Out Markets - U.S.A.
- HSX Research - U.S.A.
- Predicom - Sweden, E.U.
Labs:
- Iowa Electronic Markets - U.S.A.
- GMU's Interdisciplinary Center for Economic Science - U.S.A.
- Nottingham Trent University's Business School's Betting Research Unit - U.K., E.U.
- HP Labs - Information Dynamics Lab - U.S.A.
- Yahoo! Research Labs @ Pasadena, California - U.S.A.
Blogs:
See also
- Election Stock Market
- American Action Market
- Policy Analysis Market
- Assassination market
- Foresight Exchange
- Futarchy - a form of government which would use prediction markets to evaluate public policy