Prediction market

Prediction markets (also known as predictive markets, information markets, decision markets, idea futures, event derivatives, or virtual markets) are speculative markets created for the purpose of making predictions. The current market prices can then be interpreted as predictions of the probability of the event or the expected value of the parameter.

People who buy low and sell high are rewarded for improving the market prediction, while those who buy high and sell low are punished for degrading the market prediction. Evidence so far suggests that prediction markets are at least as accurate as other institutions predicting the same events with a similar pool of participants.

History

One of the oldest and most famous is the University of Iowa's Iowa Electronic Market. The Hollywood Stock Exchange, a virtual market game established in 1996 and now a division of Cantor Fitzgerald, LP, in which players buy and sell prediction shares of movies, actors, directors, and film-related options, correctly predicted 32 of 2006's 39 big-category Oscar nominees and 7 out of 8 top category winners. HedgeStreet, designated in 1991 as a market and regulated by the Commodity Futures Trading Commission, enables Internet traders to speculate on economic events.

Prediction markets have a long and colorful lineage. Betting on elections was common in the U.S. until at least the 1940s, with formal markets existing on Wall Street in the months leading up to the race. Newspapers reported market conditions to give a sense of the closeness of the contest in this period prior to widespread polling. The markets involved thousands of participants, had millions of dollars in volume in current terms, and had remarkable predictive accuracy.^[1]

Around 1990 at Project Xanadu, Robin Hanson used the first known corporate prediction market. Employees used it in order to bet on, for example, the cold fusion controversy.

In July 2003, the U.S. Department of Defense publicized a Policy Analysis Market and on their website speculated that additional topics for markets might include terrorist attacks. A critical backlash quickly denounced the program as a "terrorism futures market" and the Pentagon hastily canceled the program.

Prediction markets are championed in James Surowiecki's 2004 book The Wisdom of Crowds, Cass Sunstein's 2006 Infotopia, and How to Measure Anything: Finding the Value of Intangibles in Business by Douglas Hubbard.^[2]

The research literature is collected together in the peer reviewed The Journal of Prediction Markets, edited by Leighton Vaughan Williams and published by the University of Buckingham Press. The journal was first published in 2007, and is available online and in print.^[3]

In John Brunner's 1975 science fiction story The Shockwave Rider there is a description of a prediction market that he called the Delphi Pool.

In October 2007 companies from the United States, Ireland, Austria, Germany, and Denmark formed the Prediction Market Industry Association,^[4] tasked with promoting awareness, education, and validation for prediction markets.

Accuracy

Some academic research has focused on potential flaws with the prediction market concept. In particular, Dr. Charles F. Manski of Northwestern University published “Interpreting the Predictions of Prediction Markets”,^[5] which attempts to show mathematically that under a wide range of assumptions the "predictions" of such markets do not closely correspond to the actual probability beliefs of the market participants unless the market probability is near either 0 or 1. Manski suggests that directly asking a group of participants to estimate probabilities may lead to better results.

However, Steven Gjerstad (Purdue) in his paper "Risk Aversion, Beliefs, and Prediction Market Equilibrium," ^[6] has shown that prediction market prices are very close to the mean belief of market participants if the agents are risk averse and the distribution of beliefs is spread out (as with a normal distribution, for example). Justin Wolfers (Wharton) and Eric Zitzewitz (Dartmouth) have obtained similar results, and also include some analysis of prediction market data, in their paper "Interpreting Prediction Market Prices as Probabilities."^[7] In practice, the prices of binary prediction markets have proven to be closely related to actual frequencies of events in the real world.^[8][9]

Douglas Hubbard has also conducted a sample of over 400 retired claims which showed that the probability of an event is close to its market price but, more importantly, significantly closer than the average single subjective estimate.^[10] However, he also shows that this benefit is partly offset if individuals first undergo calibrated probability assessment training so that they are good at assessing odds subjectively. The key benefit of the market, Hubbard claims, is that it mostly adjusts for uncalibrated estimates and, at the same time, incentivizes market participants to seek further information.

A common belief among economists and the financial community in general is that prediction markets based on play money cannot possibly generate credible predictions. However, the data collected so far disagrees.^[8] Analyzed data from the Hollywood Stock Exchange and the Foresight Exchange concluded that market prices predicted actual outcomes and/or outcome frequencies in the real world. Comparing an entire season's worth of NFL predictions from NewsFutures' play-money exchange to those of Tradesports, an equivalent real-money exchange based in Ireland, both exchanges performed equally well. In this case, using real money did not lead to better predictions.^[9]

Hollywood Stock Exchange creator Max Keiser suggests that not only are these markets no more predictive than their established counterparts such as the New York Stock Exchange and the London Stock Exchange, but that reducing the unpredictability of markets would mean reducing risk and, therefore, reducing the amount of speculative capital needed to keep markets open and liquid.

Sources of inaccuracy

Prediction markets suffer from the same types of inaccuracy as other kinds of market, i.e. liquidity or other factors not intended to be measured are taken into account as risk factors by the market participants, distorting the market probabilities. Prediction markets may also be subject to speculative bubbles. For example, in the year 2000 IEM presidential futures markets, a flood of new traders in the final week of the election caused the market to gyrate wildly, making its "predictions" useless.^{[citation needed]}

There can also be direct attempts to manipulate such markets. In the Tradesports 2004 presidential markets there was an apparent manipulation effort. An anonymous trader sold short so many Bush 2004 presidential futures contracts that the price was driven to zero, implying a zero percent chance that Bush would win. The only rational purpose of such a trade would be an attempt to manipulate the market in a strategy called a "bear raid". If this was a deliberate manipulation effort it failed, however, as the price of the contract rebounded rapidly to its previous level. As more press attention is paid to prediction markets, it is likely that more groups will be motivated to manipulate them. However, in practice, such attempts at manipulation have always proven to be very short lived. In their paper entitled "Information Aggregation and Manipulation in an Experimental Market" (2005),^[11] Hanson, Oprea and Porter (George Mason U), show how attempts at market manipulation can in fact end up increasing the accuracy of the market because they provide that much more profit incentive to bet against the manipulator.

Using real-money prediction market contracts as a form of insurance can also affect the price of the contract. For example, if the election of a leader is perceived as negatively impacting the economy, traders may buy shares of that leader being elected, as a form of insurance.^[12]

Other issues

Legality

Because online gambling is outlawed in the United States through federal laws and many state laws as well, most prediction markets that target U.S. users operate with "play money" rather than "real money": they are free to play (no purchase necessary) and usually offer prizes to the best traders as incentives to participate. Notable exceptions are Intrade/TradeSports, which escapes U.S. legal restrictions by operating from Dublin, Ireland, where gambling is legal and regulated^{[citation needed]}, and the Iowa Electronic Markets, which operates from the University of Iowa under the cover of a no-action letter from the Commodity Futures Trading Commission and allows bets up to $500.

Controversial incentives

Some kinds of prediction markets may create controversial incentives. For example, a market predicting the death of a world leader might be quite useful for those whose activities are strongly related to this leader's policies, but it also might turn into an assassination market.

Public prediction markets

There are a number of commercial prediction markets, one of the largest is Betfair which had a valuation in the region of £1.5 billion GBP in 2010.^[13] Others include, Intrade a for-profit company with a large variety of contracts not including sports. The Iowa Electronic Markets an academic market examining elections where positions are limited to $500, iPredict and TradeSports a prediction markets for sporting events.

In addition there are a number of virtual prediction markets where purchases are made with virtual money, these include The simExchange, Hollywood Stock Exchange, NewsFutures, the Popular Science Predictions Exchange, Hubdub, Knew The News, Tahministan, The Industry Standard's technology industry prediction market, and the Foresight Exchange Prediction Market. Bet2Give is a charity prediction market where real money is traded but ultimately all winnings are donated to the charity of the winner's choice.

Use by corporations

• The simExchange introduced a perpetual contract that it calls "stocks" to predict the global, lifetime sales of video game consoles and software titles. These stocks do not expire like most contracts on prediction markets because the founder, Brian Shiau, argued that video game sales can continue for years.^[14] The premise for these stocks is that Shiau believes the video game industry suffers from a "lack of comprehensive sales data" and he compares the information problem of a game's sales to the information problem of evaluating a company's market value. Hanson warns that such a system may not work if a connection is not enforced.^[15] Keith Gamble has described the simExchange as a Keynesian beauty contest^[16] and that financial markets have certain remedies such as company buy-outs that cannot happen on the simExchange. Gamble concludes that such a prediction market can work but will be confined to play money.^[17]
• Best Buy, Motorola, Qualcomm, Edmunds.com, and Misys Banking Systems are listed as Consensus Point clients.^[18]
• Hewlett-Packard pioneered applications in sales forecasting and now uses prediction markets in several business units. Mentioned in academic publications from HP Labs. Also mentioned in Newsweek.^[19] It is working towards a commercial launch of the implementation as a product, BRAIN (Behaviorally Robust Aggregation of Information Networks).^[20]
• Corning, Renault, Eli Lilly, Pfizer, Siemens, Masterfoods, Arcelor Mittal and other global companies are listed as NewsFutures customers.
• Intel is mentioned in Harvard Business Review (April 2004) in relation to managing manufacturing capacity.
• Microsoft is piloting prediction markets internally.
• France Telecom's Project Destiny has been in use since mid-2004 with demonstrated success.^[21]
• Google has confirmed that it uses a predictive market internally in its official blog.^[22][23]
• The Wall Street Journal reported that General Electric uses prediction market software from Consensus Point^[24] to generate new business ideas.^[25]
• BusinessWeek lists MGM and Lionsgate Studios as two HSX clients.^[26]
• HSX built and operated a televised virtual stock market, the Interactive Music Exchange for Fuse Networks Fuse TV to be used as the basis of their daily live television broadcast, IMX, which ran from January, 2003 through July, 2004. The television audience traded virtual stocks of artists/videos/songs, and predicted which would make it to the top of the Billboard music charts. The first of its kind, Fuse Network and HSX won an AFI Enhanced TV (American Film Institute) Award for innoviation in television interactivity.^[27]
• Starwood embraced the use of prediction markets for developing and selecting marketing campaigns. Marketing department started out with some initial ideas and allowed employees to add new ideas or make changes to existing ones. Then subsequently incentives based prediction markets were leveraged to select the best of the lot.

See also

• Election Stock Market
• Futarchy
• Futures exchange
• Policy Analysis Market
• Prediction games

References

1. ^ BettingPaper Historical Prediction Markets: Wagering on Presidential Elections - by Paul W. Rhode and Koleman S. Strumpf - PDF file - 2003-11-10
2. ^ Douglas W. Hubbard, *How to Measure Anything: Finding the Value of Intangibles in Business", John Wiley & Sons, July 2007
3. ^ predictionmarketjournal.com
4. ^ http://www.pmindustry.org
5. ^ “Interpreting the Predictions of Prediction Markets” Northwestern University, Dr. Charles F. Manski (Revised: 2005)
6. ^ "Risk Aversion, Beliefs, and Prediction Market Equilibrium" Steven Gjerstad
7. ^ "Interpreting Prediction Market Prices as Probabilities" Justin Wolfers (Wharton) and Eric Zitzewitz (Stanford)
8. ^ ^{a b} David M. Pennock, Steve Lawrence, C. Lee Giles & Finn Årup Nielsen (February 2001). "The real power of artificial markets" (PDF). Science 291 (5506): 987–988. doi:10.1126/science.291.5506.987. PMID 11232583. http://artificialmarkets.com/am/pennock-2001-science.pdf. 
9. ^ ^{a b} "Prediction Markets: Does Money Matter?" Servan-Schreiber (Electronic Markets, 2004)
10. ^ Douglas Hubbard "How to Measure Anything: Finding the Value of Intangibles in Business" John Wiley & Sons, 2007
11. ^ manipulation2.dvi
12. ^ David Schneider-Joseph - Ideas Futures Exchanges
13. ^ "Betfair IPO values company at up to £1.5 billion". Reuters. 07.10.2010. http://uk.reuters.com/article/idUKTRE6960NL20101007. 
14. ^ the simExchange The structure of simExchange game stocks
15. ^ Robin Hanson on the Sim Exchange Midas Oracle .ORG
16. ^ simExchange a Keynesian Beauty Contest Midas Oracle .ORG
17. ^ Keith Jacks Gamble: simExchange is somewhat OK, but will remained confined in play-money land. Midas Oracle .ORG
18. ^ http://www.consensuspoint.com/customers/
19. ^ http://msnbc.msn.com/id/3087117/ (October 2004)
20. ^ HP Labs : Solutions and Services Research : New Competitive Spaces : BRAIN
21. ^ BIReview Magazine, "An Internal Futures Market" (March 2007)
22. ^ Official Google Blog: Putting crowd wisdom to work
23. ^ Microsoft Word - Information_Processing_Inside_the_Firm__draft_Jan_2
24. ^ http://www.consensuspoint.com/
25. ^ http://online.wsj.com/article/SB115073365085184192.html (June 2006)
26. ^ http://www.businessweek.com/technology/content/aug2006/tc20060804_618481.htm (August, 2006)
27. ^ AFI Enhanced TV Workshop

Academic Papers

• Bell, Tom W. Prediction Markets For Promoting the Progress of Science and the Useful Arts - PDF file - George Mason Law Review (14 Geo. Mason L. Rev 37) (2006)
• Berg, Joyce E., & Thomas A. Rietz. The Iowa Electronic Market: Lessons Learned and Answers Yearned - PDF file - 2005-01-00
• Erikson, Robert S., & Christopher Wlezien. "Are Political Markets Really Superior to Polls as Election Predictors?" Public Opinion Quarterly 72(2), Summer 2008, pp. 190–215.
• Gjerstad, Steven. "Risk Aversion, Beliefs, and Prediction Market Equilibrium," University of Arizona Working Paper 04-17, 2005.
• "Gruca, Thomas S., Berg, Joyce E. & Cipriano, Michael (2005). Consensus and Differences of Opinion in Electronic Prediction Markets." "Electronic Markets", 15 (1), 13-22. DOI: 10.1080/10196780500034939
• Hanson, Robin. The Informed Press Favored the Policy Analysis Market - PDF file - 2005-05-05
• Manski, Charles F. Interpreting the Predictions of Prediction Markets - PDF file - Revised Aug 2005—Manski suggests that there needs to be a better theoretic basis for interpreting market prices as probability, and provides a simple model for this.
• "Rosenbloom, E. S. & Notz, William (2006). Statistical Tests of Real-Money versus Play-Money Prediction Markets." "Electronic Markets", 16 (1), 63-69. DOI: 10.1080/10196780500491303
• "Servan-Schreiber, Emile, Wolfers, Justin, Pennock, David M. & Galebach, Brian (2004). Prediction Markets: Does Money Matter?" "Electronic Markets", 14 (3), 243-251. DOI: 10.1080/1019678042000245254
• Spann, Martin & Skiera, Bernd."Internet-Based Virtual Stock Markets for Business Forecasting" - PDF file - Discusses theory, design options and presents empirical comparisons on forecasting accuracy of prediction markets
• Wolfers, Justin, & Eric Zitzewitz. Prediction Markets - PDF file - 2004-05-00
• Wolfers, Justin, & Eric Zitzewitz.Interpreting Prediction Market Prices as Probabilities - PDF file - Draft version 2007-01-08 - Expands on the work of Manski, providing a more general model wherein it is somewhat rational to interpret market prices as probabilities
• Watkins, Jennifer H.Prediction Markets as an Aggregation Mechanism for Collective Intelligence - Proceedings of 2007 UCLA Lake Arrowhead Human Complex Systems Conference, Lake Arrowhead, CA, 25–29 April 2007.
• Storkey, A.J. Machine Learning Markets - Journal of Machine Learning Research C&WP 15:AISTATS. 2011.

External Resources

• The Journal of Prediction Markets