Algorithmic trading

In electronic financial markets, algorithmic trading or automated trading, also known as algo trading, black-box trading, or robo trading, is the use of computer programs for entering trading orders with the computer algorithm deciding on certain aspects of the order such as the timing, price, or even the final quantity of the order. It is widely used by hedge funds, pension funds, mutual funds, and other institutional traders to divide up a large trade into several smaller trades in order to manage market impact, opportunity cost, and risk. [ [http://www.economist.com/finance/displaystory.cfm?story_id=E1_VQSVPRT Moving markets Shifts in trading patterns are making technology ever more important, The Economist, Feb 2, 2006] ] It is also used by hedge funds and similar traders to make the decision to initiate orders based on information that is received electronically, before human traders are even aware of the information.

Algorithmic trading may be used in any investment strategy, including market making, inter-market spreading, arbitrage, or pure speculation (including trend following). The investment decision and implementation may be augmented at any stage with algorithmic support or may operate completely automatically.

A third of all EU and US stock trades in 2006 were driven by automatic programs, or algorithms, according to Boston-based consulting firm Aite Group LLC. By 2010, that figure will reach 50 percent, according to Aite. [ [http://www.iran-daily.com/1386/2836/html/focus.htm The Ultimate Money Machine] , Iran Daily May 7, 2007]

In 2006 at the London Stock Exchange, over 40% of all orders were entered by algo traders, with 60% predicted for 2007. American markets and equity markets generally have a higher proportion of algo trades than other markets, and estimates for 2008 range as high as an 80% proportion in some markets. Foreign exchange markets also have active algo trading (about 25% of orders in 2006). [ [http://www.nytimes.com/2006/08/18/business/worldbusiness/18man.html?ex=1313553600&en=b2fee1b41c85af15&ei=5088&partner=rssnyt&emc=rss A London Hedge Fund That Opts for Engineers, Not M.B.A.’s] by Heather Timmons, August 18, 2006 ] Futures and options markets are considered to be fairly easily integrated into algorithmic trading [ [http://www.economist.com/finance/displaystory.cfm?story_id=E1_JDNPSDQ Looking for options Derivatives drive the battle of the exchanges, April 15, 2007, Economist.com] ] , with about 20% of options volume expected to be computer generated by 2010. [Citation
last=
first=
author-link=
year=
title=Algorithmic trading, Ahead of the tape
periodical=The Economist
volume=383
issue=June 23, 2007
pages=p. 85
url=http://www.economist.com/finance/displaystory.cfm?story_id=9370718
doi=
oclc=.]
Bond markets are moving toward more access to algorithmic traders. [MTS to mull bond access, The Wall Street Journal Europe, April 18, 2007, p. 21]

History

Computerization of the order flow in financial markets began in the early 1970s with some landmarks being the introduction of the New York Stock Exchange’s “designated order turnaround” system (DOT, and later SuperDOT) which routed orders electronically to the proper trading post to be executed manually, and the "opening automated reporting system" (OARS) which aided the specialist in determining the market clearing opening price.

Program trading is defined by the New York Stock Exchange as an order to buy or sell 15 or more stocks valued at over $1 million total. In practice this means that all program trades are entered with the aid of a computer. In the 1980s program trading became widely used in trading between equity and futures markets.

In stock index arbitrage a trader would buy (sell) a stock index futures contract such as the S&P 500 futures and sell (buy) a portfolio of up to 500 stocks at the NYSE matched against the futures trade. The program trade at the NYSE would be pre-programmed into a computer to enter the order automatically into the NYSE’s electronic order routing system at a time when the futures price and the stock index were far enough apart to make a profit.

At about the same time portfolio insurance was designed to create a synthetic put option on a stock portfolio by dynamically trading stock index futures according to a computer model based on the Black-Scholes option pricing model.

Both strategies, often simply lumped together as “program trading,” were blamed by many people (for example by the Brady report) for exacerbating or even starting the 1987 stock market crash.

Financial markets with fully electronic execution and similar electronic communication networks developed in the late 1980s and 1990s. In the U.S., decimalization, which changed the minimum tick size from 1/16th of a dollar ($0.0625) to $0.01 per share, may have encouraged algorithmic trading as it changed the market microstructure by permitting smaller differences between the bid and offer prices, decreasing the market-makers' trading advantage, thus decreasing market liquidity.

This decreased market liquidity led to institutional traders splitting up orders according to computer algorithms in order to execute their orders at a better average price. These average price benchmarks are measured and calculated by computers by applying the time weighted (i.e unweighted) average price TWAP or more usually by the volume weighted average price VWAP.

As more electronic markets opened, other algorithmic trading strategies became possible including arbitrage, statistical arbitrage, trend following, mean reversion. These strategies are more easily implemented by computers because machines can react more rapidly to temporary mispricing and examine prices from several markets simultaneously.

Communication Standards

Algorithmic trades require communicating considerably more parameters than traditional market and limit orders. A trader on one end (the “buy side“) must enable their trading system (often called an “Order Management System” or “Execution Management System”) to understand a constantly proliferating flow of new algorithmic order types. The R&D and other costs to construct complex new algorithmic orders types, along with the execution infrastructure, and marketing costs to distribute them, are fairly substantial. What was needed was a way that marketers (the “sell side”) could express algo orders electronically such that buy-side traders could just drop the new order types into their system and be ready to trade them without constant coding custom new order entry screens each time.

FIX Protocol LTD http://www.fixprotocol.org is a trade association that publishes free, open standards in the securities trading area. Members include virtually all large and many midsize and smaller broker dealers, money center banks, institutional investors, mutual funds, etc. This institution dominates standard setting in the pretrade and trade areas of security transactions. In 2006-2007 several members got together and published a draft XML standard for expressing algorithmic order types. The standard is called FIX Algorithmic Trading Definition Language (FIXatdl). Currently targeting March 2008 for final release, FIXatdl is now in broad beta testing with the following firms participating: Barclays, [http://www.bloombergtradebook.com Bloomberg Tradebook] , [https://www.cheuvreux.com Cheuvreux] , Citigroup, Credit Suisse,
Fidelity Investments, Goldman Sachs, [http://www.itg.com ITG] , JPMorgan Chase, Merrill Lynch, Morgan Stanley, [http://www.neonet.biz NeoNet] , [http://www.weedenco.com Pragma@Weeden] , and UBS AG.

More information on FIXatdl, including example XML files and sample code may be found at: http://www.fixprotocol.org/working_groups/algowg/documents

trategies

Many different algorithms have been developed to implement different trading strategies. These algorithms or techniques are commonly given names such as "iceberging", "Dagger", "Guerrilla", "benchmarking", "Sniper" and "Snif-fer". [ [http://search.ft.com/ftArticle?queryText=%22algorithmic+trading%22&aje=true&id=070319000878 Trading with the help of 'guerrillas' and 'snipers,' Financial Times, March 19, 2007] ]

Transaction cost reduction

Large orders are broken down into several smaller orders and entered into the market over time. This basic strategy is called "iceberging". The success of this strategy may be measured by the average purchase price against the VWAP for the market over that time period. One algorithm designed to find hidden orders or icebergs is called "Guerrilla".

Arbitrage

A classical arbitrage strategy might involve three or four securities such as covered interest rate parity in the foreign exchange market which gives a relation between the prices of a domestic bond, a bond denominated in a foreign currency, the spot price of the currency, and the price of a forward contract on the currency. If the market prices are sufficiently different from those implied in the model to cover transactions cost then four transactions can be made to guarantee a risk-free profit. Algorithmic trading allows similar arbitrages using models of greater complexity involving many more than 4 securities.

Market Making

Market making involves placing a limit order to sell (or offer) above the current market price or a buy limit order (or bid) below the current price in order to benefit from the bid-ask spread. Automated Trading Desk, which was bought by Citigroup in July 2007, has been an active market maker, accounting for about 6% of total volume on both NASDAQ and the New York Stock Exchange. [ [http://www.iht.com/articles/ap/2007/07/02/business/NA-FIN-COM-US-Citigroup-Automated-Trading-Desk.php The Associated Press, July 2, 2007] Citigroup to expand electronic trading capabilities by buying Automated Trading Desk, accessed July 4, 2007]

More Complicated Strategies

A "benchmarking" algorithm is used by traders attempting to mimic an index's return. An algorithm designed to discover which markets are most volatile or unstable is called "Snif-fer".

Any type of algo trading which depends on the programming skills of other algo traders is called gaming. Dark pools are alternative electronic stock exchanges where trading takes place anonymously, with most orders hidden or "iceburged."Rob Curren, [http://online.wsj.com/article/SB121911298392752051.html Watch Out for Sharks in Dark Pools] , The Wall Street Journal, August 19, 2008, p. c5. Available at [http://blogs.wsj.com/marketbeat/2008/08/18/trading-in-a-dark-pool-watch-for-sharks/ WSJ Blogs] retrieved August 19, 2008] Gamers or "sharks" sniff out large orders by "pinging" small market orders to buy and sell. When several small orders are filled the sharks may have discovered the presence of a large iceburged order. They then front run the order.

Any sort of pattern recognition or predictive model can be used to initiate algo trading. Neural networks and genetic programming have been used to create these models.

“Now it’s an arms race,” said Andrew Lo, director of the Massachusetts Institute of Technology’s Laboratory for Financial Engineering. “Everyone is building more sophisticated algorithms, and the more competition exists, the smaller the profits.” [ [http://www.iht.com/articles/2006/11/23/business/trading.php?page=1 Artificial intelligence applied heavily to picking stocks] by Charles Duhigg, November 23, 2006 ]

Issues and Developments

More sophisticated models and intelligent programs have created the question of whether the models will break down.

“The downside with these systems is their black box-ness,” Mr. Williams said. “Traders have intuitive senses of how the world works. But with these systems you pour in a bunch of numbers, and something comes out the other end, and it’s not always intuitive or clear why the black box latched onto certain data or relationships.” [ [http://www.iht.com/articles/2006/11/23/business/trading.php?page=1 Artificial intelligence applied heavily to picking stocks] by Charles Duhigg, November 23, 2006 ]

Regulators in Great Britain are watching the development of algo trading.

“The Financial Services Authority has been keeping a watchful eye on the development of black box trading. In its annual report the regulator remarked on the great benefits of efficiency that new technology is bringing to the market. But it also pointed out that ‘greater reliance on sophisticated technology and modelling brings with it a greater risk that systems failure can result in business interruption’.” [ [http://www.telegraph.co.uk/money/main.jhtml?xml=/money/2006/08/27/ccsoft27.xml Black box traders are on the march] The Telegraph, August 26, 2006]

Other issues include the technical problem of latency or the delay in getting quotes to traders, [ [http://search.ft.com/ftArticle?queryText=%22algorithmic+trading%22&aje=true&id=061002000774 Enter algorithmic trading systems race or lose returns, report warns, Financial Times, October 2, 2006] ] security and front running, and the possibility of a complete system breakdown leading to a market crash. [ [http://www.businessweek.com/magazine/content/05_16/b3929113_mz020.htm Cracking The Street's New Math, Algorithmic trades are sweeping the stock market] .]

The cost of developing and maintaining algorithms is still relatively high, especially for new entrants, as the need for stability, bandwidth and speed is even higher than for regular order execution. Firms which have not developed their own algorithmic trading have had to buy competing firms.

"Goldman spends tens of millions of dollars on this stuff. They have more people working in their technology area than people on the trading desk...The nature of the markets has changed dramatically." [ [http://www.iht.com/articles/ap/2007/07/02/business/NA-FIN-COM-US-Citigroup-Automated-Trading-Desk.php The Associated Press, July 2, 2007] Citigroup to expand electronic trading capabilities by buying Automated Trading Desk, accessed July 4, 2007]

Financial market news is now being formatted by firms such as Reuters, Dow Jones, Bloomberg, and Thomson Financial, to be read and traded on via algorithms.

“Computers are now being used to generate news stories about company earnings results or economic statistics as they are released. And this almost instantaneous information forms a direct feed into other computers which trade on the news.” [http://www.ft.com/cms/s/bb570626-ebb6-11db-b290-000b5df10621.html "If you're reading this, it's too late: a machine got here first," The Financial Times, April 16, 2007, p.1] ]

The algorithms do not simply trade on simple news stories but also interpret more difficult to understand news. Some firms are also attempting to automatically assign "sentiment" (deciding if the news is good or bad) to news stories so that automated trading can work directly on the news story.

“There is a real interest in moving the process of interpreting news from the humans to the machines” says Kiristi Suutani, global business manager of algorithmic trading at Reuters. “More of our customers are finding ways to use news content to make money.”

An example of the importance of reporting speed to algorithmic traders was an advertising campaign by Dow Jones (appearances included page W15 of the Wall Street Journal, on March 1, 2008) claiming that their service had beaten other news services by 2 seconds in reporting an interest rate cut by the Bank of England.

In July 2007, Citigroup, which had already developed its own trading algorithms, paid $680 million for Automated Trading Desk, a 19 year old firm that trades about 200 million shares a day, accounting for about 6 percent of trading volume in U.S. markets. [ [http://www.siemon.com/us/company/case_studies/atd.asp Siemon's Case Study] Automated Trading Desk, accessed July 4, 2007] Citigroup had previously bought Lava Trading and OnTrade Inc.

Effects

Though its development may have been prompted by decreasing trade sizes caused by decimalization, algorithmic trading has reduced trade sizes further. Jobs once done by human traders are being switched to computers. The speeds of computer connections, measured in milliseconds, have become very important. [ [http://www.economist.com/finance/displaystory.cfm?story_id=E1_RRNJGNP Dodgy tickers, The Economist, March 8, 2007] ] [ [http://www.wallstreetandtech.com/showArticle.jhtml?articleID=198001836 Pleasures and Pains of Cutting-Edge Technology Mar 19, 2007] ]

More fully automated markets such as NASDAQ have gained market share from less automated markets such as the NYSE. Economies of scale in electronic trading have contributed to lowering commissions and trade processing fees, and contributed to international mergers and consolidation of financial exchanges.

Competition is developing among exchanges for the fastest processing times for completing trades. For example the London Stock Exchange, in June 2007, started a new system called TradElect, which promises an average 10 millisecond turnaround time from placing an order to final confirmation, and can process 3,000 orders per second. ["LSE leads race for quicker trades" by Alistair MacDonald The Wall Street Journal Europe, June 19, 2007, p.3]

Spending on computers and software in the financial industry increased to $26.4 billion in 2005. [ [http://www.economist.com/finance/displaystory.cfm?story_id=E1_VQSVPRT Moving markets Shifts in trading patterns are making technology ever more important, The Economist, Feb 2, 2006] ]

Brokers have found it more difficult to monitor the risk of their clients' positions, especially for clients such as hedge funds.

ee also

* Artificial Intelligence
* Complex Event Processing
* Electronic Communication Network
* Electronic trading
* Implementation shortfall
* Investment strategy
* Quantitative trading

References

External links

* [http://www.businessweek.com/magazine/content/05_16/b3929113_mz020.htm Business Week, Cracking the Street's New Math, April 18, 2005]
* [http://www.ftmandate.com/news/categoryfront.php/id/95/ALGORITHMIC_TRADING.html FT Mandate Special Report on Algorithmic Trading]
* [http://www.advancedtrading.com/algorithms/ Advanced Trading Magazine: Algorithmic Trading Resource Center Advanced Trading Magazine]
* [http://homepages.cwi.nl/~robu/cima2005.pdf Paper on the empirical efficiency of combining algorithmic trading strategies]