Making Money with High Frequency Trading

There is no standard definition of high frequency trading, nor a single type of strategy associated with it. Some strategies generate returns, not by taking any kind of view on market direction, but simply by earning Exchange rebates. In other cases the strategy might try to trade ahead of the news as it flows through the market, from stock to stock (or market to market).  Perhaps the most common and successful approach to HFT is market making, where one tries to earn (some fraction of) the spread by constantly quoting both sides of the market.  In the latter approach, which involves processing vast numbers of order messages and other market data in order to decide whether to quote (or pull a quote), latency is of utmost importance.  I would tend to argue that HFT market making owes its success as much, or more, to computer science than it does to trading or microstructure theory.

By contrast, Systematic Strategies’s approach to HFT has always been model-driven.  We are unable to outgun firms like Citadel or Getco in terms of their speed of execution; so, instead, we focus on developing theoretical models of market behavior, on the assumption that we are more likely to identify a source of true competitive advantage that way.  This leads to slower, less latency-sensitive strategies (the models have to be re-estimated or recomputed in real time), but which may nonetheless trade hundreds of times a day.

A good example is provided by our high frequency scalping strategy in Corn futures, which trades around 100-200 times a day, with a win rate of over 80%.

Corn Monthly PNL EC

 

One of the most important considerations in engineering a HFT strategy of this kind is to identify a suitable bar frequency.  We find that our approach works best using data at frequencies of 1-5 minutes, trading at latencies of around 1 millisec, whereas other firms are reacting to data tick-by-tick, with latencies measured in microseconds.

Often strategies are built using only data derived from with a single market, based on indicators involving price action, pattern trading rules, volume or volatility signals.  In other cases, however, signals are derived from other, related markets: the VXX-ES-TY complex would be a typical example of this kind of inter-market approach.

SSALGOTRADING AD

When we build strategies we often start by using a simple retail platform like TradeStation or MultiCharts.  We know that if the strategy can make money on a platform with retail levels of order and market data latency (and commission rates), then it should perform well when we transfer it to a production environment, with much lower latencies and costs.  We might be able to trade only 1-2 contracts in TradeStation, but in production we might aim to scale that up to 10-15 contract per trade, or more, depending on liquidity.  For that reason we prefer to trade only intraday, when market liquidity is deepest; but we often find sufficient levels of liquidity to make trading worthwhile 1-2 hours before the open of the day session.

Generally, while we look for outside money for our lower frequency hedge fund strategies, we tend not to do so for our HFT strategies.  After all, what’s the point?  Each strategy has limited capacity and typically requires no more than a $100,000 account, at most.  And besides, with Sharpe Ratios that are typically in double-digits, it’s usually in our economic interest to use all of the capacity ourselves.  Nor do we tend to license strategies to other trading firms.  Again, why would we?  If the strategies work, we can earn far more from trading rather than licensing them.

We have, occasionally, developed strategies for other firms for markets in which we have no interest (the KOSPI springs to mind).  But these cases tend to be the exception, rather than the rule.

Why do Investors Invest in Venture Capital Funds?

 
Too Cool for School?

Startups and Venture Capital are red hot right now. And very cool. If that isn’t a contradiction. Perusing the Business Insider list of “The 38 coolest startups in Silicon Valley”, one is struck by the sheer ingenuity of some ideas. And the total stupidity of others.

Innovation is hard. I have been doing for over 30 years in systematic trading and it never gets any easier. Ideas with great theoretical underpinnings sometimes just don’t work. Others look great in backtest, but fail to transition successfully into production. Some strategies work great for a while, then performance fades as market conditions change. What makes innovation so challenging in the arena of investment management is the competition: millions of very smart minds looking at the same data and trying to come up with something new, often using very similar approaches.

Innovation in the real world is just as challenging, but in a different way. It’s easier in the beginning – you have a whole world of possibilities to play with and so it should be less challenging to come up with something new. But innovation is much more difficult than it first appears. If your idea has any value, chances are someone has already thought of it. They may be developing it now. Or they may have tried to develop the concept and found flaws in it that you have yet to discover.

Innovation Is Hard

I have made a few attempts at innovation in the real world. The first was a product called Easypaycard, a concept that a friend of mine came up with at the start of the internet era. The idea was that you could use the card to send money to anyone, anywhere in the world, via the internet, even if they didn’t have a bank account. Aka Paypal. Couldn’t get anyone interested in that idea.bulb

Then there was a product called Web Telemetrics: a microchip that you could place on any object (or person) and track it on an interactive online map, that would provide not only location, but also other readings like temperature, stress and, in the case of a person, heart rate, etc. Bear in mind, this was in 1999, long before Google maps and location services like Apple’s “find my phone”. I thought it was a rather ingenious concept. The VCs didn’t agree – in the final competition they allocated the money to a company selling women’s shirts online. After that I decided to call it quits, for a while.

There matters stood until 2013, when I came up with a consumer electronics product called Adflik. This contained some quite clever circuitry and machine learning algorithms to detect commercials, when it would switch to the next commercial-free station in your playlist of channels. I thought the product concept was great, but I seriously under-estimated the ad-tolerance of the average American. Only one other person agreed with me! Successful product innovation is tough.

You would think that after three total failures I would hang up my boots. It’s not as though my work in investment research is uncreative, or unrewarding. But I find the idea of developing a physical product, or even an electronic product like an iPhone app, compelling.

 Venture Capital Returns

When you ask a venture capitalist about all this, he is likely to respond, rather haughtily, that his business is not about innovation, but rather to produce a return for his investors. Looking at some of the “hottest” startups, however, suggests to me that we are right back where we were in 1999. That gives me serious cause for concern about the returns that VC funds are likely to produce going forward, especially when interest rates start to rise.

For example, the business model for one of these firms is a grocery delivery service: after you have selected your very expensive groceries from Whole Foods, they will shop and deliver your order to you for an extra $3.99. Sounds like a nice idea, but a $2Bn valuation? Ludicrous. That business is going to evaporate in a puff of smoke at the first sign of a recession, or market correction, which could be right around the corner.

So how good are VC’s at producing investment returns? I did a little digging. What I found was that, while in general the VC fund industry is happy to trumpet its returns, it is almost totally silent about the other half of the investment equation: risk. As for something like a Sharpe Ratio – what that?

To answer I dug up some data from Cambridge Associates on their US Venture Capital Index, which measures quarterly pooled end-to-end net returns to Limited Partners. The index data runs from 1981 to Q2 2014, which is plentiful enough to perform a credible analysis on. Here is what I found:

  • CAGR (1981-Q2 2-14) : 13.85%
  • Annual SD: 20.35%
  • Sharpe Ratio: 0.68

Impressive? Not at all. Any half-decent hedge fund should have a Sharpe Ratio of at least 1. Our own Volatility ETF strategy, for example, has a Sharpe of over 3. We are currently running several high frequency strategies with double-digit Sharpe Ratios.

Note that in computing the Sharpe Ratio, I have ignored the risk free rate of return, which at times during the 1980’s was in double digits. So, if anything, the actual risk adjusted performance is likely significantly lower than stated here.

 VC Funds vs Hedge Funds

Why does this matter? Simple – if you gave me a risk budget equivalent to the VC Index, i.e. a standard deviation of 20% per annum, our volatility strategy would have produced a CAGR of over 60%, for the same degree of investment risk. A high frequency strategy operating at the same risk levels would produce returns north of 200% annually!

Of course, just as with hedge funds, the Cambridge Associates index is an “average” of around 1400 VC funds, some of which will have outperformed the benchmark by a significant margin. Still, the aggregate performance is not exactly stellar.

But it gets worse. Look at the chart of the compounded index returns over the period from 1981:

Source: Cambridge Associates

The key point to note is that the index has yet to regain the levels is achieved 15 years ago, before the dot com bust. If VC funds operated high water marks, as most hedge funds do, the overwhelming majority of them would gone out of business many years ago.

So Why Invest in VC Funds?

Given their unimpressive aggregate performance, why do investors invest in VC funds? One answer might lie in the relatively low correlations with other asset classes. For example, over the period from 1981, the correlation between the VC index and the S&P 500 index has averaged only 0.34.

Again, however, if low correlation to the market is the issue, investors can do better by a judicious choice of hedge fund strategy, such as equity market neutral, for example, which typically has a market correlation very close to zero.

Nor is the absolute level of returns a factor: plenty of hedge funds measure their performance in terms of absolute returns. And if investors’ appetite for return is great enough to accommodate a 20% annual volatility, there is no difficulty borrowing at very low margin rates to leverage up the return.

One rational reason for investors’ apparently insatiable appetite for VC funds is capacity: unlike many hedge funds, there is no problem finding investments capable of absorbing multiple $billions, given the global pretensions, rapid burn rates and negligible cash flows of many of these new ventures. But, of course, capacity is only an advantage when the investment itself is sound.

Plowing vast sums into grocery collection services, or online women’s-wear stores, may appear a genius idea to some. But for the rest of us, as the inestimable Lou Reed put it, “other people, they gotta work”.

The Case for Volatility as an Asset Class

Volatility as an asset class has grown up over the fifteen years since I started my first volatility arbitrage fund in 2000.  Caissa Capital grew to about $400m in assets before I moved on, while several of its rivals have gone on to manage assets in the multiple billions of dollars.  Back then volatility was seen as a niche, esoteric asset class and quite rightly so.  Nonetheless, investors who braved the unknown and stayed the course have been well rewarded: in recent years volatility strategies as an asset class have handily outperformed the indices for global macro, equity market neutral and diversified funds of funds, for example. Fig 1

The Fundamentals of Volatility

It’s worth rehearsing a few of the fundamental features of volatility for those unfamiliar with the territory.

Volatility is Unobservable

Volatility is the ultimate derivative, one whose fair price can never be known, even after the event, since it is intrinsically unobservable.  You can estimate what the volatility of an asset has been over some historical period using, for example, the standard deviation of returns.  But this is only an estimate, one of several possibilities, all of which have shortcomings.  We now know that volatility can be measured with almost arbitrary precision using an integrated volatility estimator (essentially a metric based on high frequency data), but that does not change the essential fact:  our knowledge of volatility is always subject to uncertainty, unlike a stock price, for example.

Volatility Trends

Huge effort is expended in identifying trends in commodity markets and many billions of dollars are invested in trend following CTA strategies (and, equivalently, momentum strategies in equities).  Trend following undoubtedly works, according to academic research, but is also subject to prolonged drawdowns during periods when a trend moderates or reverses. By contrast, volatility always trends.  You can see this from the charts below, which express the relationship between volatility in the S&P 500 index in consecutive months.  The r-square of the regression relationship is one of the largest to be found in economics. Fig 2 And this is a feature of volatility not just in one asset class, such as equities, nor even for all classes of financial assets, but in every time series process for which data exists, including weather and other natural phenomena.  So an investment strategy than seeks to exploit volatility trends is relying upon one of the most consistent features of any asset process we know of (more on this topic in Long Memory and Regime Shifts in Asset Volatility).

Volatility Mean-Reversion and Correlation

One of the central assumptions behind the ever-popular stat-arb strategies is that the basis between two or more correlated processes is stationary. Consequently, any departure from the long term relationship between such assets will eventually revert to the mean. Mean reversion is also an observed phenomenon in volatility processes.  In fact, the speed of mean reversion (as estimated in, say, an Ornstein-Ulenbeck framework) is typically an order of magnitude larger than for a typical stock-pairs process.  Furthermore, the correlation between one volatility process and another volatility process, or indeed between a volatility process and an asset returns process, tends to rise when markets are stressed (i.e. when volatility increases). Fig 3

Another interesting feature of volatility correlations is that they are often lower than for the corresponding asset returns processes.  One can therefore build a diversified volatility portfolio with far fewer assets that are required for, say, a basket of equities (see Modeling Asset Volatility for more on this topic).

Fig 4   Finally, more sophisticated stat-arb strategies tend to rely on cointegration rather than correlation, because cointegrated series are often driven by some common fundamental factors, rather than purely statistical ones, which may prove temporary (see Developing Statistical Arbitrage Strategies Using Cointegration for more details).  Again, cointegrated relationships tend to be commonplace in the universe of volatility processes and are typically more reliable over the long term than those found in asset return processes.

Volatility Term Structure

One of the most marked characteristics of the typical asset volatility process its upward sloping term structure.  An example of the typical term structure for futures on the VIX S&P 500 Index volatility index (as at the end of May, 2015), is shown in the chart below. A steeply upward-sloping curve characterizes the term structure of equity volatility around 75% of the time.

Fig 5   Fixed income investors can only dream of such yield in the current ZIRP environment, while f/x traders would have to plunge into the riskiest of currencies to achieve anything comparable in terms of yield differential and hope to be able to mitigate some of the devaluation risk by diversification.

The Volatility of Volatility

One feature of volatility processes that has been somewhat overlooked is the consistency of the volatility of volatility.  Only on one occasion since 2007 has the VVIX index, which measures the annual volatility of the VIX index, ever fallen below 60.

Fig 6   What this means is that, in trading volatility, you are trading an asset whose annual volatility has hardly ever fallen below 60% and which has often exceeded 100% per year.  Trading opportunities tend to abound when volatility is consistently elevated, as here (and, conversely, the performance of many hedge fund strategies tends to suffer during periods of sustained, low volatility)

SSALGOTRADING AD

Anything You Can Do, I Can Do better

The take-away from all this should be fairly obvious:  almost any strategy you care to name has an equivalent in the volatility space, whether it be volatility long/short, relative value, stat-arb, trend following or carry trading. What is more, because of the inherent characteristics of volatility, all these strategies tend to produce higher levels of performance than their more traditional counterparts. Take as an example our own Volatility ETF strategy, which has produced consistent annual returns of between 30% and 40%, with a Sharpe ratio in excess of 3, since 2012.   VALUE OF $1000

Sharpe

  Monthly Returns

 

(click to enlarge)

Where does the Alpha Come From?

It is traditional at this stage for managers to point the finger at hedgers as the source of abnormal returns and indeed I will do the same now.   Equity portfolio managers are hardly ignorant of the cost of using options and volatility derivatives to hedge their portfolios; but neither are they likely to be leading experts in the pricing of such derivatives.  And, after all, in a year in which they might be showing a 20% to 30% return, saving a few basis points on the hedge is neither here nor there, compared to the benefits of locking in the performance gains (and fees!). The same applies even when the purpose of using such derivatives is primarily to produce trading returns. Maple Leaf’s George Castrounis puts it this way:

Significant supply/demand imbalances continuously appear in derivative markets. The principal users of options (i.e. pension funds, corporates, mutual funds, insurance companies, retail and hedge funds) trade these instruments to express a view on the direction of the underlying asset rather than to express a view on the volatility of that asset, thus making non-economic volatility decisions. Their decision process may be driven by factors that have nothing to do with volatility levels, such as tax treatment, lockup, voting rights, or cross ownership. This creates opportunities for strategies that trade volatility.

We might also point to another source of potential alpha:  the uncertainty as to what the current level of volatility is, and how it should be priced.  As I have already pointed out, volatility is intrinsically uncertain, being unobservable.  This allows for a disparity of views about its true level, both currently and in future.  Secondly, there is no universal agreement on how volatility should be priced.  This permits at times a wide divergence of views on fair value (to give you some idea of the complexities involved, I would refer you to, for example, Range based EGARCH Option pricing Models). What this means, of course, is that there is a basis for a genuine source of competitive advantage, such as the Caissa Capital fund enjoyed in the early 2000s with its advanced option pricing models. The plethora of volatility products that have emerged over the last decade has only added to the opportunity set.

 Why Hasn’t It Been Done Before?

This was an entirely legitimate question back in the early days of volatility arbitrage. The cost of trading an option book, to say nothing of the complexities of managing the associated risks, were significant disincentives for both managers and investors.  Bid/ask spreads were wide enough to cause significant heads winds for strategies that required aggressive price-taking.  Mangers often had to juggle two sets of risks books, one reflecting the market’s view of the portfolio Greeks, the other the model view.  The task of explaining all this to investors, many of whom had never evaluated volatility strategies previously, was a daunting one.  And then there were the capacity issues:  back in the early 2000s a $400m long/short option portfolio would typically have to run to several hundred names in order to meet liquidity and market impact risk tolerances. Much has changed over the last fifteen years, especially with the advent of the highly popular VIX futures contract and the newer ETF products such as VXX and XIV, whose trading volumes and AUM are growing rapidly.  These developments have exerted strong downward pressure on trading costs, while providing sufficient capacity for at least a dozen volatility funds managing over $1Bn in assets.

Why Hasn’t It Been Done Right Yet?

Again, this question is less apposite than it was ten years ago and since that time there have been a number of success stories in the volatility space. One of the learning points occurred in 2004-2007, when volatility hit the lows for a 20 month period, causing performance to crater in long volatility funds, as well as funds with a volatility neutral mandate. I recall meeting with Nassim Taleb to discuss his Empirica volatility fund prior to that period, at the start of the 2000s.  My advice to him was that, while he had some great ideas, they were better suited to an insurance product rather than a hedge fund.  A long volatility fund might lose money month after month for an entire year, and with it investors and AUM, before seeing the kind of payoff that made such investment torture worthwhile.  And so it proved.

Conversely, stories about managers of short volatility funds showing superb performance, only to blow up spectacularly when volatility eventually explodes, are legion in this field.  One example comes to mind of a fund in Long Beach, CA, whose prime broker I visited with sometime in 2002.  He told me the fund had been producing a rock-steady 30% annual return for several years, and the enthusiasm from investors was off the charts – the fund was managing north of $1Bn by then.  Somewhat crestfallen I asked him how they were producing such spectacular returns.  “They just sell puts in the S&P, 100 points out of the money”, he told me.  I waited, expecting him to continue with details of how the fund managers handled the enormous tail risk.  I waited in vain. They were selling naked put options.  I can only imagine how those guys did when the VIX blew up in 2003 and, if they made it through that, what on earth happened to them in 2008!

Conclusion

The moral is simple:  one cannot afford to be either all-long, or all-short volatility.  The fund must run a long/short book, buying cheap Gamma and selling expensive Theta wherever possible, and changing the net volatility exposure of the portfolio dynamically, to suit current market conditions. It can certainly be done; and with the new volatility products that have emerged in recent years, the opportunities in the volatility space have never looked more promising.

High Frequency Trading Strategies

Most investors have probably never seen the P&L of a high frequency trading strategy.  There is a reason for that, of course:  given the typical performance characteristics of a HFT strategy, a trading firm has little need for outside capital.  Besides, HFT strategies can be capacity constrained, a major consideration for institutional investors.  So it is amusing to see the reaction of an investor on encountering the track record of a HFT strategy for the first time.  Accustomed as they are to seeing Sharpe ratios in the range of 0.5-1.5, or perhaps as high as 1.8, if they are lucky, the staggering risk-adjusted returns of a HFT strategy, which often have double-digit Sharpe ratios, are truly mind-boggling.

By way of illustration I have attached below the performance record of one such HFT strategy, which trades around 100 times a day in the eMini S&P 500 contract (including the overnight session).  Note that the edge is not that great – averaging 55% profitable trades and profit per contract of around half a tick – these are some of the defining characteristics of HFT trading strategies.  But due to the large number of trades it results in very substantial profits.  At this frequency, trading commissions are very low, typically under $0.1 per contract, compared to $1 – $2 per contract for a retail trader (in fact an HFT firm would typically own or lease exchange seats to minimize such costs).

Fig 2 Fig 3 Fig 4

 

Hidden from view in the above analysis are the overhead costs associated with implementing such a strategy: the market data feed, execution platform and connectivity capable of handling huge volumes of messages, as well as algo logic to monitor microstructure signals and manage order-book priority.  Without these, the strategy would be impossible to implement profitably.

SSALGOTRADING AD

Scaling things back a little, lets take a look at a day-trading strategy that trades only around 10 times a day, on 15-minute bars.  Although not ultra-high frequency, the strategy nonetheless is sufficiently high frequency to be very latency sensitive. In other words, you would not want to try to implement such a strategy without a high quality market data feed and low-latency trading platform capable of executing at the 1-millisecond level.  It might just be possible to implement a strategy of this kind using TT’s ADL platform, for example.

While the win rate and profit factor are similar to the first strategy, the lower trade frequency allows for a higher trade PL of just over 1 tick, while the equity curve is a lot less smooth reflecting a Sharpe ratio that is “only” around 2.7.

Fig 5 Fig 6 Fig 7

 

The critical assumption in any HFT strategy is the fill rate.  HFT strategies execute using limit or IOC orders and only a certain percentage of these will ever be filled.  Assuming there is alpha in the signal, the P&L grows in direct proportion to the number of trades, which in turn depends on the fill rate.  A fill rate of 10% to 20% is usually enough to guarantee profitability (depending on the quality of the signal). A low fill rate, such as would typically be seen if one attempted to trade on a retail trading platform, would  destroy the profitability of any HFT strategy.

To illustrate this point, we can take a look at the outcome if the above strategy was implemented on a trading platform which resulted in orders being filled only when the market trades through the limit price.  It isn’t a pretty sight.

 

Fig 8

The moral of the story is:  developing a HFT trading algorithm that contains a viable alpha signal is only half the picture.  The trading infrastructure used to implement such a strategy is no less critical.  Which is why HFT firms spend tens, or hundreds of millions of dollars developing the best infrastructure they can afford.