Jump to content

Kelly criterion

From Wikipedia, the free encyclopedia

This is an old revision of this page, as edited by LucienBOT (talk | contribs) at 20:04, 21 December 2009 (robot Adding: fr:Formule de Kelly). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.

In probability theory, the Kelly criterion, or Kelly strategy or Kelly formula, or Kelly bet, is a formula used to determine the optimal size of a series of bets. In most gambling scenarios, and some investing scenarios under some simplifying assumptions, the Kelly strategy will do better than any essentially different strategy in the long run. It was described by J. L. Kelly, Jr, in a 1956 issue of the Bell System Technical Journal.[1] Edward O. Thorp demonstrated the practical use of the formula in a 1961 address to the American Mathematical Society[2] and later in his books Beat the Dealer[3] (for gambling) and Beat the Market[4] (with Sheen Kassouf, for investing).

Although the Kelly strategy's promise of doing better than any other strategy seems compelling, some economists have argued strenuously against it, mainly because an individual's specific investing constraints override the desire for optimal growth rate.[5] The conventional alternative is utility theory which says bets should be sized to maximize the expected utility of the outcome (to an individual with logarithmic utility, the Kelly bet maximizes utility, so there is no conflict). Even Kelly supporters usually argue for fractional Kelly (betting a fixed fraction of the amount recommended by Kelly) for a variety of practical reasons, such as wishing to reduce volatility, or protecting against non-deterministic errors in their advantage (edge) calculations.[6]

In recent years, Kelly has become a part of mainstream investment theory[7] and the claim has been made that well-known successful investors including Warren Buffett[8] and Bill Gross[9] use Kelly methods. William Poundstone wrote an extensive popular account of the history of Kelly betting in Fortune's Formula.[5]

Statement

For simple bets with two outcomes, one involving losing the entire amount bet, and the other involving winning the bet amount multiplied by the payoff odds, the Kelly bet is:

where:

  • f* is the fraction of the current bankroll to wager;
  • b is the net odds received on the wager (that is, odds are usually quoted as "b to 1")
  • p is the probability of winning;
  • q is the probability of losing, which is 1 − p.

As an example, if a gamble has a 60% chance of winning (p = 0.60, q = 0.40), but the gambler receives 1-to-1 odds on a winning bet (b = 1), then the gambler should bet 20% of the bankroll at each opportunity (f* = 0.20), in order to maximize the long-run growth rate of the bankroll.

If the gambler has zero edge, i.e. if b = q/p, then the criterion will usually recommend the gambler bets nothing (although in more complex scenarios such a bet may help ensure the best compounding rate of return: for instance a short-priced favourite in a horse race may be worth covering to provide downside protection even though the only advantageous bet is on another outsider). If the edge is negative (b < q/p) the formula gives a negative result, indicating that the gambler should take the other side of the bet. For example, in standard American roulette, the bettor is offered an even money payoff (b = 1) on red, when there are 18 red numbers and 20 non-red numbers on the wheel (p = 18/38). The Kelly bet is -1/19, meaning the gambler should bet one-nineteenth of the bankroll that red will not come up. Unfortunately, the casino doesn't allow betting against red, so a Kelly gambler could not bet.

For even-money bets (i.e. when b = 1), the formula can be simplified to:

Since q = 1-p, this simplifies further to

Proof

For a rigorous and general proof, see Kelly's original paper[1] or some of the other references listed below. Some corrections can be found in: Optimal Gambling Systems For Favourable Games:- L. Breiman, University of California, Los Angeles.

We give the following non-rigorous argument for the case b = 1 to show the general idea and provide some insights.

When b = 1, the Kelly bettor bets 2p - 1 times initial wealth, W, as shown above. If she wins, she has 2pW. If she loses, she has 2(1 - p)W. Suppose she makes N bets like this, and wins K of them. The order of the wins and losses doesn't matter, she will have:

Suppose another bettor bets a different amount, (2p - 1 + )W for some positive or negative . He will have (2p + )W after a win and [2(1 - p)- ]W after a loss. After the same wins and losses as the Kelly bettor, he will have:

Take the derivative of this with respect to and get:

which equals zero if:

which implies:

but:

so in the long run, final wealth is maximized by setting to zero, which means following Kelly strategy.

This illustrates that Kelly has both a deterministic and a stochastic component. If one knows K and N and wishes to pick a constant fraction of wealth to bet each time (otherwise one could cheat and, for example, bet zero after the Kth win knowing that the rest of the bets will lose), one will end up with the most money if one bets:

each time. This is true whether N is small or large. The "long run" part of Kelly is necessary because K is not known in advance, just that as N gets large, K will approach pN. Someone who bets more than Kelly can do better if K > pN for a stretch; someone who bets less than Kelly can do better if K < pN for a stretch, but in the long run, Kelly always wins. In concusion, the Kelly strategy is the best strategy for beating a casino, because it is (upper limit) invariant.

Reasons to bet less than Kelly

A natural assumption is that taking more risk increases the probability of both very good and very bad outcomes. One of the most important ideas in Kelly is that betting more than the Kelly amount decreases the probability of very good results, while still increasing the probability of very bad results. Since in reality we seldom know the precise probabilities and payoffs, and since overbetting is worse than underbetting, it makes sense to err on the side of caution and bet less than the Kelly amount.

Kelly assumes sequential bets that are independent (later work generalizes to bets that have sufficient independence). That may be a good model for some gambling games, but generally does not apply in investing and other forms of risk-taking. Suppose an investor is offered 10 different bets with 40% chance of winning and 2 to 1 payoffs (this is the example used above). Considering the bets one at a time, Kelly says to bet 10% of wealth on each, which means the investor's entire wealth is at risk. That risks ruin, especially if the payoffs of the bets are correlated. (This scenario is not exactly following the Kelly rule, because Kelly-criterion applies when the bets are made sequentially, only one at a time. If an investor made 10 sequential bets of 10% of their current wealth on each bet, and lost all of them, they wouldn't go broke, but would be left with 0.9^10 of their initial wealth which is 34.8%.)

The Kelly property appears "in the long run" (that is, it is an asymptotic property). To a person, it matters whether the property emerges over a small number or a large number of bets. It makes sense to consider not just the long run, but where losing a bet might leave one in the short and medium term as well. A related point is that Kelly assumes the only important thing is long-term wealth. Most people also care about about the path to get there. Two people dying with the same amount of money need not have had equally happy lives. Kelly betting leads to highly volatile short-term outcomes which many people find unpleasant, even if they believe they will do well in the end.

One of the most unrealistic assumptions in the Kelly derivation is that wealth is both the goal and the limit to what one can bet. Most people cannot bet their entire wealth: for example, it is illegal to bet one's future human capital (one cannot sell onesself into slavery). On the other hand, people can bet money they do not have by borrowing. A person who is allowed to bet more than his wealth might choose to bet more than Kelly (if one knows one can always borrow a new stake, it makes sense to take more risk) while someone who is constrained to bet much less than his wealth (such as a young college graduate with high lifetime potential earnings but no cash or credit) is forced to bet less.

Bernoulli

In a 1738 article, Daniel Bernoulli suggested that when one has a choice of bets or investments that one should choose that with the highest geometric mean of outcomes. This is mathematically equivalent to the Kelly criterion, although the motivation is entirely different (Bernoulli wanted to resolve the St. Petersburg paradox). The Bernoulli article was not translated into English until 1956,[10] but the work was well-known among mathematicians and economists.

See also

References

  1. ^ a b Kelly, J. L., Jr. (1956), "A New Interpretation of Information Rate", Bell System Technical Journal, 35: 917–926{{citation}}: CS1 maint: multiple names: authors list (link) Cite error: The named reference "original Kelly article" was defined multiple times with different content (see the help page).
  2. ^ Thorp, E. O. (1961), "Fortune's Formula: The Game of Blackjack", American Mathematical Society {{citation}}: Unknown parameter |month= ignored (help)
  3. ^ Thorp, E. O. (1962), Beat the dealer: a winning strategy for the game of twenty-one. A scientific analysis of the world-wide game known variously as blackjack, twenty-one, vingt-et-un, pontoon or Van John, Blaisdell Pub. Co
  4. ^ Thorp, Edward O.; Kassouf, Sheen T. (1967), Beat the Market: A Scientific Stock Market System, Random House, ISBN 0394424395
  5. ^ a b Poundstone, William (2005), Fortune's Formula: The Untold Story of the Scientific Betting System That Beat the Casinos and Wall Street, New York: Hill and Wang, ISBN 0809046377
  6. ^ Thorp, E. O. (2008), "The Kelly Criterion: Part I", Wilmott Magazine {{citation}}: Unknown parameter |month= ignored (help)
  7. ^ Zenios, S. A.; Ziemba, W. T. (2006), Handbook of Asset and Liability Management, North Holland, ISBN 978-0444508751
  8. ^ Pabrai, Mohnish (2007), The Dhandho Investor: The Low-Risk Value Method to High Returns, Wiley, ISBN 978-0470043899
  9. ^ Thorp, E. O. (2008), "The Kelly Criterion: Part II", Wilmott Magazine {{citation}}: Unknown parameter |month= ignored (help)
  10. ^ Bernoulli, Daniel (1956) [1738], "Exposition of a New Theory on the Measurement of Risk", Econometrica, 22 (1): 22–36 {{citation}}: Cite has empty unknown parameter: |lastauthoramp= (help)