Learn · Statistics
The Deflated Sharpe Ratio, explained for traders who hate math
Here is the uncomfortable fact underneath every strategy search: test enough random strategies and one of them will “work.” The Deflated Sharpe Ratio (DSR) is the statistic that tells you whether your winner is that one.
The intuition in one paragraph
Flip 1,000 coins ten times each and a few will land eight or nine heads. Nobody calls those coins skilled. But run 1,000 backtests, pick the one with the prettiest curve, and suddenly it’s a “strategy.” Same arithmetic, same mistake. The best result out of N attempts is impressive by construction, so before you trust it, you have to ask how impressive the best of N random attempts would have been, and demand your winner beat that.
How much luck does a search manufacture?
For skill-free strategies, the expected maximum Sharpe ratio across N independent trials grows roughly like:
where σSR is the spread of Sharpe ratios across your trials. The killer property is the logarithm: luck grows slowly but relentlessly with search size. Rough expectations on pure noise, assuming a Sharpe spread of about 0.5 across trials (typical for a large parameter sweep). The formula is an asymptotic approximation and overstates at small N, so the table starts at 100:
| Strategies tried | Expected best Sharpe on pure noise |
|---|---|
| 100 | ≈ 1.5 |
| 1,000 | ≈ 1.9 |
| 21,888 (a search the size of ours) | ≈ 2.2 |
Read that table again. A backtest Sharpe of 2 sounds phenomenal, and it is roughly what pure garbage is expected to produce once tens of thousands of configurations have been tried. Which is exactly what every optimizer-wielding trader has done.
What the DSR actually does
The Deflated Sharpe Ratio (Bailey & López de Prado, 2014) takes your winner’s Sharpe and asks: what is the probability this beats the best of N random strategies? It subtracts the luck premium your search manufactured, and corrects for the things that make Sharpe ratios flattering off short, skewed, fat-tailed return series. The output reads like a confidence level: a DSR of 0.95 means roughly 95% confident the edge isn’t a search artifact. Below that, you’re looking at the best coin in the jar.
A worked example on real data
In our 21,888-trial study on NQ/ES futures, the best pattern earned +0.2R per trade and turned $100k into $227k on the test window. Its DSR at the true trial count: 0.21, far under the 0.95 bar. In plain terms: overwhelmingly consistent with being the luckiest of tens of thousands of coin-flip sequences. A second, disciplined pass (96 pre-registered trials, trend removed) produced a best DSR of 0.53. Better, still far under the bar. Both would have shipped as “profitable strategies” from any tool that doesn’t count trials.
The part everyone gets wrong: the true N
Your trial count is not “the number of strategies I saved.” It is every configuration your process looked at:
- Every parameter value your optimizer swept (each grid cell is a trial).
- Every indicator you swapped in and out “just to see.”
- Every timeframe, session filter, and stop width you eyeballed and discarded.
- Every re-run after peeking at the results. The quiet ones count double.
Honest N is almost always in the hundreds or thousands. That’s not a reason to stop searching; a wide search is how you find candidates. It’s a reason to pay for the search in the statistics instead of pretending it never happened.
If your backtesting software can’t answer “how many configurations did this search evaluate?”, it cannot compute an honest DSR, and its results are un-deflatable.
Using it in practice
- Let the machine do the sweep and the counting; automated searches know their true N.
- Demand DSR ≥ 0.95 before an edge earns further attention. It is a high bar. That’s the point.
- Pair it with a sealed out-of-sample vault and walk-forward. The DSR handles search luck; the vault handles regime luck. You need both.
TrueEdge computes the Deflated Sharpe Ratio at the true trial count on every run: it counts every combination it sweeps and holds each winner to the 0.95 bar, automatically.
Try the free tierRelated: Why your backtest looks great and your live account doesn’t · Walk-forward analysis and out-of-sample testing