Book a demoSign in
Algo Creator School
November 16, 2026

The more you test, the less your best means (Algo Creator School #4)

Anthony Garcia, QuantVue CTO
CTO Anthony Garcia
Author
The more you test, the less your best means

Run a tuning sweep with 200 combinations, pick the best cell, admire its Sharpe. Here's the uncomfortable math: pure chance manufactures winners. Under the assumption of zero real edge, the expected best Sharpe across N independent tries grows with the log of N. Ten tries of nothing on a couple of years of data and the best one shows a Sharpe around 1.5. It looks like skill. It's arithmetic. Here is that expectation, exactly:

E[max SR] ≈ (1−γ)·Z⁻¹(1 − 1/N) + γ·Z⁻¹(1 − 1/(N·e⁻¹))
           ≤ √(2·ln N)

N = 10 → E[max SR] ≈ 1.57 · N = 7 on two years → ≈ 1.0
γ ≈ 0.5772 (the Euler–Mascheroni constant) · Z⁻¹ = inverse standard normal CDF · N = number of trials. That is the best Sharpe you should EXPECT from N tries of pure noise.

Which leads to the most actionable sentence in the overfitting literature, from Bailey and Lopez de Prado: a backtest that does not report the number of trials behind it cannot be assessed for overfitting at all. Every parameter combination, every variant, every "small tweak and re-run" is a trial. If you're building your own system, keep that count. N is part of the result.

The Deflated Sharpe Ratio is the correction. Instead of asking "is the Sharpe high?", it asks "is the Sharpe higher than the best I'd expect from N tries of pure noise?" It takes the observed Sharpe, the number and spread of the trial Sharpes, the sample length, and the shape of the returns (negative skew and fat tails get penalized), and it hands back a probability that the edge is real rather than selected. The full computation, from Bailey and Lopez de Prado:

SR₀ = √V[{SRₙ}] · [(1−γ)·Z⁻¹(1 − 1/N) + γ·Z⁻¹(1 − 1/(N·e⁻¹))]

PSR(SR*) = Z[ (SR − SR*)·√(T−1) / √(1 − γ₃·SR + ((γ₄−1)/4)·SR²) ]

DSR = PSR(SR₀)
SR = the observed Sharpe · SR₀ = expected max Sharpe of N noise trials (the benchmark to beat) · V[{SRₙ}] = variance across the trial Sharpes · T = sample length · γ₃ = skewness · γ₄ = kurtosis · Z = standard normal CDF. DSR is the probability the edge is real; we require it above 0.95 before a strategy advances.

This is a working part of our validation process at QuantVue. When a strategy comes out of a grid search, the sweep's combination count travels with it, near-duplicate settings get clustered so the count is honest, and the winning cell's Sharpe is deflated against that count. A strategy only advances when the deflated number says the edge survives its own selection. Pair it with last week's rule: pick from the plateau, then deflate what you picked.

Wednesday: why standard cross-validation quietly leaks in finance, and how purging fixes it. And if you'd rather trade strategies that already passed this gauntlet, that's ATS.

This lesson was originally sent to the Algo Creator School email list on July 20, 2026. New lessons go out by email regularly. Join the list at quantvue.io.

Educational content only, not financial advice. Futures trading involves substantial risk of loss and is not suitable for all investors. Individual results vary, and past performance, actual or simulated, does not guarantee future results.

Read next

Free 20,000+ member Discord!

faqs

Your questions answered

What happens after I purchase?

After check out, you will receive a Welcome Email with your login details.

Use these details to Login to our dashboard, where you'll then submit your TradingView or NinjaTrader information.

Access is granted automatically if the form is filled out properly.

If you are having issues with access being granted, please submit a support ticket here.

Can I use this if I'm a total beginner?

No. Our core system is designed for those with baseline trading knowledge and live-trading experience. Do not sign up if you're a beginner trader. Intermediate to advanced experience is recommended.

Will I win every trade with this?

No. There is no algorithm or indicator that can accurately predict with 100% certainty the financial markets.

QuantVue is not responsible for trading losses. Past results are never indicative of future performance. Use QuantVue and trade at your own risk.

Which markets & timeframes does QuantVue work on?

Our tools are designed for futures. However, clients can tweak our toolkit to any chart or market.

Do I need a paid TradingView plan?

Most clients use a paid TradingView plan, and the most popular among users is TradingView premium.

How do I cancel my membership?

You can manage your account in the "My Account" tab or submit a support ticket here and we will process your cancellation immediately!

What is the refund policy?

Our monthly & yearly Pro / Elite plans are backed by a 30-day money back guarantee. If you are not 100% satisfied within 30 days from the time of purchase, you may request a full refund.

Beyond the 30-day period, all sales are final.

The 30 day money back guarantee only applies to first time customers. If you have used our system or had a plan in the past, you are not eligble for a refund. This means if you have used the PRO plan in the past and sign up for ELITE at a later date, you will not be elgible for the refund guarantee and vice versa.

This refund policy does not apply to our ATS program.

See our full refund policy here.

Does the 30 day money back guarantee apply to the ATS?

There is a separate money back guarantee for the ATS Program. The ATS refund policy has certain conditions that must be met to receive a full refund.

See our full ATS refund policy here.

Does the Elite plan include prop automation?

The Elite Plan on it's own does not automate into cash or prop firm accounts.

If you want to automate our tools into cash or prop accounts, you can do so via our alert connector QuantLynk here.

Keep in mind QuantLynk is detectable by prop firms, so we recommend using an automation-friendly prop firm.

To automate our tools into prop account undetected, we recommend our ATS Program here.

Is there a free trial on the ATS Program?

No. There is no free trial on the ATS program.