Outsample
Verdict 01 SuperTrend: OVERFIT · read the evidence →

Tested on data
it never saw.

Your backtest looks perfect. So did every curve-fit strategy that ever burned a funded account. We test what happens on the data it never saw, and we say exactly what we find. No signals. No promises. Evidence.

See the method

Verdicts come out robust, fragile, or overfit. You are paying for the truth, whichever it is.

OUTSAMPLE · VALIDATION REPORT #042 FRAGILE
Equity · BTCUSDT · 8H in-sample | out-of-sample
Path risk
ruin3.2%abandon17.8%
Gates
  • G1 baselinepass
  • G2 path riskpass
  • G3 regimesbear 0.41
  • G4 neighborhoodpass
  • G5 permutationp 0.0074
window 2019–2026trades 412costs includedseed 20260815
Permutation · 15,000 runs
real resultright tail
Parity · Pine → Python
412/412 tradesexact
Sample report figure with illustrative data. Every real audit opens with its verdict and shows every test behind it.
400,000+path resamples per audit
15,000+permutation runs, seed disclosed
6hard gates before a verdict
0signals sold, ever

01 · The problem

Most backtests are marketing.

A strategy tuned to its own history will always look brilliant on that history. Smooth curve, spectacular ratios, none of it real.

The industry calls it a track record. Statistics calls it overfitting. The difference is exactly one test, and almost nobody runs it before selling you the result.

We run it. It is the whole company.

An overfit equity curve: strong in sample, collapsing out of sample
Fig. 1 · What overfitting looks like. Brilliant in sample. Broke the moment it met new data.

02 · The method

The Gauntlet.

Every audit we deliver and every verdict we publish runs the same battery. It is designed to kill strategies. The ones that survive have earned it.

  1. Gate 01

    Baseline profile

    The strategy as submitted. Full history, honest costs, no tuning. The floor everything else is measured from.

    kills nothing, measures everything
  2. Gate 02

    Path risk

    400,000 reorderings of the trade sequence. Ruin, abandonment, and terminal-loss probabilities, read off the full distribution instead of the one lucky path.

    kills the strategies that only worked in one order
  3. Gate 03

    Regime slicing

    One continuous run, sliced by market regime. Bear, recovery, bull, current, each judged on its own. A bear-year failure is a verdict, not a footnote.

    kills the bull-market-only heroes
  4. Gate 04

    Parameter neighborhood

    The settings, jittered in every direction. If they are a lucky peak, the neighborhood collapses around them. Robust settings live on plateaus.

    kills the one-magic-number setups
  5. Gate 05

    Permutation

    The strategy re-run on thousands of shuffled histories. If randomness explains the returns, we say so, with the p-value and the seed disclosed.

    kills the strategies that were never real
most candidates never reach this row · survivors earn one of three verdicts
ROBUST FRAGILE OVERFIT

Every report states its limitations, every assumption is flagged, and Pine ports ship with an exact parity proof. The full methodology page publishes with our first public verdict. Honesty is not proprietary. Figures on this page are rendered from labeled sample data for illustration, seed disclosed.

03 · How it works

From your script to a verdict.

One path, no surprises. Five stations, and you can see every one of them before you ever pay.

YOUR SIDE Your strategy Pine, export, or idea INTAKE · 1 BUSINESS DAY Scope gate priced, or a free no THE ENGINE Port & parity exact-match proven THE GAUNTLET Five gates G1–G5, built to kill BACK TO YOU · 3–5 DAYS The report verdict first, all tests VERDICT YOUR SIDE Your strategyPine, export, or idea INTAKE · 1 BUSINESS DAY Scope gatepriced, or a free no THE ENGINE Port & parityexact-match proven THE GAUNTLET Five gatesG1–G5, built to kill BACK TO YOU · 3–5 DAYS The reportverdict first, all tests VERDICT
Fig. 2 · The full path. The scope gate is where we say no for free, before any payment.

04 · Services

Two ways to use the engine.

Strategy validation audit

Send your strategy. Get a verdict: robust, fragile, or overfit, with every test shown.

  • Trade audityour trade export, path-risk battery$99
  • Full gauntletyour Pine script, ported with parity proof, all five gates$299
  • Deep customPython systems, multi-asset, scoped with youfrom $599

3 to 5 business days. If we cannot test it honestly, we decline it before you pay.

Indicator & strategy development

Your idea, built properly in Pine or Python, delivered privately with honest limitations stated.

  • Indicatorbuilt clean, documentedfrom $149
  • Strategywith a real backtest, costs includedfrom $349
  • Strategy + validationdevelopment plus the full gauntletfrom $599

5 to 10 business days. One revision round included. Your code stays yours.

05 · The Verdict series

Public stress-tests of popular strategies.

The same engine customers pay for, run in public on strategies traders actually use. Episode 01 is out: SuperTrend, as commonly traded: OVERFIT, with every test shown and the seed disclosed. The verdict is whatever the evidence says. That is the point.

06 · Questions

Asked before you ask.

Do you sell signals?

No, and we never will. We sell evidence about strategies, and tools that were tested before they shipped. If someone promises you entries and exits with a win rate, that is the product we exist to check.

Will you tell me my strategy is good?

We will tell you what the evidence says. Verdicts come out robust, fragile, or overfit, and we publish the same battery against popular public strategies, so you can see we mean it.

What do I need to submit?

Tier 1 needs a trade export from any platform. Tier 2 needs your Pine script, shared read-only. Deep work is scoped person to person. Every intake states exactly what we assumed and what we could not verify.

Why should I trust the verdict?

Because we show the work. Pine ports include a parity proof against the original, permutation runs disclose their seeds, and the methodology is public. You are not asked to trust us, you are shown the evidence.

Is my strategy safe with you?

Your code is read privately, never published, never reused, and deleted on request after delivery. The report is yours. We keep only what we need to stand behind the verdict.

What does a verdict of overfit cost me?

The same as any other verdict. You are paying for the truth about a strategy before the market charges you more for the same lesson.

Intake

What are we doing for you?