How we validate an edge

Why The Crew Bot

Most trading products lead with one cherry-picked number. We'd rather explain the process — walk-forward, anti-overfit validation before a strategy ever trades, then a live forward test in the open, with no hindsight. Here's exactly what that means and how to read it.

How a strategy earns a spot on the desk

Validated before it trades a dollar

Every strategy goes through the same process before it's allowed on the live desk.

Backtested · simulated · past performance ≠ future results

1. Discover

A strategy is tested against years of real historical price data across multiple market regimes — not just one favorable stretch.

2. Validate out-of-sample

Walk-forward tested on data it was never tuned on, with a statistical penalty for every configuration tried, so a lucky curve-fit can't pass as a real edge.

3. Forward-test live

Before it trades real money, it trades a live Tradovate demo account in the open — reacting to the market in real time, with no hindsight. Watch it on the live desk.

In plain English

What every number means

No finance degree required. Here's exactly what each term above measures and why it matters.

Trades

One completed round-trip — the bot enters a position and later exits it. A bigger trade count means more data behind the numbers (more trades = more trustworthy stats).

Net P&L (per contract)

Total profit or loss in dollars, trading a single micro contract, after commissions and realistic slippage are deducted. It scales up if you trade more contracts.

Win Rate

The percentage of trades that closed profitable. Important, but not the whole story — a strategy can win less than half its trades and still be very profitable if the winners are bigger than the losers (see Profit Factor).

Profit Factor (PF)

Gross dollars won ÷ gross dollars lost. Above 1.0 means profitable. A PF of 1.30 means the strategy made $1.30 for every $1.00 it lost. Professional desks like to see this comfortably above ~1.2.

Sharpe Ratio

Return earned per unit of overall risk (volatility) — the classic 'is the ride worth it?' measure. Higher is smoother. Roughly: above 1 is good, above 2 is strong, above 3 is exceptional for a trading strategy.

Sortino Ratio

Like Sharpe, but it only counts the downside — it doesn't penalize the strategy for big winning days. A higher Sortino means the strategy's volatility is mostly in your favor.

Max Drawdown

The largest peak-to-trough drop the account would have suffered — your worst losing stretch before recovering. Smaller is better; it's the number that tells you how painful the hardest stretch felt.

Positive Months

How many calendar months ended in profit out of the total. It measures consistency — a strategy that's positive most months is steadier than one that relies on a few huge wins.

Backtest

Running the bot's exact rules over years of real historical price data to see how it would have performed. Ours is 'walk-forward, anti-overfit' validated — meaning it was tested on data it was never tuned on, so the results aren't just curve-fit to the past.

Forward Test (live demo)

The bot trading in real time on a simulated (demo) account — no hindsight, reacting to the live market exactly as it would with real money. It's the truest test short of going live, which is why we publish it even while the sample is still small.

How to read all of this together

A strategy worth trusting doesn't just have one good number — it has a positive net P&L, a profit factor comfortably above 1, a Sharpe in the strong range, a drawdown you could stomach, and it stays positive across most months and across every time window — not just one lucky stretch. Most importantly, it has to hold up out-of-sample (on data it was never tuned on) and in live forward testing, not only on the history it was built from. That's the bar every strategy on the desk has to clear before it trades — the same bar you should hold any trading product to.

Risk Disclaimer: Futures trading involves substantial risk of loss and is not suitable for all investors. Performance shown is hypothetical/simulated; past performance does not guarantee future results (CFTC Rule 4.41). Nothing here is financial advice.