Define the rule and target
Choose the metric, target line, historical sample and minimum evidence needed to create a signal.
LearnHelp Center
/
FootballValidate
Validating a rule with Football Backtesting
Test whether a player or team research rule held up historically using only information that was available before each target game.
Where to find it
Follow this path in the StatMindX interface.
1Football
2Backtesting
3Choose Player Backtesting or Team Backtesting
What you are trying to answer
Distinguish a promising historical rule from a small-sample pattern or look-ahead artifact.
How to use it
Read Opportunities and Signals
Opportunities are all eligible historical cases; Signals are the subset where prior evidence met the configured rule.
Compare hit rate with baseline
Lift is the signal hit rate minus the baseline hit rate in percentage points.
Check chronological holdout
Development data comes first in time; later validation data remains untouched while the rule is formed.
Prefer stable evidence
A repeated result across time and validation is more informative than an extreme hit rate from very few signals.
Worked example
Worked example: positive lift needs holdout support
A rule has a 52% baseline hit rate. It produces 40 development signals with a 62% hit rate, so development lift is +10 percentage points. In the later holdout, 7 of 12 signals hit (58.3%).
1
The +10 pp development lift shows historical separation between signals and all eligible opportunities in the development period.
2
The holdout remains above the 52% baseline, but 12 validation signals are still a small sample.
3
Because the holdout comes later in time, it is more informative than re-reading the same development data used to shape the rule.
4
Neither the development lift nor the holdout result includes bookmaker odds, price, margin or profitability.
Takeaway
Prefer rules whose separation survives later data with enough signals. Positive lift is evidence of historical behavior, not proof of future edge or profit.
What the important terms mean
A historical opportunity where information available before the target game met the configured research rule.
Target outcome rate across all eligible opportunities.
Signal hit rate minus baseline hit rate, in percentage points.
Later chronological data evaluated separately from the earlier development sample.