Skip to content
CFB/LAB
Menu
Historical analysis · 2025

Backtest results

The model did not beat the historical break-even rate at −110. Historical performance does not establish this week’s win probability.

ATS measures covering the spread. MAE is mean absolute margin error in points; lower is better. Binomial p measures evidence against a 50% cover-rate baseline, not the probability a pick will win.

Backtest results

ATS accuracy
50.7%
Model MAE
12.83
Market MAE
12.01
Binomial p
0.7895

Break-even at −110: 52.4% · n= 505 graded (ATS) · n=516 projected (edges)

BucketNAccuracy
0-39851.0%
3-713464.9%
7-1418671.5%
14+9892.9%
Buckets by |projected margin| (pick accuracy)
BucketNAccuracy
0-322551.6%
3-717550.9%
7-149746.4%
14+875.0%
Buckets by |edge vs market| (ATS)
WeekMatchupProjActual
12San José State @ Nevada-10.4+45.0
11San Diego State @ Hawai'i-14.9+32.0
8Old Dominion @ James Madison-5.2+36.0
10Fresno State @ Boise State+17.7-23.0
10Arizona @ Colorado+4.1-35.0
6Boston College @ Pittsburgh+2.1+41.0
7Old Dominion @ Marshall-13.3+24.0
7Louisiana Tech @ Kennesaw State-9.3+28.0
7South Florida @ North Texas+10.2-27.0
7Rice @ UTSA+10.9+48.0
7Iowa @ Wisconsin-0.5-37.0
14Fresno State @ San José State+8.4-27.0
12Northern Illinois @ Massachusetts-6.8-42.0
10James Madison @ Texas State+3.1-32.0
8UTSA @ North Texas+2.9+38.0
Worst misses, by absolute error

Projected winner · confusion matrices

Model · 2017–2025 pooled
Model · 2017–2025 pooled: actual result by projected winner
Actual ↓ / Called →Home win calledAway win called
Home won1,678 (correct)517 (wrong)
Away won638 (wrong)1,015 (correct)

Accuracy 70.0% on 3,848 games · home recall 76.4% · away recall 61.4% · called home 60.2% vs actual home share 57.0%

Market · 2017–2025 pooled
Market · 2017–2025 pooled: actual result by projected winner
Actual ↓ / Called →Home win calledAway win called
Home won1,694 (correct)493 (wrong)
Away won567 (wrong)1,084 (correct)

Accuracy 72.4% on 3,838 games · home recall 77.5% · away recall 65.7% · called home 58.9% vs actual home share 57.0% · 10 no-call

Straight-up winner calls from the sign of the projected home margin (model) and the recorded line (market) on the same walk-forward games. Highlighted cells are correct calls and gray cells are misses; stronger shading means more games. Both call the home side more often than it wins; the market is the harder benchmark, as the backtest above already says.