Saturday, February 26, 2011

NFL Wrapup: APR Pick Reliability

APR: Home vs. Visitor

Here's the breakdown of pick accuracy for picking the visiting or home teams:

Visitor
Won
Home
Won
Total
Picked Visitor 6763130
Picked Home 4268110
Total 109131240

So, the good news is, when APR picked the home team, it was right a reasonably good 61.8% of the time (though still short of the Line's 65.0% record). The bad news is, when APR picked the road team, it was little better than a coin-flip.

APR also picked the home team less than half the time

Picks by Matchup Ratio

The matchup ratio (ρ) for each game is the quotient of the corresponding power indexes for each team (larger divided by the smaller). It is intended to be an indication of "pick confidence": ρ values near 1.0 involve teams judged to be very close in power, while large values indicate more of a mismatch.

Confidence
Range
Picked
Right
Picked
Wrong
%
ρ<1.02 8 947.1%
1.02<=ρ<1.04 91242.9%
1.04<=ρ<1.0614 863.6%
1.06<=ρ<1.08 91439.1%
1.08<=ρ<1.11141351.9%
1.11<=ρ<1.15271661.8%
1.15<=ρ<1.2016 964.0%
1.20<=ρ<1.30191359.3%
1.30<=ρ 191163.3%

There's a pretty clear cut-off right around ρ ≥ 1.11 where the confidence value really seems to work well; pick results are at or above a 60% success rate.

The bad news is, particularly for ρ < 1.08, the confidence value was actually a negative indicator of which team would win, at least this year.

I need to run the pick results for more seasons to find out how much of this is how APR works, and how much it was a quirk of this season. But that's going to have to wait for another time if I want to get this posted while it's still February...