Thursday, January 29, 2009

NFL Wrapup: APR Pick Reliability

2008 Navigation Links

Read this for a description of APR

Over the course of the regular season, APR picked 240 NFL games week 2 to week 17. I am counting the Bengals @ Eagles tie game as a push in the following tallies.

Visitor vs Home:

Visitor
Won
Home
Won
Total
Picked Right6990159
Picked Wrong344680
Total103136239

APR picked the home team to win 124 times (90 right + 34 wrong). Since 136 home teams won, that's pretty good evidence that some kind of factor should be added to favor home teams in generating picks.

Picks by Matchup Ratio

The matchup ratio (ρ) for each game is the quotient of the corresponding power indexes for each team (larger divided by the smaller). It is intended to be an indication of "pick confidence": ρ values near 1.0 involve teams judged to be very close in power, while large values indicate more of a mismatch.

Range Picked
Right
#
Games
%PV+HWPV+VW
ρ<1.015955.6%23
1.01<=ρ<1.05264163.4%98
1.05<=ρ<1.10294663.0%1115
1.10<=ρ<1.15214151.2%910
1.15<=ρ<1.20243275.0%510
1.20<=ρ<1.30212875.0%58
1.30<=ρ<1.50242982.8%311
1.50<=ρ 91369.2%24

  • "PV+HW" stands for "Picked Visitor and Home Won", and indicates the number of games in each range where APR incorrectly picked the visitor to win (and could be picked up by giving home teams more power).

  • "PV+VW" stands for "Picked Visitor and Visitor Won", and indicates the number of games in each range where APR correctly picked the visitor to win (and could be lost by giving home teams more power).

  • This indicates that simply giving home teams more power would cost more correctly picked games (where the visiting team wins) than it would gain.

  • The drop off of accuracy for ρ >= 1.50 is due to the fact that very large values of ρ are only seen at the very beginning of the season, when APR only has a few games to produce power indexes.