Thursday, April 28, 2016

Caller ID: FanDuel Results

Last weekend, I published an article that measured the empirical impact of home plate umpires on DraftKings scoring during 2015. (Scroll down to April 23rd blurb to read it.) The caveat is that a one-season sample size may or may not produce credible results, as each ump only worked 20-40 games behind the plate over the season. But you could also say that each umpire called balls & strikes for 40-80 starting pitchers, which sounds like a better sample size. In any event, it is what it is. Hopefully, we can continue to update this analysis over 2016, now that the data is readily available.

I mused that the impact on FanDuel was likely similar, but didn’t do any analysis to support that intuition. Now I have. And while there are similarities, there are some interesting differences. In particular, the impact on hitters was greater for FanDuel than it was for DraftKings, while the impact on starting pitchers was smaller.

For example, the most hitter friendly umpires for DraftKings hitters were Manny Gonzalez (+16%) and Ryan Blakney (+12%). Those two also ranked atop the FanDuel hitter rankings, although hitters for Gonzalez achieved a 22% advantage, while hitters for Blakney improved by 15%. I don’t have a satisfying explanation for this extra performance, other than that the formulas were slightly different. This might be a good opportunity for further analysis.

On the pitching side, the converse is true. For DraftKings, the most pitcher-friendly umpires produced an extra 20%-24% in pitching points. For FanDuel, the advantage was only 14%-17%. I do have a plausible explanation for this. The DraftKings pitching formula uses a wider spectrum of factors, with points deducted for hits and walks allowed, and a much smaller reward for getting the win. The FD pitching formula has only four factors: IP, SO, ER, and Wins - and the Win component is accentuated. It’s likely that the winning pitcher is not particularly influenced by home plate umpire, while hits and walks allowed are more highly impacted.

Still, although the proportionate magnitudes of the advantages/disadvantages are different, the relative rankings are pretty highly correlated. For those who would like to see the gory details, here are the results in spreadsheet and in PDF format. The corresponding DraftKings results are here: spreadsheet and PDF.

No comments:

Post a Comment