Ever since I began writing publicly about baseball, I’ve been looking into the topic of player volatility. Two main questions have motivated this research: 1) To what degree do players’ performances from game to game vary from their overall seasonal performance, and 2) What accounts for differences in this variation?
I’ve published quite a bit over the past few years addressing the first question, developing two metrics to help measure the overall volatility of a hitter (VOL), as well as how that volatility compared to league average (VOL-). Last year, at FanGraphs, I relaunched after altering the methodology for calculating hitter volatility.
Settling on a metric that, while not perfect, seems to capture the essence of the first question, I’ve turned to the second question: What accounts for differences in VOL? Which types of hitters tend to be more volatile and which less so?
Brief review of VOL and VOL-
The research began at Beyond the Box Score back in 2011, when I was interested in whether there was a way to quantify David Wright’s alleged streakiness. (In fact, that was my first official public article.) After some great feedback and much experimentation, I came up with the VOL statistic.
The idea behind VOL was to put a number to what fans and observers generally feel about the reliability of a player’s production. Does a player perform at generally the same level or does he tend to have a great game followed by bad game?
VOL was not envisioned as being a measure of streakiness. You may have a high-VOL player who also is streaky (meaning his production tends to be lumpy–a long steak of production above his average production followed by a long streak of below-average production–but that is not the same thing. (For a great treatment of the streaky concept, see Seth Samuels’ two-part series at FanGraphs–and, yes, it’s that Seth Samuels.)
After moving to FanGraphs, I decided to revisit the research. There were issues with it, but there was something about the topic that kept me interested. In late 2012, I rolled out a new metric and approach to VOL and began calculating VOL-, which is simply a player’s VOL relative to MLB average (VOL/lgVOL). Note that it is not park or league adjusted in the traditional sense.
The current calculation for VOL is:
VOL = STD(daily_wOBA)/Yearly_wOBA^.52
VOL = volatility
STD(daily_wOBA) = the standard deviation of a player’s daily batting performance, measured by wOBA*
Yearly_wOBA^.52 = a player’s yearly wOBA raised to the .52 power
*Only games where the player had more than two plate appearances are used in the calculation.
Why limit the calculation to games with greater than two plate appearances?
In previous work, a reader pointed out that there was a strong correlation between VOL and PA/G. In essence, due to how VOL was being calculated, hitters higher in the batting order appeared to be getting an artificial boost in terms of consistency.
Now, that isn’t the worst problem, since we see similar relationships between PA/G and overall wOBA (r=.413) and wRC+ (r=.404), but the relationship was extremely strong (-.787). However, as you limited the sample to higher and higher levels of PA/G, the correlation began to decrease.
What I’ve done in the current iteration is to limit the calculation of VOL to just those games in which the hitter logged at least three plate appearances. When this was done previously, the correlation between between PA/G and VOL dropped to -.26, and only -.19 when restricting to hitters with greater than 500 plate appearances.
A lower VOL (and, obviously, VOL-) value is “better” in the sense that it indicates a hitter has been more consistent offensively. However, both good and bad hitters can be consistent, so a lower VOL always needs to be viewed in the proper context.
There have been questions as to whether consistency is inherently a good thing. I haven’t been able to adequately answer that at the individual level, but there does appear to be some evidence that offensive consistency at the team level is beneficial.
VOL and VOL+ for 2011-2013
The last time I published on VOL was June of 2013. Before moving into the analysis, I thought it would be helpful to provide a look at the final season leaderboard.
I’ve included leaderboards for 2013, as well as the past two seasons (you should also be able to see it embedded below). There is also a tab that has three-year averages for players with at least 300 PA in each of the past three seasons. Click next to the 3-Year Average tab, and there is a dashboard you can use to get a quick snapshot of a single player’s VOL and VOL- in each of the past three seasons.
As for 2013, if we restrict to hitters with >=500 PAs, the VOL- crown goes to Dustin Pedroia, at 81 percent of league average. Pedroia did not have a great year at the plate, but he was very consistent. Pedroia is generally a very consistent hitter, posting the seventh-best VOL- over the past three seasons (14 percent better than league average).
If we just focus on the best offensive players (wRC+ >= 130), the least volatile player was Brian Kenny’s favorite on-base machine, Shin-Soo Choo (85 VOL-). Choo has the fourth-best VOL- since 2011 and easily the best for hitters that averaged better than a 130 wRC+ over that time period.
The most volatile offensive weapon in 2013? Chris Davis wins going away with a 111 VOL-. However, if we instead limit to hitters with more than 300 PAs, Albert Pujols takes the crown with a 138 VOL-. Not only has King Albert’s production slipped since signing in Los Angeles, but the production he is providing became extremely inconsistent in 2013. Since 2011, he is the most volatile hitter among those with an above-average wRC+ (111 VOL-).
Okay, enough with the leaderboards, lets take a look at what kinds of hitters tend to be more or less volatile.
What types of hitters are volatile?
To get a handle on what types of hitters may be more or less prone to volatility, I decided to start with some simple correlations and data plotting, limiting this analysis to hitters with >=500 PA in consecutive seasons from 2011 to 2013. The same-season correlations for VOL and VOL- are essentially the same (as we would expect), so I am just listing VOL- in the table below:
|Correlation with VOL-|
So what do we see?
The first thing is that power hitters should generally be more volatile. Racking up high strikeouts–with a high whiff percentage–and driving the ball in the air and out of the ballpark appears to drive VOL- higher (and remember, higher VOL- means more volatile and less consistent). The second is that hitters that tend to hit the ball on the ground, and reach base at a higher rate as a result, tend to have lower VOL-.
These correlations aren’t too far afield from the original research I conducted around the causes of volatility. There I found that ISO and K% were positively correlated to VOL, and BB% was negatively correlated.
Now, we can simplify this since some of the metrics correlate to VOL- are really just components or drivers of each other. For example, hitters with high ISO tend to hit the ball in the air (r=.561) and hit a high percentage of those fly balls out of the park (r=.898). Hitters with high OBP tend to walk more (r=.622 vs. r=.371) and have greater success reaching base when they put the ball in play (r=.646 vs. r=.109).
So let’s plot OBP against ISO, split the plot into four quadrants based on whether the hitter’s OBP or ISO was above league average, and see what the average VOL- is for those four quadrants:
|VOL- by Quadrant (PA=300)|
|Quadrant||Above Average ISO||Below Average ISO|
|Above Average OBP||98.2||92.5|
|Below Average OBP||105.1||97.3|
|VOL- by Quadrant (PA=300): +/- 1 Standard Deviation|
|Quadrant||+1 STD ISO||– 1 STD ISO|
|+ 1 STD OBP||98.7||91.0|
|-1 STD OBP||105.8||100.8|
The results largely conform to what we would expect. Hitters with above-average OBP but below-average ISO have on average the best VOL- (92.5). Hitters on the opposite end of the spectrum (above-average ISO, below-average OBP) have the worst VOL- (105.1).
Consistency of consistency (or the brilliance of Joey Votto)
One final question is whether VOL is a repeatable skill–or, more importantly, how reliable a metric is VOL on a year-to-year basis.
Turning again to our data set and restricting to hitters with seasons of >=500 PA, we find that the correlation between VOL- in year one and year two is .401 (n=435). As with the previous research, this isn’t an incredibly robust correlation, as the .401 places it in the same company as batting average and BABIP.
Given that VOL and VOL- have mild correlations, year to year, I still wanted to see which hitters have been the most reliable in terms of their volatility.
To tease this out, I took three consecutive years of VOL and VOL- scores for hitters in my data set and simply calculated the standard deviation of their respective VOL- statistics over the three-year span between 2011 and 2013.
The hitter with the lowest standard deviation in terms of his VOL- over that span was Adrian Beltre (.002). However, Beltre’s VOL- in each year was roughly 103 percent, meaning he was three percent more volatile than league average.
Melky Cabrera was the hitter with the lowest standard deviation who managed a better-than-average VOL- over this time frame. However, Cabrera wasn’t exactly a dominant hitter over these three years. In 2011, he posted a 118 wRC+, followed by a 150 and then an 87 in 2012 and 2013, respectively.
What about consistently excellent hitters?
I restrict the data to hitters who posted >= 130 wRC+ in each year since 2011. This yielded a list of only 11 hitters. Of those 11, only three managed to post VOL- better than league average in each of those three years: Aramis Ramirez, Joey Votto, and Matt Holliday. (While some others had better-than-average VOL over that span, only these three had better-than-average VOL in each of those three seasons.)
|Most consistent hitters, 2011-2013 (>=130 wRC+)|
|Name||STDVOL-||Ave VOL-||Ave wRC+|
While all three were excellent in terms of their production and the consistency of that production, I have to give the title to Joey Votto.
Over this three-year span, Votto posted a 162 wRC+ and a combined VOL- of just 91. Ramirez posted 136 wRC+ and 92 VOL-, while Holliday posted a 148 wRC+ and a 92 VOL-.
Ramirez had the smallest standard deviation between his three VOL- scores, but just barely. And while Holliday was extremely close to Votto in terms of VOL- and the consistency of those VOL- scores, Votto was 14 percent better relative to the league in terms of overall production. That is pretty impressive.
So what have we learned?
First, there appear to be real differences in how players distribute their production over the course of a season, and that difference likely underlies many of the “feelings” fans and observers have about whether hitters “show up” every day.
Second, much of that difference seems to be a function of the type of hitter you are. Hitters that tend to hit the ball in the air for power tend to produce in a more volatile fashion, while groundball hitters with higher on-base skills appear to produce more closely to their average on a daily basis.
With batted-ball distribution and BABIP playing a large role in the consistency of production, it is easy to see how some players could be labeled as “unfocused”, or “not giving it their all” every day when in reality, it may simply be a function of the kind of hitter they are.
Third, while the year-to-year correlation for VOL- is quite low relative to other metrics, we shouldn’t chalk it up to pure randomness. Like BABIP, VOL- might jump around year-to-year, but over the long term we do see a separation between hitters where some are consistently high and others are consistently low. VOL- appears to simply take longer to stabilize, much like BABIP.
And, finally, we’ve further confirmed that Joey Votto is a freak of nature whom we are all lucky to be able to watch play the game of baseball in our lifetime.
What’s next for this research? Well, I am open to suggestions. There is the possibility of delving more deeply into the causes of VOL, but I also don’t want to beat a dead horse. So please do offer any suggestions for what would be interesting.
My first thought was to go deeper into batted-ball profiles (e.g. batted-ball angle and distance), but my guess is it won’t tell us much more beyond what we see regarding flyball and groundball hitters.
There is still the outstanding question of value: can you place a value on the consistency of hitters? I don’t have a ready approach for that question, but it is one I plan to explore. Also, I am planning to revisit pitchers, as I originally created a pitcher VOL metric that needs to be updated and undergo the same analysis.