Evaluating catchers: Framing pitches, part 2

A couple of weeks ago we estimated that catchers may generate up to a full extra win by their ability at framing pitches. While the final number was intended to be conservative, Peter Jensen pointed in the comments to the fact that the value had been estimated neglecting at-bats by left-handed hitters.

Thus another three borderline pitches per game should be added to the back-of-the-envelope calculations. That would make for a contribution of nearly 18 runs for Russell Martin, who was shown to be a top-tier catcher at framing.

However, while the number of borderline pitches per game for which a catcher can make the difference has always been estimated conservatively, the assumption that the framing skill is equal on either side of the plate and regardless of the batter’s handedness has not been tested, and that could be a cause for inflated values.

This issue will be explored in this follow-up article.

Inside, outside, lefty, righty

Using the same methodology outlined in the previous article, catchers have been ranked according to their framing ability on inside pitches to right-handed batters, and on both inside and outside pitches to left-handed batters. The following scatter plot matrix should help identify the how the four ratings are related.

image

Ratings on pitches coming to the same side of the plate (outside to lefties and inside to righties, or outside to righties and inside to lefties) show positive correlations, while rating on pitches on opposite sides show mild negative correlations.

Also, the charts below show there’s a higher variation in ratings on outside pitches (both against right-handed and left-handed batters), while the spread on the inside part is negligible. Given the umpires’ reluctance to concede the inner border to the pitchers, this was probably to be expected.

image

All the above said, it’s not advisable to extrapolate a global framing rating from the values obtained on the outside part of the plate against right-handed batters, as was done in the previous article.

Recalculating the run contribution due to framing skills considering the separate ratings (by side of the plate and batter handedness), we get that the top catchers (Jose Molina, David Ross and, again, Russell Martin) are worth eight/nine runs per 130 games (data from 2008 to May 2011).
That’s a lower value than the one estimated in the previous article, but it’s still close to one win per season.

 Best framing catchers
          player R/130
     Jose Molina 9.14
      David Ross 8.39
  Russell Martin 8.20
       Paul Bako 6.75
     Brayan Pena 5.16
 Michael Barrett 5.16
 Worst framing catchers
          player  R/130
     Mike Rabelo -7.73
   Jason Kendall -7.65
 Eliezer Alfonzo -7.18
    Brandon Inge -6.55
     J.R. Towles -6.19

Framing on high and low pitches has not been considered, and catchers have been evaluated on an equal number of “frameable” pitches per game, while it’s likely that good framing catchers will receive more borderline pitches.

Extra effect?

Since on an outside borderline pitch to a right-handed batter, a catcher can increase the probability of a called strike by as much as 20 percent, one can wonder whether hitters adjust to this and expand their strike zone accordingly, especially on two-strike counts.

Using the same technique to predict a probability of a swing, it turns out that only the identity of the pitcher and the hitter alter the outcome. On the contrary, neither a pitcher-friendly umpire nor a good framing catcher induces the hitter to have a more aggressive approach, even on two-strike counts.

What’s next?

There is still a lot of work to be done on the subject.

First, the sample size can be expanded. In fact, for ease of interpretation of the results, the analysis has been performed only on borderline pitches (which, however, are the ones that make the difference). Though the variability in the likelihood of a called strike diminishes both toward the fat part of the plate and way out of the strike zone, those pitches can add some information to the model.

Then, season to season rating variations can be analyzed. In particular it will be useful to see what happens to catchers who move to a new team in comparison to the their colleagues who stay with their employer, as suggested on The Book’s Blog.

Also, until now the run contribution has been estimated by arbitrarily assigning an average number of borderline pitches to each catcher. Once all the pitches get into the model, the difference between observed and expected called strikes can be calculated for each catcher.

A Hardball Times Update
Goodbye for now.

Finally, the issue has been explored only on the horizontal plane. A separate analysis needs to be performed to understand the catcher effect both on high and low pitches. The ultimate analysis would simultaneously account for both the horizontal and the vertical planes; unfortunately that would require a to add a spatial component to the multilevel logistic regression and, to my knowledge, that has not been implemented yet to the statistical package I’m using.

References & Resources
I’d like to thank all those who have commented either here at The Hardball Times or at The Book’s Blog for their input. I know I have not addressed many of the questions yet, but hope I’ll be able to do that before I move to another subject.


6 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Dave the Ump
12 years ago

Fun article to read.  Thanks.  One note on inside versus outside pitches.  Note that us umps set up on the inside corner.  It’s a much easier pitch to call because it is right in front of us.  The outside corner is much more subjective.  I disagree that it’s ” the umpires’ reluctance to concede the inner border to the pitchers”.  I think it’s more the umpires positioning that allows more consistency on that call. 
Great article and research.

Max Marchi
12 years ago

Dave,
thanks for the important information.
Yes, if umps position on the inside corner your final remark is extremely sound.

Thank you.

Tom Tomsick
12 years ago

Great data, but there’s room for even more analysis. Framing isn’t applied only to both sides of the plate.  Framing doesn’t only include moving the glove and ball from outside the plate back over the plate.  Catching the same pitch palm in as opposed to palm out is a framing technique.  Catching the low pitch, particularly a change-up, breaking ball, or splitter, palm-up (to make the pitch look better than it might be, showing the umpire the white of the ball) is a lost framing art. I discuss the matter a bit in my book STRIKE THREE!

Guy
12 years ago

I think it’s worth noting that most of your leaders and trailers are backup catchers.  This likely isn’t a coincidence:  small sample sizes will obviously tend to produce more extreme results.  If these were regressed, it looks like the range in true talent might be something like +/- 3 runs.  Not nothing, but quite a bit smaller than your earlier estimate.

Max Marchi
12 years ago

Good point Guy.
I’m running some more code, and what I see is that those back-up catchers come up ahead even when I sum the runs (instead of pro-rating them).

Thus, yes probably a regression would shrink the effect, but those guys should really be at the top of the list (and they are year in and year out).

But I’m putting the cart in front of the horses… there’s room for Part 3.

George N
9 years ago

Good article, and thank you. I’m thinking that a lot of the framing comes at the bottom of the zone. One of the more difficult things for a catcher is holding a ball at the bottom of the zone, mainly because the energy in the pitch and the downward angle tend to drive the glove down and back. A good catcher will try to catch the ball out in front as well, in order to stop it as high as possible, which increases the leverage and thus the difficulty. A few catchers do it well; more do not.
I think it would be the most subjective call an umpire would have to make as well, because distance judgement as well as line come into the call. The ump has to decide how high the ball was when it crossed the front of the plate. Good framing of below the zone pitches may have more effect than any other.