practicalist

joined 1 year ago
[–] [email protected] 1 points 1 year ago

Ran this for 2023 if anyone is interested.

NFL 2023 QB ANY/As Scores Through Week 12

 

This has to be one of the bigger head scratching stats I have seen in a while. I was looking at the Jets Bills box score and the QBR numbers caught my eye.

Tim Boyle 7/14 33yds 0TD 1INT 1 Sack 1rush attempt for 1 yard QBR 50.2

50% completion, NFL avg 64.9%

2.4 yard/attempt average, the NFL avg is 7.0

4.7 yards per completion, NFL average is 10.8

So I decided to grab every QBR rating for Sunday(and Passer Rating to keep us all grounded in reality).

That legendary Tim Boyle performance you witnessed, according to QBR, was the 13th best qb performance on Sunday.

https://www.espn.com/nfl/boxscore/_/gameId/401547543

QBR loves Tim Boyle

Tim Boyle for Joe Burrow? Let me think about it

Tim Boyle for Josh Allen? Maybe if you throw in a 3rd round pick.

Tim Boyle for C.J. Stroud? C.J. Stround and who else?

Tim Boyle for Tua Tagovailoa? If you toss in a 1st rounder we can talk.

Tim Boyle for Russell Wilson? Hang up the phone scoffing at the unmitigated gall for even calling me.

Whew, thank you QBR for keeping me from looking like a complete idiot as a NFL GM.

[–] [email protected] 1 points 1 year ago

I think we may be arguing levels of bad here but let's dissect the Titans metrics. Just looking at a final score doesn't tell the full story.

The Titans get their scoring from five metrics

Blitz% - they have been blitzed the second most often behind the Colts

Penalties - The don't commit many

Avg Pocket time - 2.51, which is quite good.

Overall block win rate is 64% which is above average

Blitz deflection is just a smidge above average.

On the flip side

Their YBC is below average

Their sack % and pressure% are even worse, near or at bottom.

So they are facing a lot of blitzing but still allowing for significantly above average time in pocket. They deal with blitzes about average(blitz deflection), but even with more than average time, the qb is being pressured and sacked. This would point more towards the quarterback than the line.

They don't create a huge amount running lanes for the rush game. This is on the line, but they are not really abyssmal in this, just below average.

Conclusion - the lack of penalties is probably helping them in this system, but their passing woes may be more on the qb than on the line. Their overall block win rate is above average and there are just at least a half dozen other lines that are definitively worse when comparing them to Tennessee.

I can't say I have watched every Titans game like a Titans fan, so I could be way off base, but this is what the stats are saying when comparing them to other offensive lines.

[–] [email protected] 1 points 1 year ago (1 children)

It is important to analyze the individual metrics to see how/why the offensive line's final value may be distorted. Remember everything is comparative and essentially net zero. In ultra simple terms, for a team to score well in a metric another team must score poorly.

Much of what you say about Miami is correct, but i can't agree with the Detroit part.

4.42 of Miami's 5.42 rating is from YBC score. Take that away and Miami is an average line at 1.00, but that is still better than Detroit with all 8 metrics at 0.91.

Look at the metrics and Detroit doesn't do anything particularly well save sack% or anything much below average except avg pocket time. They are just solid, and there is nothing wrong with solid. Now from game to game they may range from dominating to middling but this is an aggregate of 10 weeks.

I like Detroit as a team and was on them early if you read the week 6 offensive, defensive, and team grades calling them top 4 material. Unfortunately this is pure stats as compared to other line stats which is about as objective a measurement as possible.

And just to go back to Miami YBC...YBC score is being doubled in order to stress that a team that can dominate by running really doesn't need to be great at pass blocking. This doubling may need to be adjusted in the future when I run the stats again, but everything has to start somewhere.

As far as the Rams, they score well in every metric and have no real weaknesses. Their total score came from just doing well in almost every metric save overall block win rate, and they were just below average in that.

+1 for the reddit name. I miss that guy.

 

Before diving in, I just want to wish everyone a nice holiday week, and safe travels to all those doing so.

NFL 2023 - Offensive Line Rankings

If you are interested in the Math & Methodology just keep reading, or for even more: NFL 2023 - Comparative Offensive Line Ratings

If you are math adverse and just want to read the team offensive line capsules (all the charts and data are still there if you wish to review them): NFL 2023 - Offensive Line Rankings

TLDR: Just look at the last 2 columns on the main chart posted below.

Example Offensive Line Capsule

NY Giants Offensive Line Capsule

The Role & Metrics of the Offensive Line

For the offensive line ratings, we are going to assume that the offensive line's 4 main objectives are:

  • Open holes for the rushing game
  • Identify, adjust and negate blitzes
  • Protect the quarterback for a reasonable amount of time
  • Win & hold blocks as a unit

In addition, like any other player or unit on the field, they should accomplish this without drawing fouls.  Since this is basically a given for all units/players, I won't list it as a main objective, but offensive lines will be scored on their ability to avoid costly penalties.

NFL 2023 - Offensive Line Metrics & Ratings - The main chart is listed alphabetically. The final columns show the rankings in descending order.

The List of Offensive Line Metrics

  • Rushing Yards Before Contact x 2
  • Blitz %
  • Pressure %
  • Blitz Deflection %
  • Average Pocket Time
  • Sack %
  • Estimated Penalty Yards
  • Overall Block Win%

Let's look at each objective and identify the metric(s) used to measure the line's effectiveness.

Opening Holes For The Rushing Game

Clearly one of the offensive line's main tasks is to run block effectively.  An offensive line that cannot run block and create opportunities for ball carriers is going to find itself forced into a lot of predictable pass block situations.  Without the threat of an effective running game, defensive players can sit on pass routes and pass rushers can pin their ears back.

The metric to be used to measure run block effectiveness is Rushing Yards Before Contact(YBC), and this will be the only rushing metric used..  While  the ball carrier's ability is certainly a part of the metric, the size of the hole, or the time until the first defender can make contact with a ball carrier, is primarily a result of blocking.  And while wide receivers and tight end blocking is also a factor, we can simply assume that all wr/te blocks are equal(which they surely are not), and assume these blocks are simply an extension of the line blocking(or that the wr/te in the play assume linemen status for the play).

Because the run game can in and of itself win ball games, and an effective run game compliments an effective pass game, the value of this metric will be doubled(the score each line receives for this metric is multiplied by two).  Thus the score you see in the Standardized YBC column is the sd value, and the next column shows the YBC score(its SD value * 2).

Pivot tables were needed to sum up totals like every players that has rushed the ball for each time to calculate YBC. You will see more of them below.

Pivot Table for YBC for each team. If we expanded the table you would see every player that has rushed ther ball for each team along with their respective stats.

Identifying, Adjust To, And Negate Blitzes

This is probably the most difficult and important task assigned to the offensive line.  Before providing time for a quarterback to throw, the line must identify the pass rushers, call the line protection, and still be aware of any misidentifications or additional blitzers not accounted for pre-snap.  If any of this goes wrong without a blitz, it can lead to a negative play.  When it goes wrong with a blitz, the potential for disasterous outcomes rises significantly.

We are going to assign three metrics to measuring this task:

Blitz % - An offensive line that faces a high amount of blitzing will score more higher in this metric.  The purpose of this metric is to measure the amount of blitzes the line has had to face while producing the stats it has.  It should be clear that a line facing 30% blitz % who gave up just 5 sacks, is probably more effective than a line who faced a 15% blitz % and gave up 5 sacks.  Either the blitz pickup of the latter line is not good OR they are getting beat without a blitz.

Pressure % - Pressure % is simply the amount of hurries, knockdowns and sacks as a cumulative total, changed into a percentage by dividing that sum by the amount of pass attempts, scrambles & sacks.  It assigns equal weight to a knockdown, a hurry and a sack even though they each have different Expected Point values, and affects on down/distance/outcome.

For measuring purposes, offensive lines that allow the least amount of pressure will score highest.

Blitz Deflection % - This is a metric you have never heard of because I just made it up.  I am defining Blitz Deflection % as [1 - (Pressure % / Blitz %)].  Let's look at a simple example of what it is and why it may be a valuable metric.

Let's assume a line has faced a Blitz % of 25%.  Let's also assume, that every blitz leads directly to pressure.  Thus a Blitz % of 25% should lead to a Pressure % of 25%.  Essentially, blitzes always work.  Thus if a team faces 25% Blitzes, then the average line would allow 25% pressure.

A line that could keep pressure % BELOW Blitz % would be doing a better job than a line who's Pressure % was higher than their Blitz %.  If this happens the line must be giving up pressure outside the Blitz and negating little to none of the blitzes sent.

Looking at the chart, Baltimore's offensive line has faced the blitz on 30.68% of designed passing plays.  Their pressure % is a mere 14.49%.  While this cannot show the exact breakdown of how often Baltimore's offensive line picked up the blitz and how many time they allowed pressure without a blitz, it should be obvious that line is picking up blitzes.

The ratio [1 - (14.49% / 30.68%)] = 52.78%.  Thus Baltimore's offensive line is deflecting 52.78% of blitzes.

Conversely, let's take a look at Pittsburgh's offensive line in this metric.  The Steelers Offensive line faces a blitz 18.08% of the time(by far the lowest % in the league, Cincinnati is second least blitzed at 21.61%).  However the Steeler offensive line allows a pressure % of 25.32%.

The ratio [1-(25.32 / 18.08%)] = -40.35%.  The Steeler's line is not deflecting any blitzes and giving up pressure outside of being blitzed.

Just remember Blitz Deflection is not measuring the actual amount of blitz pickups, but the theoretical amount a line is negating blitzes.

The Blitz % Data

Protect the Quarterback for a Reasonable Amount of Time

Regardless as to whether the blitz pickup has been identified and executed properly, the offensive line is still tasked with giving the quarterback enough time to go through his reads and complete the passing motion.  It would be great if the qb is still standing and in the pocket when this is completed, but sometimes things go wrong and quarterbacks get sacked.

The two metrics being used in this portion of the offensive line ratings are fairly straightforward.

Average Time in The Pocket - The amount of time the quarterback has before contact or being flushed is average time in the pocket.  It should follow that allowing more time for the quarterback would be good, and allowing less time bad.

This is a bit of scheming that plays into this as some times have an extremely quick read system that inherently gets the ball out faster than other schemes looking for deeper, or double, routes. But it is a fairly reliable indicator on the ability of the line to pass protect and form a workable qb pocket.

Sack % - Sacks are the worst kind of pressure as they come with loss of down and yardage by the very definition of a sack.  This is an inverse metric in that it is better to have a lower sack % than a higher one.  Lines that allow a lower % of sack will score well, while porous lines will score poorly.

Minimize Penalties

Another metric in measuring offensive lines will be their ability to avoid getting in their own way.  Every penalty on each individual line is collected and the entire line is responsible for the total penalties.

Pivot table summarizing every lineman's penalties for each team

For estimating penalty yardage, a false start is 5 yards, holding and any other penalty is 10 yards(the other penalties are a mix of 5 yard and 15 yard infractions, thus I decided to use 10 yards as the punishement for each.  Offsetting and declined penalties are still counted.  Multiplying out the types of penalties and the estimated yardage for each results in an estimated total penalty yardage total for each offensive line.  This is also an inverse metric.  Lines that have been penalized the most will score poorly, while the mistake free lines will score high.

Winning Blocks - Overall Offensive Line Blocking Win Rate

The final metric is another metric you may not have seen before, Overall Block Win Rate.   To calculate this metric, ESPN's Pass Blocking Win Rate and Rush Blocking Win Rate percentages were used for each team(which just so happened to be published this week).

ESPN Win Block Rates for Passing and Rushing - Note how compact rush block win % is, the highest 72% is ranked 7th and lowest 70% is ranked 25th. The 7th rank Pass block win rate is 64% and the 25th best is 50%, a much bigger range.

Then the breakdown between passing and running plays for each team were taken into account.  To find the overall block win rate, the pass block win rate was multiplied by the passing play %, and the rush block win rate was multiplied by the rush play %.  Turning the resulting metric back into a percentage, leads to overall block win rate.

For example, a team has a pass block win rate of 60% and a rush block win rate of 70%.  They pass 60% of the time and run 40% of the time.  What is the overall block win %?

Overall Block Win % = [(0.60*60)+(0.70*40)]/100 = 64%

You can see all the data and calculation in the main chart.  Perhaps you think everything before this section is nonsense and overall block win rate % is the true measure of offensive lines.  In that case, here is the ranking based solely on Overall Block Win Rate %

Overall Block Win Rate when pass/run ratio is factored in.

Final Offensive Line Ratings & Rankings

Summing up the score from the 8 metrics(and doubling the YBC value), we arrive at a final rating for each of the 32 offensive lines.  Like any rating system there are sure to be disagreements and niggles in the methodology. 

The Offensive Line Ratings see Baltimore, Philadelphia, Miami, & the LA Rams as the having the best offensive lines.   It sees Houston, Pittsburgh, Carolina, and the extremely woeful NY Giants as having the worst performing offensive lines thus far in 2023.

 

When it comes to luck in the NFL we can boil it down to two old addages:

  • It’s better to be lucky than good.
  • Good teams make their own luck.

So which is it?  Let’s try to use some statistics and metrics to see which NFL teams have been the luckiest and unluckiest, and see if there is an addage that fits the 2023 season.

To keep the reddit post as short as possible, the metrics methodology part has been cut out. If you are interested in the thought process and methodology behind the luck quotient, you can read the entire article here: In the NFL, it's better to be lucky than good. Or is it?

NFL 2023 - Luck Quotient

The Luck Quotient

The Luck Quotient will be a measurement of how lucky or unlucky each NFL team has been thus far in 2023.  The one luck component I could not add was the effect of injuries.   Clearly it would be unlucky to lose your starting QB for the year, while remaining relatively injury free would be lucky for any team.

Unfortunately, I could not find a free source that listed all injuries by all teams in terms of man games lost.  I know the stats exist, but NFLLINES always limits statistics and metric to publicly availble stats.  If it were possible to add in the injuries metrics, we could do something where we assign value for starters, substitute and partial game injuries.  Unfortunately this will have to wait until such stats become available to all.

Luck Quotient metrics will either count for their full value, 1/2 their value, 1/4 of their value, or a flat 0.50 or 0.25 StDev units.  If you are interested in the how/why of the metrics, use the link above to read the full post. With that in mind, here is the list of metrics I chose for the Luck Quotient:

Full Value Metrics

  • FG %
  • Opponent Fumble Recovery %
  • Interceptions thrown

Half Value Metrics

  • Punt return avg
  • Kick return average

0.50 StDev units per occurance

  • Returned Fumble for TD
  • Returned Interception for TD
  • Recorded a Safety

Quarter Value Metric

  • Extra Point %

0.25 StDev units per occurance

  • Punt return TD
  • Kick return TD

The Luckiest & Unluckiest  NFL Teams in 2023

After we total up the scores for each metric, we are left with the final Luck Quotient for each team.  The 3 luckiest teams are the only 3 teams that scored over 3.0: 

  • Dallas(3.74)
  • Houston(3.16)
  • Tampa Bay(3.06)

Dallas scored 2.5 of their 3.74 luck points from defensive returns for TD and a safety.  Houston has no defensive scores and Tampa has a Interception return for TD.  If we eliminated luck points for defensive scores, Houston would be the luckiest team(3.16), followed by Tampa bay(2.56) and LA Chargers (2.46).

At the other end of the luck spectrum, the three unluckiest teams are the only 3 teams that scored lower than -2.0:

  • New England(-3.67)
  • Buffalo(-2.70)
  • LA Rams(-2.28)

If we eliminated defensive scores, New England(-3.17) would still be the unluckiest, but the Rams(-2.28), would flip spots with the Bills (-2.20), and the Vikings(2 defensive scores) would drop & tie for 3rd unluckiest(-2.20).  Both the Patriots & Bills have 1 defensive score, while the Rams have zero.  So their unluckiness extends to their defensive scoring prowess as well.

One statistical oddity, note the Denver Broncos Punt and Kick return units.  Punt return avg of 20.7 yds and kick return avg of 33.6 yds with a TD.  Surely that kick return average is inflated due to the TD return, but the punt return average is also off the charts.  Gold Stars to the Denver kick/punt return unit and coach for their performance in 2023 so far.

The other unusual tidbit, Green Bay's opponents only recovering 18.75% of fumbles so far. The lowest value for that I could find since 2018 was the 2021 Arizona Cardinal's opponents recovered only 30.51% of fumbles & 2019 New Orleans Saints' opponents recovered only 30.77% of fumbles. The ball is bouncing the Packers way so far.

Is It Better To Be Lucky Than Good, Or Do Good Teams Make Their Own Luck?

The record for each team is listed in the final columns of the Luck Quotient chart.  And the answer at least for 2023 is pretty clear.

  • The 8 Luckiest NFL teams in 2023 have a combined record of 36 – 36 (.500).
  • The 8 Unluckiest NFL teams in 2023 have a combined record of 29 – 50 (.367).
  • If we combine the 8 luckiest and 8 unluckiest teams, those 16 teams have a combined record of 65 – 86 (.4305).
  • The 16 teams with average luck have a combined record of 86 – 65 (.5695).

Thus, good teams make their own luck, at least in 2023.

 

A few weeks ago I posted a new quarterback rating system called QB Score or QBS. Using the feedback from Reddit, here is QB Score v2.0 and a midseason grade for every NFL starter using QBS as the measuring stick. Note all stats/score are through 9 weeks and DO NOT include yesterday's games.

For the TLDR types: Just look at the charts and you should have enough ammunition to flame the idiot who wrote this nonsense. You will find QB Score, Passer Rating & QBR scores and ranks for each quarterback within. The following to links will take you to the full article about QB Score and Quarterback Grades.

QB Score Explained

NFL 2023 QB Midseason Grades

NFL 2023 QB Scores (QBS) Through Week 9

NF: 2023 QB Score & Midseason Grades

Why QB Score?

QB Score, QBS, is derived from comparing the stats of all quarterbacks to each other and then scoring each QB in 14 categories.  To do the scoring, QBS uses Standard Deviation units.  Essentially the better a QB is compared to all his fellow QBs in that metric, the higher the score he receives for that metric.

The argument for using QBS is pretty clear:

  1. It is the most intuitive of the QB rating scales with an average of virtual zero and the smallest range.
  2. QBS is the easiest QB rating metric to calculate
  3. QBS is the only comparative QB rating system that takes into account the QB’s performance compared to their peers.
  4. Quantifying the QBS score to a descriptive adjective on the QB play is simplest due the inherent ranges in its scoring system.

QB Score Metrics

Here is the process for calculating QBS.  All NFL QBs are scored in 11 statistics:

  • Completion %
  • Passing Yards / Game
  • Intended Air Yards / Pass Attempt
  • Completed Air Yards / Game
  • Completed Air Yards / Pass Attempt
  • Intended Air Yards/ Pass Attempt – Completed Air Yards / Pass Attempt (Inverse)
  • On Target %
  • Touchdown %
  • Interception % (Inverse)
  • 1st Down Success %
  • Sack % (Inverse)
  • Pressure % (Inverse)
  • Rushing Yardage
  • Rushing 1st Downs

You’ll notice that 4 statistics have (Inverse) next to them.  This simply means when calculating, a lower value is better.  It is better to have a low INT% and Sack% so the stat/score is inverted.  At the bottom of every metric you can see the average and the size of 1 unit SD range.  The 3 new QBS v2.0 metrics are in bold italics at the bottom of the list.

Upon the release of the first version of QBS, there was suggestion that it was not rewarding more mobile quarterbacks for their play extending, and play creating talents.  Essentially that QB Score was too focused on the actual throwing of the football as opposed to scoring the position of quarterback.  A good way to think of it is that QBS would measure and rate all of Tom Brady, but only 3/4 of Lamar Jackson.

This is a fair criticism and something that needed to be tweaked if QBS was going to rate quarterbacks, and not just the ability of quarterbacks to throw the ball.   However, it had to be limited.  Even in seasons when Lamar Jackson ran for 1000 yards, he was still passing for about 3000 yards and these are the most exteme cases of rushing yds vs passing yds for quarterbacks.  A fair estimate is probably more like 500 yards rushing per 3000 yards passing is the sign of a mobile qb. As a ratio this means about 1/7 (500/3500) of the QB’s production is rushing, 6/7(3000/3500) is passing.  1/7 translates into roughly 14.3%, and for extremely mobile quarterback it could range as high as 25%(Jackson in 2019 & 2020).

Thus the ability to rush and avoid pressure should count for about 15%-20% of a quarterbacks value.  There are now 2 out of 14 metrics strictly dedicated to a quarterbacks rushing ability, or 1/7.  Considering the Pressure % metric is intended to reward quarterbacks under pressure, it is also recognizing the value of a mobile quarterback.  Thus we come to that 15%-20% area.  Ideally, QB Score would be flexible and robust enough to identify the best all around quarterback of that year whether the qb was a statuesque Tom Brady, or a Tasmanian Devil like Lamar Jackson.

New Metrics in QB Score

Pressure % (Inverse)

The Pressure % metric has been added to balance out how much time each quarterback has had to produce their statistics.  This is an INVERSE metrics so QBs who are facing a high % of pressure will score higher, and quarterbacks facing minimal pressure will score lowest.

The logic for including this revolves around protection scheme and line play.  If a qb faces pressure a smaller % of the time, they should, all other things held equal, produce better statistics.  They are not being rushed, or running for the lives as much.  They are sitting in a clean pocket, scanning the field, and can step into throws.

Likewise, a quarterback that is under pressure a high % of the time is most likely having to make quicker reads, scramble, and work from dirtier pockets.  Again, all other things being equal, a qb facing a high % of pressure will typically produce worse stats than a qb facing a low % of pressure.

A modern mobile quarterback is going to be helped by this metric as they will be more capable of producing positive stats after being flushed.  They simply deal with pressure better than a statuesque type quarterback.

If a team wants to Max Protect a quarterback to mimizize pressure %, that is fine, but the quarterback will be expected to produce better stats when Max Protected then when not Max Protected.  Simply put, if a qb is not performing better with extra blockers, it would be better to send the blockers out as receivers.   Their value as extra protection is zero.

One of the reasons Tom Brady is Tom Brady is because he often faced a small % of pressure.  Take an exceptional qb, add in a bit more time in the pocket via more protection(which increases his production), and you end up with a GOAT.

And while I don’t think Zach Wilson is Tom Brady, I am not sure Zach Wilson is as bad as Zach Wilson IF Zach Wilson wasn’t facing an inordinately high amount of pressure.

Rushing Yardage

This one is as straightforward as it gets.  Quarterbacks who rush the ball effectively will score high in this metric.  Tom Brady will not.

This metric has nothing to do with throwing the football, but has something to do with playing modern QB in the NFL.  The only small issue with this metric is the large rushing yardage range between the best of the running QBs and the Pocket Passers.  But using StDev units, the damage of a single metric with an unusual range is always limited.

Rushing 1st Downs

This metric is a double barrel for rushing quarterbacks.   By choosing rushing 1st downs as a metric I also included rushing touchdowns.  How?  In the NFL every touchdown scored by rushing or passing, regardless of the distance covered, is awarded a first down Guide for NFL Statisticians.

For example, Jalen Hurts gets Tush Pushed from the 1 yard line in for a touchdown.  Hurts would get credit for 1 yard rushing, a rushing td, and a rushing 1st down.  So as you can see by using the rushing first down metric, we can give credit for qb rushing touchdowns without adding the extra metric.

Intended Air Yards – The Gunslinger Metric

Every metric you see above you may have seen before or know already with the exception of two: the metrics involving Intended Air Yards.  First, Intended Air Yards is simply the measure of how far the QB threw the ball on all attempts, whether complete, or incomplete.

For example, a QB attempts a 10 yard pass but it is incomplete.  Intended Air Yards is 10, but Completed Air Yards is zero.  If the pass was complete and the receiver ran for 6 yards after the catch: Intended Air Yards is 10, Completed Air Yards is 10, YAC is 6, and Passing Yards are 16.

I am calling this the Gunslinger metric, and here is why it is included.  Ideally you would love to have a QB willing, and able, to push the ball downfield.  So let’s reward the ones who do in QBS.  All other metrics being equal, we would love it if our QB threw for 9 intended air yards every attempt as opposed to 6, because all other things being equal(including completion %), we would move down the field faster.

But all other things are not equal…Completion % decreases as intended air yards increase(its harder to complete a longer pass than a shorter one in most cases).  The ball literally takes longer to travel 9 yards as opposed to 6 yards giving defense more time to react.  Most importantly, most NFL defenses are set up to minimize long pass completions in exchange for shorter ones.  So a gunslinger QB who is always trying to go deep needs to be kept in check in QBS by making sure they are not just flinging it willy nilly downfield.

The way this is done is with the second metric, (Intended Air Yards / PA – Completed Air Yards / PA), a metric I made up.  I call this metric, The Take What The Defense Is Giving You Metric.  This is how it works…By taking IAY/PA and subtracting CAY/PA we are seeing if the QB is trying to go deep too often.  Essentially, NOT taking what the defense gives them.

NFL 2023 - QB Score Gunslinger Metric Chart

The Case for QB Score – QBS

For scoring, all we have to do is take the actual StDev value.  Do that for all 14 metrics, add them all up, and you get QB Score, or QBS.  The major difference being that, in QBS each QB is scored in each metric based on their performance AGAINST ALL OTHER QUARTERBACKS in that metric.  While it does matter what the quarterback did in the game on Sunday, it is also dependent on what all other QBs did on Sunday as well.

The second thing that makes QBS easier to understand and calculate, is that the average QBS score is literally 0.00 through 9 weeks.  That is pretty easy to remember compared to avg Passer Rating of 89.99 and an average 53.16 for QBR.  A quarterback with a positive QBS is performing above average, one with a negative QBS is performing below average.  Again pretty simple to use.

The third thing that makes QBS the better QB metric is that it has the smallest range of values.  The current range for QB is -10.80 to 11.07  Through Week 9, the current range for Passer Rating is 70.5 – 106.4, and the range for QBR is 32.3 to 75.3.  With QBS, using StDev of the QB Scores themselves, we can easily assign grades or performance buckets to the range.

The avg QB Score is 0.00, and the StDev is 6.73.

QB Score Interpretation

13.47+ = Exceptional6.74 – 13.46 = Good to Excellent0.00 – 6.73 = Slightly above average to Good0.00 – -6.73 = Slightly below average to Bad-6.74 – 13.46 = Bad to Horrible-13.47 or lower = WTF?!

QB Score is a lot easier and clearer than either Passer Rating or QBR when it comes to figuring out what the number translates into with regards to summarizing the QB’s performance.  The chart below will help crystalize it.

QB Score vs Passer Rating vs QBR

The chart shows QB Score, Passer Rating, & QBR scores and ranks for every quarterback.  The extra column shows how many SD above or below the average for the rating each QB happens to be.  We are converting Passer rating and QBR into quasi-QBS in order to compare them.  Thus trying to measure/compare them Apples to Apples to Apples.

NFL 2023 - QB Score vs Passer Rating vs QBR

Converting Passer Rating & QBR Into Standard Deviation Units

QBS has a range of 1.65(Hurts) down to -1.60(Tannehill)

Passer Rating has a range for 1.61(Tagovailoa) down to -1.71(Tannehill)

QBR has a range of 1.64(J. Allen) down to -1.55(Z. Wilson)

Thus both Passer Rating and QBR show the same StDev range and characteristics as QBS.  However they are murkier and more confusing in both the calculation and interpretation.

Since we are only looking at half a year stats in 2023, I ran QB Scores for both 2022 and 2021.  I found it interesting that QBS has Tom Brady #1 for 2021, & Patrick Mahomes #1 for 2022.  You could not find two more opposite quarterbacks in the way they play the position, but QB Score allowed each to be the best in a given season.  This a sign of hope that QB Score could be a metric that allows comparison between typical pocket passers and modern mobile quarterbacks without being overally biased against either type.

NFL 2022 QB Scores

NFL 2021 QB Scores

Calculating Grades, Strengths & Weaknesses For Each Quarterback

Let's look at how grades, strength & weaknesses are identified statistically.  This is the little bit of math part but it is something you are already familar with if you ever had a teacher grade on the curve.

The unit of measure for QB Score is Standard Deviation units (StDev).  Very simply, StDev units measure how unusually good or bad a statistic is compared to the range it is in.  In mathematics:

  • 68.26% of the data should fit within +/- 1 StDev unit
  • 95.44% of a data range should fit within +/- 2 StDev units,
  • 99.72 % within +/- 3 StDev units.

Remember the old Bell Curve that your teacher would use to adjust test scores?  The Bell Curve is simply a graphical representation of normal probability distribution.  That is a lot of mathematical jargon that boils down to the Bell Curve is showing Standard Deviation in picture form.  The greek letter sigma σ is the mathematical symbol for STDev Units.

https://preview.redd.it/by2f4235e40c1.png?width=746&format=png&auto=webp&s=f125f97d416444f2e5805ba1247fd7701eadfe91

So it should make sense that a statistic that is close to +2.0 StDev is unusually high, while a statistic that measures -1.95 StDev is unusually low.  Normally any measurement that results in an StDev between +2 - +3 or -2 to -3 is so unusual compared to the other data, it is called an Outlier.   This just means that data point, or outlier, is worth investigating because being able to replicate positive outliers is like statistical gold.  Maybe even platinum when applying it to something like e-commerce or an NFL quarterback skill.

Letter Grade Scale

A = 1.51+ StDev units

B = 0.51 thru 1.50 StDev

C = -0.50 thru -0.50

D = -1.50 thru -0.51

F = Below -1.51 StDev units

The grade scale simply uses the Overall QB Score StDev units for grading purposes.  A quarterback who's overall QB Score is 1.51 or more StDev above average will grade out an A. Remember, this is the overall score StDev units, not each particular metric's StDev units. 

Strengths & Weaknesses Scale

For individual metrics, the following scale was used to categorize performance in the metric.  It is simply using the standard deviation ranges to quantify metric into a simple adjectives.

Real Strength = 1.01+

Strength = 0.00 thru 1.00

Weakness = 0.00 thru -1.00

Real Weakness = -1.01 or below 

You can see the value for each metric in the QB capsule. QB Score is COMPARATIVE.  This means all strengths & weaknesses are in comparison to all other quarterbacks in that statistic/metric.  Thus the scoring is essentially a Net Zero system.  For one QB to get +1.5 StDev score in a metric, another quarterback must score roughly -1.5 StDev to balance the range.

This is the huge difference between QB Score vs Passer Rating or QBR. QB Score measures the quarterbacks against each other, Passer Rating & QBR rate quarterbacks against a set standard.

Each quarterback is listed with all their metrics scores.  QB Score, Passer Rating & QBR are shown.  Each quarterback is assigned a letter grade for their overall score, and a list of strengths and weaknesses for each metric.  Remember, strengths & weaknesses are in comparison to other quarterback, essentially where they gained and lost points.

Strength & Weakness Symantics

If there is ever a metric listed as a strength or weakness that could be misleading, it is normally followed with an * and then a note at the bottom of the QB capsule explaining the possible confusion.  Simply apply the same note if you see the same potentially misleading metric in a similar spot further down.

For example, Pressure % listed as a Real Strength means the quarterback has been under the most pressure compared to all other quarterbacks, NOT that the quarterback is good at dealing with pressure.  It is there to indicate that the stats and score the quarterback have produced thus far have been under abnormally high pressure % compared to other QBs on the list.

Similarly, Pressure % listed as a Real Weakness DOES NOT mean the quarterback cannot deal with pressure.  Rather that they have produced their stats while facing far less pressure than their fellow quarterbacks thus far in 2023.

A QB Score Quaterback Capsule

NFL 2023 - Jalen Hurts QB Score Capsule

Everything in QB Score is comparative. So the list of strengths and weaknesses define which metrics and stats Hurts is excelling in(gaining points), and suffering in(losing points) COMPARED TO THE OTHER 31 STARTING QUARTERBACKS. You can find all 32 grades in the article linked at the top of the post.

I hope everyone had an enjoyable day of football yesterday, and let's get ready for some football and a Monday night party.

[–] [email protected] 1 points 1 year ago

there was an incorrect chart posted at one point. You may have been deceived by my posting ineptitude.

it was showing all auto 1st down penalties by down instead of by type and was same color and size and I missed it. sorry bout that. The correct chart is in place now.

[–] [email protected] 1 points 1 year ago

Hi Alyssa! Nice to see you on the thread 8-)

If you read this as me implying the refs are purposely screwing the Saints, or secretly placing wagers on the Jags, then I messed up somewhere, and its my bad. Sorry bout that.

I agree with the decelerating penalties theory, but I believe it is especially prevelent when the NFL introduces a new protection rule(i think maybe 2020 & 2022 were last two years). I was not aware of a crackdown or implementation of new safety rules this year. In fact I would say they are simply enforcing the rules of 2020 & 2022 more often, and at times, incorrectly.

As far as complaining about too many penalties, that was not the aim of the article at all. It was to show there was a marked increase in a particularly damaging type of penalty and the timing of them. And while I agree we both can get the stats to say anything we want in the end, the statistics and math used do support the claim of a significant increase in 4th quarter auto 1st down passing penalties thus far this season.

Hope you have a nice week and good luck to your team!

[–] [email protected] 1 points 1 year ago (1 children)

I can try. Here is a poorly formatted chart that converts point spreads into win%. Note that a 3 point favorite is considered to have 59.4% win %. link to chart https://www.boydsbets.com/nfl-spread-to-moneyline-conversion/

Home field advantage is often calculated as 3 points. So if we take that concept one step further down the line....

If referees were influencing games at around the +/-10% mark, they would be roughly adding or subtracting 3 points to the final score.

Point Spread Fav Win % Fav ML Dog Win % Dog ML

0 50.00% -100 50.00% +100

0.5 50.00% -100 50.00% +100

1 51.30% -105 48.80% +105

1.5 52.50% -111 47.50% +111

2 53.50% -115 46.50% +115

2.5 54.50% -120 45.50% +120

3 59.40% -146 40.60% +146

3.5 64.30% -180 35.70% +180

4 65.80% -192 34.20% +192

[–] [email protected] 1 points 1 year ago (1 children)

You are absolutely correct regarding records(not sure whether you ran this or felt it)

The combined record for the Top 16 Most Negatively Impacted By Auto 1st Down Penalties: 70 - 69

The record for the the Top 16 teams that have benefitted most by auto first down penalties: 67 - 68

Statistical Gold Star for you sir!

 

In this article, we are going to look into the influence referees and penalties have on a typical NFL game and season.  First, all the penalty data comes from nflpenalties.com.  If you would like to reveiw any of the data here, or data going back 10 years, you can do so on their site.

Let's break this article down into 2 parts:

  • What influence do penalties have on the game?
  • What penalties are being called this season in comparison to pervious seasons?

If you would like to read more about the penalty research issues & fixes, the full article is posted here:

NFL 2023 - Referees & Penalties Midseason Report

NFL 2023 Penalties by team

What influence do penalties have on an NFL Game?

First we should try to use the data to determine the amount penalties influence the outcome of NFL games.  To do that we are going to look at two charts:

  • Win % by Penalty Calls Differential
  • Win % by Penalty Yardage Differential

Let's start with Win % based on the difference of total penalties called against each team.  In the chart below you will see the penalty differnces , amount of  times a difference occured, team records, & Win %.

Win % by Penalty Amount Difference

Look at the range from 8 Fewer to 8 More in the win % column.  You will see almost a direct relationship between penalty difference and Win %.  The less penalties called against a team, the higher its chances of winning.  Outside the 8 Fewer to 8  More range we get into smaller sample sizes, so we are going to see more chaos in the records & Win % numbers

How about the relationship between Penalty Yardage and Win %, will we see the same thing there?

We have many small ranges in this chart so we are going to see a bit of chaos, but again if you look from 60-64 Fewer to 60-64 More range, you will again see a strong correlation between Win % and penalty yardage differential.

Win % by Penalty Yardage Difference

Therefore, the amount penalties called against a team, and/or the more penalty yardage called against a team relative its opponent, can swing Win % about 10% in either direction.   Thus this +/- 10% influence is about the influence referees can have on any single game, assuming they dont go completely flag crazy against one team.

What penalties are being called this season in comparison to previous seasons?

The following chart will show NFL Penalties over the past 5 years broken down by quarter, offense, defense, ST, amount of penalties and penalty yardage.  As you can see, if we project out the 2023 penalties, we are headed for the most penalties called in a season since 2019, and the most penalties called on the defense since 2020.  So it is fair to say, based on the projections, that referees are having more of an influence in 2023 than they have had since at least 2020.

NFL Penalties 2019 - 2023

If they are calling more penalties, what kind of penalties are the calling more of & when are they calling them?

This is the sticky wicket.  Different penalties have different punishments.  All are punished by yardage, but some grant automatic first downs.  However,  automatic 1st down penalties are the drive changers.  When they are taking place late in a game, it is going to appear as though, and in fact it actually may be, a game that is unduly influenced by penalties.

Look a the amount of penalties called in the 4th quarter thus far in 2023(445).  This projects out to about 900 4th quarter penalties in 2023, which again would be the most in the 4th quarter since 2019.

The real damning information comes in form of the following charts. The first is Automatic First Down Passing Penalties FOR each team.  In this chart the team listed is the beneficiary of an automatic 1st down penalty via the 4 main types of defensive passing penalties: Defensive Holding, Defensive Pass Interference, Illegal Contact, & Roughing the Passer.

As we can see, Tennessee has benefitted the most and Chicago has benefitted the least.  And there is a large difference between teams that benefitted most vs teams that have benefitted least.

Automatic 1st Down Penalties FOR

Here is the same chart but now we are looking at automatic 1st penalties AGAINST each team

Automatic 1st Down Penalties AGAINST

Below is a chart showing NET automatic 1st down penalties by team(FOR - AGAINST).  It is sorted from team most punished to most helped.  Since all these penalties come with auto 1st down, the Total column shows the amount of free 1st downs a team has given away(negative#) or gained(positive #).

NFL 2023 NET automatic first down penalties

Now I am simply going to repost one chart with 2022 and extrapolated 2023 data. This should allow us to see changes in amount/type of calls between 2022 & 2023.

Automatic First Down Penalty Calls 2022 vs 2023

So in 2022, there were 610 of these types of penalties called against the defense for a total of 6529 yards.

In 2023, there are projected to be 695 types of these penalties called for a total of 7348 yards.

The changes:

  • Total calls - up from 2.24 calls to 2.56 calls, an increase of 13.95%
  • Defensive Holding calls - Down 10.87%
  • Defensive Pass Interfence calls - Up 27.98%
  • Illegal Contact calls - Up 26.30%
  • Roughing the Passer calls - Up 27.82%

So while one of the 4 calls is showing a decrease of just under 11%, it is the least damaging penalty(along with Illegal Contact) among the four.  Meanwhile, the most damaging types of calls, Pass Interference & Roughing the Passer are both up nearly 28%(as is illegal contact).  Essentially all the referees have done is changed a few of the defensive holding calls into illegal contact calls.  While at the same time throwing a fairly massive increase of supremely damaging defensive penalties.

And if we simply combine this information, with the information about 4th quarter penalties being up, it means the referees are throwing more of the most damaging types of defensive passing penalties in 2023 than they have since at least 2020.  By doing this they are going to put there influence on games at the very edges of that +/- 10%, as opposed to having less influence over outcomes this year.

Enjoy your football Sunday & best of luck to your team. They may need it.