This was the whole reason for a lot of laughs at saber metrics (moneyball) for football. If a CB gets gets beat, but its after 10 seconds and the QB scrambling how do you measure that. Its to much dependent on other people where as in baseball its pretty much individuals
I think you just described how you quantify that. The problem is that to do this from scratch will take a lot of man hours.
- Define new array of statistics, many position-specific
- Hire a team of interns to pour over the all22 footage of every game in the last 5 years to collect those statistics
- Test the new statistics against measurable results on the field (score, yardage, first downs, field position) to confirm which ones are useful and which ones were bad guesses (this will also give you the relative strength of different statistics when you have a player that's strong in one area and weak in another)
- Iterate through the process several more times
My hope would be that he already has a lot of this down... but could also just be using Browns to work out the kinks.
The other area that I think will be difficult for analytics compared to baseball is strategy. There's not a whole lot of strategy in baseball. You get some tactical decisions between the pitcher, catcher, batter... a little shifting your defense for different batters... stealing bases... bunt/sac... substitutions... but compared to football, it's minimal.
Football offenses and defenses use a very large variety of schemes to adapt over the course of a game. The skill and competency of your Coordinators is no small factor - especially how fast they go through the decision making loop. You can have a chess board full of studs but if your Coordinator can't put them in position that will cost you at some point -- and vice versa.
If analytics wants to get really deep with football eventually they're going to need statistics for the coaching staff as well.