Predicted 2014 Draft selection order

Below is the predicted order based off of the following variables:


Top 100 consensus ranking
Height
Weight
Arm Length
Avg Mock Draft Points


Order Player Pos Top100 Height Weight Arms Avg Mock Draft points Pred Mock Draft Points
1 Jadeveon Clowney DE 1 77 266 35 2911.111111 2656.180654
2 Greg Robinson OT 3 77 332 35 2600 2414.823449
3 Khalil Mack OLB 2 75 251 33 2188.888889 1990.70493
4 Sammy Watkins WR 4 73 211 32 1833.333333 1646.896388
5 Taylor Lewan OT 10 79 309 34 1494.444444 1581.072755
6 Mike Evans WR 6 77 231 35 1450 1566.586301
7 Jake Matthews OT 5 77 308 33 1572.222222 1558.98738
8 Johnny Manziel QB 11 72 207 31 1572.222222 1386.016481
9 Anthony Barr OLB 13 77 255 34 1094.444444 1250.329576
10 Eric Ebron TE 12 76 250 33 1175 1247.941459
11 Aaron Donald DT 8 73 285 33 1215.555556 1219.553732
12 Zack Martin OT 15 76 308 33 1144.444444 1216.86755
13 Justin Gilbert CB 16 72 202 33 1188.888889 1188.137736
14 Blake Bortles QB 14 77 232 33 1044.444444 1170.458139
15 Cyrus Kouandjio OT 34 79 322 36 797 1139.066329
16 C.J. Mosley ILB 9 74 234 33 1058.333333 1126.560729
17 Odell Beckham Jr. WR 18 71 198 33 1022.222222 1044.672079
18 Ha Ha Clinton-Dix FS 18 73 208 32 990 1011.699527
19 Kyle Fuller CB 27 72 190 33 950 1006.921183
20 Morgan Moses OT 36 78 314 35 695.8333333 1000.100097
21 Timmy Jernigan DT 30 74 299 32 925 966.0854087
22 Ja'Wuan James OT 57 78 311 35 660 965.7691372
23 Ra'Shede Hageman DT 24 78 310 34 640 918.4423979
24 Jimmie Ward SS 35 71 193 31 950 895.0107152
25 Calvin Pryor FS 22 71 207 31 927.7777778 881.5884295
26 Jace Amaro TE 39 77 265 34 606.6666667 874.7488037
27 Darqueze Dennard CB 19 71 199 30 975.5555556 874.4638941
28 Kony Ealy DE 26 76 273 34 620 869.9957469
29 Joel Bitonio OT 46 76 302 34 597.5 842.0860553
30 Ryan Shazier OLB 21 73 237 32 766.1111111 839.6863546
31 Derek Carr QB 33 74 214 32 743.3333333 839.5957556
32 Dee Ford DE 31 74 252 33 680 833.3038955

This was published at 1:30 am MST on 5/8/14


Thoughts on trying to predict the NFL Draft

Although analyzing the relationships between variables of NFL draft prospects was actually very interesting and I could've continued digging deeper forever, ultimately I needed to actually move on and try to create a prediction formula for the draft selections.  

My first attempts were to try to predict the aforementioned draft value of each prospect given their physical measurements, top 100 ranking composite score, aggregated mock draft scores and how many visits they made.  It actually did pretty well in terms of accuracy I mentioned in my earlier post comparing the NFL pundit predictions.  I do want to reiterate that I graded them on pick selection accuracy, not team based accuracy, so it is more of a reflection of what pick number the prospect should be than where they should go.  It's just a quick way to make a general suggestion of what should happen.  

Before I looked pundits' predicted vs. actual JJ Draft Value plots and ranked them by the amount of the actual draft value an algorithm could predict given their previous mock drafts results.  Here is the prediction formula's plot, it performed well at a R-square value of XXX.  This would place it above the highest ranking expert I looked at, Todd McShay had a R-square value of 0.76.  Not bad for someone who has no experience scouting and no inside NFL knowledge.


Anyways I graded the prediction formula against the pundits a little differently as well.  This time instead of using JJ Draft Value as a metric, I'll use pick selection for the 2013 Draft.  So I compared the prediction formula's projected pick to the expert's picks, here are the experts picks:


You can see that Mel Kiper did much better in 2013 than he has done in his career, but Todd McShay is still doing better.  By the way I don't mean to pick on Mel or anything, he's just the most recognizable NFL Draft expert.  Anyways, below are my picks versus the actual selections in the 2013 Draft:


What I think this shows is that if you use even a very basic prediction algorithm of what pick a prospect is going to be selected at, rather than trying to predict what team will select them, you can get a better sense of a prospect's draft value than even some of the experts in the field.  

I would love to see people take ideas from this project and expand on the research, I'm sure it would be valuable to any NFL front office.  I will post my data after the project is complete.  In the next post, I will attempt to predict the 2014 draft order.



Exploratory Draft Data: Top 100 rankings

I deviated from the last topic I was going to dive into at the outset of the project.  Instead of looking at the college statistics of each individual I thought it would be more prudent to study the overall rankings of each player.  College stats wouldn't be the best predictors because they're heavily dependent on the scheme and caliber of teammates each prospect had, whereas overall rankings project them compared to other prospects at their respective positions.  I think there will be some crossover effects with the mock draft rankings, but mock drafts project fit with teams and aren't true ordered rankings.


To create a composite style ranking similar to this one, I collected the top 100 rankings of 10 different draft pundits, averaged out their rankings to get a consensus and then ranked them.  Below are the top 50 results from 2013, since my test draft prediction will be run on that draft.


Pundits used:


DraftTek
Mike Mayock
NE Draft
Walter Football
Blogging the Boys
Gil Brandt
New Era Scouting
NFL Draft Scout
Matt Miller
Daniel Jeremiah



Player College Rank Avg
Luke Joeckel Texas A&M 1 1.8
Eric Fisher Central Michigan 2 3.1
Dion Jordan Oregon 3 4.6
Sharrif Floyd Florida 4 6.9
Chance Warmack Alabama 5 7.2
Star Lotulelei Utah 6 8.1
Lane Johnson Oklahoma 7 8.8
Dee Milliner Alabama 8 9.2
Ezekiel Ansah Brigham Young 9 10.6
Jonathan Cooper North Carolina 10 11.1
Sheldon Richardson Missouri 11 11.2
Tavon Austin West Virginia 12 13.22
Barkevious Mingo LSU 13 13.8
Kenny Vaccaro Texas 14 15
Bjoern Werner Florida State 15 17.9
Geno Smith West Virginia 16 19.4
Jarvis Jones Georgia 17 20.8
Tyler Eifert Notre Dame 18 21.2
Xavier Rhodes Florida State 19 21.4
Cordarrelle Patterson Tennessee 20 21.4
Sylvester Williams North Carolina 21 26.7
Alec Ogletree Georgia 22 27.4
D.J. Fluker Alabama 23 27.5
Cornellius Carradine Florida State 24 28.7
Desmond Trufant Washington 25 29.2
Jonathan Cyprien Florida Int'l 26 30.9
Keenan Allen California 27 31.7
Datone Jones UCLA 28 32.2
Manti Te'o Notre Dame 29 33.3
DeAndre Hopkins Clemson 30 33.5
Arthur Brown Kansas State 31 34.1
Damontre Moore Texas A&M 32 36.9
Eddie Lacy Alabama 33 37.11
Matt Elam Florida 34 38.11
Johnthan Banks Mississippi State 35 38.25
Kevin Minter LSU 36 39.3
Kawann Short Purdue 37 40.4
D.J. Hayden Houston 38 40.9
Jamar Taylor Boise State 39 42.1
Robert Woods USC 40 42.3
Matt Barkley USC 41 42.88
Jesse Williams Alabama 42 43.2
Eric Reid LSU 43 45.1
Zach Ertz Stanford 44 45.5
Menelik Watson Florida State 45 45.71
Justin Hunter Tennessee 46 45.8
Alex Okafor Texas 47 46.71
Johnathan Hankins Ohio State 48 49.33
Larry Warford Kentucky 49 51.22
Kyle Long Oregon 50 51.44

Exploratory Draft Data: Evaluating team visits

Another aspect I wanted to look at was if whether or not a prospect visited a team during Draft season influenced if that team eventually selected said player.  To do this, I found Walter Football's team visit list very helpful and tabulated the results for 2013.  I hope to do the same for previous years as well to improve on the accuracy.


Here's a breakdown of what teams brought in what positions (and was reported and collected by Walter Football) for visits or were confirmed to have spoken with them at gatherings.  Again this is just what was reported so that's likely the reason for the disparities in numbers, most teams probably bring in about the same number each year.

The columns were conditionally formatted, with the dark green values indicating that team worked out that position more than other teams worked out the position in the same column, same with the grand totals at the end:

There's some pretty clear indicators in there.  Some I can think of:  New England and Philadelphia like to do their homework, Atlanta scouted a bunch of DB (and picked one 1st round), Buffalo scouted a bunch of QB (and surprise picked one 1st round) and DB and DL were met with by almost every team.


Here's whether or not each team's 1st round pick visited or not (for the record, 61% or 19 of the 31 known prospects did):

One guess as to why more teams didn't bring as many prospects in that they ended up selecting towards the end of the round could be that those team's picked more from the "best player available" methodology and ended up with people they didn't initially believe they would have the opportunity to draft.


Exploratory Draft Data: Comparing pundits mock drafts

Like I have mentioned previously, the NFL Draft is now a major industry that exists within the massive industry that of professional football.  It is a field in which celebrities exist but is accessible to all, people with a lifetime of experience can give their views next to someone who knows little about the subject, and you can even change your ideas as much as you want as the draft season of February to now May mvoes along.  This has both its advantages and disadvantages in predicting where a prospect will be drafted.


What you want to do ultimately do to use the advantages and reduce the disadvantages is aggregate mock draft predictions to reduce the reliance on any one person's judgment.  This new mock ranking should be a combination of both what pick the prospect is predicted to be across the board but also what teams the pundits think are good fits, but for right now is just the draft value points.  This should help quantify the very qualitative process of what a lot of people feel makes sense in terms of fit, which is important as well.


If someone were to expand on this start, I'd suggest they get a much broader array of pundits, I only had time to collect a couple in time to complete this project.  There are literally thousands of people willing to give their opinions of where they think prospects should be drafted.


One thing I do want to note is that in order to numerically compare what pick these prospects should be drafted I used the method that is generally accepted as the standard draft pick value, the Jimmy Johnson Draft Value Chart.  It has been used since the 1990s to come up with a way to numerically compare draft pick trades between teams, so it more accurately describes draft value than just a number slot in my opinion.  I decided to use what the NFL ultimately uses, since I want the prediction to be as accurate as possible.  Incorporating a truer draft value chart would make sense if one were available, so until then the old coach of my Miami Hurricanes will continue to be the way the game is defined.



Comparing mock drafts based on draft pick value:


I collected the final mock predictions of the following draft pundits for any years I could between 2008 and 2013 within my limited timeframe

Some had 2 years worth of data, some had 5 years.  Obviously the more years worth of data, the more accurate the evaluation of the pundit would be but this is what I could collect.  If expanded, I would collect as many years back that I could from many sources.

To compare their accuracy, I fit a linear regression line and am comparing their R-square values.  What this essentially tells me is what percentage of the prospects 1st round draft value you could get right with just each pundit's prediction.  So if Eric Fisher is worth 3000 points as the first pick and Matt Elam is 590 points as the last pick, how close could I come just using the pundit's corresponding draft value prediction as the only variable considered.


Here is one full example, that of the popular Draft godfather himself, Mel Kiper:

This is both a good visual as well as numerical representation of the pundit's accuracy.  The circled blue value Mel guessed around 2200, but the prospect was really "worth" only about 1500.  So Mel overestimated this prospects draft position this particular year. The red line is the linear regression fit line and would go from the bottom left corner to the top right diagonally in an ideal world.  The further this line is off visually indicates how off the accuracy is.  Also the correlation value on the bottom lets me know numerically how closely associated an increase in Mel's predicted draft value is with the prospect's actual draft value.


Here is the full list of pundits, ordered from most accurate to least, along with how many observations I collected of each:

These aren't perfect comparisons because I couldn't find every pundit's mock for each year of every other one (although if I wanted to just compare 2013 I probably could to accurately rank them as of last year).  But it is more for overall accuracy generalizations.  Really what this says is that Todd McShay is better at predicting a prospect's eventual draft value based on JJ's chart better than his contemporary at ESPN, the original draft don, Mel Kiper.