Fantasy Baseball Advice

Archive for the ‘Rudy Gamble’

Hot Hitter and Hot Pitcher Player Raters Now Available!

May 11, 2012 By: Rudy Gamble Category: Player Raters, Rudy Gamble 19 Comments →

We’ve added two new data grids to our Fantasy Baseball Player Rater to help you identify streaking hitters/pitchers (streaking in the non-Ferrellian sense):

  • Hot Hitters:  This has hitting stats for the past 20 days of all hitters with 1+ AB.  Besides your typical 5×5 stats, it includes BABIP, OBP, OPS, SLG, and K%.  Players are ranked in descending order of their ‘Heat Index’ which is calculated using a mix of Hits, Runs, HRs, RBI, SBs, and ABs.  Each player is indexed against the 156th most valuable hitter for the period (156 hitters are active on a given day in a 12-team league).  While it isn’t possible for us to know if he’s available or not in your league, we provide pre-season and in-season $ estimates (based on 12 team 5×5 ESPN rosters) – the higher those values, the more likely a player is already owned.
  • Hot Pitchers:  This has pitching stats for the past 20 days of all pitchers with 0.3 IP.  Besides your typical 5×5 stats, this includes FIP, Blown Saves, Holds, K/BB, K/9, and Quality Starts.  Players are ranked in descending order of their ‘Heat Index’ which is calculated using a mix of Wins, Saves, Earned Runs, Hits, Walks, Innings, and Holds.  Each pitcher is indexed against the 108th most valuable pitcher for the period (108 pitchers are active on a given day in a 12-team league).  Pre-season and in-season $ estimates (based on 12 team 5×5 ESPN rosters) are provided for each player to help identify players more likely to be free agents in your league.

The inaugural #1 hot hitters/pitchers are Carlos Gonzalez (edging out Josh Hamilton) and Johnny Cueto (edging out CC Sabathia).

As with our other Player Raters, the grids are sortable and you can filter based on position (including SP vs. RP).  The data should update every weekday by around 10AM EST – the last column will indicate the last day’s worth of games that are included.

If you see a player missing or set at the wrong position, please mention it in the comments section of the latest post.  Please note that players just called up may take a week or so to be added.

Introducing the Razzball Player Rater + FIP/ERA & BABIP/AVG Comparisons

April 18, 2012 By: Rudy Gamble Category: Player Raters, Rudy Gamble 100 Comments →

With great pride and bland post titling, I’d like to announce a Beta release of our fantasy baseball in-season player rater as well as two charts that highlight the differences between pitcher FIP vs. ERA and batter BABIP vs. AVG.

The player rater work is an adaptation of the Point Shares methodology I’ve used the last couple of years for pre-season and post-season player estimates.  Here is a link to a favorable test I did earlier this year vs. ESPN’s player rater methodology.  After some trial and error plus assistance from a variety of folks (Eric K at my favorite fantasy baseball escort service – EliteFantasyPlayers.com - and Doug at Dougstats.com among others), we now have a fairly automated system for updating in-season player rankings on a daily basis.

The Razzball Player rater is at –> Fantasy Baseball Player Rater and covers the following 5×5 league formats:

  • ESPN Roster format (C/1B/2B/SS/3B/5 OF/CI/MI/UTIL/9 P) – 10 Team / 12 Team / 14 Team / 15 Team / 16 Team MLB
  • Yahoo! Roster format (C/1B/2B/SS/3B/3 OF/2 UTIL/2 SP/2 RP/4 P) – 10 Team / 12 Team / 14 Team / 15 Team / 16 Team MLB
  • AL-Only (2 C/1B/2B/SS/3B/5 OF/CI/MI/UTIL/9 P) – 10 Team / 12 Team
  • NL-Only (2 C/1B/2B/SS/3B/5 OF/CI/MI/UTIL/9 P) – 10 Team / 12 Team

The table is ranked based on a players’ projected Point Shares (a player’s value in standings points vs. the average player with some factoring in of position).  Dollar estimates are provided both for in-season as well as comparisons vs. pre-season estimates.  Take the dollar estimates with a grain of salt for now – they should become more stable as the season goes on.  You can filter by position (P for all pitchers, -P for all hitters) and sort by any of the columns (1 click ascending, two clicks descending).

There are two pages focused on popular hitter/pitcher stats outside of 5×5 (popularity based on our pre-season poll results).  These tables are filterable/sortable as well.

  • Hitting – OBP, SLG, OPS, Hits, Total Bases
  • Pitching – Quality Starts, Holds, Losses

Lastly, there are two tables that highlight differences between pitcher FIP vs. ERA and hitter BABIP vs AVG.

  • The pitcher table is sorted based on the ‘luckiest’ pitchers – i.e. pitchers ranked in descending order based on the difference between their FIP and their ERA.  For those wondering why I chose FIP vs. xFIP, I do not have access to the league-average fly ball to home run ratio nor pitcher HR:FB ratio.  You may also find that my FIP estimates are slightly off from other sources – this is mainly because I cannot currently separate out intentional from non-intentional walks but it can also be due to how the ‘constant’ is applied to bring the league average FIP in the 3.20 range.
  • The hitter table is sorted based on the ‘luckiest’ hitters - i.e. hitters ranked in descending order based on the difference between their current AVG and their expected AVG.  A hitter’s expected AVG is calculated by applying a hitter’s 3-year BABIP to their in-season performance.  3-year BABIP was used as this stat does vary per hitter based on various factors (line drive rate, their speed, GB to FB ratio, etc.) but a hitter’s BABIP tends to be steady in the long run.  Hitters with less than 100 AB in the previous 3 years are given the league average BABIP of .300.

I’ll do my best to keep these tables updated daily (generally by 10 AM EST).  The last column of each chart reflects the last games included so it will be transparent when it has not been updated for a couple days.  While I will do my best to keep on top of the moving pieces, please do not hesitate to provide the following information in the comments section of Grey and/or my posts:

  • Any missing players from the tables (for now, I’m including any hitter/pitcher with 1+ AB or 0.1+ IP.  That minimum threshold will likely increase as the year goes on.
  • Any position eligibility changes based on 10 game in-season eligibility (I know Yahoo! is 5 games but prefer to make one change across both).  For hitters where position eligibility seems imminent (e.g., Jesus Montero at catcher), I include the additional position and add an asterisk at the end of it.
  • Any wonky data or functionality

Other potential FAQ:

  • Will you ever have a ‘rest of season’ player rater?
    • Maybe.  Would be dependent on a respected projection source providing an uploadable file that is 1) updated on a regular basis, 2) accounts for expected playing time, and 3) is free.
  • Will you create a dynamic player rater to reflect any conceivable league format?
    • Not planning on it.
  • Was your wife turned on by this accomplishment?
    • Nope.  She prefers it when I go Don Draper and fix shit around the house in a white t-shirt.

Razzball’s 2012 DraftDay 10 Team AL-Only Draft

April 06, 2012 By: Rudy Gamble Category: Our Leagues, Rudy Gamble 12 Comments →

Over the past 2 years, Grey and I have had several conversations around joining a high-stakes baseball league.   We are intrigued by the NFBC  but our math keeps suggesting that their rake is too high (e.g., I calculated a 20% rake on the $150 slow draft).

We decided to take the plunge this year with a league consisting mainly of poker degenerates (Derek Carty of BaseballProspectus is the only other ‘pert).  The league is sponsored by daily fantasy sports site DraftDay (“Where every day is draft day!” exclaims Rudy Gamble) with the fantasy baseball league’s blog hosted at http://www.ddfantasybaseball.com.

This was the first time that Grey and I have been in a 10-team AL auction.  I’ve been doing an expert 12-team AL auction the past 2 years and Grey popped his AL-only cherry in a 12-team CBSSports AL league we are co-managing (FWIW, that CBS team is my least favorite team going into the season).

There were two quirks to the draft:

  1. The $260 could be used to fill bench spots as well.  Once every team with $ has filled all their starting + 5 reserve spots, the remaining teams fill out the rest of their rosters via a snake draft.
  2. The draft was done via an AIM chat room + Skype

The first quirk plays to one of our strengths as we tend to have a little money left over at the end of the draft.  So this could allow us to stock up on some reserves with assured playing time or high-end prospects.  The second quirk made it impossible for Grey to bid so he listened in via Skype while I did Razzball’s bidding (cue evil laugh).

Below is our team.  Here are the full draft results (along with Point Share $ per player at a straight 154/96 Hitter/Pitcher split):

Position Player Auction $ Point Share $
C Yorvit Torrealba $2 ($1)
C Salvador Perez $4 ($3)
1B Adrian Gonzalez $33  $28
2B Jemile Weeks $14  $10
SS Cliff Pennington $7  $9
3B Evan Longoria $31  $28
OF Curtis Granderson $29  $30
OF Adam Jones $22  $21
OF Peter Bourjos $18  $13
OF Luke Scott $5  $7
OF Eric Thames $6  $8
1B/3B Brent Lillibridge $2  ($7)
2B/SS Gordon Beckham $6  $6
UTIL Bobby Abreu $1  $6
SP Jon Lester $22  $26
SP Colby Lewis $14  $19
SP Chris Sale $9  $18
SP Jake Peavy $6  $9
SP Tommy Milone $3  $11
SP Kevin Millwood $2  ($3)
SP Blake Beavan $0  ($1)
RP Jordan Walden $12  $15
RP David Robertson $2  $8
Bench OF Mike Trout $4  $0
Bench 2B/SS/3B Robert Andino $3  $1
Bench OF Ryan Kalish $1  ($15)
Bench SP Danny Hultzen $2 NA
Bench RP Francisco Cordero $0 $5
Sum $260 $272 (not inc. Kalish)

One constant throughout our drafts this year has been a concern for value at 1B/3B.  We’ve gotten a 1B every time in the first round and snagged Longoria in the 2nd when available and punted for someone like Moustakas in late rounds.  Thus, it should come as no surprise that we budgeted $35 for A-Gonz (assuming M-Cab and Pujols would go for more) and $33 for Bautista or Longoria.  We were psyched to nab A-Gonz and Longoria for $2 less than budgeted (and bumped Bautista up to $34 in the process for a competitor).

Our third offensive pillar was an OF in the $25-$30 range.  We got Granderson at $29 but don’t love the pick given that OFs went for less than I expected – e.g., Hamilton for $25, Cruz for $23, Choo for $22.  The prices were discounted enough that we nabbed a 2nd strong OF in Adam Jones.

I overpaid on Bourjos but we needed speed – Grey was pissed that I didn’t bid more aggressively on Gardner who went for a fair price at $22.  I think I’d be a bigger fan of Gardner if he had either HR or AVG upside but I don’t think he has either.  I addressed speed as well by only going $1 over the budgeted $20 on the 2B/SS pair of Jemile Weeks and Cliff Pennington.  The best thing I can say for the rest of the hitters is that they’ll have solid playing time and we may have some upside in June with Mike Trout, Ryan Kalish, and Salvador Perez.  I’m not thrilled about getting stuck with Abreu after no one topped my $1 bid but hopefully he’ll get 300+ AB with the Angels or another team.  Also, while I’m glad I didn’t get caught overbidding on Valencia or Betemit, it’s TBD whether Lillibridge gets enough playing time to be an adequate CI.  I had Parmelee on my ‘late round’ checklist and wished I got him for $1 during the later rounds.

As for pitching, I really wanted an ace that wouldn’t cost more than $24.  I went last year in an AL 12 team with Hellickson and Phil Hughes as my aces.  Our 2012 CBSSports AL team has Justin Masterson as the ace.  Thus, I was happy (Grey less so) that we were able to nab Lester for only $22.  Colby Lewis is a solid #2, Sale/Peavy make for higher risk/upside #3/#4, and we got an Athletic (Milone) and three Marginers on the cheap in Millwood, Beavan, and Hultzen (rookie who could get called up in May/June).   Real happy to get such SP depth in a league like this as it can cost a lot of FAAB to acquire it once the season starts.  We only needed one closer and Walden is fine at $12.  K-Rob seems like a bargain at $2 given his K-rate and that he’s next in line for saves in New York in the spare chance that Mariano Rivera ever ages.  F-Cord was our last pick who’ll generally be on the bench (it’s a weekly league) but might deliver some cheap saves if Santos gets hurt.

Overall, I think we have a contending team.  I don’t think we have any weak spots, we have decent depth, and have a good mix of reliable and high upside players.  Our luck, the shitty CBSSports AL team will catch all the breaks (1st prize – you can mention you won on your own blog!) and this team will implode.

Review of 2011 Fantasy Baseball Player Rankings

April 03, 2012 By: Rudy Gamble Category: Rudy Gamble, Testing Projections + Player Raters 109 Comments →

In a previous post, I laid out a methodology for testing fantasy baseball player rankings/auction values and all the components involved in projecting player values.  I got feedback from some smart folks that didn’t ‘get’ the test.  Since the common variable in that equation was me, I’m going to try explaining it one more time before I jump into the results of my test across 14 player rankings across 12 sources (2 f0r ESPN & Razzball) + the Average Draft Position (ADP) for the 456 (38 leagues of 12 teams) Razzball Commenter Leagues participants.  (feel free to skip the next paragraphs if you just want to see the results).

There are three main components to developing pre-season fantasy baseball rankings:

  1. Playing Time Estimates (PA/AB and IP)
  2. Statistical Projections (HRs per AB, K/9, etc.)
  3. Methodology For Converting #1 and #2 Into Player Rankings/Value

Most player rankings are published as ‘Top 200′ or ‘Top 300′ with no stat projections.  I call these ‘curated’ lists.  Each curator creates their list differently but I’d gather that they probably all use some source for Playing Time and Stat Projections and then use their fantasy experience to determine each player’s value (vs. an actual formula).  For testing purposes, you have to test the composite effectiveness of these three variables since they aren’t explicitly listed in the rankings.

It would seem straightforward to just test each Player Ranking (or isolated component) against the end of year results.  Matt Swartz of FanGraphs did a great test of Projection systems isolating wOBA and ERA.  But here are the challenges that I see for such a test to have fantasy baseball relevance:

  1. The test needs to consider all the fantasy baseball categories.  If you just focus on ERA, what about Wins, WHIP and K’s?  How would that help with Closers?  So you would need to figure out a way to test and properly weight each statistical category.
  2. There is a BIG difference if your pre-season ranking screw up the value of a Top 3 round player vs a late round player.  So you would need to figure out a way to weight players based on their likely draft status.
  3. If a player misses significant playing time (for a hitter, let’s say 30+ games), the timing and sequencing of these missed days as well as the availability of waiver/FA pickups plays a major role in terms of the player’s impact on a team’s success.  For instance, a player like Chipper Jones who might miss games throughout the season is harder to replace than Nelson Cruz who goes on 15 day DL trips.  If a player gets sent down before opening day (like Lonnie Chisenhall), it’s even easier to adjust for the loss in expected playing time.  So you would need to credit replacement level performance that varies depending on the timing/sequencing of missed playing time.
  4. The timing and sequence of a player who underperforms can dramatically change how a player impacts one’s fantasy team.  Let’s say Player A and Player B had equal pre-season rankings and both underperform, hitting .220 with 15 HRs for the season.  If Player A goes .150 with 0 HR in April and Player B goes .240 with 3 HR, Player A will likely be dropped quicker and that team might find a replacement player who performs above replacement value.  So you would need to account for how quickly/slowly a player was replaced as well as estimate the impact of the replacement player.

Now, I can see an argument that particularly #3 and #4 come down to chance vs. a prognosticator’s skill.  But that’s not entirely true.  Some players are more injury-prone than others and they may be marked down accordingly (e.g., I knocked Kinsler’s playing time down about 50-75 PAs from my sources which took his value down about 10 spots in the rankings.  Shouldn’t I be credited/hurt because of that choice?).  And while there is some chance involved, I’d argue it’s still better to reflect the real impact these chance instances had on teams vs. find ways to remove them (like testing a rate stat like HR per AB instead of total HR).

So here is the test I put together that I think addresses these ‘near impossible to model’ variables:

  1. Take the draft results by team from the 38 Razzball Commenter Leagues in 2011 (hosted on ESPN using ESPN’s default league formats for 12 team 5×5 MLB leagues).  This amounts to 456 teams’ worth of draft data.
  2. Create team total values based on ‘expert’ rankings/$ totals/other arbitrary metric (like Point Shares or THT Z-Score)
  3. See how these team totals correlate with each team’s final Total Standings Points

Since we’re testing based on a team’s pre-season aggregated player value and their end of year Total Standings Points, we are factoring in all the categories (#1).  The pre-season rankings provide a natural way to weight each player’s value/impact by matching them up against ranked auction dollar amounts (#2).  Since the end of year Total Standings Points reflects how fantasy baseball managers behaved when facing situations involved lower than expected playing time or performance, it accounts for these two last variables (#3 and #4).

Hope that makes sense to everyone!  Now on to the good stuff!

2011 Pre-Season Rankings Tested (click here for the aggregated results, links provided for rankings that are still posted):

Here are some general notes before I start throwing data out:

  • Most rankings do not provide $ estimates.  Since there is a larger gap in value between earlier draft picks vs. later (e.g, average gap between 10th and 11th best players greater than difference in 150th vs 151st best players), I converted all rankings into dollar estimates by providing the $ estimate for the corresponding rank from my Point Shares.  I used the published dollar estimates if they were available (vs forcing my $ estimates).  For HardballTimes and my Point Shares, I used the player scores since they estimate the value between picks (vs. just an arbitrary 1 between picks when done as rankings).
  • I believe all these rankings were released between Feb 1 and March 30th with the majority in the March time frame.  To be fair, I gave everyone the same values for the following players whose value dropped significantly during Spring Training – even if they had not ranked them.  The values are based on my Point Share value as of late March (I put a Z-score equivalent to $6 for THT):
    • Adam Wainwright – $0 – Tommy John surgery
    • Chase Utley – $6 – Knee issues became more problematic
    • Kendry(s) Morales – $6 – Comeback plans hit a snag
  • Most rankings do not specify the league format (# of teams, positions, etc).  Since the Razzball Commenter League format is about as standard as it gets (12 team, 5×5, ESPN roster format), I thought it was still fair to include in this test.  When possible, I used a source’s ’12 team MLB’ rankings/estimates.
  • Some rankings (ESPN/Matthew Berry, KFFL, USAToday) ranked only 200 players.  I tested the impact of adding the next 100 players based on a composite of the other rankings and the correlation percentages decreased.  I didn’t feel this was fair so I kept it as just the top 200.
  • Any player not in a source’s rankings who was drafted was valued at $0.
  • I capped (or is it floored?) any estimates at the equivalent of $0 as only some sources such as Point Shares and Last Player Picked report negative dollar values for players.  This is probably for the best, anyway, as players with negative projected value before the draft are dropped like luxury good brand names in rap songs – early and often.
  • In the previous post, I tested whether there was a clear bias in the RCL teams’ draft behavior.  The ADP of the RCL teams’ correlated closer to the ESPN Top 300 (96.7%) than either Grey’s rankings (92.6%) or my Point Shares (81.5%).  While I don’t have a second non-RCL sample to confirm, I would theorize the largest bias in the RCL teams’ behavior is driven by ESPN being the draft host and providing default rankings.

Here are the test results – see the following file for the raw results including the draft picks per team and the total standings points per team:

Chart #1:  Correlation % Between Team Final Standings’ Points & Team Drafted Player Projected Value By Rankings Source 

Rank Source $ Converted Correlation
1 Razzball – Point Shares (Late March) N 8.0%
Razzball – Point Shares (Late March) Y 7.7%
2 Razzball – Grey’s Rankings Y 7.7%
Razzball Point Shares (March 8th) N 6.8%
Razzball Point Shares (March 8th) Y 6.6%
3 RotoChamp top 300 Y 0.0%
4 HardballTimes - Jeffrey Gross (Z-score) N -0.9%
5 RotoExperts Top 300 Y -3.2%
6 KFFL Top 200 N -3.5%
7 FantasyPros Aggregated Top 300 Y -3.88%
8 USAToday Top 200 Y -3.93%
9 RCL ADP Top 100 Y -5.0%
10 Last Player Picked N -5.8%
11 RCL ADP All Y -6.1%
12 SI.com top 300 Y -7.7%
13 CBSSports Top 300 N -8.0%
14 FoxSports Top 300 N -8.1%
15 ESPN Berry Top 200 Y -9.3%
16 ESPN Top 300 N -12.2%

 

For those that care about this sort of thing, here is a link that tests the Point Shares (Late March) against the other sources.  Other that Grey’s rankings, Point Shares performed better at a 99.9+% statistical confidence level.  This means that – based on these results – it would have lost to one of the other sources in less than 1 in 1000 instances.

General takeaways (all specific to the 12-team MLB 5×5 format although I imagine much of it would apply to other formats):

  • The vast majority of pre-season rankings have a slight negative correlation with projected team performance.  Even the few that were positive aren’t very positive (8% being the high) when you consider the previous test showed that 64% of a team’s success is correlated to the actual performance of their draft picks.  It’s likely there are high-stakes fantasy baseball players or subscription sites who could exceeded this 8% but, for now, it’s the ceiling.  So I surmise that…
    • Somewhere around 55% of fantasy baseball team performance is driven by drafted players performing above/below consensus expectations (including injuries) – or, in other words, luck.  (Note: This isn’t the sum of all luck as I would think there is also luck involved around in-season pickups performing above/below consensus expectations)
    • The delta between the best performing rankings and worst performing rankings (~20%) is perhaps a rough estimate of the true difference between the best and worst drafted teams prior to the season (assuming the worst drafter didn’t veer too far from ADP).
    • Further proof can be seen in the nominal difference (-5.0% vs. -6.1%) between the ADP of the top 100 finishing RCL teams vs. all 456 teams.  The Top 100 teams clearly drafted  better judged on final season performance but it couldn’t have been predicted to any significant degree before the season started by any of these sources (and, I’d surmise, anyone)
  • Pre-season standings calculations are – by and large – a waste of time and energy unless it can be shown that the source’s stat + playing time expectations greatly exceeds the 8% ceiling found in this study (i.e., Having the most Point Shares $ value after the draft would increase one’s chances of winning by a negligible amount vs. 1/12th of a percent in a 12-team league) 
  • RCL ADP’s correlation for the Top 100 and All Teams is further from 0% than I expected.  I have a theory later in the post on why.
  • The small delta (0.2-0.3%)  between the $-converted and non-$ converted Point Shares calculations (March 8th and Late March) is a positive sign that no ranking source was significantly helped/hurt by the $ conversion process.
  • Aside from major injury news (Wainwright, Utley, K. Morales), the learnings from early March until opening day are fairly minor.  Point Shares improved from 6.8% to 8.0% in correlation.  This difference is statistically confident at an 81.3% level – so it’s meaningful but not overwhelming so.  So for you multi-league drafters who have a late March draft, don’t feel too much pressure to update your rankings (I would scan for injuries/playing time shifts though).
  • Combining/averaging rankings (like FantasyPros.com does) pays some dividends but is no panacea.  I use multiple sources for both my stat projections and playing time estimates based on the belief that my rankings are more likely to suffer from an outlier than benefit (case in point, if you used just Oliver like THT, you’d have Juan Francisco as a top 10 player in 2011).  But if you are just combining a bunch of ‘safe’ rankings (the next section will define this further), you are not removing any risk.  You are just creating one big vanilla-flavored rankings porridge.  I’d rather identify a base rankings source (I’d recommend Point Shares) and then average it with a 2nd source as a sanity check
    • I averaged my Late March Point Shares with Grey’s rankings and got 8.1% (vs. 8.0% for Point Shares alone).  So no major gain but it didn’t hurt either.
    • I averaged my Late March Point Shares with FPro’s rankings and got 2.76%.  So adding in the safer rankings just dragged Point Shares down towards mediocrity.

Personal takeaways:

  • I’m obviously quite happy to see how (relatively) well my Point Shares did – although it’s humbling how small a percentage it explains in team performance.  Here’s the humbling math – if one team in a 12-team league used +8% correlated rankings (Point Shares) and the others used -8% correlated rankings, that would increase the +8% team’s chances of winning from 8.33% (1/12th) to 9%.  Perhaps that explains why Grey and I didn’t have a ton of fantasy baseball success last year despite doing so well in this test.  (That and Mornoooooooooooo!)
  • I can’t believe Grey did so well.  Given that he published them in February and his percentages beats my March 8th estimates, I’d say he’s the real (if not statistically significant) winner.  It’s quite annoying because it makes this study seem rigged – all I can say is that I did not make any changes to all the sources’ rankings (other than the 3 players noted ab0ve),  RCL Draft results, or final standings.

I ran two correlations to better understand the similarity (or lack thereof) between the various rankings.  The first chart (Chart #2) shows how each source’s player rankings correlates against Point Shares, Grey’s Rankings, and FantasyPro’s aggregated rankings (average of 18 separate rankings).  The second chart (Chart #3) shows how each source’s projected team values correlate vs those three sources.

Chart #2:  Correlations of Each Source’s Player Rankings vs. Point Shares, Grey’s Rankings, and Industry Average (Sorted by Uniqueness to FPRo Aggregated Rankings)

Rankings Correlations
Source  Point Shares (Late March) Grey’s Rankings FantasyPro Aggregated Rankings
HardballTimes – Jeffrey Gross (Z-score) 57% 62% 67%
Razzball – Point Shares (Late March) 100% 73% 82%
CBSSports Top 300 82% 79% 85%
KFFL Top 200 74% 71% 85%
Rotochamp – Top 300 81% 77% 86%
Last Player Picked 90% 79% 87%
Razzball – Grey Rankings 73% 100% 89%
ESPN Berry Top 200 78% 79% 89%
FoxSports Top 300 70% 82% 89%
SI.com Top 300 80% 83% 91%
ESPN Top 300 80% 85% 92%
USAToday Top 200 78% 80% 93%
RCL ADP Top 100 85% 90% 93%
RCL ADP All 84% 91% 93%
RotoExperts Top 300 83% 90% 94%
FantasyPros Aggregated Top 300 82% 89% 100%
Average 78% 81% 88%

Chart #3 Correlation of Team Projected Values By Each Rankings Sources (Sorted by Uniqueness to FPro Aggregated Rankings)

Team Projected Value Correlations
Source  Point Shares (Late March Grey’s Rankings FantasyPros Aggregated Rankings
Razzball – Grey Rankings 2% 22%
HardballTimes - Jeffrey Gross (Z-score) 57% -7% 37%
Razzball – Point Shares (Late March) 2% 59%
RotoChamp top 300 67% -15% 61%
ESPN Berry Top 200 37% -4% 63%
Last Player Picked 73% -21% 64%
RCL ADP Top 100 45% 39% 66%
RCL ADP All 43% 40% 68%
CBSSports Top 300 52% 1% 70%
KFFL Top 200 49% 8% 72%
ESPN Top 300 41% -9% 73%
FoxSports Top 300 36% 17% 74%
USAToday Top 200 49% 6% 78%
SI.com top 300 44% 16% 78%
RotoExperts Top 300 47% 31% 80%
FantasyPros Aggregated Top 300 59% 22%
Average 47% 8% 64%

Some observations:
  • While Chart #2 is a more straightforward test (e.g., compares rankings directly vs. running the results through 456 RCL teams), I think Chart #3 is the better test.
    • Example #1:  Grey’s rankings look close to the other systems in Chart #2 but are wildly unique when valuing RCL Teams.  If Grey’s rankings were as close as Chart #2 suggests, his team values wouldn’t have been so divergent from the rest of the sources (8% correlation is really low)
    • Example #2:  Point Shares should correlate highest with three other automated/quant-based systems (HardballTimes, RotoChamp, Last Player Picked).  This is not the case in Chart #2 but clearly the case in Chart #3.
  • The four most unique rankings in Chart #3 finished in the top 4 in correlating to team success while the 5th (Matthew Berry) finished 2nd to last.  I don’t think this isn’t a coincidence – the most unique rankings should be furthest above/below the consensus rankings.
  • It is odd how ESPN’s Top 300 could finish last and yet be so safe in terms of similarity to consensus rankings.   FantasyPro’s Aggregated Rankings finished middle of the pack so there appears to be some safety in consensus.  Seems most likely that ESPN just had some bad luck.
  • The 4 quantitative-based solutions (HardballTimes, Point Shares, Rotochamp, and Last Player Picked) finish in the top 6 for uniqueness.

Two unsubstantiated theories:

  • I have no idea how to prove this but here’s a theory for why so many rankings are below 0%….Most of the ‘curated’ rankings reflect conventional fantasy baseball thinking (e.g., don’t draft pitchers in the first 15 picks).  This conventional thinking either feeds or just mirrors what ends up as the default rankings within draft software.  Weaker players lean on the default rankings more than stronger players.  While success in a 12-team mixed league requires a lot of luck, there is enough skill during the draft (and in post-draft roster moves) that weaker players in aggregate will perform worse than stronger players.  If weaker players depend more on default rankings/ADPs than stronger players, a negative correlation would arise between team success and any ranking system similar to default rankings.  (If correct, this also means that if the RCL somehow used Grey’s rankings or my Point Shares as the default rankings, they’d automatically fare worse in a test like this.)
  • The common advice of “Zag when others zig” seems true for both experts who publish rankings and fantasy baseball players who seek those rankings out.  If I was curating a rankings list, I’d follow Grey’s lead and take a lot of chances.  (We’ll see if Grey has similar success in 2012).  ’Safe’ rankings have value only if people are drafting without default rankings (or with really bad default rankings).  If I were building a system from scratch to quantify player values, I would do my best to avoid using traditional rankings as a benchmark (I’d also advise against this because there’s a lot more learning curve than you think….I’d just use Point Shares for my draft and invest that time doing something that might get you laid like learning to play guitar.)

Other Notes:

  • I plan on running a similar test at the end of 2012.  We’ve got about 10 more RCLs than last year (38 to 48) – more sample is always better.
  • Since I got such a late start on this analysis, I’m going to hold off analyzing stat projections (Marcel, ZiPs, Steamer, etc.) until the offseason and have 2 years of data to reference.  I”ll only be including projections that are directly available for users.  Projections available for subscription will require direct permission from the publisher.
  • The worksheet provided in Google Docs is considered public domain – feel free to create and publish complementary or contradictory analyses  with it.  Please just link to this post and note the data is available courtesy of Razzball.

Final Note:

Grey & Rudy’s Drafts In The 2012 Razzball ‘Expert’ League

March 29, 2012 By: Grey / Rudy Category: 2012 Fantasy Baseball Draft, Our Leagues, Rudy Gamble 204 Comments →

As we mentioned earlier this month, we created an ‘expert’ league that follows the same rules as the Razzball Commenter League and will be included in the master standings.  Will the Expert League reign supreme (Iron ChefTM) in competitive index or will several RCL leagues put the experts in their place?  We shall see…

Here are the participants in the first annual Razzball ‘Expert’ League (links if they posted a draft review):

Razzball – Grey Albright
Razzball – Rudy Gamble
Yahoo! – Brandon Funston
Yahoo! – Scott Pianowski
Yahoo! – Andy Behrens
FanGraphs – Eno Sarris
Hardball Times – Jonathan Halket
MLBTradeRumors.com/RotoAuthority – Tim Dierkes
Mastersball – Ryan Carey
Rotowire – Dalton Del Don
SI.com – Eric Mack
Steamer Projections – Dash Davidson

Here’s a link to the entire Draft Recap:

Grey:

As mentioned in our 2nd podcast, ESPN screwed me for messing with them for the last five years.  Right before my 1st pick, my computer crashed.  Here’s me during the draft.  “Hey, I have the 7th pick.  Awesome.  I’m gonna have a 1st baseman.  I might even get Votto.  I wonder who that lady is watering her lawn across the street.  Maybe I’ll stand up carefully to make sure I don’t knock over my coffee and get a better look–NOOOOOO!  Crap, mother-effin’, son-of-a-motherless-goat!  Reboot!  Reboot!  Reboot!  Okay, it’s rebooting… I have a minute and thirty seconds… Reboot!  DAH!  I drafted Robinson Cano!”  And then that dictated just about all my other hitter picks.  Since I had Cano, I couldn’t grab Kinsler, didn’t want a shortstop and the only 1st baseman or 3rd baseman within the vicinity was Tex and I wasn’t drafting him with my 18th pick.  So I took Giancarlo.  Then I really felt like I needed to make sure I had some sorta corner man so I reached for Zimmerman.  Not feeling totally comfortable with Zimmerman as my 3rd baseman, I reached for Hosmer for my other corner.  Then I felt like if Zimmerman got hurt again, I should have another 3rd baseman, so I grabbed Aramis, then I realized later on that Aramis wasn’t a clean bill of health either so I grabbed Chisenhall.  Then I dropped Chisenhall when he was demoted and grabbed Smoak for the two game Japaning Day, then, when those games ended, I grabbed Eric Thames.

I may have 5 aces when it’s all said and done.  I wouldn’t even need Gio on this staff, but he fell so far down that I wasn’t going to let him go.  I’m not worried about saves, even if my closers are little iffy.  SAGNOF!  Since I had Cano and Hosmer, I took some guys that may be average drains, but should give steals and power.  Though, I do think average will be one of my biggest concerns.  In true Grey fashion (I love to pick up and drop players and talk about myself in third person), I’ve already made a few moves on pitching too.  Dropped Fuentes (right after Balfour became the closer) and grabbed Bourgeois.  Bourgeois is the kinda of guy that if he sneaks into a large playing role or if I switch him in only when he plays, he could get me 30 cheap steals.  SAGNOF!  I dropped Stauffer and grabbed Lidge when Storen was hurting (Clippard was drafted) and dropped Crain for Henry Rodriguez.  It’s a bit of a shizzshow, but, in some ways, I like to be able to juggle my last roster spots so I don’t care I wasted a pick on Chisenhall, Fuentes, etc.  Rudy gets a lot more tied to his drafts than I do.  In the end, I think I still have a solid team.  By the time you read this, I may have made three more pick-ups and drops.

Grey’s RCL Draft
Position Player Round/Pick
C Geovany Soto R23 Pick 271
1B Eric Hosmer R4 Pick 42
2B Robinson Cano R1 Pick 7
SS Zack Cozart R17 Pick 199
3B Ryan Zimmerman R3 Pick 31
OF Giancarlo Stanton R2 Pick 18
OF Brett Gardner R6 Pick 66
OF Krispie Young R7 Pick 79
OF Alex Rios R14 Pick 162
OF Peter Bourjos R19 Pick 223
1B/3B Aramis Ramirez R8 Pick 90
2B/SS Aaron Hill R16 Pick 186
UTIL Lonnie Chisenhall R24 Pick 282
SP Madison Bumgarner R5 Pick 55
SP Mat Latos R9 Pick 103
SP Anibal Sanchez R11 Pick 127
SP Gio Gonzalez R12 Pick 138
SP Mike Minor R15 Pick 175
SP Jake Peavy R20 Pick 234
RP Jose Valverde R10 Pick 114
RP Huston Street R13 Pick 151
RP Matt Capps R18 Pick 210
Bench RP Brian Fuentes R21 Pick 247
Bench RP Jesse Crain R22 Pick 258
Bench SP Tim Stauffer R25 Pick 295

Rudy:

At this point in the draft season, I’m starting to get predictable in my early round draft behavior.  I was really happy picking 10th with the confidence that either Joey Votto or (more likely) Adrian Gonzalez would fall to me and I wouldn’t have to worry about overpaying for a 1B later in the draft.  As luck should have it, Grey’s computer crashed and he auto-picked Robinson Cano vs. his preferred Joey Votto pick who came gift-wrapped to me at #10.   Longoria was an easy choice at #15 as I figured there would still be top SPs on the board by the time I picked next at #34.  The experts were more aggressive than I figured at drafting SPs however as Halladay, Kershaw, Verlander, Lee, F-Her, and Lincecum were all off the board.  Luckily, I liked Greinke slightly more than F-Her and Lincecum.  But I also liked Jay Bruce for this pick and, in retrospect, probably should’ve gamed Greinke was the more likely of the two to make it me at pick #39.  Hunter Pence was the consolation prize.

I spread out my SP selections and seemed to have a lot of success nabbing K-friendly pitchers (Lester, Beachy, Morrow).  I specifically drafted Lewis and Nolasco in later rounds because of their solid WHIPs (which help balance out Morrow).  For the first time in years, I drafted the first closer off the board (Kimbrel – 6th round/63rd pick) as the value was too great given his obscene K-rate.  Marmol and Putz came at decent values at Rounds 11/12 and I was glad to be done with closers before a closer run occurred (10 closers went in the next 33 picks after Putz).

As for offense, I just drafted for value and was able to avoid inadvertently punting AVG or SBs.  I reached for Jose Altuve whom I think has 30 SB upside with solid AVG and, like several of my teams this year, got solid R/RBI value out of my other MI spots (Alexei Ramirez, Neil Walker).

All in all, this was about as good of a draft as I could’ve hoped for.  I don’t think my team has any major weaknesses and hopefully my team has good injury karma.  It’ll be interesting to see how well I do in this type of format (12 team, daily changes) – especially without Grey as co-manager

Rudy’s RCL Draft
Position Player Round/Pick
C J.P. Arencibia R23 Pick 274
1B Joey Votto R1 Pick 10
2B Jose Altuve R13 Pick 154
SS Alexei Ramirez R10 Pick 111
3B Evan Longoria R2 Pick 15
OF Hunter Pence R4 Pick 39
OF Shin-Soo Choo R7 Pick 82
OF Drew Stubbs R8 Pick 87
OF Jeff Francoeur R16 Pick 183
OF Colby Rasmus R18 Pick 207
1B/3B Gaby Sanchez R17 Pick 202
2B/SS Neil Walker R14 Pick 159
UTIL J.D. Martinez R20 Pick 231
SP Zack Greinke R3 Pick 34
SP Jon Lester R5 Pick 58
SP Brandon Beachy R9 Pick 106
SP Brandon Morrow R15 Pick 178
SP Colby Lewis R20 Pick 226
SP Ricky Nolasco R21 Pick 250
RP Craig Kimbrel R6 Pick 63
RP Carlos Marmol R11 Pick 130
RP J.J. Putz R12 Pick 135
Bench RP Mike Adams R22 Pick 255
Bench RP David Hernandez R24 Pick 279
Bench OF Denard Span R25 Pick 298