Developing Competitive Advantage: A Guiding Framework for Hockey Strategy

This article is being co-posted on Hockey Prospectus as well as on my own site, OriginalSixAnalytics.com. Find me @michael_zsolt on twitter.

 I often write about concepts tied to finance valuation, forecasting, salary cap management, player transactions, and contract negotiations – all of which are extremely important in a salary-capped league. However, when driving towards every team’s ultimate goal – wins – maximizing value will only ever be one part of the solution. Many other factors also play integral roles: coaching, systems, team management, culture, work ethic, among many others. Although these factors are all essential to a team’s success, I believe there is a single, over-arching element that ties them all together: a team’s strategy.

Although this sounds straightforward, it is very far from it. In the simplest sense, a team’s ‘strategy’ represents how it intends to win, and what broad competitive advantages it can develop and maintain over time against other teams. To be clear, ‘strategy’ does not mean ‘systems’. Systems are extremely important and closely tied to strategy, but a team’s strategy is closer to its ‘identity’ – who it wants to be and how it wants to win – while its systems are the scenario-specific on-ice tactics it uses to help win games.

Naturally, having a clear and well understood strategy will directly impact all elements of running that team. A team’s strategy should be guiding its day-to-day (and year-to-year) priorities, how it invests its time and resources, and be the consistent thread connecting everything from its coach selection to its player evaluation and how practice time is spent. Unfortunately, this is much easier said than done.

 ‘Corporate Strategy’

Although everyone tends to have an intuitive grasp of the concept of ‘strategy’, many (especially corporations), frequently fail to pin down exactly what it is. Many corporations have ‘strategic visions’ such as ‘Becoming a $500M company’. While this phrase sounds glamorous, it actually is an objective, not a strategy (and dozens of books have been written about discerning the differences here). ‘Strategy’ relates to exactly how they plan to achieve that objective, and how they will be different and better than their competitors in order to be successful.

The most succinct description of a ‘true’ strategy I have heard, in a business sense, is answering the questions of ‘Where to play?’, and ‘How to win?’. Practically, this will segue into questions like: What industries/sub-industries should a company participate in? Should that company target the mass market, and win by using its large scale to provide the lowest cost product to consumers? Or should it target a specific ‘niche’, become a specialized provider, and sell a high-priced premium product to those who care about it most?

The most important decision coming out of this type of analysis for companies is how to invest their resources (people, dollars, etc.) across all of the activities they are involved in (product design, manufacturing, marketing, sales, R&D, etc.). Resources are inherently scarce, and different strategies will get greater value out of emphasizing and investing in different areas.

Applying Strategy to Hockey Operations

Now, as mentioned, in hockey, ‘strategy’ represents how a team intends to win, and how it can develop and maintain systemic advantages relative to the rest of the league. If a team is choosing to use a heavy, defensive shut-down style such as that of the LA Kings, they are going to select different players, coaches, and systems than if they were trying to use a fast, offensive ‘run & gun’ approach like the Dallas Stars. Once that strategy is determined, many other aspects of decision-making change – for example, I think most of us agree that Dean Lombardi and Jim Nill probably use different criteria to evaluate players, and how well those players fit into their team’s needs.

The most important aspect of effective strategy is making all hockey operations decisions work towards the exact same aim of fostering this on-ice identity. Just like in business, teams that try to be ‘good at everything’ will never be ‘the best’ at anything. Finally, because resources are finite, a true strategy is just as much about defining what a team is NOT going to focus on as it is about determining where it should be investing its time, energy and resources.

 One side note – every NHL team also happens to be a for-profit corporation of its own – so they should each also have a separate, profit-maximizing ‘corporate strategy’, focused on ticket sales, advertising revenue, etc. ‘Hockey operations strategy’ and ‘corporate strategy’ are closely connected – but not the same – and this article will be strictly focusing on the hockey side.

Now – a very important question for strategic analysis is what ‘levers’ are in our control? What factors can a team actually focus on in order to develop sustainable competitive advantages on the ice?

A Guiding Framework to Hockey Strategy

 In order to help think through the components of hockey strategy, I have created a basic framework that deconstructs wins into all of the major sub-components that create them. Naturally, winning starts with scoring more goals than your opponent, so goal differential % (goals for – goals against / total goals) was my starting point.

 Guiding Framework

 The framework above should be pretty objective. Teams win by scoring more goals than their opponents, with PP/ES being the main offensive game states and PK/ES being the main defensive ones. I have tried to further deconstruct each element into its sub-components, before getting to the final blue-shaded oval ‘levers’. For one example – a team could focus on driving goals-for by increasing its conversion rate (shooting %) or by increasing its volume (shot attempts/scoring chances). As I said – this isn’t rocket science.

A couple side notes:

  • Feel free to substitute the final ‘levers’ for whatever metric fits your own analysis; for example, some may prefer to further segment ES Goals-For into chances by Danger Zone, and Danger Zone conversion rates
  • I have listed that PP for and PK against ‘may or may not be influence-able at a team level’ – I personally think this could go either way (e.g. players like Nazem Kadri certainly can and the 2016 SJ Sharks seemed able to). As such, if anyone is aware of a study that shows penalty differential to be a repeatable talent at a team level, please send it my way

OK – we have a framework. How do teams turn these levers into a competitive advantage? Which strategies focus on which levers? To answer these questions, let’s take a look at some of the top teams from the 2016 Stanley Cup Playoffs as case studies.

Core Strategies Displayed in 2016 Playoff Teams

The table below is a summary of four major strategic approaches I have observed in the NHL that hopefully reflect some of the more common and successful strategies that teams use.

Core strategies

As the chart above shows, in a hockey context, the ‘where to play’ and ‘how to win’ questions fall into four major ‘strategic approaches’ existing in the league today. Two of the approaches are singularly offensively or defensively-focused, and two strategies represent more balanced styles of play.

Before getting into the detail, some caveats:

  • This is merely one way to try to categorize potential strategies – I don’t think of this list an exhaustive nor necessarily the ‘best’ way
  • There are likely other effective strategies employed within the league today – for the sake of simplicity I have focused on teams from the 2016 playoffs
  • Some of the teams not listed may either (i) not have a clearly articulated strategy (ii) be executing their strategy ineffectively, or (iii) have chosen a strategy that doesn’t fit well with their player/system/coach choices, (or (iv) I simply haven’t watched enough of their games to know)
  • Please feel free to comment/tweet if you have some ideas for other categories, or additional teams that fit into each bucket

Despite these points of clarification, I think it is safe to say that the 11 teams listed here do have a clear vision of how they want to compete. These teams know how they are trying to win, and when facing an opponent that is trying to be ‘all things to all to people’, I would argue the teams listed have a distinct advantage against any of their less-focused opponents.

In order to understand exactly how these core strategies are used, in the next section I will walk through the fundamental aspects of all four. To do so, I will use the original framework to illustrate the similarities, differences, strengths and weaknesses of each.

 Defensive Shut-Down Strategy (DSD)

 Below I have tweaked my ‘Guiding Framework for Hockey Strategy’ in order to highlight the (typical) strengths and weaknesses of a team employing a DSD Strategy.

Defensive Shut down

 Looking at the chart above:

  • As mentioned, the DSD strategy focuses on using heavy-style players with a very strong fore-check and frequent dump-ins, all in an effort to pin the other team in their own zone, and to prevent any counter attack
  • As you would expect – defensively-minded strategies have the majority of their green-shaded strengths on the bottom half of the framework: suppressing goals/shots
    • LA and ANA epitomize this, finishing 2016 at #1 and #4 in CA/60 in the league
  • The chart above suggests this archetype would be strong in both reducing shot attempts against as well as shot quality against (e.g. improving Sv%, or increasing the proportion of Low Danger shots against); however, some teams may emphasize one of these levers over the other

One thing to keep in mind looking at these charts – I have applied the strengths of the strategy in a general sense, and made the assumption they would apply to both even strength and special team play. In reality, many teams will not necessarily be equally strong at employing their strategy in both ES and special teams situations.

Defensively Responsible, Balanced Strategy (DRB)

 I have omitted the chart for this category, as it looks very similar to the one above, and it can tend to be highly dependent on the specific team. As you would expect however, this strategy is used by teams that take a balanced approach but that still are ‘defense-first’. Teams with a DRB Strategy have very strong defensive cores and play a balanced game, with excellent shot suppression, puck possession, and controlled zone exits. If you think about the defensive ‘core’ embodied on each of the three teams listed (St Louis, San Jose and Nashville), you come across some well recognized and very successful defenders:

  • Alex Pietrangelo
  • Kevin Shattenkirk
  • Jay Bouwmeester
  • Colton Parayko
  • Brent Burns
  • Marc-Edouard Vlasic
  • Paul Martin
  • K. Subban
  • Roman Josi
  • Ryan Ellis
  • Shea Weber (formerly)
  • Seth Jones (formerly)

Hopefully this list serves as an example of the type of defensive strength and depth required to succeed with this strategy. That said, there are definite overlaps between DRB and the second ‘balanced’ strategy, below.

Offensive Play-Driving Strategy (OPD)

Next is one of the strategies most loved by the analytics crowd, emphasizing speed, skill, puck possession and dynamic offense – while often sacrificing or de-emphasizing size. See below for the core strengths of the Offensive Play-Driving Strategy.

Offensive Play Driving

Looking at the chart above:

  • This is one of the strongest archetypes for driving ‘possession’ (shot-rate) stats such as corsi, at both ends of the ice
    • Three of the most successful teams in the last half decade seem to have employed this strategy: Chicago, Tampa Bay, and Pittsburgh
  • These teams excel at all aspects of puck possession, including controlled zone exits and entries, and use their pace and skill to retain and recover pucks in all three zones
  • CHI/TBL/PIT also have among the fastest and most skilled players in the league – with multiple top 3 overall picks in each lineup – signifying the type of high-end offensive and two way talent that OPD requires to succeed
  • While there is not much red in the chart above, I would stop short of saying teams using this strategy ‘don’t have any weaknesses’ – however, it does tend to be one of the most balanced and well-rounded styles, and its weaknesses will largely be team-specific

Earlier I mentioned that teams won’t necessarily fit perfectly into these boxes, and I think the Stanley Cup winning 2016 Pittsburgh Penguins are a great example of this. Although I would argue the 2016 Pens do fit in the Offensive Play-Driving Strategy, Pittsburgh also took a distinctly physical approach to it – emphasizing an extremely aggressive, hard-hitting fore-check. This physicality factor, in conjunction with their incredible speed, was a strong differentiator in the Pens’ cup run that made it very difficult for others to compete.

Offensive Run & Gun Strategy (ORG)

 Last, below is the summary table for the Offensive Run & Gun Strategy:

Offensive Run & Gun

Finally, with respect to the Offensive Run & Gun Strategy:

  • Although out of favour for the analytics community, this is definitely a strategy teams have employed for some time
    • The 2016 Capitals and Stars are arguably two of the most successful versions of this approach
  • Teams employing this strategy are characterized by their high-risk, high-reward approach, playing a very up-tempo and highly skilled offensive style
  • Although the Run & Gun Strategy de-emphasizes defensive structure and shot suppression, teams employing it often make up for this in shot quality, demonstrating some of the highest shooting %’s around the league
  • When compared to the Offensive Play-Driving Strategy, Run & Gun teams differentiate with their back-and-forth style of attack, outplaying teams on the transition, and by capitalizing on increased odd-man rushes throughout each game

Last, for the ORG strategy to work, often it requires an ‘elite’ level goaltender to shore up the defensive side of the equation for his team. This was demonstrated in 2016 both by Holtby’s consistency helping Washington be a legitimate contender and how the lack of consistent net-minding in Dallas was seen as the biggest barrier from them being able to do the same.

Final Thoughts: Strategy & Player Evaluation

Although this is already 2000+ words, there is of course much more to be said on the topic of strategy. Deciding on a strategy is simply the first step in a very long, difficult process of managing a team towards it, and implementing it effectively. A team’s strategy will impact coach selection, practice time usage, game planning, the decision of investing in analytics (or not), and all other aspects of its operations. Above all, it should be one of the most significant factors driving a team’s roster construction decisions, and the characteristics of players they are prioritizing.

A great example of this was last years win-win trade between PIT and ANA, swapping David Perron for Carl Hagelin. Perron was an under-utilized asset in Pittsburgh’s fast system, and Hagelin didn’t have the size that ANA wanted to play their heavy, slower style. After the trade, both players clearly hit their stride, substantially increasing each of their production rates on their new teams. I think this tells us an incredibly important and under-appreciated point – that player evaluation is never an ‘absolute’ exercise – rather, each player’s value will be in part based on his innate capability, and also in large part based on how well he fits in and contributes to the strategy, identity and system of his team.

Conclusion

To wrap up, I will point out that I personally haven’t commented or concluded that any of these strategies are the ‘best’. Just like in business, no strategy will ever be perfect, but there will always be one that is the best fit for each team based on its current roster, resources, strengths and weaknesses, and financial situation. I believe that one of the most significant factors in a team’s success is how cohesively and clearly the strategy, capabilities, and end-to-end decisions made across a team’s hockey operations fit together – and how disciplined they can be in maintaining their approach over 5+ year horizons. The only thing worse than not having a clear strategic direction is to attempt to pick one, second-guess it, and then continually turn an organization upside down every 1-2 years.

Valuing Stamkos: Estimating What Steven’s Next 7 Seasons are Worth

 This article is being co-posted on Maple Leafs Hotstove as well as on my own site, http://www.originalsixanalytics.com. Find me @michael_zsolt on twitter.

 All season long, Toronto fans have been talking about Steven Stamkos. It is well known that Stamkos will be an unrestricted free agent (UFA) this July. This means that – you guessed it – Steven Stamkos could become a Leaf. Naturally, if it happens, many fans have presumed Stammer would be named captain, immediately become the face of the franchise, and lead the Leafs through its centennial season and beyond.

As a result, many have also asked – what is Steven Stamkos worth? Assuming he reaches UFA status, what will it cost the Leafs to sign him? Does he deserve the same type of money as Kopitar, Kane, and Toews? Back in January, Ryan Kennedy over at thehockeynews.com made some reasonable comparisons and suggested that he sees Stamkos as being worth roughly ~$9M in AAV. Full credit to Ryan – as that was earlier in the season and somewhat different situation – however, in this article I will argue that it is extremely unlikely that any team, Toronto included, will be able to sign Stamkos for an AAV of less than $10M, or for much less than the maximum term of 7/8 years.

Before getting into the approaches to valuation, let’s look at some of Stamkos’ key statistics to understand exactly how he adds value.

Stamkos’ Goals Above Replacement (GAR)

Stamkos GAR BARs

 (If this data doesn’t mean much to you – I recommend you check out my summary of the practical applications of Goals Above Replacement).

For individual player analysis, GAR (Goals Above Replacement) can be a useful starting point to illustrate the big picture. Looking at Stamkos’ GAR shows us:

  • He performs at an elite level, hitting 15-20+ GAR all but his rookie season, something done in fewer than ~6% of all player-seasons
  • Stamkos contributes value to his team almost entirely through his offensive play:
    • 95% of Stamkos’ career GAR comes from his offensive ability, approximately 2/3rd of which coming from his shooting percentage (15.2% at 5v5) and 1/3rd from his impact on shot-rates (Corsi For)
    • At times over his career he has been a slight defensive drag to his team – but ultimately he is a relatively neutral contributor in non-offensive areas
  • As noted in the chart, Stamkos’ 2012-2014 results may not be indicative of his capability as the seasons were impacted by the lockout and his broken leg, respectively

We likely didn’t need GAR to tell us any of the above, as many would know most of this from simply watching Steven. However, GAR will be important to keep in mind for when we estimate Stamkos’ value later on.

WARRIOR Chart

Next, I have copied Domenic Galamini’s WARRIOR chart of Stamkos, showing Steven’s relative performance within the league on a number of metrics. For those not familiar with WARRIOR charts, Dominic provides a great summary here.Stammer solo

Looking at this chart confirms the following:

  • Stammer is an elite scorer and a solid playmaker, scoring very high on Goals/60, Primary Points/60, RelCF60 and RelxGF60
  • Stamkos should not be considered a two-way forward: his defensive contribution is sub-par, as shown by his shot/goal suppression (CA60Rel/xGA60 Rel)
  • As a result, when valuing Stamkos, we should be comparing him to similar elite shooters (e.g. Ovechkin, Kane, Perry), as opposed to the leagues’ finest two-way forwards (e.g. Toews, Kopitar, Bergeron)

Given that elite shooters don’t always excel at driving 5v5 CF%, it will be important to keep in mind shooting percentage and power play results when comparing Stamkos to other players.

Before we get into valuing Stamkos, let’s quickly look at the qualitative side of the equation.

A Note on Intangible Factors

Although the hockey analytics community tends to discount ‘intangible’ factors, I personally consider them very meaningful. Consider: if you have two players with similar stats – would you pay more for the driven, hard-working, high-character guy, or the player who demonstrates none of these traits?

We all know Steven Stamkos is a strong leader. Last season he captained his team to game six of the Stanley Cup final. He also has an incredible work ethic; he is well known for his rigorous offseason training with Gary Roberts. While these strong intangibles are difficult to quantify, they still should play a meaningful role in justifying a premium valuation for Stamkos. But first – what aspects can we quantify?

Approaches to Financial Valuation

In the world of corporate finance – buying and selling companies – great effort is spent attempting to value the businesses being acquired. Generally speaking, there are two approaches:

  1. Relative (market based) valuation methods
  2. Intrinsic valuation methods

Let’s start with relative valuation methods.

Market Based Valuation: Comparable Company Player Analysis

For investors, ‘comparable company’ analysis is a key aspect any deal. The valuation multiples of companies across an industry (e.g. ‘Enterprise Value / Earnings’) set the baseline for determining what the price should be for a similar one. As many readers will know, the exact same approach is often applied to players: we can look at a set of comparable elite shooters to help derive a benchmark for Stamkos’ market value. Keep in mind – relative valuation methods like comparables tell us what others are willing to pay for an asset (the market), not necessarily the inherent or ‘true’ value of it.

Using Corsica’s Similarity score feature, focused specifically on Stamkos’ most important stats (e.g. G/60, P/60, Sh%), I have arrived at the following set of comparables. All players listed below had a similarity score of at least 85% with Steven. I have also tried to present this similarly to how it is done in finance:

Comp Table

(Note – All data shown is all situations, except where specifically noted).

As you can see, few players in the league score goals and contribute primary points at the same rate as Stamkos. Compared to this set as a whole, Stamkos outperforms the group average for all metrics listed, except for the Corsi stats and FirstA/60.

However, for this analysis to truly be relevant, we can only really compare Steven to players in the same free agency situation when signing, i.e. UFAs. As such, I have highlighted the four UFA players that I consider as having the most comparable performance statistics to Stamkos: Patrick Kane, Alexander Ovechkin, Evgeni Malkin, and Corey Perry. I have also shown their four-player average at the bottom of the table. As you can see, Stamkos is neck and neck with these players on every metric.

In terms of dollars, these four players averaged an AAV of $9.7M, and had an average term of the maximum 8 years. Considering that these players are also not historically known for their exceptional leadership qualities – which Stamkos has in spades – you can begin to see the case for Steven to be earning $10.0M-$10.5M+ per season.

Intrinsic Valuation Methods

In financial markets, the other approach to valuation is using ‘intrinsic’ methodologies – e.g., trying to derive what is a company is worth in an absolute sense. When valuing a company, this is based on the discounted ‘present value’ of a company’s future cash flows – how much money a company will generate cash for its new owner in the future.

My view is that the best ‘intrinsic’ player valuation method available based on public stats is using GAR, which I introduced at the beginning. The first approach I will use is valuing a player based on his historical GAR score, which I have shown previously. The second is a new approach, where I will show a high level attempt to forecast a player’s future GAR – and use that to derive what he should be paid. When we have confidence in a forecast for a player – (which I won’t necessarily say about my own Stamkos GAR forecast today) – forward-looking analysis will be the most ‘pure’ measure we can use in valuation.

Historical GAR

First I will plot Stamkos on the Fair Market Value curve, in order to see what he is worth based on what he has done historically. Typically I would encourage using a 3-year average GAR – however, due to the issues of the lock-out season and Stamkos’ injury, I will instead use his career average (ex-rookie season) GAR of 22.

Historical GARLooking at this chart shows:

  • Stamkos’ career Avg GAR/season of 22 values him at $10.8M in AAV
  • However, historical GAR will tend to over-estimate a player’s value, as it is backward-looking, and does not adjust for how players decline with age
  • As such, though this is a useful data point, we should take it with a grain of salt

Forward-Looking GAR: A High Level Estimate

To truly estimate a company’s, or players’, intrinsic value we need a forecast of how it/he is going to do in the future. Of course, like any prediction, this type of estimate is inherently flawed and almost never is how reality actually plays out. However, creating a forecast can help us to see some reasonable scenarios of how Steven might perform in the future. To do this, I will combine his past performance with the aging curve of a typical NHL forward.

Fortunately for us, part 2 of Moneypuck’s Building a Contender Series has an excellent chart that summarizes the league-average GAR aging curve for forwards (is anyone tired of me referring to this series, yet?):

Moneypuck GAR Aging curve

(Source: Moneypuck)

In order to connect this to Stamkos’ expected performance, I will use a rather blunt methodology of simply applying the same absolute value of decline in GAR score showed here to ‘extend’ forward Stevens’ historical performance. The most accurate way to do this would likely be to base Stamkos’ long term decline on how his comparables declined at the same age. However, for the purpose of brevity, I will use this simplified approach to help illustrate the methodology.

Stamkos GAR Forecast

In the chart above I did the following:

  • Extended the ‘historical’ performance by one year in 2015-2016, assuming his current season is comparable to 2014-2015
  • Starting at Stamkos’ current age of 26, I applied the absolute decline from Moneypuck’s chart to Stamkos in five and three year chunks
    • (As you can see, the projection begins to decline more quickly after 2020-2021F)
  • Last, I adjusted this ‘base’ case by +20% and -20% to create illustrative upside and downside cases

Although this is a very high level estimate, I think this gives an interesting, basic idea of what we could expect from Stamkos over the next eight seasons. What does this equate to in terms of dollars? The base case results in an average GAR per season of 18.3, equating to $9.1M per year in AAV. The downside and upside cases each average GARs of 14.7 and 22.0, respectively, coming out at AAV values of $7.4M and $10.8M.

Sizing it all Up

So – lets stack these all up next to each other:

Aggregate

Naturally, looking at a wide range of methods gives a wide range of potential values. However, all three of these approaches can be used to justify a valuation for Stamkos at $10.0M+ of AAV. There is also every precedent for him to get the full 8-year maximum term, or 7 years with the Leafs (in the case of a UFA signing with a new team). We can all be sure Stamkos’ agent is well aware of all of these approaches and will be pushing for the high end, trying to secure as much as possible for his client.

Practicalities of TML’s Negotiation Position

Much like in valuing and buying/selling companies – you can do as many fancy calculations as you want – but something is ultimately worth what someone is willing to pay for it. Given that Stamkos is a UFA, he is essentially able to auction his contract to the highest bidder – putting all of the power in his hands. This power dynamic, combined with the prior valuation approaches, gives me strong reason to believe Stamkos deserves $10M+ – and teams should be willing to pay it, if they have the cap space available.

I’m sure some readers will point out that Stamkos’ basic counting stats (goals/assists/points per game) have declined in the past two seasons, which may be a red flag for the future. Travis Yost and Stephen Burtch both addressed this somewhat, arguing that his quality of teammate and usage are both factors that may be impacting his performance. However, in terms of the value he commands, the strength of his negotiation position will ultimately rule the day. If teams want him, it will take big dollars to get him – either they will be willing to pay for an elite player, or they will not – and I suspect there will be at least one team left standing at a double-digit AAV.

Conclusion

In the end, I know Leafs fans will continue to argue that Stamkos wants to come home, and that maybe he will take a hometown discount to join the Leafs. Although this is possible, in reality the Leafs should not be expecting to walk into a bargain contract with Stamkos. He is an elite scorer, a strong leader, he deserves a top dollar contract, and I strongly believe there will be a team willing to step up and give him the $10M+ per season he commands. Stamkos is entirely worth that amount, and he is an excellent candidate to lead this young Leafs’ team through their centennial season, and six more after that. All us fans can do now is sit and wait.

Your move, Lou.

 

This article is presented by OAK Coasters, where you can buy hand made, One of A Kind (OAK) coasters that make the perfect housewarming gift. Check them out at OAKCoasters.com.

 

 

 

The Importance of Financial Analysis: A League-wide Review of Salary Cap Efficiency

Dimitri Filipovic recently wrote a great article summarizing that – despite the NHL’s rhetoric of ‘parity’ – it is a still a league where the teams’ with the greatest financial resources tend to be the most successful. After reading his piece, I wanted to write a short article building on this concept, where I will show that although having more resources is an advantage, how efficiently a team manages its salary cap space is just as important as how much they spend.

In this piece I will apply the same methodology I have used previously, where I showed how the Goals Above Replacement (GAR) metric can be used to quantify both a player’s and their team’s salary cap efficiency. I will apply the same methodology in order to do a league-wide review of salary cap efficiency in 2014-2015. Doing so, I will argue that (i) salary cap efficiency is an integral lens for all teams to look through when building their roster, and (ii) although an efficient use of salary cap alone will not win a team the Stanley cup – ignoring this type of financial analysis can quickly push them out of Cup or playoff contention entirely.

Determining Team-level Salary Cap Efficiency

Salary Cap Efficiency is defined as how effectively a team uses its salary cap space, based on a bottom-up analysis of each individual player.  To calculate it, I first derive the fair market value of all players as a function of their GAR (FMV = $575K + ($467K * GAR)). Then, I compare that to the Average Annual Value (AAV) of each player’s contract – his cap hit – in order to see if he is being over or under-paid. By aggregating this analysis for an entire team, you can see (a) which player contracts on each team are the most cost-efficient, and (b) approximately how well that team manages its salary cap as a whole.

As a quick refresher, here are two previous charts that summarize the cap efficiency of the 2014-2015 Chicago Blackhawks. The first chart shows all members of the team in relation to the Fair Market Value equation that I just described. The second shows the amount of value created or lost on each individual’s contract.

Hawks - Arbitrage line

Hawks - by player calc

You can see from this that – as the Stanley Cup winning team – most of Chicago’s players are quite close to the FMV line, with only a few exceptions (Seabrook, Toews, Saad). Also, to be clear, we should never expect a team to price/negotiate any given player’s contract ‘perfectly’ – there will always be far too many changing variables in that player’s performance in the years after signing. However, a team can be most competitive by largely signing players with positive GAR, and by generally paying them within a reasonable range of their FMV – or much less, as enabled by their ELC/RFA deals.

In the second chart, I also want to draw your attention to the ‘Net Value Created/(Overpaid)’ figure shown under the legend, of -$6.3M. This figure is the sum of all individual player amounts displayed on the chart. Keep it in mind, as it provides the core of my analysis in the next section.

 (Side note: this Net Value Created figure for the Blackhawks specifically will not tie perfectly to my analysis in the next section. The next section is based on team 2014-2015 GAR scores, where the chart above is based on 3-year average GAR).

Application Across the League

Now, I will apply this type of analysis across the league in order to show which teams had the most cap-efficient roster in 2014-2015, and how that may have impacted their results in the standings. Given this is a GAR-based analysis I will start by showing the total Goals Above Replacement of all teams in the league.

Chart 1 - GAR by team

Looking at this, a few things are worth pointing out:

  • The vast majority of playoff teams are concentrated on the left hand side of this graph, and likewise the non-playoff teams are on the right
  • There are obviously exceptions where teams likely should have made the playoffs, but didn’t (e.g. BOS, LAK), or teams that did make the playoffs and maybe shouldn’t have (CGY, VAN)
  • Although this is a sample of only one season, I think it supports the validity of GAR as having a strong connection with a team’s success – despite only being available retroactively

In order to keep this brief I will fast forward a few steps (e.g. I will not show the calculations for getting the FMV of each team’s roster, and subtracting their total salary cap hit from that). Instead, here is the result, which is the Net Value Created/Overpaid for each team over the season, in absolute dollars.

Chart 2 - Net Value Created by team

Although this is a useful way to look at how well a team spent, it is also impacted by their total salary cap dollars. Given Dimitri’s point about the varying spending power across teams, it is important to look at this on a basis that is directly comparable across teams. As such, I have calculated each team’s ‘Salary Cap Efficiency %’ by simply dividing their Net Value Created by their total cap hit. The larger the percentage, the more efficiently a team has managed its cap.

The chart below shows the relationship between where a team finished in the playoff race along with its Cap Efficiency %. To be clear – a higher percentage (top of the chart) is a more efficient use of cap space, and a lower percentage is a worse use of cap space.

Chart 3 - Team Level Cap Eff - A

Here are some observations from this chart:

  • Most playoff teams are above 0% on cap efficiency – e.g. successful playoff teams are not wasting money by overpaying for players
  • Notably, Chicago was barely above 0%, having won the cup, and both Nashville and Winnipeg were in the ~30% range, while both being eliminated in the first round – showing that maximizing salary cap efficiency clearly won’t win you the Stanley cup on it is own

As Filipovic’s article made clear, greater financial resources will always help a team get the best talent, despite their efficiency or inefficiency. This chart does not highlight which teams spent the most overall, and naturally if two teams are getting the same ‘bang for their buck’ (spending at equal efficiency), the team that spends more will of course win out.

Despite this, a team can very easily ruin its own chance of being a contender by failing to look at its roster through a properly quantified salary cap efficiency lens. Below is another version of the same chart, where I have highlighted the large and unfortunate set of teams whose inefficient use of cap space has very likely impacted their ability to be a contender.

Chart 4 - Team Level Cap Eff - B

Fortunately for the teams in the bottom left quadrant, I think they are all well aware of their situations, and doing everything in their power to undo the current mess they find themselves in (with maybe one exception).

Conclusion

To wrap up, I think it should be clear that any team not conducting salary cap efficiency (or similar) analysis when contemplating its long-term roster construction is taking a significant risk. Being the most cap-efficient team may not be able to win you a Stanley Cup on its own (which Boston and San Jose learned the hard way in 2014-2015) – but having a very poorly managed cap is uniquely capable of taking your team out of contention. All that being said, we of course should keep in mind that cap efficiency is only one piece of the puzzle – to use dollars efficiently a team first has to acquire players worth spending money on.

 

How to Value Draft Picks vs. Active Players

What is a Draft Pick Worth in a Trade for an Active Player?

This article is being co-posted on Maple Leafs Hot Stove as well as on my own site, http://www.originalsixanalytics.com. Find me @michael_zsolt on twitter.

Many, many writers have touched on the concept of Draft Pick Value, myself included. Those who find it interesting are happy to talk about it for days, and those who don’t tend to steer clear pretty quickly. The one downfall of the work done to date is that almost all of it has focused on what draft picks are worth when traded for – you guessed it – other draft picks. In the spirit of the (now passed) trade deadline, I want to take a quick look at answering the following question:

How can we reasonably compare the value of a draft pick to the value of an active player?

To answer this, I will (i) introduce the concept of ‘absolute’ draft pick value, and (ii) go through an example, looking at the Leafs’ recent trade of Roman Polak and Nick Spaling to San Jose. My goal is not to conclude who ‘won’ the deal (I think that has already been decided), but rather to apply the concepts to a concrete example and give this analysis a bit more of a practical implication.

I want to make one caveat clear before comparing pick value and player value: This — and any other type of ‘valuation’ analysis — will always be an inexact approach and will not tell us the full picture. Teams don’t make decisions on deadline day because of abstract math; they make trades because they want to win, they have a specific spot to fill, and they believe that particular trade is the best way to fill it. The market dynamics of the trade deadline also have a huge impact in how trades go. This year, demand exceeded supply for defensemen, driving up the price of players like Roman Polak. Similarly, no one was really looking for a rental goalie, so James Reimer fetched far less than he is probably worth. As such, keep in mind this type of analysis should always be considered in conjunction with a wide range of other quantitative and qualitative factors.

(Relative) Draft Pick Value

As mentioned, previous work has largely focused on relative draft pick value – that is, what a pick is worth in a deal for other picks. These draft pick value charts often end up quantifying picks/future players in terms of some currency or ’unit’ that is hard to assign meaning to out of context. Relative draft pick value is most useful on the day of the draft, when many pick-for-pick trades are made and we know the exact selection number a pick relates to (as opposed to only knowing the round). However, in order to compare between draft picks and players, we need to compare players on the same metric — one that addresses the concept of absolute draft pick value.

Absolute Draft Pick Value

In his recent piece, Stephen Burtch took another big step forward in this area by laying out a number of simple and clear metrics in a concise table to illustrate some proxies for draft pick value. Here is his table:

burtch

I am a big fan of this table. Not only does Burtch introduce an absolute value metric for players (Expected Pts/GP), but he shows how long it takes for those players to become real contributors (Seasons until 150GP). He also connects it all to the Goals Above Replacement metric – another thing I am a big fan of. Later on in his article, Burtch also essentially splits teams into ‘buyers and sellers’ – a very useful lens through which to view the market dynamics on deadline day (e.g. availability or scarcity of particular assets, driving demand and price).

Although this chart is a great start for absolute pick value, I think we can go one step further. Having analyzed Expected Pts/GP for draft picks myself, there are two things I want to point out. The first, which we’re all aware of, is that it differs significantly by forwards and defensemen (Burtch no doubt recognizes this; he just wasn’t showing that level of detail in his table). Secondly, it has a survivorship bias – that is, over time, only the strongest players remain in the league and continue scoring points, thus driving up the averages over time. Thus, Pts/GP does not appropriately account for the probability that a player stays in the league at all.

Player Lifetime Production

While I recommend using as many value-metrics as possible to establish a well-rounded view, one of my own favourites for absolute pick value is Lifetime Production, calculated as the expected average cumulative points per player (e.g. total career points). This metric implicitly adjusts for players who never make it into the league at all, as the denominator in the equation is total players drafted rather than total games played. See below for two of my previous charts, showing this metric for both forwards and defensemen.

Lifetime Production - F

Lifetime Production - D

(Note: The chart sample is all players drafted between 2000 and 2004, and their subsequent playing histories over each of their first ten seasons in the league).

Although this data doesn’t separate the top three picks overall, who deserve their own echelon, you can still see some clear results:

  • Over their first ten seasons in the league, a top-10 overall pick should be considered to be worth ~170 total points if a defenseman is selected, or ~350 points if a forward is selected.
  • Depending on how soon that player really begins to contribute, (e.g. many players only are NHL regulars for 5-8 of their first ten seasons), top-10 overall defensemen come out as ~20-30 point per season players, and top-10 forwards come out as ~40-60 point per season players.

Now, this metric is also not perfect. It works well when used far in advance of the draft, when it is unclear what overall selection number a pick relates to. However, it can be a pretty high level approach when a team knows it is holding the 33rd overall pick, for example, which could be treated much the same as a late first round pick. Many will also rightfully point out that these are averages with huge distributions in results. In all rounds, there will be many players who will have 500-600+ points over these 10 seasons, and many who will have less than 10. As a result, these averages/expected values will only ever be one piece of the puzzle.

Case Study: TML trade Polak/Spaling for two second round picks

Lastly, I will try to illustrate this concept a little more clearly by looking at the Leafs’ recent trade of Polak and Spaling to San Jose in return for two second round picks. Here are the assets that changed hands in the deal:

Pic 1

Now, Raffi Torres was more of a cap offload by San Jose, who the Leafs have let remain at San Jose’s AHL affiliate (he’s also not playing for the rest of the season). As a result, let’s exclude him from the comparison. For simplicity’s sake, to stack up the remainder of the trade I have assumed TML uses the two picks to select one forward and one defenseman. Further, based on both Burtch’s and my charts above, second round picks only really begin to meaningfully contribute around their fifth season after being drafted. As such, you should consider the ‘lifetime production’ for these picks to be over approximately five or six active NHL seasons.

The table below summarizes the career points we can expect from these picks versus what could be expected from Roman Polak / Nick Spaling over each of their next five seasons.

Lifetime total

In order to try to show this on an apples-to-apples basis, I have assigned Polak/Spaling the value of their cumulative points over their last five seasons. Now, this is not exactly scientific, and should not be treated as a ‘trade-defining’ result. However, the chart does show an interesting finding: based on what can reasonably be expected from these picks over ~10 years after being drafted (which includes adjusting for their likelihood to succeed in the league at all), they will not necessarily be as productive as Polak/Spaling will be over each of their next five seasons, in the aggregate.

However, that is not the full story of course. Polak and Spaling are shown here in a somewhat generous view of what you could expect out of them for the next ~5 seasons. It does not discount their performance at all for declining with age, nor does it consider their moderate cap hits, as 27 and 29 year old players. Given that they are both Unrestricted Free Agents (UFAs) at the end of this year, San Jose may only actually realize the value of ‘one’ of the next five seasons from these two players. The table below adjusts this data to be shown on a per-season basis, rather than in aggregate, simply by dividing the last chart by five expected seasons:

Per season total

Looked at differently, although San Jose got a total of 32 ‘Pts/Season’ worth of production, the Sharks only have certainty that they acquired the tail end of the 2015-16 season (e.g. ~20 games) before these two players could walk away and sign with any team in the league.

At the same time, Toronto ‘only’ acquired 23 Pts/Season, but this will be spread out over five productive years. These will also be the prime years of those players’ careers, where their value is the highest, due to being a low cap hit while on Entry-level/UFA deals; Toronto has the players’ exclusive rights while they develop. Last, as has been touched on in the past, ideally Mark Hunter and company can actually increase the probability of turning these picks into higher-calibre players than average, given his and his team’s strong network and scouting capabilities.

A Note on Time Value

One final note before concluding: It is also worth pointing out that, given these picks are for 2017 and 2018, they are inherently less valuable than a pick for this upcoming draft, and I suspect that is a key reason that San Jose was willing to make this trade. Even rebuilding teams want to rebuild now, not 2-3 years from now.

To illustrate this concept, ask yourself if a second round draft pick in 2022 is worth the same as one in 2016? Standing here in 2016, it is not. The same logic applies to 2017 and 2018 picks, although to a lesser extent. Fortunately for Toronto, the Leafs have so many picks in 2016 that arguably they were looking for picks in later years in the first place. However, this willingness to accept a later date (plus the lack of supply of rental defensemen this year) likely helped the Leafs increase their yield in this trade significantly. For anyone interested, this ‘time value’ concept is directly borrowed from the world of corporate finance, where ‘discounting future cash flows’ (e.g. player production) is the foundation of assigning a value to a business.

Conclusion

To wrap up, I have hopefully heavily caveated that this analysis should not be considered scientific, the best, or even the only way to compare the value of draft picks to active players. What this hopefully does provide us, though, are some useful heuristics (rules of thumb) to keep in mind for future deals, which can be combined with all of the other methods available at our disposal to evaluate transactions. As a result, the next time you see a team toss around two 1st round picks (or equivalent players) for a long-term Phil Kessel-type player, or an short-term rental of an Andrew Ladd-type player, hopefully you walk away thinking about just how many hundreds of future points they are giving up down the road.

Using GAR to Quantify a Player’s Value and Salary-Cap Efficiency (Part 2)

(OSA’s WAR “Explainer” Part 2) 

This article is being co-posted on Maple Leafs Hot Stove as well as on my own site, http://www.originalsixanalytics.com. Find me @michael_zsolt on twitter.

In my last article I walked through what the WAR/GAR metric is, and the practical applications, and limitations, of using it to evaluate individual players. In this post I would like to build on that work to (i) show how to use GAR to quantify what a player is worth in dollars, (ii) introduce the concept of ‘contract arbitrage’, and (iii) use that concept to review the cap efficiency of Jonathan Toews, Dion Phaneuf, P.A. Parenteau and Brad Boyes.

GAR and Quantifying Player ‘Value’

In a salary-capped league, NHL franchises operate under a series of constraints:

  • Maximum of 50 contracts per team
  • $71.4M salary cap in 2015-2016
  • $52.8M salary minimum
  • Minimum NHL-level salary of $575K
  • Maximum NHL-level salary of $14.3M (20% of the cap)
  • Maximum Entry Level Contract (ELC) base salary of $925K, or $3.78M after performance bonuses

As you can see, the Collective Bargaining Agreement (CBA) defines the limits that teams must optimize within. When faced with this, the concept of opportunity cost becomes extremely important. Opportunity cost is the implied cost of a decision by not choosing the next-best alternative available at the time. Think of signing a 35+ year-old to a five-year, $35M deal. Even if that player is a strong contributor, the team’s opportunity cost (five years of losing ~10% of their cap) will often make these deals unjustifiable, especially as that player’s performance declines over time.

Having looked at GAR and player evaluation, I now want to incorporate contract dollars to show how to use GAR to quantify player ‘value’. To do this, I will be focusing on salary cap impact (rather than annual salary paid), as that is what matters to teams when making contract decisions – at least those that aren’t more constrained by their own finances than the cap (e.g. ‘budget’ teams). As you may know, salary cap hit is calculated by the league as the average annual value (AAV) of a player’s contract.

The central approach I will be using to value players is based on some very helpful past analysis by Eric T and Hawerchuk. Amongst many other things, their work showed us the following:

  • 1 win (WAR) = ~6 goals (GAR)
  • Based on the free agent market and the current cap, every 1 WAR a player contributes is worth $2.8M in contract value
  • After adding in the baseline salary ($575K minimum contract, AKA a zero-GAR player): the market ‘price’ of a 1 WAR or 6 GAR player is approximately $3.4M in player salary per year

Estimating Player Value: Some Initial Examples

One way to connect our $2.8M cap-dollars per win to players is to simply insert it into the table I shared in my last post. Doing so will give a range of estimated player ‘value’, shown in terms of contract dollars against the cap.

Expected Contract Dollar by WAR Range

Hopefully this table helps demonstrate an initial idea of what these players are ‘worth’, based on their GAR scores. However, much like my previous draft-pick-value analysis, what works well for a range is not necessarily as applicable on an individual basis. Instead, showing this on a curve can help us assign players a more precise estimate of the value they contribute, and deserve.

The Cap Efficiency Curve

To demonstrate this, I have created the chart below, which I will call the ‘Cap Efficiency Curve’. This curve illustrates the linear relationship between a player’s cost (in contract AAV) and the GAR/WAR a team should expect from an individual with that level of compensation:

Player Value vs Cost Curve

The relationship shown above is relatively straightforward, directly derived from our earlier concepts – that each 1 WAR/6 GAR is worth $2.8M in AAV, above the player’s minimum salary. Hopefully this visualization can help turn the general relationship into an intuitive, usable tool for a team. For example, this curve allows us to:

  1. Evaluate if a player is outperforming/underperforming expectations in his existing contract
  2. Define the ‘fair’ market price for a player’s future contract, based on what he has been able to do historically, and ideally, based on what we can project he will do in the future

One note: as you can see, the equation above only holds between the minimum and maximum player salary levels, as a player currently cannot be paid less than $575K or more than $14.3M per season.

Now that we have a good understanding of what a player is worth – how can a team leverage this relationship to ensure they use their cap space as efficiently as possible?


‘Contract Arbitrage’: How to Take Advantage of Market Inefficiencies

The word ‘arbitrage’ can have multiple meanings, depending on whether it is being used in a very technical, financial sense, or a more general one. More generally, people use arbitrage to mean buying something for less than it is worth. Like a typical ‘value’ investor, this is done by conducting detailed research to figure out an asset’s ‘true’ value, before searching for opportunities to acquire it at a very good price. After purchase, value investors typically hold assets (companies) for a very long time, often continuing to invest their dollars, time and expertise in order to maximize future growth, profits, and investment returns.

Applying this value investing arbitrage to the world of NHL contracts brings me to the idea of ‘Contract Arbitrage’. I will define ‘Contract Arbitrage’ as any situation where a team receives more value from a player’s contract than it costs them. Specifically, that would mean earning more in WAR/GAR than the team gave up in equivalent cap-space, making contract arbitrage a measure of cap-efficiency as much as it is ‘financial’ value. While GMs are most obviously focused on acquiring talented hockey players, a key component of the job of a GM is to maximize his team’s wins per cap dollar spent.

Let’s go back to the Cap Efficiency Curve to illustrate this concept:

Value vs Cost Curve - ShadedLooking at the above:

  • Fair market value (FMV) for a player would be any contract value along the curve shown
  • Overpaying for a player would be a contract that falls into the area above the curve (shaded red)
  • Creating value (e.g. signing a player with the potential for contract arbitrage) would be any contract that falls into the green area, below the curve
    • Simply put, the green area represents any time a team pays a player less than the goals/wins he contributed to the team would justify

For simplicity, I will focus my upcoming examples on past performance, in order to illustrate these concepts. In the truest sense, teams should be using this concept on a forward-looking basis. For example, if a team can reasonably forecast a 20-22 year old to reach 10, 15, or 20+ GAR over the next 5+ years, they should be inclined to ‘lock in’ his contract now – ideally within the green area of the chart above. Keep an eye on Aleksander Barkov’s GAR performance over the next few years, as he may grow into an excellent example of such a contract.

Now – let’s get into those examples:

Our Original GAR Case Study: Jonathan Toews

I will start with Jonathan Toews in order to connect this analysis back to the player evaluation case study from my last post. Toews’ 3-year average GAR is 20.3, and his current AAV is $10.5M on a contract with seven years remaining. Plotting Toews’ GAR together with his contract dollars on the curve below will help us see if he is currently being over, or underpaid. The curve will also allow us to see how much over/underpaid Toews is – measured by the distance between his (x,y) coordinates and the FMV line.

Contract Eval - Toews

  • As shown above, plotting Toews’ onto the Cap Efficiency Curve shows he is ‘worth’ ~$10.1M (e.g. where his ~20 GAR hits the curve)
  • Compared to the $10.5M AAV he currently takes of the Blackhawks’ cap, this would show Toews’ to be paid quite close to his fair value, receiving a ‘premium’ of only $400K

Although Toews’ performance has started to show slight declines, I would argue that Toews’ contract appropriately reflects his FMV. Teams will never be able to predict exactly how a player will perform, but the Blackhawks have come pretty close here. Further, this calculation doesn’t attribute any value to qualitative factors, such as the incredible leadership, work ethic, and experience that Toews brings to his team. In my view, these factors will more than offset the $400k premium that the Blackhawks are paying.

Now let’s look at an example at the opposite end of the spectrum…

Former Toronto Maple Leaf: Dion Phaneuf

First, I want to go on the record and say that I had written almost this entire article and analysis of Dion prior to the recent announcement of his trade to the Senators. As a result of that announcement, I now get the benefit of no longer explaining to the world just how bad Dion’s contract is for the Leafs, and how hard it will be for them to offload it. So that is nice.

Second, I will deliberately avoid getting too far into reviewing the trade directly, as there are many other good examples of people who have done so already. My big picture ‘take away’ is that I was very impressed by the Leafs’ ability to source and negotiate a deal that rids them of his contract, with zero salary retained. I also will say that, from the seat of a Leafs’ fan – i.e. supporting a team that has always been overflowing with cash, and is only constrained by the cap – it can be hard to appreciate this deal from the Senators’ perspective.

However, I think the swap has more positives for the Senators than most think. In this trade, the Sens found a creative way to convert very unproductive cap space (injured/inactive players) into a contributing asset (Dion) with a similar cap hit, only for a longer term. Further, James Mirtle’s insightful tweet summarized that the Sens’ actual cash out the door for next season went down by $4.2M after this deal. For a budget team, that cash compensation change is arguably just as valuable as offloading an additional $4.2M in salary cap – all while picking up a solid, top 4 defensemen.

Now – let’s take a look at Dion’s contract.

Contract Eval - Phaneuf

  • Plotting Dion’s $7M AAV and his 3-year average GAR of -3.4 (2012-2013 to 2014-2015) paints a dismal picture
  • Relative to the FMV line, Dion is being paid $6.5M per year more than he contributes to his team’s goal differential
  • The most pessimistic way of looking at this (which I’m sure will make most Leafs’ fans glow), is to directly multiply the $6.5M loss by the five remaining seasons on his deal: giving a total maximum overpayment/loss of value of $32.5M

However, much like we couldn’t reasonably interpret the first graph as simply ‘Toews is overpaid’, I think we need to caveat this analysis for Dion as well – even if that only results in being nice to Sens fans. To qualify this analysis of Phaneuf’s contract:

  1. First, as shown in my last post, GAR doesn’t necessarily include every aspect of how defensemen contribute to their teams – thus, it may understate the value of Dion, or any other D-man
  2. Second, this data also only includes up to 2014-2015; the eye-test alone makes it clear that Phaneuf has stepped up in the current 2015-2016 season. The change in Dion’s usage and minutes under the Babcock regime have likely bumped up his recent GAR considerably – and to Ottawa’s credit, they were buying into Dion’s play this year, not his play over the three years before this one
  3. Last – I legitimately believe Lamoriello and Babcock’s comments that Dion is an excellent leader, person, and guy to have in the Leafs’ dressing room. I think this was providing a lot more value to the Leafs than us number-crunchers tend to give credit for – and it will be missed

Going forward, the same analysis above can be applied to see if Dion is living up to his contract any better in the future than he has historically. By tracing his $7M over to the FMV line, we can see that a $7M AAV player ought to be in the 13-14 GAR range each year. Thus, if Dion’s GAR for 2015-2016 and onward come out anywhere north of 10, Ottawa will be looking a lot better than we all are currently giving them credit for.

For one last example, let’s look at the free agent signings done this past summer by the Leafs’ current front office:

Brad Boyes and P.A Parenteau

Brad Boyes and P.A. Parenteau are consummate examples of the strong decision-making process and asset management analysis that Shanahan, Lou, Dubas (and likely Brandon Pridham) may be implementing. Boyes and Parenteau each have 3-year average GARs of 5.1, and 5.2, respectively – almost contributing 1 WAR each to their prior teams. On the cost side, Boyes was picked up for an AAV of only $700K and Parenteau for an AAV of $1.5M. Here are the charts to evaluate their respective contracts:

Contract Eval - Boyes

Contract Eval - ParenteauAs the charts above show, given the fact that a ~5 GAR player is typically worth $2.9M, as long as Parenteau and Boyes perform in line with their recent history, the Leafs will have immediately created a combined $3.6M in salary cap value when they signed these two players. Further, being more than halfway into the season, the value that Pierre-Alexandre has brought on the ice thus far speaks for itself. Finally, none of this analysis even factors in the potential ‘exit’ value that Lamoriello & Co. could pick up by offloading P.A. or Brad for picks or prospects at the deadline, which is hopefully made easier by their very minor cap requirements.

Conclusion

To wrap up, the great work done by the likes of Hawerchuk and Eric Tulsky has provided us with the perfect framework to dig deeper into using GAR to quantify player value. Hopefully this article has been helpful to walk through those concepts, illustrate what this relationship looks like visually, and to show how the Cap Efficiency Curve can be a useful tool for analysis of player contracts and salary negotiations.

Building on these concepts, within the constraints of the CBA, the most legitimate, ‘fair’, and repeatable way for a team to maximize their cap efficiency is to either focus on acquiring young players in the draft, or by trying to trade for prospects early into their tenures as NHLers. As such, the upcoming third part of this series will focus on how teams can take advantage of Entry Level Contracts and Restricted Free Agency to consistently generate contract arbitrage opportunities for themselves, and maximize their wins per cap dollar spent.

2015 Draft Day: How Hunter and Dubas May Have Out-Played the League (Part 2)

This article is being posted here as well as in parallel as a guest post at Maple Leaf Hotstove.

In my last post I shared my analysis on long term player performance and development based on draft round. As a follow-on to that article, I’d like to do two things: first, I’ll convert my last analysis into a relatively straightforward and ‘usable’ metric for draft pick value. Then, I’ll apply this metric to two short case studies in order to illustrate who won each of the Leafs draft day trades this past summer (hint: it wasn’t Ron Hextall or Jarmo Kekalainen…).

Draft Pick Value

The third and final objective from my original report posed the following question:

  • How much more valuable is a pick in the first round versus the other rounds? All things being equal, what should a pick from each round be worth in a trade?

Building on the analysis done by others mentioned in my last post, the chart below summarizes how I have approached ‘converting’ long term performance data into a relative draft pick value metric. To be clear: I am not proposing the values shown in this chart, rather, I hope to use this chart to illustrate the methodology I have applied across a number of metrics.

Games played data is one metric that can inform relative pick value by draft round

Pick Value Demo Chart 

  • The chart above shows how likely a player from each round is to play ~2+ seasons in his career, and by when he should be expected to do so
  • The chart then calculates how much more likely a player from each round is to pass 150 GP than the bottom cohort of rounds (e.g. average of Rounds 4-9) – shown as a multiple of those rounds
  • Thus, if we define a pick in rounds 4-9 as the ‘base unit’ (e.g. ‘1.0 units’), using the >150 GP threshold shows a third round pick to be worth 1.8 units, a second round pick being worth 2.4, an 11th-30th overall pick being worth 6.0, and a top 10 overall pick being worth 7.6

Applying this approach to multiple metrics will give us a more robust view of relative pick valueRelative Pick Value Chart

  • The table above shows the ‘Draft Value Units’ (working name) of a pick in each round across three metrics: >30 Pts, >100 Pts, and Avg Career Pts. In essence, ‘Draft Value Units’ are comparable to a currency with which teams can value and exchange draft picks
  • As mentioned – each round is shown as its multiple of the lowest group (Rounds 4-9) – and most of my attention going forward will be on the far right, highlighted column; also, all of the values of this chart are derived from the data shown in my last article
  • As Michael Schuckers and Stephen Burtch previously showed, this data suggests teams should use caution when trading their first and second round picks, as they can be worth many times more valuable than the other rounds
  • It is worth noting that Lifetime Production data can also shed light on ‘absolute’ pick value; e.g. in a trade for active players, a pick in the top 10 overall should be treated as if it has a career lifetime value of ~350+ points as a forward, or ~170+ points as a defensemen – something directly comparable to ‘remaining’ production in an active NHLer

Part of the goal of this exercise was to create a pick valuation methodology that is highly simple, and usable by many, regardless of their level of analytical sophistication. As someone very familiar with the world of corporate finance and valuations, I can tell you first hand that – despite financial firms using the ‘fanciest’, most complex valuation models you could imagine – the most effective of these models will often reduce complexity, rather than create it. All investors and bankers also know that valuation analysis is a ‘blunt’ tool, and it will never give you an exact, ‘true’, intrinsic value for a corporation or a stock (i.e. picture using an axe to carve a statue). I think the same thought process applies to this draft pick value methodology – it is directional, rather than exact – but hopefully it also intuitive to understand and apply. My general philosophy is that decision-makers do best when considering metrics that are reflective of the big picture, while simultaneously weighing those against the typical qualitative information they bring to the table, such as team needs, player skill, size, character, etc.

Now – let’s get into the deals.

Draft Day 2015 Deal #1 – Dubas and Hunter v. Ron Hextall of the Philadelphia Flyers

After seemingly endless conversations and hustling around the draft floor, Dubas and Hunter’s first trade of the day was with Philadelphia:

 TOR PHL Trade Chart

Now, based on the far right column in my ‘Draft Value Unit’ table above, we would think to assign the following values to these picks:

TOR PHL - 'Wrong' Pick Chart

Huge win for the Leafs, right?

Not necessarily. As we all know, and as Schuckers and Burtch’s analyses clearly demonstrate – all picks in each round are not created equal. The 11th overall pick is not equivalent to the 30th, even though the table above would be treating them as having the same value. Because of this, the Draft Value Units shown above would be most appropriate to use when a trade is done well in advance of a draft, and it is not known exactly which overall draft number a given pick will relate to. In order to make this metric meaningful to trading ‘known’ pick numbers, we will have to do some adjusting.

Applying ‘Draft Value Units’ directly to draft pick numbers will show some counter-intuitive results

Draft Value Units - Step Function

Instead, for individual pick numbers, we need to ‘fill in the gaps’ with a new curve, equivalent to the equation shown below

 DVU - Curve

  • Once we do know what pick numbers each team will have, we need to adjust the value of each pick appropriately
  • To do this, I have derived the solid, light blue line in the chart above, which best fits the original Draft Pick Values shown
  • This line shows what the appropriate Draft ‘Value’ is for a pick once we know the exact pick number that it relates to
  • The line was derived by looking at the (x,y) coordinates of each pick number and its respective Draft Value Units, after assigning the values in the first table shown to the mid-point of each round (e.g. 5th overall pick being worth ~11.1 DVUs, 20th overall pick being worth ~7.0, etc.)

In order to test validity, we can compare this curve/equation to those derived by Shuckers and Burtch. The similarities between the three draft value methodologies help to support the accuracy of the findings of each. Note – the one downfall of this curve is that, in order for it to appropriately reflect the value of the first 100 picks, the DVU’s hit zero around pick 100. As a result, my advice for those trying to use this to value picks from the 4th Round and onward is to treat each pick as having a Draft Value of 1.0 units, rather than zero (e.g. revert back to the dotted line).

Now – back to Leafs v. Philadelphia.

Plotting the three Leafs/Flyers picks traded on our curve shows the value of each individually

 DVU Curve - TOR PHL

  • The chart above shows that the theoretical value of the 24th overall pick is 6.0 DVUs, with the 29th and 61st overall being worth 5.2, and 2.3, respectively
  • As I did here, in order to use this on any other trade, all you have to do is find each pick number on the x-axis, trace it to the curve, and then trace that point on the curve back to the y-axis – giving you the Draft Value Units of that pick
    • The end of this article also has a table showing Draft Value Units for each pick number, e.g. the coordinates that make up this line

On an expected value basis, the Leafs won the trade with Philly by 25%

TOR PHL - Stacked Bar

  • Based on the values assigned above, the Leafs were the clear winners of this trade
  • As a reminder – these Draft Value Units originate based on an average of the probabilities for each player drafted to do three things: 1) Exceed 30 career points, 2) Exceed 100 career points, and 3) Maximize their lifetime (point) production

One last important thing to point out – as I’m sure many Flyers fans and general non-stats folks will want to discuss – the Flyers executed this trade because they badly wanted to pick Travis Konecny, of recent Canadian World Junior ‘fame’. They saw him as materially better than their next choice (if they had picked 29th) – Nick Merkley. This piece isn’t about scouting or individual player evaluation, which are of course important factors to consider – generally speaking, every team should be drafting with a broad strategy in mind, that drives towards filling its specific needs (which I’m sure justified this trade from the Flyers’ perspective). The point of this analysis is to say that – on a long term, expected value/probability basis – a team will do better to be on the Leafs’ side of this trade. Even if 10 years from now Konecny is the next John Tavares, and everyone thinks Ron Hextall is a genius – I think the Leafs were on the right side of this trade based on what was known on draft day.

(As a side note: this article by Travis Hughes gives a bit of background about Philadelphia’s rationale for being so eager to trade up for Travis Konecny).

So far, Leafs 1, League 0

Draft Day 2015 Deal #2 – Dubas and Hunter v. Jarmo Kekalainen of the Columbus Blue Jackets

 It didn’t take long for Dubas and Hunter to turn around and offload their newly acquired 29th overall pick either – employing a highly similar strategy in their trade with Columbus:

TOR CLB Trade Chart

Now if we apply the same analysis to this deal:

Looking at the value of each pick individually…

DVU Curve - TOR CLB

… It is clear the Leafs ‘won’ this deal too – by 23%

TOR COL - Stacked Bar

You don’t need me to tell you too much more, as the same analytical framework shows the Leafs fared similarly well in their trade with Columbus as they did with Philadelphia.

Before I wrap up, just for fun let’s look at the two deals as whole:

TOR Aggregate Trade Chart

The Leafs’ two trades during the 2015 draft created an incremental two players, 2.7 draft value units, or otherwise a 43% increase in relative value

TOR Aggregate Stacked Bar

By the end of the draft, the Leafs had used these three picks to select Travis Dermott, Jeremy Bracco, and Martins Dzierkals, based on the scouting expertise employed by Hunter and his team. It also helped fill some of the team’s draft objectives early on, enabling them to wait it out for sleeper picks like Dmytro Timashov in the fifth round – a player who turned many heads at the recent World Juniors tournament. I wouldn’t (yet) go as far as to say that Hunter has a legitimate ‘competitive advantage’ over other teams in player scouting and evaluation until more time has passed. However, Dermott’s OHL performance this year and recent World Junior selection also suggest that getting him at 34th was a also bit of a steal in its own right. Regardless, it should be clear that on this fateful day last June, Kyle Dubas and Mark Hunter made some excellent decisions, which created a ton of value and long term potential for the Toronto Maple Leafs club.

Also – I won’t go into it in depth here – but how did the Leafs acquire that original 24th overall pick? The Leafs got it by trading two ‘rental’ players (Franson/Santorelli), who were both about to become UFA’s, in return for that 1st Round pick, Brandon Leipsic (another solid prospect), and Olli Jokinen’s cap space. Keep an eye out for the Leaf’s front office to hopefully make a couple similar deals approaching the trade deadline this year, and repeat their excellent 2015 performance next June.

Leafs 2, League 0

Conclusion

When considering teams that have been successful in the NHL draft, the teams that come to mind intuitively support the findings of this analysis. The Chicago Blackhawks are a great example where their distinct strategy has been ‘quantity over quality’: rather than trying to pick ‘better’, as has been shown to be very difficult to do, Chicago has simply focused on using transactions like these to draft as many players as possible. Chicago’s massive, league leading number of picks from 2000-2004 show that the Hawks certainly planted their seeds – and in case anyone has been paying attention, they have been doing ‘OK’ in the last 5-10 years. Another great example of this strategy is Bill Belichick and the New England Patriots – who seem to have done alright in the last 10 or so years as well…

In the end – as one of the small but growing number of patient, excited Leafs fans out there, I will make our collective opinion clear: the current front office knows what they are doing – and we are behind them.

Appendix Table

About the author, and this site

Original Six Analytics is (yet another) blog focused on exploring the world of advanced statistics within the NHL and other hockey leagues. My own background is in the field of private equity investing, and before that as a management consultant – both fields heavily focused on summarizing quantitative analysis into easily understood output in order to support decision making. As such, I hope to specifically use this blog to apply the concepts of value investing (and to an extent, corporate strategy) to the world of hockey analysis.

Lastly – as the image of Morgan Rielly and Leo Komarov may suggest – I am a lifelong Leaf fan, with a great deal of patience and support behind the approach of the current front office. The name of ‘Original Six’ Analytics refers to what seems to be the vision of the current Leafs organization – ‘returning an original six franchise to its rightful place in the league’. Which I think we can all get behind.

My inaugural post (with actual analytics content) will be coming soon, on the topic of the value of draft picks, based on typical player performance and development from a given draft round. Please feel free to reach out at any time, with questions, comments, feedback or any requests for a future type of analysis:

  • @OrgSixAnalytics on Twitter
  • OriginalSixAnalytics@gmail.com