What is Impact Index?
It is a newly-developed statistical system used in the game of cricket to determine the accurate worth of a player's performance, in a match, team and career context.
What is its salient feature?
It measures the impact of a cricketer's performance in a specific match on a scale of 0 to 5, entirely in the match context and relative to the other performances in the same match - this is the big idea in the system.
How does it work?
Since every match has its own fingerprint based on the context of the performances during the game, this system determines a base figure (in runs) for every match. Then, every performance in the match is measured as a ratio against this base figure (and the result limited to 5 in a career context).
Why is the scale only between 0 and 5?
To avoid the skews of conventional stats systems (like averages) where one big performance can cover for repeated failures thereafter, limiting it to a maximum of 5 in a career context keeps it more accurate. The construct of the system also makes the Impact number roughly representative of how many players’ job is done by the player (an Impact number of 2.65 means he has done roughly done the job of 2.65 people in the match), so it makes it meaningful also on that level. Doing 5 players’ job (if all contributions are deemed equal) comes up as the right measure in a team of 11 players.
What makes it better than existing systems?
It is clearly better than batting and bowling averages as the skews that result inherently from those methods are intrinsically avoided. This system enables a more holistic measurement by taking into account the context of the performance (intangibles like state of the pitch, state of the match in which the performance happened, strength of opposition, even the state of series/tournament within which the match is occurring), which has always been considered beyond the realm of cricket statistics.
It is better than other rating systems because more than being a statistical system, Impact Index is a different lens with which to evaluate the game. It does not number crunch with external factors but organically from what exactly transpired in the specific match (which also results in far less unnecessary crunching). This leads to far fewer assumptions and a far, far more objective system, which also makes it much more accurate fundamentally.
It is a very versatile system that can be extended to cover almost any aspect of cricket more accurately than before. Most importantly, it is a transparent, honest system that cannot be manipulated. Conclusions cannot be just arrived at and hidden behind the opacity that all other systems seem to eventually display.
Is this system basically for geeks and therefore unnecessarily intimidating for a normal fan to get into?
Actually, it is exactly the opposite. Impact Index is specifically designed to simplify existing cricket statistics for the masses (which is why it is also fundamentally different from Sabermetrics in Baseball, of “Moneyball” fame) while making it much more accurate and meaningful than anything that has ever existed before. All the statistics you see used on television are actually reduced to one single number between 0 and 5 for a player. What could be simpler?
You can see an Impact scoresheet as a report card for a match – where each player has got marks out of 5 for the impact he actually had on the match. Newspapers and websites often do this highly subjective (sometimes, outright whimsical) exercise after a series or a tournament by an “expert” assigning points out of ten (whole numbers) for players. Imagine if that could actually be done scientifically, match-by-match. Well, that is exactly what Impact Index does.
Once you get the fundamental idea – that every performance is measured on a scale of 0 to 5 (in a career context) in every match – it actually becomes very easy.
If you want to know exactly how it works, unlike Rating systems, we are happy to reveal our process. Our Methodology section explains the steps involved (without yet revealing the proprietary algorithms, for obvious reasons, though we hope to soon, once our patents are confirmed).
Is it not just another rating system, and therefore subjective?
We prefer to not call ourselves a Rating system because of the inherent subjectivity associated with those. We don’t rate; we measure, using elements inherent to the scorecard, and not looking at anything outside it. We do not add external weights; we do not try to account for context by playing with individual elements.
Within the construct of Impact Index, even when it appears to limit and choose between choices, even a little scrutiny will reveal that there is only one logical choice that can be made – which doesn’t really make it a choice, and therefore makes it scientific, rather than subjective.
Simply put, Impact Index finds a way to measure (and this is the key word) the ratio of every cricketing performance and the other 21 performances in the same match. That is the big idea, and the rest is detail.
Is Impact Index’s version of the truth the only one?
No, it isn’t. Impact Index basically brings to light an alternative universe – where hard facts from the scorecard are used to determine the real value of players’ performances within the context of the match. Without sentimentality, romanticism and aesthetic considerations. The picture it paints is considerably different at times from the picture that is shown in media and what is discussed by most people. Whether you choose this alternative point-of-view to temper the mainstream view, to complement it, or to replace it – is a call you have to make, and you can actually do different things at different times.
Are there no mistakes in the system; is everything perfect?
One in 20-25 matches tends to have a minor element that needs minute fine-tuning, on a logic level. Those variations are very minor and are often missed unless specifically sought out. Even when tallied, rather than adding up, they tend to neutralize each other largely and the variations from the accurate figure are very, very small. So, fundamentally, on a career level, these numbers are very close to being 100% accurate; on a match level, some fine-tuning is going on still, and that will remain an ongoing process, as we believe it should be.
Does Impact Index concentrate on performances which won the match for the team, thereby giving those performances a higher value?
No, it does not, contrary to what has been reported in news reports previously. On a match-by-match basis, it absolutely doesn’t. It gives a higher value only to high impact performances (above an impact of 4) which come during crucial times (for the team) in a series or a tournament and/or determines whether the team progresses or wins.
Is Impact Index doing a hatchet job on cricketers?
On the contrary, it is giving many cricketers the pride-of-place they have not had before. At the end of the day, it is just a handful of players who are the real stars – almost always on the basis of aggregate statistics (total runs, total wickets, highest average, most centuries, etc), they are the ones covered extensively in the media. Impact Index allows for different cricketers to be valued for their more unique qualities (like Roger Twose for absorbing the most pressure in ODI batting history).
In fact, we believe that the foundation of a lot of cricket analysis is fundamentally flawed – as multiple performances are invariably seen through the prism of averages. Flowery writing around it, garnished with an erudite awareness of history sometimes, ironic or witty writing – that’s the only evaluation cricket coverage seems to mostly accomplish – leading readers astray down the same roads the writers are themselves so blissfully lost in, their micro-analysis of the art form of cricket the only evidence that they’ve actually been paying attention.
Impact Index takes the context of every cricket performance and converts it into hard, measurable fact. However small the performance its context brings out its truest value. These performances, taken together in a career context, can often transform the way the cricketer is eventually seen by history. Not quite a hatchet job, that.
Is Impact Index really measuring a player's greatness? Or merely his effectiveness?
That's the thing - we don't see any difference. If a player achieves great things for his side, in a match and team context, then regardless of his "talent" or his "flair" or his "technique", that has to count as the main point of the activity. If you just want to see a batsman ply his aesthetics, why not just set him up in the middle with a field and random bowlers bowling at him? Why does it need to be in a match situation, and why does a match need to be part of a series or a tournament?
Surely, in a team sport, the point is to prevail relatively. The point of Impact Index is to measure the achievements of those who help their teams prevail. Again and again. Which is what career Impact numbers are - a record of sustained efforts - put together in the right context. The war as measured by independent battles, self-contained in their own importance.
It takes talent to make something substantial of those sustained efforts, but more than that, it takes application... and character. Strangely, those are not qualities being ascribed to greatness by these followers of cricket, for some reason.
Why would it have mass appeal?
By reducing all player impact figures into a single number (up to two decimal points) between 0 and 5, it just makes player comparisons very easy, more than it ever has been before. The fact that it is more holistic and therefore accurate on top of this makes it even more meaningful.
Moreover, it brings bowlers and batsmen on the same platform - in that you can actually rightfully calculate the relative strengths. So, when a bowler bowls to a batsman, you can actually assign a figure to each of them. Catchy, when you see it in action.
Why is it called Impact Index?
Fundamentally, the system measures the impact that a player has on a particular match. It does not measure potential or talent or flair. . . just the actual deeds of the player in that match relative to the deeds of the other players. From the information only contained on the score sheet.
A player has Impact Index figures for every match he participates in (when he does not participate in a match, in any capacity, it is not included in his career chart) and when those are added up and divided by the number of matches he has played (in a series or over a career), it gives a truer picture of his value to his side and his ability more than anything ever has in the game so far.
What are the main applications of Impact Index?
It is a flexible system that has the potential to be applied in a variety of areas. The evaluation of an individual cricketer with his mean Impact Index over a career (with a higher value for series/tournament-winning performances) would be far more meaningful than his batting or bowling averages or the career aggregate statistics usually around that. A variety of other factors are measured in the above process, which have so far never been factored-in for measuring a cricketer's performance. For example, a batsman's ability to play under pressure throughout his career, or a bowler's propensity to break partnerships. Team strengths are also measured in this system - which leads to a more accurate team ranking system than any other.
There can be a variety of uses of Impact Index from this. Besides broadcasting and media options to make cricket statistics much simpler and yet more accurate for cricket consumers, it can also be used effectively for deciding winners of individual awards like man-of-the-match or man-of-the-series/ tournament more scientifically than ever before in the game's history.
Given the manner in which Impact Index clearly measures character, it can even be used selecting players, composing teams and analysing the opposition more accurately than anything else.
What does Impact Index aim to achieve?
It seeks to complement (and not necessarily replace) time-honoured systems first so that its efficacy can be fully comprehended. However, in T20, it seeks to be the statistical system of choice as no other system (especially batting/bowling averages, strike rate, aggregates, etc) is anywhere near as adequate. This system's fundamental accessibility (everything reduced to a figure between 0 and 5) also makes it a promising option for the mass version of the game.
The system also seeks acceptance from various cricket boards as it is a better way to evaluate and select cricketers than any other system. The system is being fully automated to be zero-error and lightening-fast. It will also take every cricketer who has ever played the game, in any format, through its comprehensive database.
As an entity, Impact Index seeks to emulate Hawkeye as a standard that has added to the game, though in an entirely different sense. Just like Hawkeye is being called upon to make umpiring decisions more accurate, Impact Index can be used to make cricket statistics more accurate and meaningful all at once.