The Library
ROYAL SOCIETY OPEN SCIENCE

Don't follow the leader: how ranking performance reduces meritocracy

unknownby Giacomo LivanNovember 6, 2019 28 min read
performance ranking meritocracy imitation serendipity agent-based modelling inequality goodhart's law public relative performance feedback higher education homogenization

Editorial summary. This is our text summary of an article published by royal-society-open-science. Charts, figures, and the author’s full voice are at the original — read it there .

Editorial verdict

Theoretically rigorous simulation study with clear limitations — the agent-based model generates compelling dynamics showing imitation undermines meritocracy, but the stylized assumptions (no agent memory, static payoffs, no network structure) constrain direct real-world applicability; treat the directional findings as hypothesis-generating, not prescriptive.

Executive summary

This paper addresses the tension between performance ranking systems and genuine meritocratic outcomes in modern economies. The author argues that ranking-driven imitation of top performers is a self-defeating strategy that consolidates early advantages of lucky — rather than necessarily talented — individuals. Using an agent-based numerical simulation with N agents selecting among M actions, the study contrasts two action-selection mechanisms: imitation of better-ranked peers (parameterised by q) and random exploration (serendipity). Key findings demonstrate that higher imitation propensity (high q) increases aggregate utility but simultaneously raises inequality (measured via Gini coefficient), reduces correlation between agents' intrinsic fitness and ranking outcomes, homogenizes the action space, and freezes ranking mobility. Conversely, lower imitation propensity (low q) preserves upward ranking mobility, maintains diversity of strategies, and produces outcomes more aligned with agents' intrinsic capabilities. The model draws on Goodhart's Law, the Hawthorne effect, and empirical parallels in academia, financial markets, and sports. The author concludes that performance ranking systems, as currently implemented, structurally undermine the meritocratic goals they purport to serve.

researchRelevance: 7/10Global

Key insights

  • 1Imitation of top performers increases aggregate utility but produces higher inequality and lower meritocracy — the bottom 10% of agents eventually accumulate less utility under high-imitation regimes than under random action selection.
  • 2Rankings tend to freeze under high imitation: early 'lucky winners' consolidate their positions regardless of intrinsic talent, creating a negative feedback loop where attempts to climb rankings through imitation further entrench existing hierarchies.
  • 3Serendipity (random action exploration) acts as a double-edged mechanism — it initially creates lucky winners disconnected from talent, but at low imitation levels it partially restores meritocracy by enabling upward mobility and preserving diversity of strategies.

Practical takeaways

  • Organizations relying on public relative performance feedback (PRF) and best-practice dissemination may observe aggregate productivity gains while simultaneously generating increasing inequality and reduced meritocratic alignment — these outcomes are not mutually exclusive.
  • Environments that allow for independent, exploratory approaches to performance (analogous to low-q serendipity) are associated in this model with greater ranking fluidity and stronger correlation between individual capability and measured outcomes.

Frameworks mentioned

Hawthorne Effect

The phenomenon of individuals modifying their behaviour in response to awareness of being observed — referenced as the mechanism underlying 'reactivity' in ranking contexts.

References

  1. Management Science (2017).Closing the productivity gap: improving worker productivity through public relative performance feedback and validation of best practices.
  2. Journal of Public Economics (2010).The importance of relative performance feedback information: evidence from a natural experiment using high school students.
  3. The Accounting Review (2008).The effects of disseminating relative performance feedback in tournament and individual performance compensation plans.
  4. Journal of Behavioral and Experimental Economics (2018).Relative performance feedback: effective or dismaying?.
  5. Proceedings of the National Academy of Sciences USA (2012).Top performers are not the most impressive when extreme performance indicates unreliability.
  6. Proceedings of the National Academy of Sciences USA (2011).How social influence can undermine the wisdom of crowd effect.
  7. Science (2006).Experimental study of inequality and unpredictability in an artificial cultural market.
  8. Advances in Complex Systems (2018).Talent versus luck: the role of randomness in success and failure.
  9. PLOS ONE (2013).Are random trading strategies more successful than technical ones?.
  10. Canadian Journal of Behavioural Science (1988).Birthdate and success in minor hockey: the key to the NHL.
  11. Palgrave Communications (2017).Bibliometric indicators: the origin of their log-normal distribution and why they are not a reliable proxy for an individual scholar's talent.
  12. Research Policy (2019).Self-citations as strategic response to the use of metrics for career decisions.
  13. GigaScience (2019).Over-optimization of academic publishing metrics: observing Goodhart's law in action.
  14. EPJ Data Science (2019).Reciprocity and impact in academic careers.
  15. Europhysics Letters (2009).The first-mover advantage in scientific publication.
  16. Journal of Economic Interaction and Coordination (2019).Inequality, mobility and the financial accumulation process: a computational economic analysis.
  17. International Journal of Theoretical and Applied Finance (2005).Experts' earning forecasts: bias, herding and gossamer information.
  18. Scientific Reports (2018).Homophily influences ranking of minorities in social networks.
  19. Journal of Statistical Physics (2013).The social climbing game.
  20. Springer Science & Business Media (2011).University rankings: theoretical basis, methodology and impacts on global higher education.
  21. British Journal of Sociology of Education (2012).University ranking as social exclusion.
  22. Circulation: Cardiovascular Quality and Outcomes (2016).National survey of UK consultant surgeons' opinions on surgeon-specific mortality data in cardiothoracic surgery.
  23. Educational Researcher (2014).'Teaching to the test' in the NCLB era: how test predictability affects our understanding of student performance.
  24. Journal of Organizational Behavior Management (1991).A review of public posting of performance feedback in work settings.
  25. BMC Medical Research Methodology (2007).The Hawthorne effect: a randomised, controlled trial.
  26. arXiv preprint (2018).Categorizing variants of Goodhart's Law.
  27. Nature Reviews Physics (2019).Taking census of physics.

Source & Provenance

Verified
Publisher / Source

royal-society-open-science

Author

Giacomo Livan

Publication Date

November 6, 2019

Article Type

Research Study

Geography

Global

Content Type
Unknown Source Type
Original Source

Original source metadata is preserved. AI analysis is generated separately.

Like this? Get the Monday Decision Brief — free, every week.

No spam, unsubscribe anytime.

Rate this article

Want the full article? Read it at the original source — free, no paywall.

Read original article
All content belongs to original publishers. AI analysis is for research purposes only. View original source.