Creative destruction in science

Warren Tierney, Jay Hardy, Charles Ebersole, Keith Leavitt, Domenico Viganola, Elena Clemente, Michael Gordon, Anna Dreber, Magnus Johannesson, Thomas Pfeiffer, Hiring Decisions Forecasting Collaboration, Eric Uhlmann

Research output: Contribution to journalArticlepeer-review

6 Citations (Scopus)
51 Downloads (Pure)

Abstract

Drawing on the concept of a gale of creative destruction in a capitalistic economy, we argue that initiatives to assess the robustness of findings in the organizational literature should aim to simultaneously test competing ideas operating in the same theoretical space. In other words, replication efforts should seek not just to support or question the original findings, but also to replace them with revised, stronger theories with greater explanatory power. Achieving this will typically require adding new measures, conditions, and subject populations to research designs, in order to carry out conceptual tests of multiple theories in addition to directly replicating the original findings. To illustrate the value of the creative destruction approach for theory pruning in organizational scholarship, we describe recent replication initiatives re-examining culture and work morality, working parents’ reasoning about day care options, and gender discrimination in hiring decisions. Significance statement: It is becoming increasingly clear that many, if not most, published research findings across scientific fields are not readily replicable when the same method is repeated. Although extremely valuable, failed replications risk leaving a theoretical void— reducing confidence the original theoretical prediction is true, but not replacing it with positive evidence in favor of an alternative theory. We introduce the creative destruction approach to replication, which combines theory pruning methods from the field of management with emerging best practices from the open science movement, with the aim of making replications as generative as possible. In effect, we advocate for a Replication 2.0 movement in which the goal shifts from checking on the reliability of past findings to actively engaging in competitive theory testing and theory building. Scientific transparency statement: The materials, code, and data for this article are posted publicly on the Open Science Framework, with links provided in the article.

Original languageEnglish
Pages (from-to)291-309
Number of pages19
JournalOrganizational Behavior and Human Decision Processes
Volume161
Early online date29 Sept 2020
DOIs
Publication statusPublished - Nov 2020

Keywords

  • Replication
  • Theory pruning
  • Theory testing
  • Direct replication
  • Conceptual replication
  • Falsification
  • Hiring decisions
  • Gender discrimination
  • Work-family conflict
  • Cultural differences
  • Work values
  • Protestant work ethic

Fingerprint

Dive into the research topics of 'Creative destruction in science'. Together they form a unique fingerprint.

Cite this