The Replication Database: Documenting the Replicability of Psychological Science

Lukas Röseler; Leonard Kaiser; Christopher Albert Doetsch; Noah Klett; Christian Seida; Astrid Schütz; Balazs Aczel; Nadia Adelina; Valeria Agostini; Samuel Alarie; Nihan Albayarak-Aydemir; Alaa Aldoh; Ali H. Al-Hoorie; Flavio Azevedo; Bradley J. Baker; Charlotte Lilian Barth; Julia Beitner; Cameron Brick; Hilmar Brohmer; Subramanya Prasad Chandrashekar; Kai Li Chung; Jamie Philip Cockcroft; Jamie Cummins; Veronica Diveica; Tsvetomira Dumbalska; emir efendic; Mahmoud Elsherif; Thomas Rhys Evans; Gilad Feldman; Adrien Alejandro Fillon; Nico Förster; Joris Frese; Oliver Genschow; Vaitsa Giannouli; Biljana Gjoneska; Timo Gnambs; Amélie Gourdon-Kanhukamwe; Christopher J Graham; Helena Hartmann; Clove Haviva; Alina Herderich; Leon Paul Hilbert; D. Holgado; Ian Hussey; Zlatomira Ilchovska; Tamara Kalandadze; Veli-Matti Karhulahti; Leon Kasseckert; Maren Klingelhöfer-Jens; Alina Koppold; Max Korbmacher

doi:10.31222/osf.io/me2ub

The Replication Database: Documenting the Replicability of Psychological Science

Lukas Röseler, Leonard Kaiser, Christopher Albert Doetsch, Noah Klett, Christian Seida, Astrid Schütz, Balazs Aczel, Nadia Adelina, Valeria Agostini, Samuel Alarie, Nihan Albayarak-Aydemir, Alaa Aldoh, Ali H. Al-Hoorie, Flavio Azevedo, Bradley J. Baker, Charlotte Lilian Barth, Julia Beitner, Cameron Brick, Hilmar Brohmer, Subramanya Prasad ChandrashekarKai Li Chung, Jamie Philip Cockcroft, Jamie Cummins, Veronica Diveica, Tsvetomira Dumbalska, emir efendic, Mahmoud Elsherif, Thomas Rhys Evans, Gilad Feldman, Adrien Alejandro Fillon, Nico Förster, Joris Frese, Oliver Genschow, Vaitsa Giannouli, Biljana Gjoneska, Timo Gnambs, Amélie Gourdon-Kanhukamwe, Christopher J Graham, Helena Hartmann, Clove Haviva, Alina Herderich, Leon Paul Hilbert, D. Holgado, Ian Hussey, Zlatomira Ilchovska, Tamara Kalandadze, Veli-Matti Karhulahti, Leon Kasseckert, Maren Klingelhöfer-Jens, Alina Koppold, Max Korbmacher

Psychology

Research output: Working paper/Preprint › Preprint

73 Downloads (Pure)

Abstract

In psychological science, replicability—repeating a study with a new sampleachieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://metaanalyses.shinyapps.io/replicationdatabase/), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

Original language	English
Publisher	MetaArXiv
Number of pages	42
DOIs	https://doi.org/10.31222/osf.io/me2ub
Publication status	Published - 11 Apr 2024

Access to Document

10.31222/osf.io/me2ubLicence: Creative Commons: Attribution-NoDerivs (CC BY-ND)

RöselerL2024Replication_preprintOther version, 1.35 MBLicence: Creative Commons: Attribution-NoDerivs (CC BY-ND)

Cite this

Röseler, L., Kaiser, L., Doetsch, C. A., Klett, N., Seida, C., Schütz, A., Aczel, B., Adelina, N., Agostini, V., Alarie, S., Albayarak-Aydemir, N., Aldoh, A., Al-Hoorie, A. H., Azevedo, F., Baker, B. J., Barth, C. L., Beitner, J., Brick, C., Brohmer, H., ... Korbmacher, M. (2024). The Replication Database: Documenting the Replicability of Psychological Science. MetaArXiv. https://doi.org/10.31222/osf.io/me2ub

@techreport{f1d9fef14fb64c7387703bcb34edfcf0,

title = "The Replication Database: Documenting the Replicability of Psychological Science",

abstract = "In psychological science, replicability—repeating a study with a new sampleachieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://metaanalyses.shinyapps.io/replicationdatabase/), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.",

author = "Lukas R{\"o}seler and Leonard Kaiser and Doetsch, {Christopher Albert} and Noah Klett and Christian Seida and Astrid Sch{\"u}tz and Balazs Aczel and Nadia Adelina and Valeria Agostini and Samuel Alarie and Nihan Albayarak-Aydemir and Alaa Aldoh and Al-Hoorie, {Ali H.} and Flavio Azevedo and Baker, {Bradley J.} and Barth, {Charlotte Lilian} and Julia Beitner and Cameron Brick and Hilmar Brohmer and Chandrashekar, {Subramanya Prasad} and Chung, {Kai Li} and Cockcroft, {Jamie Philip} and Jamie Cummins and Veronica Diveica and Tsvetomira Dumbalska and emir efendic and Mahmoud Elsherif and Evans, {Thomas Rhys} and Gilad Feldman and Fillon, {Adrien Alejandro} and Nico F{\"o}rster and Joris Frese and Oliver Genschow and Vaitsa Giannouli and Biljana Gjoneska and Timo Gnambs and Am{\'e}lie Gourdon-Kanhukamwe and Graham, {Christopher J} and Helena Hartmann and Clove Haviva and Alina Herderich and Hilbert, {Leon Paul} and D. Holgado and Ian Hussey and Zlatomira Ilchovska and Tamara Kalandadze and Veli-Matti Karhulahti and Leon Kasseckert and Maren Klingelh{\"o}fer-Jens and Alina Koppold and Max Korbmacher",

year = "2024",

month = apr,

day = "11",

doi = "10.31222/osf.io/me2ub",

language = "English",

publisher = "MetaArXiv",

type = "WorkingPaper",

institution = "MetaArXiv",

}

Röseler, L, Kaiser, L, Doetsch, CA, Klett, N, Seida, C, Schütz, A, Aczel, B, Adelina, N, Agostini, V, Alarie, S, Albayarak-Aydemir, N, Aldoh, A, Al-Hoorie, AH, Azevedo, F, Baker, BJ, Barth, CL, Beitner, J, Brick, C, Brohmer, H, Chandrashekar, SP, Chung, KL, Cockcroft, JP, Cummins, J, Diveica, V, Dumbalska, T, efendic, E, Elsherif, M, Evans, TR, Feldman, G, Fillon, AA, Förster, N, Frese, J, Genschow, O, Giannouli, V, Gjoneska, B, Gnambs, T, Gourdon-Kanhukamwe, A, Graham, CJ, Hartmann, H, Haviva, C, Herderich, A, Hilbert, LP, Holgado, D, Hussey, I, Ilchovska, Z, Kalandadze, T, Karhulahti, V-M, Kasseckert, L, Klingelhöfer-Jens, M, Koppold, A & Korbmacher, M 2024 'The Replication Database: Documenting the Replicability of Psychological Science' MetaArXiv. https://doi.org/10.31222/osf.io/me2ub

TY - UNPB

T1 - The Replication Database

T2 - Documenting the Replicability of Psychological Science

AU - Röseler, Lukas

AU - Kaiser, Leonard

AU - Doetsch, Christopher Albert

AU - Klett, Noah

AU - Seida, Christian

AU - Schütz, Astrid

AU - Aczel, Balazs

AU - Adelina, Nadia

AU - Agostini, Valeria

AU - Alarie, Samuel

AU - Albayarak-Aydemir, Nihan

AU - Aldoh, Alaa

AU - Al-Hoorie, Ali H.

AU - Azevedo, Flavio

AU - Baker, Bradley J.

AU - Barth, Charlotte Lilian

AU - Beitner, Julia

AU - Brick, Cameron

AU - Brohmer, Hilmar

AU - Chandrashekar, Subramanya Prasad

AU - Chung, Kai Li

AU - Cockcroft, Jamie Philip

AU - Cummins, Jamie

AU - Diveica, Veronica

AU - Dumbalska, Tsvetomira

AU - efendic, emir

AU - Elsherif, Mahmoud

AU - Evans, Thomas Rhys

AU - Feldman, Gilad

AU - Fillon, Adrien Alejandro

AU - Förster, Nico

AU - Frese, Joris

AU - Genschow, Oliver

AU - Giannouli, Vaitsa

AU - Gjoneska, Biljana

AU - Gnambs, Timo

AU - Gourdon-Kanhukamwe, Amélie

AU - Graham, Christopher J

AU - Hartmann, Helena

AU - Haviva, Clove

AU - Herderich, Alina

AU - Hilbert, Leon Paul

AU - Holgado, D.

AU - Hussey, Ian

AU - Ilchovska, Zlatomira

AU - Kalandadze, Tamara

AU - Karhulahti, Veli-Matti

AU - Kasseckert, Leon

AU - Klingelhöfer-Jens, Maren

AU - Koppold, Alina

AU - Korbmacher, Max

PY - 2024/4/11

Y1 - 2024/4/11

N2 - In psychological science, replicability—repeating a study with a new sampleachieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://metaanalyses.shinyapps.io/replicationdatabase/), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

AB - In psychological science, replicability—repeating a study with a new sampleachieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://metaanalyses.shinyapps.io/replicationdatabase/), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

U2 - 10.31222/osf.io/me2ub

DO - 10.31222/osf.io/me2ub

M3 - Preprint

BT - The Replication Database

PB - MetaArXiv

ER -

The Replication Database: Documenting the Replicability of Psychological Science

Abstract

Access to Document

Fingerprint

Cite this