The Replication Database: Documenting the Replicability of Psychological Science

Lukas Röseler; Leonard Kaiser; Christopher Albert Doetsch; Noah Klett; Christian Seida; Astrid Schütz; Balazs Aczel; Nadia Adelina; Valeria Agostini; Samuel Alarie; Nihan Albayrak-Aydemir; Alaa Aldoh; Ali H. Al-Hoorie; Flavio Azevedo; Bradley J. Baker; Charlotte Lilian Barth; Julia Beitner; Cameron Brick; Hilmar Brohmer; Subramanya Prasad Chandrashekar; Kai Li Chung; Jamie P. Cockcroft; Jamie Cummins; Tsvetomira Dumbalska; emir efendic; Mahmoud Elsherif; Thomas R. Evans; Gilad Feldman; Adrien A. Fillon; Nico Förster; Joris Frese; Oliver Genschow; Vaitsa Giannouli; Biljana Gjoneska; Timo Gnambs; Amélie Gourdon-Kanhukamwe; Christopher J. Graham; Helena Hartmann; Clove Haviva; Alina Herderich; Leon Paul Hilbert; Darías  Holgado; Ian Hussey; Zlatomira Ilchovska; Tamara Kalandadze; Veli-Matti Karhulahti; Leon Kasseckert; Maren Klingelhöfer-Jens; Alina Koppold; Max Korbmacher; Louisa Kulke; Niclas  Kuper; Annalise A LaPlume; Gavin  Leech; Feline Lohkamp; Nigel Mantou Lou; Dermot  Lynott; Maximilian  Maier; Maria Lessani; Maria Montefinese; David Moreau; Kellen  Mrkva; Monika  Nemcova; Danna  Oomen; Julian  Packheiser; Shubham  Pandey; Frank  Papenmeier; Mariola  Paruzel-Czachura; Yuri G. Pavlov; Zoran Pavlović; Charlotte R. Pennington; Merle-Marie Pittelkow; Willemijn  Plomp; Paul E.  Plonski; Ekaterina Pronizius; Andrew Adrian  Pua; Katarzyna Pypno-Blajda; Manuel  Rausch; Tobias R.  Rebholz; Elena  Richert; Jan Philipp Röer; Robert M  Ross; Kathleen Schmidt; Aleksandrina  Skvortsova; Matthias F. J.  Sperl; Alvin W. M.  Tan; J. Lukas  Thürmer; Aleksandra  Tołopiło; Wolf  Vanpaemel; Leigh Ann Vaughn; Steven Verheyen; Lukas  Wallrich; Lucia Weber; Julia K. Wolska; Mirela Zaneva; Yikang  Zhang

doi:10.5334/jopd.101

The Replication Database: Documenting the Replicability of Psychological Science

Lukas Röseler, Leonard Kaiser, Christopher Albert Doetsch, Noah Klett, Christian Seida, Astrid Schütz, Balazs Aczel, Nadia Adelina, Valeria Agostini, Samuel Alarie, Nihan Albayrak-Aydemir, Alaa Aldoh, Ali H. Al-Hoorie, Flavio Azevedo, Bradley J. Baker, Charlotte Lilian Barth, Julia Beitner, Cameron Brick, Hilmar Brohmer, Subramanya Prasad ChandrashekarKai Li Chung, Jamie P. Cockcroft, Jamie Cummins, Tsvetomira Dumbalska, emir efendic, Mahmoud Elsherif, Thomas R. Evans, Gilad Feldman, Adrien A. Fillon, Nico Förster, Joris Frese, Oliver Genschow, Vaitsa Giannouli, Biljana Gjoneska, Timo Gnambs, Amélie Gourdon-Kanhukamwe, Christopher J. Graham, Helena Hartmann, Clove Haviva, Alina Herderich, Leon Paul Hilbert, Darías Holgado, Ian Hussey, Zlatomira Ilchovska, Tamara Kalandadze, Veli-Matti Karhulahti, Leon Kasseckert, Maren Klingelhöfer-Jens, Alina Koppold, Max Korbmacher, Louisa Kulke, Niclas Kuper, Annalise A LaPlume, Gavin Leech, Feline Lohkamp, Nigel Mantou Lou, Dermot Lynott, Maximilian Maier, Maria Lessani, Maria Montefinese, David Moreau, Kellen Mrkva, Monika Nemcova, Danna Oomen, Julian Packheiser, Shubham Pandey, Frank Papenmeier, Mariola Paruzel-Czachura, Yuri G. Pavlov, Zoran Pavlović, Charlotte R. Pennington, Merle-Marie Pittelkow, Willemijn Plomp, Paul E. Plonski, Ekaterina Pronizius, Andrew Adrian Pua, Katarzyna Pypno-Blajda, Manuel Rausch, Tobias R. Rebholz, Elena Richert, Jan Philipp Röer, Robert M Ross, Kathleen Schmidt, Aleksandrina Skvortsova, Matthias F. J. Sperl, Alvin W. M. Tan, J. Lukas Thürmer, Aleksandra Tołopiło, Wolf Vanpaemel, Leigh Ann Vaughn, Steven Verheyen, Lukas Wallrich, Lucia Weber, Julia K. Wolska, Mirela Zaneva, Yikang Zhang

Psychology

Research output: Contribution to journal › Article › peer-review

8 Downloads (Pure)

Abstract

In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

Original language	English
Article number	8
Number of pages	23
Journal	Journal of Open Psychology Data
Volume	12
Issue number	8
DOIs	https://doi.org/10.5334/jopd.101
Publication status	Published - 11 Sept 2024

Access to Document

10.5334/jopd.101Licence: Creative Commons: Attribution (CC BY)

RöselerL2024ReplicationFinal published version, 4.22 MBLicence: Creative Commons: Attribution (CC BY)

Cite this

Röseler, L., Kaiser, L., Doetsch, C. A., Klett, N., Seida, C., Schütz, A., Aczel, B., Adelina, N., Agostini, V., Alarie, S., Albayrak-Aydemir, N., Aldoh, A., Al-Hoorie, A. H., Azevedo, F., Baker, B. J., Barth, C. L., Beitner, J., Brick, C., Brohmer, H., ... Zhang, Y. (2024). The Replication Database: Documenting the Replicability of Psychological Science. Journal of Open Psychology Data, 12(8), Article 8. https://doi.org/10.5334/jopd.101

@article{173d4a43318246fdaa56a722742413d6,

title = "The Replication Database: Documenting the Replicability of Psychological Science",

abstract = "In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.",

author = "Lukas R{\"o}seler and Leonard Kaiser and Doetsch, {Christopher Albert} and Noah Klett and Christian Seida and Astrid Sch{\"u}tz and Balazs Aczel and Nadia Adelina and Valeria Agostini and Samuel Alarie and Nihan Albayrak-Aydemir and Alaa Aldoh and Al-Hoorie, {Ali H.} and Flavio Azevedo and Baker, {Bradley J.} and Barth, {Charlotte Lilian} and Julia Beitner and Cameron Brick and Hilmar Brohmer and Chandrashekar, {Subramanya Prasad} and Chung, {Kai Li} and Cockcroft, {Jamie P.} and Jamie Cummins and Tsvetomira Dumbalska and emir efendic and Mahmoud Elsherif and Evans, {Thomas R.} and Gilad Feldman and Fillon, {Adrien A.} and Nico F{\"o}rster and Joris Frese and Oliver Genschow and Vaitsa Giannouli and Biljana Gjoneska and Timo Gnambs and Am{\'e}lie Gourdon-Kanhukamwe and Graham, {Christopher J.} and Helena Hartmann and Clove Haviva and Alina Herderich and Hilbert, {Leon Paul} and Dar{\'i}as Holgado and Ian Hussey and Zlatomira Ilchovska and Tamara Kalandadze and Veli-Matti Karhulahti and Leon Kasseckert and Maren Klingelh{\"o}fer-Jens and Alina Koppold and Max Korbmacher and Louisa Kulke and Niclas Kuper and LaPlume, {Annalise A} and Gavin Leech and Feline Lohkamp and Lou, {Nigel Mantou} and Dermot Lynott and Maximilian Maier and Maria Lessani and Maria Montefinese and David Moreau and Kellen Mrkva and Monika Nemcova and Danna Oomen and Julian Packheiser and Shubham Pandey and Frank Papenmeier and Mariola Paruzel-Czachura and Pavlov, {Yuri G.} and Zoran Pavlovi{\'c} and Pennington, {Charlotte R.} and Merle-Marie Pittelkow and Willemijn Plomp and Plonski, {Paul E.} and Ekaterina Pronizius and Pua, {Andrew Adrian} and Katarzyna Pypno-Blajda and Manuel Rausch and Rebholz, {Tobias R.} and Elena Richert and R{\"o}er, {Jan Philipp} and Ross, {Robert M} and Kathleen Schmidt and Aleksandrina Skvortsova and Sperl, {Matthias F. J.} and Tan, {Alvin W. M.} and Th{\"u}rmer, {J. Lukas} and Aleksandra To{\l}opi{\l}o and Wolf Vanpaemel and Vaughn, {Leigh Ann} and Steven Verheyen and Lukas Wallrich and Lucia Weber and Wolska, {Julia K.} and Mirela Zaneva and Yikang Zhang",

year = "2024",

month = sep,

day = "11",

doi = "10.5334/jopd.101",

language = "English",

volume = "12",

journal = "Journal of Open Psychology Data",

issn = "2050-9863",

publisher = "Ubiquity Press",

number = "8",

}

Röseler, L, Kaiser, L, Doetsch, CA, Klett, N, Seida, C, Schütz, A, Aczel, B, Adelina, N, Agostini, V, Alarie, S, Albayrak-Aydemir, N, Aldoh, A, Al-Hoorie, AH, Azevedo, F, Baker, BJ, Barth, CL, Beitner, J, Brick, C, Brohmer, H, Chandrashekar, SP, Chung, KL, Cockcroft, JP, Cummins, J, Dumbalska, T, efendic, E, Elsherif, M, Evans, TR, Feldman, G, Fillon, AA, Förster, N, Frese, J, Genschow, O, Giannouli, V, Gjoneska, B, Gnambs, T, Gourdon-Kanhukamwe, A, Graham, CJ, Hartmann, H, Haviva, C, Herderich, A, Hilbert, LP, Holgado, D, Hussey, I, Ilchovska, Z, Kalandadze, T, Karhulahti, V-M, Kasseckert, L, Klingelhöfer-Jens, M, Koppold, A, Korbmacher, M, Kulke, L, Kuper, N, LaPlume, AA, Leech, G, Lohkamp, F, Lou, NM, Lynott, D, Maier, M, Lessani, M, Montefinese, M, Moreau, D, Mrkva, K, Nemcova, M, Oomen, D, Packheiser, J, Pandey, S, Papenmeier, F, Paruzel-Czachura, M, Pavlov, YG, Pavlović, Z, Pennington, CR, Pittelkow, M-M, Plomp, W, Plonski, PE, Pronizius, E, Pua, AA, Pypno-Blajda, K, Rausch, M, Rebholz, TR, Richert, E, Röer, JP, Ross, RM, Schmidt, K, Skvortsova, A, Sperl, MFJ, Tan, AWM, Thürmer, JL, Tołopiło, A, Vanpaemel, W, Vaughn, LA, Verheyen, S, Wallrich, L, Weber, L, Wolska, JK, Zaneva, M & Zhang, Y 2024, 'The Replication Database: Documenting the Replicability of Psychological Science', Journal of Open Psychology Data, vol. 12, no. 8, 8. https://doi.org/10.5334/jopd.101

TY - JOUR

T1 - The Replication Database

T2 - Documenting the Replicability of Psychological Science

AU - Röseler, Lukas

AU - Kaiser, Leonard

AU - Doetsch, Christopher Albert

AU - Klett, Noah

AU - Seida, Christian

AU - Schütz, Astrid

AU - Aczel, Balazs

AU - Adelina, Nadia

AU - Agostini, Valeria

AU - Alarie, Samuel

AU - Albayrak-Aydemir, Nihan

AU - Aldoh, Alaa

AU - Al-Hoorie, Ali H.

AU - Azevedo, Flavio

AU - Baker, Bradley J.

AU - Barth, Charlotte Lilian

AU - Beitner, Julia

AU - Brick, Cameron

AU - Brohmer, Hilmar

AU - Chandrashekar, Subramanya Prasad

AU - Chung, Kai Li

AU - Cockcroft, Jamie P.

AU - Cummins, Jamie

AU - Dumbalska, Tsvetomira

AU - efendic, emir

AU - Elsherif, Mahmoud

AU - Evans, Thomas R.

AU - Feldman, Gilad

AU - Fillon, Adrien A.

AU - Förster, Nico

AU - Frese, Joris

AU - Genschow, Oliver

AU - Giannouli, Vaitsa

AU - Gjoneska, Biljana

AU - Gnambs, Timo

AU - Gourdon-Kanhukamwe, Amélie

AU - Graham, Christopher J.

AU - Hartmann, Helena

AU - Haviva, Clove

AU - Herderich, Alina

AU - Hilbert, Leon Paul

AU - Holgado, Darías

AU - Hussey, Ian

AU - Ilchovska, Zlatomira

AU - Kalandadze, Tamara

AU - Karhulahti, Veli-Matti

AU - Kasseckert, Leon

AU - Klingelhöfer-Jens, Maren

AU - Koppold, Alina

AU - Korbmacher, Max

AU - Kulke, Louisa

AU - Kuper, Niclas

AU - LaPlume, Annalise A

AU - Leech, Gavin

AU - Lohkamp, Feline

AU - Lou, Nigel Mantou

AU - Lynott, Dermot

AU - Maier, Maximilian

AU - Lessani, Maria

AU - Montefinese, Maria

AU - Moreau, David

AU - Mrkva, Kellen

AU - Nemcova, Monika

AU - Oomen, Danna

AU - Packheiser, Julian

AU - Pandey, Shubham

AU - Papenmeier, Frank

AU - Paruzel-Czachura, Mariola

AU - Pavlov, Yuri G.

AU - Pavlović, Zoran

AU - Pennington, Charlotte R.

AU - Pittelkow, Merle-Marie

AU - Plomp, Willemijn

AU - Plonski, Paul E.

AU - Pronizius, Ekaterina

AU - Pua, Andrew Adrian

AU - Pypno-Blajda, Katarzyna

AU - Rausch, Manuel

AU - Rebholz, Tobias R.

AU - Richert, Elena

AU - Röer, Jan Philipp

AU - Ross, Robert M

AU - Schmidt, Kathleen

AU - Skvortsova, Aleksandrina

AU - Sperl, Matthias F. J.

AU - Tan, Alvin W. M.

AU - Thürmer, J. Lukas

AU - Tołopiło, Aleksandra

AU - Vanpaemel, Wolf

AU - Vaughn, Leigh Ann

AU - Verheyen, Steven

AU - Wallrich, Lukas

AU - Weber, Lucia

AU - Wolska, Julia K.

AU - Zaneva, Mirela

AU - Zhang, Yikang

PY - 2024/9/11

Y1 - 2024/9/11

N2 - In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

AB - In psychological science, replicability—repeating a study with a new sample achieving consistent results (Parsons et al., 2022)—is critical for affirming the validity of scientific findings. Despite its importance, replication efforts are few and far between in psychological science with many attempts failing to corroborate past findings. This scarcity, compounded by the difficulty in accessing replication data, jeopardizes the efficient allocation of research resources and impedes scientific advancement. Addressing this crucial gap, we present the Replication Database (https://forrt-replications.shinyapps.io/fred_explorer), a novel platform hosting 1,239 original findings paired with replication findings. The infrastructure of this database allows researchers to submit, access, and engage with replication findings. The database makes replications visible, easily findable via a graphical user interface, and tracks replication rates across various factors, such as publication year or journal. This will facilitate future efforts to evaluate the robustness of psychological research.

U2 - 10.5334/jopd.101

DO - 10.5334/jopd.101

M3 - Article

SN - 2050-9863

VL - 12

JO - Journal of Open Psychology Data

JF - Journal of Open Psychology Data

IS - 8

M1 - 8

ER -