TY - UNPB
T1 - Reporting and interpreting non-significant results in animal cognition research
AU - Farrar, Benjamin George
AU - Vernouillet, Alizée
AU - Garcia-Pelegrin, Elias
AU - Legg, Edward William
AU - Brecht, Katharina Friederike
AU - Lambert, Poppy
AU - Elsherif, Mahmoud Medhat
AU - Francis, Shannon
AU - O'Neill, Laurie
AU - Clayton, Nicola
AU - Ostojic, Ljerka
PY - 2022/2/19
Y1 - 2022/2/19
N2 - How negative results are reported and interpreted following null hypothesis significance testing is often criticised. With small sample sizes and often low number of test trials, studies in animal cognition are prone to producing non-significant p-values, irrespective of whether this is a false negative or true negative result. Thus, we assessed how negative results are reported and interpreted across published articles in animal cognition and related fields. In this study, we manually extracted and classified how researchers report and interpret non-significant p-values, and examined the p-value distribution of these non-significant results. We found a large amount of heterogeneity in how researchers report non-significant p-values in the result sections of articles, and how they interpret them in the titles and abstracts. “No Effect” interpretations were common in the titles (84%), abstracts (64%), and results sections (41%) of papers, whereas “Non-Significant” interpretations were less common in the titles (0%) and abstracts (26%), but were present in the results (52%). Discussions of effect sizes were rare (
AB - How negative results are reported and interpreted following null hypothesis significance testing is often criticised. With small sample sizes and often low number of test trials, studies in animal cognition are prone to producing non-significant p-values, irrespective of whether this is a false negative or true negative result. Thus, we assessed how negative results are reported and interpreted across published articles in animal cognition and related fields. In this study, we manually extracted and classified how researchers report and interpret non-significant p-values, and examined the p-value distribution of these non-significant results. We found a large amount of heterogeneity in how researchers report non-significant p-values in the result sections of articles, and how they interpret them in the titles and abstracts. “No Effect” interpretations were common in the titles (84%), abstracts (64%), and results sections (41%) of papers, whereas “Non-Significant” interpretations were less common in the titles (0%) and abstracts (26%), but were present in the results (52%). Discussions of effect sizes were rare (
U2 - 10.31234/osf.io/g9ja2
DO - 10.31234/osf.io/g9ja2
M3 - Preprint
BT - Reporting and interpreting non-significant results in animal cognition research
PB - PsyArXiv
ER -