Univ.-Prof. Dr. Erich Kirchler

Portraitfoto Erich Kirchler

Universitaetsstrasse 7 (NIG)

1010 Vienna

Room: D0603

T: +43-1-4277-47332

erich.kirchler@univie.ac.at



Publications

Research practices and statistical reporting quality in 250 economic psychology master’s theses: A meta-research investigation

Author(s)
Jerome Olsen, Johanna Mosen, Martin Voracek, Erico Kirchler
Abstract

The replicability of research findings has recently been disputed across multiple scientific disciplines. In constructive reaction, the research culture in psychology is facing fundamental changes, but investigations of research practices that led to these improvements have almost exclusively focused on academic researchers. By contrast, we investigated the statistical reporting quality and selected indicators of questionable research practices (QRPs) in psychology students' master's theses. In a total of 250 theses, we investigated utilization and magnitude of standardized effect sizes, along with statistical power, the consistency and completeness of reported results, and possible indications of p-hacking and further testing. Effect sizes were reported for 36% of focal tests (median r = 0.19), and only a single formal power analysis was reported for sample size determination (median observed power 1 − β = 0.67). Statcheck revealed inconsistent p-values in 18% of cases, while 2% led to decision errors. There were no clear indications of p-hacking or further testing. We discuss our findings in the light of promoting open science standards in teaching and student supervision.

Organisation(s)
Department of Occupational, Economic and Social Psychology, Department of Cognition, Emotion, and Methods in Psychology
External organisation(s)
Universität Wien
Journal
The Royal Society Open Science
Volume
6
No. of pages
16
ISSN
2054-5703
DOI
https://doi.org/10.1098/rsos.190738
Publication date
12-2019
Peer reviewed
Yes
Austrian Fields of Science 2012
501029 Economic psychology
Keywords
ASJC Scopus subject areas
General
Portal url
https://ucris.univie.ac.at/portal/en/publications/research-practices-and-statistical-reporting-quality-in-250-economic-psychology-masters-theses-a-metaresearch-investigation(14a70486-fbb5-41c9-bd00-a1fe5f0d4ebb).html