Arbeitspapier

Non-standard errors

In statistics, samples are drawn from a population in a datagenerating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidencegenerating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.

Language
Englisch

Bibliographic citation
Series: Working Papers in Economics and Statistics ; No. 2021-31

Classification
Wirtschaft
Subject
Statistischer Fehler
Streuungsmaß
Wissenschaftler
Wissenschaftliche Methode
Theorie

Event
Geistige Schöpfung
(who)
Menkveld, Albert J.
Dreber, Anna
Holzmeister, Felix
Huber, Jürgen
Johannesson, Magnus
Kirchler, Michael
Neusüss, Sebastian
Razen, Michael
Weitzel, Utz
Event
Veröffentlichung
(who)
University of Innsbruck, Research Platform Empirical and Experimental Economics (eeecon)
(where)
Innsbruck
(when)
2021

Handle
Last update
10.03.2025, 11:42 AM CET

Data provider

This object is provided by:
ZBW - Deutsche Zentralbibliothek für Wirtschaftswissenschaften - Leibniz-Informationszentrum Wirtschaft. If you have any questions about the object, please contact the data provider.

Object type

  • Arbeitspapier

Associated

  • Menkveld, Albert J.
  • Dreber, Anna
  • Holzmeister, Felix
  • Huber, Jürgen
  • Johannesson, Magnus
  • Kirchler, Michael
  • Neusüss, Sebastian
  • Razen, Michael
  • Weitzel, Utz
  • University of Innsbruck, Research Platform Empirical and Experimental Economics (eeecon)

Time of origin

  • 2021

Other Objects (12)