Non-Standard Errors

In statistics, samples are drawn from a population in a data generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.Online appendix available at https://bit.ly/3DIQKrB.Please note a full list of authors is available in the working paper

Monitoring and Pay: An Experiment on Employee Performance under Endogenous Supervision

We present an experimental test of a shirking model where monitoring intensity is endogenous and effort a continuous variable. Wage level, monitoring intensity and consequently the desired enforceable effort level are jointly determined by the maximization problem of the firm. As a result, monitoring and pay should be complements. In our experiment, between and within treatment variation is qualitatively in line with the normative predictions of the model under standard assumptions. Yet, we also find evidence for reciprocal behavior. Our data analysis shows, however, that it does not pay for the employer to solely rely on the reciprocity of employees

Non-Standard Errors

In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in estimates of population parameters. In science, evidence is generated to test hypotheses in an evidencegenerating process (EGP). We claim that EGP variation across researchers adds uncertainty: Non-standard errors (NSEs). We study NSEs by letting 164 teams test the same hypotheses on the same data. NSEs turn out to be sizable, but smaller for better reproducible or higher rated research. Adding peer-review stages reduces NSEs. We further find that this type of uncertainty is underestimated by participants

What explains the North–South divide in Italian tax compliance? An experimental analysis

This is the author accepted manuscript. The final version is available from Palgrave Macmillan via the DOI in this recordI undertake a comparative study assessing the North–South divide in Italian tax compliance, employing the largest behavioral tax compliance experiment to date. Contrary to a large body of literature, I argue that willingness to pay taxes is constructed within a specific institutional environment and reflects the country’s quality of institutions. To test this hypothesis, I use controlled tax compliance experiments from four laboratories in Capua, Rome, Bologna, and Milan. By employing the experimental method, I am able to hold institutions constant allowing me to isolate cultural variation. Contrary to cultural explanations for tax compliance, when controlling the institutional environment, there is no difference in tax compliance. Furthermore, using social value orientation to compare prosociality, I also find no differences between the two regions. I therefore conclude that individuals’ relationship to their states shapes these behavioral differences in tax compliance.Funds for this research were provided by the European Research Council (Grant Agreement No. 295675 )

Eliciting taxpayer preferences increases tax compliance

Two experiments show that eliciting taxpayer preferences on government spending—providing taxpayer agency--increases tax compliance. We first create an income and taxation environment in a laboratory setting to test for compliance with a lab tax. Allowing a treatment group to express nonbinding preferences over tax spending priorities, leads to a 16% increase in tax compliance. A followup online study tests this treatment with a simulation of paying US federal taxes. Allowing taxpayers to signal their preferences on the distribution of government spending, results in a 15% reduction in the stated take-up rate of a questionable tax loophole. Providing taxpayer agency recouples tax payments with the public services obtained in return, reduces general anti-tax sentiment, and holds satisfaction with tax payment stable despite increased compliance with tax dues. With tax noncompliance costing the US government $385billion annually, providing taxpayer agency could have meaningful economic impact. At the same time, giving taxpayers a voice may act as a two-way "nudge," transforming tax payment from a passive experience to a channel of communication between taxpayers and government

Science Forum: Consensus-based guidance for conducting and reporting multi-analyst studies

Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research