Is There Selection Bias in Laboratory Experiments? The Case of Social and Risk Preferences

Laboratory experiments are frequently used to examine the nature of individual preferences and inform economic theory. However, it is unknown whether the preferences of volunteer participants are representative of the population from which the participants are drawn or whether they differ due to selection bias. We examine whether the social and risk preferences of participants in a laboratory experiment represent the preferences of the population from which they are recruited. To answer this question, we measured the preferences of 1,173 students in a classroom experiment. Separately, we invited all students to participate in a laboratory experiment. We find that the social and risk preferences of students who attend the laboratory experiment do not differ significantly from the preferences of the population from which they were recruited. Moreover, participation decisions based on social and risk preferences do not differ significantly across most subgroups, with the exception that female participants are on average less risk averse than female non-participants, and male participants are more risk averse than male non-participants.selection bias, laboratory experiments, external validity, social preferences, risk preferences

Is There Selection Bias in Laboratory Experiments?*

Do the social and risk preferences of participants in laboratory experiments represent the preferences of the population from which they are recruited? To answer this question, we conducted a classroom experiment with a population of 1,173 students using a trust game and a lottery choice task to measure individual preferences. Separately, all 1,173 students were invited to participate in a laboratory experiment. To determine whether selection bias exists, we compare the preferences of the individuals who eventually participated in a laboratory experiment to those in the population. We find that the social and risk preferences of the students participating in the laboratory experiment are not significantly different from the preferences of the population from which they were recruited. We further show that participation decisions across most subgroups (e.g., men vs. women) do not differ significantly. We therefore fail to find selection bias based on social and risk preferences.external validity; social preferences; selection bias; laboratory experiments; risk preferences

Is there selection bias in laboratory experiments? The case of social and risk preferences

Laboratory experiments are frequently used to examine the nature of individual preferences and inform economic theory. However, it is unknown whether the preferences of volunteer participants are representative of the population from which the participants are drawn or whether they differ due to selection bias. We examine whether the social and risk preferences of participants in a laboratory experiment represent the preferences of the population from which they are recruited. To answer this question, we measured the preferences of 1,173 students in a classroom experiment. Separately, we invited all students to participate in a laboratory experiment. We find that the social and risk preferences of students who attend the laboratory experiment do not differ significantly from the preferences of the population from which they were recruited. Moreover, participation decisions based on social and risk preferences do not differ significantly across most subgroups, with the exception that female participants are on average less risk averse than female non-participants, and male participants are more risk averse than male non-participants

Is There Selection Bias in Laboratory Experiments?*

Do the social and risk preferences of participants in laboratory experiments represent the preferences of the population from which they are recruited? To answer this question, we conducted a classroom experiment with a population of 1,173 students using a trust game and a lottery choice task to measure individual preferences. Separately, all 1,173 students were invited to participate in a laboratory experiment. To determine whether selection bias exists, we compare the preferences of the individuals who eventually participated in a laboratory experiment to those in the population. We find that the social and risk preferences of the students participating in the laboratory experiment are not significantly different from the preferences of the population from which they were recruited. We further show that participation decisions across most subgroups (e.g., men vs. women) do not differ significantly. We therefore fail to find selection bias based on social and risk preferences

Perfect and imperfect strangers in dilemma games

This paper focuses on social dilemma games where players may or may not meet the same partner again in the future. In line with the notion that contagion of cooperation is more likely the higher the likelihood of being re-matched with the same partner in the future, both a novel experiment and a meta-study document higher cooperation rates if this likelihood is sufficiently high

Perfect and Imperfect Strangers in Social Dilemmas

This paper focuses on social dilemma games where players may or may not meet the same partner again in the future. In line with the notion that contagion of cooperation is more likely the higher the likelihood of being re-matched with the same partner in the future, both a novel experiment and a meta-study document higher cooperation rates if this likelihoodis sufficiently high