Experiments, Surveys and the Use of Representative Samples as Reference Data

During the last two decades, laboratory experiments have come into increasing prominence and constitute a popular method of research to examine behavioral outcomes and social preferences. However, it has been debated whether results from these experiments can be extrapolated to the real world and whether, for example, sample selection into the experiment might constitute a major shortcoming of this methodology. This note discusses potential benefits of combining experimental methods and representative datasets as a means to overcome some of the limitations of lab experiments. We also outline how large representative surveys can serve as reference data for researchers collectingexperiments, survey, representativity

Experiments, Surveys and the Use of Representative Samples as Reference Data

"During the last two decades, laboratory experiments have come into increasing prominence and constitute a popular method of research to examine behavioral outcomes and social preferences. However, it has been debated whether results from these experiments can be extrapolated to the real world and whether, for example, sample selection into the experiment might constitute a major shortcoming of this methodology. This note discusses potential benefits of combining experimental methods and representative datasets as a means to overcome some of the limitations of lab experiments. We also outline how large representative surveys can serve as reference data for researchers collecting their own datasets in order to explore potential sample selection biases." [author's abstract

Measuring Time Use in Surveys: How Valid Are Time Use Questions in Surveys? Concordance of Survey and Experience Sampling Measures

Since it is still unclear to what extent time allocation retrospectively reported in questionnaires, reflects people's actual behavior, examining the accuracy of responses to time use survey questions is of crucial importance. We analyze the congruence of time use information assessed through retrospective questionnaires and through experience sampling methodology. The sample comprised 433 individuals ranging in age from 14 to 86 years. Participants completed standard survey questions on time allocation. In addition, a mobile-phone based experience sampling technology was used over a period of three weeks to obtain snapshots of, on average, 54 momentary activities in which participants participated while pursuing their normal daily routines. Experience sampling assessments were scheduled six times a day over at least nine days, including workdays, Saturdays, andSundays. Results indicate that the congruence between time allocation assessed with survey questions (i.e. in SOEP) and time allocation assessed with experience sampling methodology depends on the characteristics of the respective activities. Associations between standard survey questions and experience sampling methods are quite substantial for long-lasting and externally structured activities, such as paid work on workdays. Incontrast, associations between survey and experience sampling methods are somewhat weaker, though highly statistically significant, for less externally structured, short-term and infrequent activities, such as errands, housework, and leisure. These moderate and relatively small correlations may indicate either an error-prone estimation of the prevalence of shortterm and infrequent activities by experience sampling or respondents' overrating of sporadic and short activities in survey questions. We conclude that activities with a long duration, such as paid work, can be measured in a satisfactory manner using short survey questions. Futureresearch is necessary to elucidate which method (experience sampling method or survey questions) delivers more reliable and valid measures for shortterm and sporadic activities.Day Reconstruction Methods (DRM) should be included in this future methodological research.Survey methods, experience sampling method, validity, time use, market work, housework, leisure, German Socio-Economic Panel Study, MMAA, SOEP

Intergenerational Earnings Mobility and Preferences for

Any opinions expressed here are those of the author(s) and not those of IZA. Research published in this series may include views on policy, but the institute itself takes no institutional policy positions. The IZA research network is committed to the IZA Guiding Principles of Research Integrity. The Institute for the Study of Labor (IZA) in Bonn is a local and virtual international research center and a place of communication between science, politics and business. IZA is an independent nonprofit organization supported by Deutsche Post Foundation. The center is associated with the University of Bonn and offers a stimulating research environment through its international network, workshops and conferences, data service, project support, research visits and doctoral program. IZA engages in (i) original and internationally competitive research in all fields of labor economics, (ii) development of policy concepts, and (iii) dissemination of research results and concepts to the interested public. IZA Discussion Papers often represent preliminary work and are circulated to encourage discussion. Citation of such a paper should account for its provisional character. A revised version may b