Developmentally Appropriate Evaluations: How Evaluation Practices Differ Across Age of Participants

It is well-known that meaningful differences in development exist among children, adolescents, and adults. However, to what extent do evaluators adapt their approach, designs, and methods to be responsive to a youth population? This study used an experimental simulation in which practicing evaluators designed an evaluation of a hypothetical tutoring program and were randomly assigned to the program serving children, adolescents, or young adults. Results indicate that evaluators were less likely to be participatory—both in the evaluation overall and in data collection—when the participants of the program were children than when they were adults. These findings suggest that evaluators, even those with experience conducting evaluations of youth programs, do not consider age as a meaningful cultural context and may need additional training in conducting developmentally appropriate evaluations

Promoting Intentions to Persist in Computing: An Examination of Six Years of the EarSketch Program

This is a postprint (accepted manuscript) of an article published by Taylor & Francis in Computer Science Education on January 2020, available online: http://www.tandfonline.com/10.1080/08993408.2020.1714313Background and Context: EarSketch was developed as a program to foster persistence in computer science with diverse student populations. Objective: To test the effectiveness of EarSketch in promoting intentions to persist, particularly among female students and under-represented minority students. Method: Meta-analyses, structural equation modeling, multi-level modeling, and qualitative analyses were performed to examine how participation in EarSketch and other factors affect students’ intentions to persist in computing. Findings: Students significantly increased their intentions to persist in computing, g=.40[.25,54], but examination within just the five quasi-experimental studies did not result in a significant difference for students in EarSketch compared to students not in EarSketch, g=.08[-.07, .23]. Student attitudes towards computing and the perceived authenticity of the EarSketch environment significantly predicted intentions to persist in computing. Implications: Participation in computer science education can increase students’ intentions to persist in programming, and EarSketch is one such program that can aid in these intentions.National Science Foundation (U.S.