Complexidade e escala na investigação da eficácia do ensino: reflexões do estudo MET

Researchers and policymakers in the US and beyond increasingly seek to identify teaching qualities that are associated with academic achievement gains for K-12 students through effectiveness studies. Yet teaching quality varies with academic content and social contexts, involves multiple participants, and requires a range of skills, knowledge, and dispositions. In this essay, we address the inescapable tension between complexity and scale in research on teaching effectiveness. We provide five recommendations to study designers and analysts to manage this tension to enhance effectiveness research, drawing on our recent experiences as the first external analysts of the Measures of Effective Teaching (MET) study. Our recommendations address conceptual framing, the measurement of teaching (e.g., observation protocols, student surveys), sampling, classroom videoing, and the use and interpretation of value-added models.Investigadores y legisladores en los Estados Unidos y en otros países buscan identificar las cualidades de la enseñanza que se asocian con incrementos de desempeño académico para alumnos de primaria y secundaria a través de estudios de eficacia. Sin embargo, la calidad de la enseñanza varía según el contenido académico y los contextos sociales, involucra a múltiples participantes y requiere una variedad de habilidades, conocimientos y disposiciones. En este ensayo, abordamos la ineludible tensión entre la complejidad y la escala en la investigación sobre la eficacia de la enseñanza. Proveemos cinco recomendaciones a los diseñadores de estudios y analistas para manejar esta tensión y mejorar la investigación de eficacia, aprovechando nuestras experiencias recientes como los primeros analistas externos del estudio Measures of Effective Teaching (MET). Nuestras recomendaciones abordan el marco conceptual, la medición de la enseñanza (por ej., protocolos de observación, encuestas de estudiantes), el muestreo, el video en el aula y el uso e interpretación de modelos de valor agregado.Pesquisadores e legisladores nos Estados Unidos e em outros países buscam identificar as qualidades de ensino associadas ao aumento do desempenho acadêmico de alunos do ensino fundamental e médio por meio de estudos de eficácia. No entanto, a qualidade do ensino varia de acordo com o conteúdo acadêmico e os contextos sociais, envolve múltiplos participantes e requer uma variedade de habilidades, conhecimentos e disposições. Neste ensaio, abordamos a tensão inescapável entre complexidade e escala na pesquisa sobre a eficácia do ensino. Fornecemos cinco recomendações para projetistas e analistas de estudo para gerenciar essa tensão e melhorar a pesquisa sobre eficácia, alavancando nossas experiências recentes como os primeiros analistas externos do estudo Measures of Effective Teaching (MET). Nossas recomendações abordam a estrutura conceitual, a medição do ensino (por exemplo, protocolos de observação, pesquisas com estudantes), amostragem, vídeo em sala de aula e o uso e interpretação de modelos de valor agregado

‘Fitting in’ in high school: how adolescent belonging is influenced by locus of control beliefs

Social interactions in the high school context are the source material for more enduring perceptions of fitting in for adolescents. Prior research demonstrates that perceptions of belonging relate to school engagement and academic outcomes. This study extends theories of adolescent belonging in school to highlight how individual differences in locus of control exist across adolescents' with disparate levels of belonging. In-depth, semi-structured interviews were conducted with 34 adolescents. The methods of interpretive science were used to explore adolescent sense-making around navigating fitting in with peers. This analysis identified that adolescents' locus of control beliefs differed across levels of perceived belonging. Results provide evidence for both the need to account for individual differences in conceptualising adolescent belonging in school and the consideration of teaching practice and task structure when designing school-based interventions

Depicting the logic of three evaluation theories.

Here, we describe the development of logic models depicting three theories of evaluation practice: Practical Participatory (Cousins & Whitmore, 1998), Values-engaged (Greene, 2005a, 2005b), and Emergent Realist (Mark et al., 1998). We begin with a discussion of evaluation theory and the particular theories that were chosen for our analysis. We then outline the steps involved in constructing the models. The theoretical prescriptions and claims represented here follow a logic model template developed at the University Wisconsin-Extension (Taylor-Powell & Henert, 2008), which also closely aligns with Mark's (2008) framework for research on evaluation

Depicting the logic of three evaluation theories.

Here, we describe the development of logic models depicting three theories of evaluation practice: Practical Participatory (Cousins & Whitmore, 1998), Values-engaged (Greene, 2005a, 2005b), and Emergent Realist (Mark et al., 1998). We begin with a discussion of evaluation theory and the particular theories that were chosen for our analysis. We then outline the steps involved in constructing the models. The theoretical prescriptions and claims represented here follow a logic model template developed at the University Wisconsin-Extension (Taylor-Powell & Henert, 2008), which also closely aligns with Mark's (2008) framework for research on evaluation

Bridges and Barriers: Adolescent Perceptions of Student-Teacher Relationships

In urban secondary schools where underpreparation and dropping out are real world concerns, students understand that their relationships with teachers affect their learning. Using descriptive coding and thematic analysis of focus group data, we explore adolescents’ perceptions of the bridges that foster and the barriers that inhibit supportive relationships with teachers, and the boundary expectations that function as both. The characteristics of supportive student–teacher relationships identified by youth participants suggest a number of teacher practices capable of meeting adolescents’ developmental needs and, as such, are likely to positively influence adolescents’ developmental and academic trajectories