Evaluating Students' Evaluations of Professors

This paper contrasts measures of teacher effectiveness with the students' evaluations for the same teachers using administrative data from Bocconi University (Italy). The effectiveness measures are estimated by comparing the subsequent performance in follow-on coursework of students who are randomly assigned to teachers in each of their compulsory courses. We find that, even in a setting where the syllabuses are fixed and all teachers in the same course present exactly the same material, teachers still matter substantially. The average difference in subsequent performance between students who were assigned to the best and worst teacher (on the effectiveness scale) is approximately 43% of a standard deviation in the distribution of exam grades, corresponding to about 5.6% of the average grade. Additionally, we find that our measure of teacher effectiveness is negatively correlated with the students' evaluations: in other words, teachers who are associated with better subsequent performance receive worst evaluations from their students. We rationalize these results with a simple model where teachers can either engage in real teaching or in teaching-to-the-test, the former requiring higher students’ effort than the latter. Teaching-to-the-test guarantees high grades in the current course but does not improve future outcomes. Hence, if students are myopic and evaluate better teachers from which they derive higher utility in a static framework, the model is capable of predicting our empirical finding that good teachers receive bad evaluations, especially when teaching-to-the-test is very effective (for example, with multiple choice tests). Consistently with the predictions of the model, we also find that classes in which high skill students are over-represented produce evaluations that are less at odds with estimated teacher effectiveness.teacher quality, postsecondary education

Financial Literacy: The Impact of Financial Training in High School on the Credit Behavior of College Students

Managing credit is increasingly important not only for adults, but for college students. In recent years with sky rocketing tuition and easily available credit, college students find themselves with increasing debt burdens that result in serious and lasting financial problems. In response, financial literacy programs are emerging in hopes that better educated people will make healthy financial decisions, as well as responsibly manage credit. Research suggests that financial education should begin in high school so that young adults can effectively manage credit during the college years. This study assesses both college students’ financial knowledge and their credit management practices. Specifically, it examines whether Bryant University students retain and use the financial training from high school when making financial decisions and managing credit. The findings from this study illustrate that almost 75% of the 345 students that manage their own credit in college received financial training in high school and that although this training is negatively correlated with poor credit management behavior in college, the association is weak. This study further suggests that even with additional financial literacy training available in college, almost 60% of these students demonstrate poor credit management behavior. As a result, this study suggests that young people need to improve their credit management skills by setting budgets and employing good credit management techniques

Evaluating students' evaluations of professors

This paper contrasts measures of teacher effectiveness with the students’ evaluations of the same teachers using administrative data from Bocconi University (Italy). The effectiveness measures are estimated by comparing the subsequent performance in follow-on coursework of students who are randomly assigned to teachers in each of their compulsory courses. We find that, even in a setting where the syllabuses are fixed, teachers still matter substantially. Additionally, we find that our measure of teacher effectiveness is negatively correlated with the students’ evaluations of professors: in other words, teachers who are associated with better subsequent performance receive worse evaluations from their students. We rationalize these results with a simple model where teachers can either engage in real teaching or in teaching-to-the-test, the former requiring greater student effort than the latter. Teaching-to-the-test guarantees high grades in the current course but does not improve future outcomes. Hence, if students are short-sighted and give better evaluations to teachers from whom they derive higher utility in a static framework, the model is capable of predicting our empirical finding that good teachers receive bad evaluations.teacher quality, postsecondary education

Adobe Youth Voices Literature Review

Education Development Center, Inc. (EDC) received a grant from Adobe to conduct an evaluation of the Adobe Youth Voices (AYV) program. As part of the evaluation, EDC conducted a review of relevant literature to situate AYV in a broader context, provide stakeholders with a framework for understanding goals and outcomes, and frame and inform the evaluation questions. EDC reviewed scholarly articles, program reports and evaluations, and research studies that addressed youth media programs, youth development, teacher professional development, and other areas related to AYV's goals.Among the findings, the literature review includes 6 key points that speak to the AYV program:1. The goals of youth media programs most commonly cited can be grouped into several categories: Youth voice -- the capacity for self-expression Youth development -- the process of developing the skills and personal attributes that enable young people to become successful adults Media literacy -- the ability to analyze, evaluate and produce information in a variety of media forms Skill development -- such as communication, critical thinking, technology, and media production skills Social action or civic engagement 2. Outcomes and impacts on participants of youth media programs commonly found in the literature include: Improved skills Improved community perception of youth Positive youth development Increased social action and civic engagement 3. Outcomes and impacts on participants of youth development programs frequently cited include:Improved communication, critical thinking, and related skills Increased self-esteem More positive attitudes towards school and their futures 4. There is broad agreement that traditional educational approaches do not adequately address 21st century skills. Education must adapt to be more compatible with the ways in which young people think and learn, as well as the tools and media that are part of their environment.5. Student engagement in education has been associated with positive youth development and 21st century skills. Engaging instruction often includes inquiry- or project-based, multidisciplinary, and authentic learning activities.6. Educator professional development is believed to be a key step toward improving student outcomes. While there is little research that can demonstrate this connection, there is new focus on evaluating the effectiveness of professional development activities. Elements of effective professional development include learning communities and collaboration, ongoing support and assistance, and active or applied learning

Advances in Teaching & Learning Day Abstracts 2005

Proceedings of the Advances in Teaching & Learning Day Regional Conference held at The University of Texas Health Science Center at Houston in 2005

Passing Muster: Evaluating Teacher Evaluation Systems

Describes how state or federal governments could reward exceptional teachers based on a uniform standard across various district-level teacher evaluation systems by determining the systems' reliability in predicting future performance. Includes Q & A