Striving against invalidity in qualitative research: Discussing a reflective framework

The aim of this paper is to discuss a reflective validation framework related with the study of teaching approaches, teaching styles or teaching orientations of university academics. In the recent years, and particularly since the eighties, there have been a growing number of investigations linking teaching conceptions with teaching practices. The majority of investigations dealing with university teachers’ conceptions and practices draw their conclusions based on indirect observation, since data gathering involves mainly semi-structured interviews or the application of questionnaires and inventories. Therefore ‘only-half-the-story’ has been reported. The presented validation framework has a five-part three-stage structure and was built upon earlier work (Selvaruby, O’Sullivan, & Watts, 2007). In this model validity is conceptualized as an ‘iterative-interactive-process’, therefore integrating a set of specific strategies envisaging the maximization of scientific quality. The application of the model is illustrated by using it for the discussion of a longitudinal study involving the investigation of the relationship between questioning practices and Trigwell and co-workers’ concept of preferential teaching approaches (Trigwell, Prosser & Taylor, 1994). Field work of this naturalistic-interpretative research was conducted during two academic years (2009/2010 and 2010/2011) and implied close collaboration with a group of four university teachers lecturing biology to undergraduates.This work was financed by Fundação para a Ciência e a Tecnologia (SFRH/BD/44611/2008) and by Fundos FEDER através do Programa Operacional Fatores de Competitividade – COMPETE e por Fundos Nacionais através da FCT (PTDC/CPE-CED/117516/2010)

Reviews

Francis Botto, Dictionary of Multimedia and Internet Applications ‐ A Guide for Developers and Users, Chichester, UK: John Wiley & Sons, 1999. ISBN: 0–471–986240. Hardback, x+362 pages, £34.95

Inside Online Charter Schools

Online charter schools -- also known as virtual charters or cyber charters -- are publicly funded schools of choice that deliver student instruction via telecommunications. Today, about 200 online charter schools are operating in the United States, serving about 200,000 students at the elementary, middle, and high school grade levels. Although online instruction is increasing rapidly, there have been few studies of their operations and effects. In innovative new research funded by the Walton Family Foundation, the National Study of Online Charter Schools offers a rigorous analysis of online charter schools and their effects. Mathematica Policy Research's report provides the first nationwide data and analysis of the operations and instructional approaches of online charter schools, based on data collected in a survey completed by 127 principals of online charter schools across the country and public data from the U.S. Department of Education

A validity and reliability study of the Attitudes toward Sustainable Development scale

This article describes the development and validation of the Attitudes toward Sustainable Development scale, a quantitative 20-item scale that measures Italian university students\u2019 attitudes toward sustainable development. A total of 484 undergraduate students completed the questionnaire. The validity and reliability of the scale was statistically tested by computing the KMO and Bartlett tests and via an exploratory factor analysis, descriptive statistics, Cronbach\u2019s alpha, a confirmatory factor analysis and a multi-group invariance testing. The results of the principal components factor analysis show that the scale consists of the following four dimensions, with five items in each: environment, economy, society and education. The overall structure and measurement of the scale are confirmed by the confirmatory factor analysis and by the multi-group invariance testing. Internal reliability, which was found using Cronbach\u2019s alpha, varies between .660 and .854. The results show that the instrument meets the validity and reliability criteria. To demonstrate its utility, the scale was applied to detect differences in sustainable development attitudes among students pursuing degrees in psychology and in agriculture. Relevant differences were detected for the dimensions of environment and society. The Attitudes toward Sustainable Development scale could be useful for understanding the ways in which students think about sustainability issues and could be used to investigate the relationship between sustainability attitudes and other variables

Using classroom communication systems to support interaction and discussion in large class settings

Teaching methods that promote interaction and discussion are known to benefit learning. However, large class sizes make it difficult to implement these methods. Research from the United States has shown that an electronic classroom communication system (CCS) can be used to support active discussion in large lecture classes. This investigation extends that research and it evaluates students’ and teachers’ experiences of CCS technology in the context of two different modes of discussion — peer‐group and class‐wide discussion. With CCS technology, students’ answers to multiple‐choice concept tests are collated in real time with the class results fed back as a histogram. This information serves as the trigger for each mode of discussion. This paper explores the unique contribution of CCS technology, the relative strengths of peer‐ and class‐wide discussion and some practical implementation issues

Evaluating Students' Evaluations of Professors

This paper contrasts measures of teacher effectiveness with the students' evaluations for the same teachers using administrative data from Bocconi University (Italy). The effectiveness measures are estimated by comparing the subsequent performance in follow-on coursework of students who are randomly assigned to teachers in each of their compulsory courses. We find that, even in a setting where the syllabuses are fixed and all teachers in the same course present exactly the same material, teachers still matter substantially. The average difference in subsequent performance between students who were assigned to the best and worst teacher (on the effectiveness scale) is approximately 43% of a standard deviation in the distribution of exam grades, corresponding to about 5.6% of the average grade. Additionally, we find that our measure of teacher effectiveness is negatively correlated with the students' evaluations: in other words, teachers who are associated with better subsequent performance receive worst evaluations from their students. We rationalize these results with a simple model where teachers can either engage in real teaching or in teaching-to-the-test, the former requiring higher students’ effort than the latter. Teaching-to-the-test guarantees high grades in the current course but does not improve future outcomes. Hence, if students are myopic and evaluate better teachers from which they derive higher utility in a static framework, the model is capable of predicting our empirical finding that good teachers receive bad evaluations, especially when teaching-to-the-test is very effective (for example, with multiple choice tests). Consistently with the predictions of the model, we also find that classes in which high skill students are over-represented produce evaluations that are less at odds with estimated teacher effectiveness.teacher quality, postsecondary education

Teaching with Twitter:reflections on practices, opportunities and problems

In recent times there has been an increasing wave of interest in the use of Social Media for Teaching and Learning in Higher Education. In particular, the micro-blogging platform Twitter has been experimentally used in various Universities world-wide. There are relevant publications reporting on experimentations with Twitter for reaching diverse learning goals, including better engagement, informal learning or collaboration among students. Existing research papers on the use of Twitter however focus exclusively on the positive aspects of experimentations, on what went well in the use of Twitter. In our University we run a small project on the use of Twitter with goals that are similar to those of others: fostering participation and better learning processes. In this paper we report on our project and the strategies and best practices we adopted for using Twitter for teaching. We also reflect that in our experimentation however we encountered a number of practical problems connected for example with use of technology, with the class settings and with spam. In the conclusion we offer some recommendations for Teaching and Learning with Twitter based on our personal experience