Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

Adolescent Literacy and Textbooks: An Annotated Bibliography

A companion report to Carnegie's Time to Act, provides an annotated bibliography of research on textbook design and reading comprehension for fourth through twelfth grade, arranged by topic. Calls for a dialogue between publishers and researchers

Students’ Perceptions of Their Teachers’ Performance in Teaching Engineering Drawing in Nigerian Tertiary Institutions

There have been concerns about the performance of Nigerian school teachers’ in delivering occupational related courses. However, there are currently limited empirical data on this phenomenon – in particular with respect to the teaching of engineering drawing – to justify further actions from educational managers and policy makers. The aim of this study was to assess teachers’ performance in teaching engineering drawing using students’ perception as indicator of teachers’ performance. The study utilized a cross-sectional research design method with the target population of technical education students drawn from four (4) Federal Colleges of education (Technical) in Northern Nigeria. Stratified proportionate sampling technique was used to arrive at the study sample of 253 technical education students. A specifically designed instrument, the Students’ Perceptions of Teachers’ Performance Scales (SPTPS) was used to gather data on the three performance dimensions namely contextual, task and adaptability performance. The exploratory factor analysis and confirmatory factor analysis methods were conducted to validate the performance constructs. The instrument has a high reliability of 0.90 based on the Cronbach Alpha method. The result of the analysis using estimation method indicates that students perceive their teachers’ performance to be at a slightly above average level (M= 3.51 ± 0.05 at the 95% confidence level). The teachers’ task performance, in particular, is found to be the least developed among the three dimension of performance while their adaptability performance is the highest while still being less than excellent. The data support the conclusion that there are aspects of teachers’ performance in teaching engineering drawing that is less than excellent and in need of further enhancements

Issues for consideration to adopt educational computer games for learning and teaching

Computer games have started to gain attention in the domain of learning and teaching. The integration of computer games for education in the classroom has starting to gain acceptance in some countries. However, for schools which have never used computer games in the classroom, study still need to be conducted to investigate the teachers' belief and attitude toward the usage. The purpose of this paper is to examine issues for consideration when adopting educational computer games for learning and teaching. This paper also examines the concepts that related to educational computer games and aspects of learning and teaching. In addition, the theories of technology acceptance which use to assess the perception, belief and attitude of teachers and students have also been investigated

Students’ Perceptions of Their Teachers’ Performance in Teaching Engineering Drawing in Nigerian Tertiary Institutions

There have been concerns about the performance of Nigerian school teachers’ in delivering occupational related courses. However, there are currently limited empirical data on this phenomenon – in particular with respect to the teaching of engineering drawing – to justify further actions from educational managers and policy makers. The aim of this study was to assess teachers’ performance in teaching engineering drawing using students’ perception as indicator of teachers’ performance. The study utilized a cross-sectional research design method with the target population of technical education students drawn from four (4) Federal Colleges of education (Technical) in Northern Nigeria. Stratified proportionate sampling technique was used to arrive at the study sample of 253 technical education students. A specifically designed instrument, the Students’ Perceptions of Teachers’ Performance Scales (SPTPS) was used to gather data on the three performance dimensions namely contextual, task and adaptability performance. The exploratory factor analysis and confirmatory factor analysis methods were conducted to validate the performance constructs. The instrument has a high reliability of 0.90 based on the Cronbach Alpha method. The result of the analysis using estimation method indicates that students perceive their teachers’ performance to be at a slightly above average level (M= 3.51 ± 0.05 at the 95% confidence level). The teachers’ task performance, in particular, is found to be the least developed among the three dimension of performance while their adaptability performance is the highest while still being less than excellent. The data support the conclusion that there are aspects of teachers’ performance in teaching engineering drawing that is less than excellent and in need of further enhancements

Applying science of learning in education: Infusing psychological science into the curriculum

The field of specialization known as the science of learning is not, in fact, one field. Science of learning is a term that serves as an umbrella for many lines of research, theory, and application. A term with an even wider reach is Learning Sciences (Sawyer, 2006). The present book represents a sliver, albeit a substantial one, of the scholarship on the science of learning and its application in educational settings (Science of Instruction, Mayer 2011). Although much, but not all, of what is presented in this book is focused on learning in college and university settings, teachers of all academic levels may find the recommendations made by chapter authors of service. The overarching theme of this book is on the interplay between the science of learning, the science of instruction, and the science of assessment (Mayer, 2011). The science of learning is a systematic and empirical approach to understanding how people learn. More formally, Mayer (2011) defined the science of learning as the “scientific study of how people learn” (p. 3). The science of instruction (Mayer 2011), informed in part by the science of learning, is also on display throughout the book. Mayer defined the science of instruction as the “scientific study of how to help people learn” (p. 3). Finally, the assessment of student learning (e.g., learning, remembering, transferring knowledge) during and after instruction helps us determine the effectiveness of our instructional methods. Mayer defined the science of assessment as the “scientific study of how to determine what people know” (p.3). Most of the research and applications presented in this book are completed within a science of learning framework. Researchers first conducted research to understand how people learn in certain controlled contexts (i.e., in the laboratory) and then they, or others, began to consider how these understandings could be applied in educational settings. Work on the cognitive load theory of learning, which is discussed in depth in several chapters of this book (e.g., Chew; Lee and Kalyuga; Mayer; Renkl), provides an excellent example that documents how science of learning has led to valuable work on the science of instruction. Most of the work described in this book is based on theory and research in cognitive psychology. We might have selected other topics (and, thus, other authors) that have their research base in behavior analysis, computational modeling and computer science, neuroscience, etc. We made the selections we did because the work of our authors ties together nicely and seemed to us to have direct applicability in academic settings

The Use of Project-Based Learning in a Technology Course for Math and Science Teachers

In this project, pre- and in-service math and science teachers used project-based learning to learn the complex skills involved in integrating technology into math and science teaching. The teachers in the course E36.1002: Microcomputer Applications in Math and Science Instruction in the Department of Teaching & Learning at New York University developed a four-week curriculum that integrates math, science, and technology using a common theme chosen by the teachers. The program has received very positive feedback from all participants and may be expanded in the future. Some recommendations are provided on how field experience in teaching with technology can be integrated into math and science teacher education programs

Courseware evaluation by teachers: An implementation perspective

This study has investigated teachers' criteria for the use of courseware packages in the classroom. The starting point of the study was the assumption that it is the teacher who decides whether or not courseware will be used in the classroom. The integration of courseware into the curriculum is conceived as a complex innovation. The study is oriented towards the process of decision making by teachers. A positive decision to actual use of courseware is one of the first steps towards integration of courseware into the curriculum. Three determinants of quality and practicality of an innovation, viz. instrumentality, congruence and cost, formed the theoretical framework of the study. From the study it can be concluded that at the very first stage of the process leading to the integration of courseware into the curriculum, courseware should motivate students, realize educational objectives better than traditional methods and its content should be an operationalization of teacher's ideas and beliefs

Professional self-efficacy scale for information and computer technology teachers: validity and reliability study

This study aims at developing a valid and reliable scale to measure information and communication technology (ICT) teachers' self-efficacy related to the Turkish national framework of ICT competencies. For statistical procedures, data were respectively analyzed with exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Furthermore, test-retest procedure was carried out to confirm the time invariance of the scale. EFA results revealed that the scale's seven-factor structure accounts for 65.90 percent of total variance. CFA results produced an acceptable statistical support for model-data fit between the observed item scores and the seven-dimension scale structure (X-2/df = 1.98, RMSEA = .073, CFI = .86). The standardized regression weights between the latent and observed variables ranged from .57 to .89 and Cronbach's alpha coefficient of the scale sub-dimensions ranged from .80 to .88. Besides, the item-scale correlations varied between values of .53 and .79. As a result, the developed scale is a likert questionnaire and composed of 33 five-point items with seven sub-dimensions

Developing Technological Pedagogical Content Knowledge in pre-service science teachers: Support from blended learning

The Technological Pedagogical Content Knowledge (TPACK) framework has been used to prepare pre-service science teachers at the Public Authority of Applied Education and Training in Kuwait for ICT integration in education. Pre-service teachers worked in teams to design an ICT solution for an authentic problem they faced during in-school training. Pre-service teachers were separated into two groups. The first group was coached by ICT, pedagogy, and content experts. The second group was offered a blended condition, by which they had access to an online portal with different tutorials and examples, with opportunities to meet with different experts whenever they wanted. Pre-test and post-test design data were collected for attitudes toward ICT, ICT skills, and TPACK. The findings show that the self-reported TPACK, the score of attitudes toward ICT, and ICT skills increased in both groups. However, the blended support condition reported a higher increase in the participants' technological knowledge (TK), technological pedagogical knowledge (TPK), their attitude toward ICT as a tool for instruction and productivity, and ICT enjoyment. This indicated that students perceived the blended condition for supporting design teams as a more desirable method for enhancing their development of TPACK