Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

Integrating Technology With Student-Centered Learning

Reviews research on technology's role in personalizing learning, its integration into curriculum-based and school- or district-wide initiatives, and the potential of emerging digital technologies to expand student-centered learning. Outlines implications

Online Coursework as Related to Graduation Rates of At-Risk Students in a Rural Public High School in Bedford County, Tennessee

The purpose of this study was to determine if there was a significant relationship between the academic achievement, disciplinary referrals, and attendance of at-risk students in rural Bedford County, TN, prior to and after participation in online coursework. The independent variables were the academic achievement towards successful course completions, disciplinary referrals, and attendance rates of at-risk students. The dependent variable was the participation in online coursework in Bedford County Schools (BCS) Online On-track (OLOT) program. A series of ttests and a chi-square analyses was performed to examine the differences in the mean course completion rates, discipline referrals, attendance rates, and postsecondary plans of graduates. There was a significant difference in disciplinary referral rates and attendance rates prior to and after participation. Based on these findings there was a positive impact on discipline rates and inversely a negative impact on the attendance rate. Additionally, there was a negative impact on academic achievement rates prior to and after participation in online coursework in the BCS OLOT program. Also, the difference in the proportions of graduates continuing their education and other plans was significantly different from the responses given by all graduates in Tennessee

Student Success in Face-to-Face and Online Sections of Biology Courses at a Community College in East Tennessee

The purpose of this quantitative study was to determine if there were significant differences in student success in face-to-face and online biology courses as categorized by gender, major, and age; and as measured by lecture grades, lab grades, and final course grades. The data used for analyses included data from 170 face-to-face sections and 127 online sections from a biology course during the fall and spring semesters beginning fall 2008 through spring 2011. Researchers have reported mixed findings in previous studies juxtaposing online and face-to-face course delivery formats, from no significant differences to differences in grades, learning styles, and satisfaction levels. Four research questions guided this study with data analysis involving t-tests for independent groups and chi-square tests. This researcher noted significant differences in the results of this study: grades, success rates by gender, success rates by health and nonhealth majors, and nontraditional age (≥25) success rate were higher for students in the face-to-face courses; and the attrition rate was higher for students in the online course sections. There was no significant difference found in the success rate for traditional age (\u3c25) students in the face-to-face sections compared to those in the online sections

Student Outcomes in Traditional, Hybrid, and Online Courses in Community College Career and Technical Education Programs

The purpose of this quantitative study was to examine whether differences in student course outcomes as defined by final course grades existed between three content delivery methods in career and technical education courses: Traditional (face to face), hybrid, and online. Final course grades in career and technical education courses at one community college for the Fall 2011 through the Fall 2015 semesters were used in this study to compare the success of students in courses employing the three content delivery methods. The outcomes for male and female students and the outcomes for traditional and nontraditional students in career and technical education programs were compared as well. The method of delivery was found to have an impact. Withdrawal rates for career and technical education courses were also impacted by course delivery method. Seven research questions were included in this study, and the data was analyzed using one-sample chi-square tests for the seven research questions in the study. Results indicated that students had significantly higher student learning outcomes in traditional courses in career and technical education programs than in either hybrid or online courses. Withdrawal rates were higher for hybrid and online courses than traditional courses. Student gender and age were related to student final course outcomes with both male and female students more likely to earn transferable final course grades in traditional courses than in hybrid or online courses. Traditional age and nontraditional age students were also more likely to earn transferable final course grades in traditional courses than in hybrid or online courses. Nontraditional age students were significantly more likely than traditional age students to earn a transferable final course grade regardless of delivery method. Overall findings suggest that delivery method may impact student outcomes in career and technical education courses. The study is significant in that it provides insight into specific differences in student outcomes by the three different delivery methods currently used in higher education and may be used for comparison with other institutions’ student outcomes

Student Sucess and Retention : Critical Factors for Success in the Online Environment

Abstract This study was designed to determine the relationship between identified student characteristics and readiness factors and measures of success in selected online courses as defined by final course grades. This study focused on two sets of variables. The first was regarding the relationship of student demographic and educational background factors such as age, gender, academic placement, educational level, enrollment status, grade point average, withdrawal history, and previous online course experience to success in online courses. The second was regarding the relationship of learning readiness factors of personal attributes, learning style, life factors, technical competency, technical knowledge, and reading rate to success in online courses. The study analyzed data regarding students at a state college enrolled in online courses during a single term. Archival data from the readiness assessment SmarterMeasure Learning Readiness Indicator (previously named READI) results as well as demographic, end of course grades, and educational background data from available student records were collected for students registered in the selected sample sections. The SmarterMeasure Learning Readiness Indicator is a web-based, 122-item assessment intended to measure a learner’s readiness for success in an online learning environment. The statistical techniques of correlation and multiple regression analysis were used to analyze the relationship between the dependent variable of final course grade and the independent variables of student characteristics and readiness and to determine the predictive nature of the independent variables. The findings of this study indicate that the age, academic placement, and GPA of students taking online courses may have a statistically significant relationship to their final grade and so success in their courses. These findings regarding demographic and educational background variables suggest that a more mature, non-traditional student who has a higher GPA and did not place into remedial mathematics or English may have a stronger opportunity for success in the online environment. The findings regarding the second set of variables indicated that scores for students on the assessment scales of personal attributes, reading, technical knowledge and competency, and life factors also might have a relationship to their final grade in their online course. Although the predictive relationships were not strong, the findings regarding the assessment variables suggest that students who are better equipped and prepared in the readiness factors assessed may have slightly higher grades as well

A Phenomenological Study of Community College Career and Technical Education Graduates\u27 Perceptions of the Impact of Online Delivery on Their Employability Skills Preparation

This qualitative study used a phenomenological approach to elevate and explore the voices of Oregon community college graduates of online career and technical education (CTE) programs to better understand how they perceive they were prepared with employability skills. The participants graduated from their program in Spring 2020, after their final term of classes were shifted completely online due to COVID-19. A three-interview protocol was conducted to explore how participants define employability skills, and the extent to which they felt their online learning experience prepared them with strong teamwork, communication, and results-orientation skills, requisite for success in their fields. Five major findings were uncovered in this study: (a) participants broadly perceive dependability, adaptability, and work ethic as the most desirable employability skills; (b) participants define strong teamwork skills as the ability to delegate and communicate tasks based on a realistic assessment of individuals’ abilities within the team; (c) participants believe that strong communication skills are relational, and marked by honesty and transparency, self and situational awareness, and non-verbal skills such as listening and body language; (d) participants understand strong results-orientation as the ability to effectively plan to clear outcomes and implement; and (e) employability skills can be taught and learned in an online modality, provided the appropriate technology, preparedness of the instructor, and alignment of assignments or activities. This study sought to bring student voice to the literature on online CTE learning, although it represents a particular experience in time with COVID-19. Implications for this study suggest a need for CTE programs and employers to better articulate desirable employability skills to students, for faculty to build belonging and communication into instructional plan, and for community colleges to invest in appropriate technology and professional development for growth and development of online CTE learning

High School Redesign and the Senior Year

The purpose of this qualitative study was to describe how high school principals in Indiana are redesigning senior year academic experiences as a means to increasing student engagement and making the senior year more valuable for students. Using an exploratory multiple-case study design, three high school principals serving in high performing high schools in Indiana (as defined by the Indiana Department of Education rating each school an “A”) were interviewed, with interviews recorded and transcribed, then coded for item analysis. The participants’ commentary, outlined themes, and sub-themes from the case study provide insight into the experiences of high school principals as they work to create site-specific redesign solutions for their schools. Themes from this study are: (a) rigor, (b) relevance, (c) freedom, and (d) increasing post-secondary opportunities for students, supported by the subthemes of (a) physical plant structures, building projects, and building design have direct impacts on how redesign of educational programming is structured, (b) local stakeholder desires help shape changes, (c) communicating change, (d) perceived student needs, and (e) the individual strengths and dispositions of school leadership personnel. The themes identified through data analysis have been assessed leaving three assertions for principals to consider when seeking to create site-specific school redesign solutions in their own settings: (a) Principals must have a clear vision for the need to change; (b) Principals must communicate clearly with stakeholders; (c) Principals must embrace the uniqueness of their school and create redesign solutions specific to their schools. The results of this study are intended to provide insight and ideas for other high school principals pursuing high school redesign ideas in their school setting