Admission Variables Predict Success in a Hybrid-online Physical Therapist Education Program

Purpose: Screening student applicants can be a valuable measure for hybrid-online Doctor of Physical Therapy (DPT) programs.Institutions embrace a wide variety of measurements that drive admissions decisions. However, uncertainties exist regarding the most accurate admission predictors of academic outcomes, especially among hybrid-online DPT programs. The purpose of this study was to examine predictive relationships between applicants’ admission variables and program grade point average and National Physical Therapy Examination (NPTE) performance in a cohort of entry-level hybrid-online DPT students. Methods: A retrospective cohort design and convenience sampling method was used across two entry-level hybrid-online DPT programs in the Southeastern US. Hybrid-online DPT programs utilized ≥51% online instructional delivery. Applicants’ undergraduate admissions records, DPT program academic records, and NPTE scores were collected. Multiple linear regression analyses tested the hypotheses. Cross-tabulations and McNemar’s test were used to identify cut-off scores for variables and odds-ratios of passing the NPTE. Results: N=377 were collected and analyzed from two hybrid-online DPT programs (N=143 [38%] Program A; N=234 [62%] Program B) between Fall of 2018 and Spring of 2020. Applicant undergraduate (uGPA) and trending (tGPA)(final 60 credits) predicted first-time NPTE pass rate (r2 = 0.30, p2 = 0.18, p2 = 0.26, p = 0.02), F(6, 370). Applicant uGPA and tGPA were associated with 3-fold and 2-fold increase odds of passing NPTE on the first attempt, respectively. Conclusions: This study suggests certain applicant variables may be more indicative of success and could be weighted more heavily during the application process. Cumulative and trending undergraduate GPA accurately predict academic performance in hybrid-online DPT education, and NPTE scores. Notably, GRE and undergraduate science GPA were unremarkable. Hybrid-online DPT program GPA strongly predicts outcomes in NPTE scores

The New Frontier: Can Faculty be Consistent When Rating Clinical Skills Virtually?

Purpose/Hypothesis: Accreditation criteria mandate the evaluation of student technical skills. The emerging need for DPT programs to deliver course content remotely and subsequently assess student clinical skills highlights the lack of research surrounding faculty rating consistency when evaluations occur virtually. This study aimed to investigate rating consistency among faculty testers when assessing clinical skills virtually. The primary questions were: (1) is there faculty rating consistency for virtual practical assessments, (2) are there any trends that impact faculty rating of virtual practical performance? Number of Subjects: 623 Materials and Methods: Faculty utilized check list rubrics based on Miller’s Pyramid of Assessment to evaluate students’ virtual practical performances. During the case-based virtual practical performance students were required to simulate a face to face patient encounter, or verbally describe how to perform skills during a patient encounter appropriately. A convenience sample of 623 individual student scores across the DPT curriculum were collected and utilized. Post hoc analysis and One-Way ANOVA was employed to determine differences between faculty raters. Results: There were 4 to 7 faculty raters per course, with faculty testing 7 to 13 students on average. Students were expected to complete the virtual practical performance within; 11-20 minutes (47.5%), 21-30 minutes (25.5%), and 41-60 minutes (15%). Individual course analysis revealed some differences in faculty rating of the students’ virtual practical skills for 6 of the 13 courses. One course in the first year and five courses in the second year of the curriculum had significant differences in faculty rating of student virtual skills performances (p=0.018, p=0.001, p=0.045, p=0.013, p=0.004, p=0.001). Overall, the students’ scores earned from the faculty raters were consistent when compared to traditional face to face practical scores. Conclusions: Faculty rating of students’ virtual skills performance were more consistent in the first year of the DPT curriculum, with more variability in rating for the program’s second year courses. There is the possibility that more faculty rating errors during the second year of the curriculum may have impacted how the students were rated. Even with the differences in faculty rating, virtual skills practicals may be an acceptable option for DPT programs. Clinical Relevance: The recent Coronavirus 2019 (COVID-19) pandemic has increased the need for innovative virtual methods for testing technical skills taught in physical therapy programs. Assessing if consistency between faculty raters can be maintained in the virtual environment is essential in determining the effectiveness of this form of examination. The results of this study indicate that consistency appears to be better maintained earlier in the curriculum, the reason for this trend is unknown. Some difference in how faculty rated students could be attributed to the difference in the courses. This study will be significant in helping to show that effective faculty rating of students’ performance of virtual technical skills is possible

Admission Variables Predict Success in a Hybrid-online Physical Therapist Education Program

Purpose: Screening student applicants can be a valuable measure for hybrid-online Doctor of Physical Therapy (DPT) programs.Institutions embrace a wide variety of measurements that drive admissions decisions. However, uncertainties exist regarding the most accurate admission predictors of academic outcomes, especially among hybrid-online DPT programs. The purpose of this study was to examine predictive relationships between applicants’ admission variables and program grade point average and National Physical Therapy Examination (NPTE) performance in a cohort of entry-level hybrid-online DPT students. Methods: A retrospective cohort design and convenience sampling method was used across two entry-level hybrid-online DPT programs in the Southeastern US. Hybrid-online DPT programs utilized ≥51% online instructional delivery. Applicants’ undergraduate admissions records, DPT program academic records, and NPTE scores were collected. Multiple linear regression analyses tested the hypotheses. Cross-tabulations and McNemar’s test were used to identify cut-off scores for variables and odds-ratios of passing the NPTE. Results: N=377 were collected and analyzed from two hybrid-online DPT programs (N=143 [38%] Program A; N=234 [62%] Program B) between Fall of 2018 and Spring of 2020. Applicant undergraduate (uGPA) and trending (tGPA)(final 60 credits) predicted first-time NPTE pass rate (r2 = 0.30, p2 = 0.18, p2 = 0.26, p = 0.02), F(6, 370). Applicant uGPA and tGPA were associated with 3-fold and 2-fold increase odds of passing NPTE on the first attempt, respectively. Conclusions: This study suggests certain applicant variables may be more indicative of success and could be weighted more heavily during the application process. Cumulative and trending undergraduate GPA accurately predict academic performance in hybrid-online DPT education, and NPTE scores. Notably, GRE and undergraduate science GPA were unremarkable. Hybrid-online DPT program GPA strongly predicts outcomes in NPTE scores