Challenges to Implementation of the Co-Curriculum in Accredited Pharmacy Programs

Objective. To determine areas of concern, and challenges to implementing and assessing the co-curriculum in accredited Doctor of Pharmacy programs, along with how confident programs are in their ability to meet the co-curriculum requirement as mandated by the Accreditation Council for Pharmacy Education (ACPE). Methods. A survey was administered to all ACPE-accredited pharmacy programs to collect information regarding areas of concern, challenges, and confidence in their ability to meet the co-curriculum requirement. The frequency of responses to items are presented along with comparisons based on characteristics, including institution type, cohort size, most recent ACPE accreditation review, and supporting offices. Results. The most common concerns centered on the documentation and assessment process. The most commonly reported challenges were lack of enthusiasm or buy-in from faculty, staff, and students; lack of a clear definition of co-curriculum; and faculty time and insufficient staff. Overall, programs had a high level of confidence in their ability to meet the requirements for co-curriculum. The only differences found were related to supporting offices and cohort size. Conclusion. The results suggest that having supporting offices may reduce the co-curriculum burden. Similarly, student cohort size may have an impact on the challenges for some programs, particularly those with moderate-sized cohorts reporting challenges related to faculty and staff. Further research is needed to determine how programs address these critical issues, and to explore whether programs report differently on these areas after completing an accreditation review. The study results may be useful to members of the Academy when evaluating co-curriculum

Co-Curriculum Implementation and Assessment in Accredited Doctor of Pharmacy Programs

Objective. To determine how accredited Doctor of Pharmacy programs implement and evaluate the co-curriculum requirement as mandated by the Accreditation Council for Pharmacy Education (ACPE). Methods. A survey was administered to all ACPE-accredited pharmacy programs to collect information regarding how co-curriculum models were being implemented, including types of activities, structure, learning outcomes, oversight, and assessment. The frequency of responses to items were presented to describe the general features of co-curriculum models. Results. The types of co-curricular activities reported by programs were generally consistent, with the majority of programs categorizing these activities and allowing students to choose which they would engage in. Most respondents reported that the program mapped co-curricular activities to learning outcomes, primarily ACPE Standards 1-4. The structural oversight of the co-curriculum typically included a co-curriculum committee, subcommittee, or task force, and supporting offices. The most common offices/departments involved in the co-curriculum were assessment, student affairs/services, experiential education, and academic/curricular affairs. The most common assessments were reflections, self-assessment surveys, and checklists. Conclusion. In most programs, implementation of the co-curriculum was a joint effort among various individuals, committees, and offices. Given the developing nature of programs, descriptive studies should be repeated to identify how programs develop and enhance co-curriculum models. The study results may be useful to members of the Academy when evaluating the current state of co-curriculum implementation and potential areas for program development

Co-Curriculum Implementation and Assessment in Accredited Doctor of Pharmacy Programs

Objective. To determine how accredited Doctor of Pharmacy programs implement and evaluate the co-curriculum requirement as mandated by the Accreditation Council for Pharmacy Education (ACPE). Methods. A survey was administered to all ACPE-accredited pharmacy programs to collect information regarding how co-curriculum models were being implemented, including types of activities, structure, learning outcomes, oversight, and assessment. The frequency of responses to items were presented to describe the general features of co-curriculum models. Results. The types of co-curricular activities reported by programs were generally consistent, with the majority of programs categorizing these activities and allowing students to choose which they would engage in. Most respondents reported that the program mapped co-curricular activities to learning outcomes, primarily ACPE Standards 1-4. The structural oversight of the co-curriculum typically included a co-curriculum committee, subcommittee, or task force, and supporting offices. The most common offices/departments involved in the co-curriculum were assessment, student affairs/services, experiential education, and academic/curricular affairs. The most common assessments were reflections, self-assessment surveys, and checklists. Conclusion. In most programs, implementation of the co-curriculum was a joint effort among various individuals, committees, and offices. Given the developing nature of programs, descriptive studies should be repeated to identify how programs develop and enhance co-curriculum models. The study results may be useful to members of the Academy when evaluating the current state of co-curriculum implementation and potential areas for program development

Factors Associated With Cultures of Assessment at US Schools and Colleges of Pharmacy

Introduction: Pharmacy education has standards for assessment that must be met, prompting many programs to develop cultures of assessment. This study assesses the extent to which assessment personnel perceive that a culture of assessment has been established within their schools/colleges of pharmacy (S/COPs) and determines whether a relationship exists between assessment structure and the perceived strength of the culture of assessment. Methods: An electronic survey was administered to assessment personnel at 134 S/COPs. Respondents were asked about changes within the past five years pertaining to assessment personnel/committees and factors prompting these changes. They were also asked to rate items related to support for institutional assessment (SIA scale) and faculty engagement with assessment (FEA scale). The reliability of each scale was estimated using Cronbach alpha and bivariate correlations were conducted to estimate the relationships among the two scales and other survey items. Results: The S/COP response rate was 84% (113/134). Most (58%) noted the formation or re-structuring of the assessment office, with 26% creating one or more new assessment positions. The most common source of change was new accreditation standards (55%) followed by a new leadership position created in assessment (40%). Cronbach alpha for the SIA scale was 0.79 and 0.84 for the FEA scale. Program size was strongly negatively correlated with school age (rs = −0.58) and the FEA scale (r = −0.21). Conclusions: There was a strong relationship between SIA and FEA. Future studies are warranted to determine the interdependency of support for assessment and faculty engagement with assessment

Reported Challenges to Co-Curriculum Implementation at Accredited Pharmacy Programs

Objective. To determine areas of concern, and challenges to implementing and assessing the co-curriculum in accredited Doctor of Pharmacy programs, along with how confident programs are in their ability to meet the co-curriculum requirement as mandated by the Accreditation Council for Pharmacy Education (ACPE). Methods. A survey was administered to all ACPE-accredited pharmacy programs to collect information regarding areas of concern, challenges, and confidence in their ability to meet the co-curriculum requirement. The frequency of responses to items are presented along with comparisons based on characteristics, including institution type, cohort size, most recent ACPE accreditation review, and supporting offices. Results. The most common concerns centered on the documentation and assessment process. The most commonly reported challenges were lack of enthusiasm or buy-in from faculty, staff, and students; lack of a clear definition of co-curriculum; and faculty time and insufficient staff. Overall, programs had a high level of confidence in their ability to meet the requirements for co-curriculum. The only differences found were related to supporting offices and cohort size. Conclusion. The results suggest that having supporting offices may reduce the co-curriculum burden. Similarly, student cohort size may have an impact on the challenges for some programs, particularly those with moderate-sized cohorts reporting challenges related to faculty and staff. Further research is needed to determine how programs address these critical issues, and to explore whether programs report differently on these areas after completing an accreditation review. The study results may be useful to members of the Academy when evaluating co-curriculum

Surveying the Current Landscape of Assessment Structures and Resources in US Schools and Colleges of Pharmacy

Introduction: Expectations for assessment in higher education have increased in recent decades, prompting institutions to invest additional resources in this area. This study aimed to determine the resources, structure, and perception of assessment resources in United States schools and colleges of pharmacy (S/COPs). Methods: Assessment personnel in S/COPs were surveyed electronically. Information collected included S/COP demographics, composition of assessment positions, experience and training of assessment personnel, and structure and responsibilities of committees engaged in assessment. Respondents’ perception of their S/COPs having sufficient assessment personnel, recent changes in assessment, and the factors that prompted assessment changes were also surveyed. Results: Respondents included individuals from 113 S/COPs (84% response rate). Most S/COPs had 1–2 assessment positions and 1–2 assessment-related committees. The most common assessment position titles were assistant/associate dean, director, coordinator/specialist, and administrative assistant. Dean-level administrators typically had worked in assessment the longest, whereas directors were more likely to have formal assessment training. Most respondents (75%) agreed they had sufficient assessment personnel to meet the 2007 Accreditation Council for Pharmacy Education Standards. Nearly two-thirds of respondents agreed they had sufficient personnel to meet the 2016 Standards and support their current assessment plan/process. Most S/COPs had a formal assessment committee (93%) and an average of two committees overseeing assessment. Conclusion: Most S/COPs reported having sufficient resources to support assessment activities. Although there were some consistent themes, there does not appear to be a single model for structuring assessment resources or committees. Effectiveness of various assessment structures represents an area for future research

Use of the estimated intraclass correlation for correcting differences in effect size by level

In a meta-analysis of intervention or group comparison studies, researchers often encounter the circumstance in which the standardized mean differences (d-effect sizes) are computed at multiple levels (e.g., individual vs. cluster). Cluster-level d-effect sizes may be inflated and, thus, may need to be corrected using the intraclass correlation (ICC) before being combined with individual-level d-effect sizes. The ICC value, however, is seldom reported in primary studies and, thus, may need to be computed from other sources. This article proposes a method for estimating the ICC value from the reported standard deviations within a particular meta-analysis (i.e., estimated ICC) when an appropriate default ICC value (Hedges, 2009b) is unavailable. A series of simulations provided evidence that the proposed method yields an accurate and precise estimated ICC value, which can then be used for correct estimation of a d-effect size. The effects of other pertinent factors (e.g., number of studies) were also examined, followed by discussion of related limitations and future research in this area