How does portfolio use support self-regulated learning during general practitioner specialty training?:A qualitative focus group study

OBJECTIVES: Portfolios are used to support self-regulated learning (SRL), but the research literature is still inconclusive on their effectiveness. This study explored experiences with portfolio use among different stakeholders, to answer the research question: How does portfolio use support SRL during general practitioner (GP) specialty training? DESIGN: We used a qualitative research design, based on phenomenology. SETTING: Three of the eight training institutes of Dutch GP specialty training participated in this study. PARTICIPANTS: The three stakeholder groups that use the portfolio were included in nine homogenous focus groups: trainees (n=16), supervisors (n=16) and faculty (n=17). All participants had at least 6-month experience with portfolio use. RESULTS: Three themes were identified: SRL with(out) the portfolio, stakeholder dynamics and ambiguities. Respondents were doubtful about the learning benefits of portfolio use, as most trainees used their portfolio to 'check off' what was considered required. Stakeholder dynamics contributed to checking off behaviour in two ways. First, trainees experienced documenting learning activities to be superfluous, since the close relationship with their supervisor already supported SRL sufficiently. Second, faculty often (unintentionally) took portfolio ownership away from trainees, as they instructed trainees to deliver portfolio content that was valuable for assessment. Without ownership, trainees struggled to use the portfolio for SRL. Besides, ambiguities related to portfolio use amplified checking off behaviour. CONCLUSIONS: Portfolio use did not support SRL in our setting. The multipurpose use of the portfolio (for the support of SRL and assessment) was identified as the primary obstacle. Underlying is a conflict that is often present in current medical curricula: agency versus accountability. If the support of SRL is considered a valuable and attainable purpose of portfolio use, it is important to realise that deliberate attention for this purpose is required during the design, guidance, assessment and evaluation of the portfolio

How does portfolio use support self-regulated learning during general practitioner specialty training?:A qualitative focus group study

OBJECTIVES: Portfolios are used to support self-regulated learning (SRL), but the research literature is still inconclusive on their effectiveness. This study explored experiences with portfolio use among different stakeholders, to answer the research question: How does portfolio use support SRL during general practitioner (GP) specialty training?DESIGN: We used a qualitative research design, based on phenomenology.SETTING: Three of the eight training institutes of Dutch GP specialty training participated in this study.PARTICIPANTS: The three stakeholder groups that use the portfolio were included in nine homogenous focus groups: trainees (n=16), supervisors (n=16) and faculty (n=17). All participants had at least 6-month experience with portfolio use.RESULTS: Three themes were identified: SRL with(out) the portfolio, stakeholder dynamics and ambiguities. Respondents were doubtful about the learning benefits of portfolio use, as most trainees used their portfolio to 'check off' what was considered required. Stakeholder dynamics contributed to checking off behaviour in two ways. First, trainees experienced documenting learning activities to be superfluous, since the close relationship with their supervisor already supported SRL sufficiently. Second, faculty often (unintentionally) took portfolio ownership away from trainees, as they instructed trainees to deliver portfolio content that was valuable for assessment. Without ownership, trainees struggled to use the portfolio for SRL. Besides, ambiguities related to portfolio use amplified checking off behaviour.CONCLUSIONS: Portfolio use did not support SRL in our setting. The multipurpose use of the portfolio (for the support of SRL and assessment) was identified as the primary obstacle. Underlying is a conflict that is often present in current medical curricula: agency versus accountability. If the support of SRL is considered a valuable and attainable purpose of portfolio use, it is important to realise that deliberate attention for this purpose is required during the design, guidance, assessment and evaluation of the portfolio.</p

How does portfolio use support self-regulated learning during general practitioner specialty training?: A qualitative focus group study

OBJECTIVES: Portfolios are used to support self-regulated learning (SRL), but the research literature is still inconclusive on their effectiveness. This study explored experiences with portfolio use among different stakeholders, to answer the research question: How does portfolio use support SRL during general practitioner (GP) specialty training? DESIGN: We used a qualitative research design, based on phenomenology. SETTING: Three of the eight training institutes of Dutch GP specialty training participated in this study. PARTICIPANTS: The three stakeholder groups that use the portfolio were included in nine homogenous focus groups: trainees (n=16), supervisors (n=16) and faculty (n=17). All participants had at least 6-month experience with portfolio use. RESULTS: Three themes were identified: SRL with(out) the portfolio, stakeholder dynamics and ambiguities. Respondents were doubtful about the learning benefits of portfolio use, as most trainees used their portfolio to 'check off' what was considered required. Stakeholder dynamics contributed to checking off behaviour in two ways. First, trainees experienced documenting learning activities to be superfluous, since the close relationship with their supervisor already supported SRL sufficiently. Second, faculty often (unintentionally) took portfolio ownership away from trainees, as they instructed trainees to deliver portfolio content that was valuable for assessment. Without ownership, trainees struggled to use the portfolio for SRL. Besides, ambiguities related to portfolio use amplified checking off behaviour. CONCLUSIONS: Portfolio use did not support SRL in our setting. The multipurpose use of the portfolio (for the support of SRL and assessment) was identified as the primary obstacle. Underlying is a conflict that is often present in current medical curricula: agency versus accountability. If the support of SRL is considered a valuable and attainable purpose of portfolio use, it is important to realise that deliberate attention for this purpose is required during the design, guidance, assessment and evaluation of the portfolio

How does portfolio use affect self-regulated learning in clinical workplace learning:What works, for whom, and in what contexts?

Introduction Portfolio use to support self-regulated learning (SRL) during clinical workplace learning is widespread, but much is still unknown regarding its effectiveness. This review aimed to gain insight in the extent to which portfolio use supports SRL and under what circumstances. Methods A realist review was conducted in two phases. First, stakeholder interviews and a scoping search were used to formulate a program theory that explains how portfolio use could support SRL. Second, an in-depth literature search was conducted. The included papers were coded to extract context–mechanism–outcome configurations (CMOs). These were synthesized to answer the research question. Results Sixteen papers were included (four fulfilled all qualitative rigor criteria). Two primary portfolio mechanisms were established: documenting as a moment of contemplation (learners analyze experiences while writing portfolio reports) and documentation as a reminder of past events (previous portfolio reports aid recall). These mechanisms may explain the positive relationship between portfolio use and self-assessment, reflection, and feedback. However, other SRL outcomes were only supported to a limited extent: formulation of learning objectives and plans, and monitoring. The partial support of the program theory can be explained by interference of contextual factors (e.g., system of assessment) and portfolio-related mechanisms (e.g., mentoring). Discussion Portfolio research is falling short both theoretically—in defining and conceptualizing SRL—and methodologically. Nevertheless, this review indicates that portfolio use has potential to support SRL. However, the working mechanisms of portfolio use are easily disrupted. These disruptions seem to relate to tensions between different portfolio purposes, which may undermine learners’ motivation

Supervisors' intention to observe clinical task performance:an exploratory study using the theory of planned behaviour during postgraduate medical training

Background Direct observation of clinical task performance plays a pivotal role in competency-based medical education. Although formal guidelines require supervisors to engage in direct observations, research demonstrates that trainees are infrequently observed. Supervisors may not only experience practical and socio-cultural barriers to direct observations in healthcare settings, they may also question usefulness or have low perceived self-efficacy in performing direct observations. A better understanding of how these multiple factors interact to influence supervisors' intention to perform direct observations may help us to more effectively implement the aforementioned guidelines and increase the frequency of direct observations. Methods We conducted an exploratory quantitative study, using the Theory of Planned Behaviour (TPB) as our theoretical framework. In applying the TPB, we transfer a psychological theory to medical education to get insight in the influence of cognitive and emotional processes on intentions to use direct observations in workplace based learning and assessment. We developed an instrument to investigate supervisors intention to perform direct observations. The relationships between the TPB measures of our questionnaire were explored by computing bivariate correlations using Pearson's R tests. Hierarchical regression analysis was performed in order to assess the impact of the respective TPB measures as predictors on the intention to perform direct observations. Results In our study 82 GP supervisors completed our TPB questionnaire. We found that supervisors had a positive attitude towards direct observations. Our TPB model explained 45% of the variance in supervisors' intentions to perform them. Normative beliefs and past behaviour were significant determinants of this intention. Conclusion Our study suggests that supervisors use their past experiences to form intentions to perform direct observations in a careful, thoughtful manner and, in doing so, also take the preferences of the learner and other stakeholders potentially engaged in direct observations into consideration. These findings have potential implications for research into work-based assessments and the development of training interventions to foster a shared mental model on the use of direct observations

Supervisory dyads' communication and alignment regarding the use of workplace-based observations:a qualitative study in general practice residency

BACKGROUND: In medical residency, performance observations are considered an important strategy to monitor competence development, provide feedback and warrant patient safety. The aim of this study was to gain insight into whether and how supervisor-resident dyads build a working repertoire regarding the use of observations, and how they discuss and align goals and approaches to observation in particular. METHODS: We used a qualitative, social constructivist approach to explore if and how supervisory dyads work towards alignment of goals and preferred approaches to performance observations. We conducted semi-structured interviews with supervisor-resident dyads, performing a template analysis of the data thus obtained. RESULTS: The supervisory dyads did not frequently communicate about the use of observations, except at the start of training and unless they were triggered by internal or external factors. Their working repertoire regarding the use of observations seemed to be primarily driven by patient safety goals and institutional assessment requirements rather than by providing developmental feedback. Although intended as formative, the institutional test was perceived as summative by supervisors and residents, and led to teaching to the test rather than educating for purposes of competence development. CONCLUSIONS: To unlock the full educational potential of performance observations, and to foster the development of an educational alliance, it is essential that supervisory dyads and the training institute communicate clearly about these observations and the role of assessment practices of- and for learning, in order to align their goals and respective approaches

Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia

Dysphagia can have severe consequences for the patient's health, influencing health-related quality of life (HRQoL). Sound psychometric properties of HRQoL questionnaires are a precondition for assessing the impact of dysphagia, the focus of this study, resulting in recommendations for the appropriate use of these questionnaires in both clinical practice and research contexts. We performed a systematic review starting with a search for and retrieval of all full-text articles on the development of HRQoL questionnaires related to oropharyngeal dysphagia and/or their psychometric validation from the electronic databases PubMed and Embase published up to June 2011. Psychometric properties were judged according to quality criteria proposed for health status questionnaires. Eight questionnaires were included in this study. Four are aimed solely at HRQoL in oropharyngeal dysphagia: the deglutition handicap index (DHI), dysphagia handicap index (DHI'), M.D. Anderson Dysphagia Inventory (MDADI), and SWAL-QOL, while the EDGQ, EORTC QLQ-STO 22, EORTC QLQ-OG 25 and EORTC QLQ-H&N35 focus on other primary diseases resulting in dysphagia. The psychometric properties of the DHI, DHI', MDADI, and SWAL-QOL were evaluated. For appropriate applicability of HRQoL questionnaires, strong scores on the psychometric criteria face validity, criterion validity, and interpretability are prerequisites. The SWAL-QOL has the strongest ratings for these criteria, while the DHI′ is the most easy to apply given its 25 items and the use of a uniform scoring format. For optimal use of HRQoL questionnaires in diverse settings, it is necessary to combine psychometric and utility approaches