From aggregation to interpretation:how assessors judge complex data in a competency-based portfolio

While portfolios are increasingly used to assess competence, the validity of such portfolio-based assessments has hitherto remained unconfirmed. The purpose of the present research is therefore to further our understanding of how assessors form judgments when interpreting the complex data included in a competency-based portfolio. Eighteen assessors appraised one of three competency-based mock portfolios while thinking aloud, before taking part in semi-structured interviews. A thematic analysis of the think-aloud protocols and interviews revealed that assessors reached judgments through a 3-phase cyclical cognitive process of acquiring, organizing, and integrating evidence. Upon conclusion of the first cycle, assessors reviewed the remaining portfolio evidence to look for confirming or disconfirming evidence. Assessors were inclined to stick to their initial judgments even when confronted with seemingly disconfirming evidence. Although assessors reached similar final (pass-fail) judgments of students' professional competence, they differed in their information-processing approaches and the reasoning behind their judgments. Differences sprung from assessors' divergent assessment beliefs, performance theories, and inferences about the student. Assessment beliefs refer to assessors' opinions about what kind of evidence gives the most valuable and trustworthy information about the student's competence, whereas assessors' performance theories concern their conceptualizations of what constitutes professional competence and competent performance. Even when using the same pieces of information, assessors furthermore differed with respect to inferences about the student as a person as well as a (future) professional. Our findings support the notion that assessors' reasoning in judgment and decision-making varies and is guided by their mental models of performance assessment, potentially impacting feedback and the credibility of decisions. Our findings also lend further credence to the assertion that portfolios should be judged by multiple assessors who should, moreover, thoroughly substantiate their judgments. Finally, it is suggested that portfolios be designed in such a way that they facilitate the selection of and navigation through the portfolio evidence

Self-care research: How to grow the evidence base?

Background and objective: The number of studies in the area of self-care is growing and international researchers are increasingly developing self-care interventions to improve outcomes of individual patients and communities. However, growth of the evidence is still slow due to challenges with designing and testing self-care interventions. In this article we address major methodological challenges with regard to the definition of self-care, use of theory, and research design, intended to provide guidance to researchers in this field.Method: During the inaugural conference of the International Center for Self-Care Research held in Rome, Italy in June 2019 we identified important issues in existing self-care research. Discussion and literature review lead to eight recommendation for future self-care research.Results: In preparation, begin with a theoretically sound definition of self-care. In planning the intervention, build on and extend previous studies. Use theory to develop self-care interventions and consider translational models to guide development, evaluation and implementation of complex self-care interventions. Employ a study design that fits the current phase and objectives of the research and measure self-care and related factors carefully. In reporting, describe the sample and setting sufficiently so that others can draw conclusions about generalizability and applicability to their practice and patient population. In interpretation, describe how the intervention is assumed to work (causal assumptions) and its key components.Conclusion: Our review of existing self-care research clearly illustrates that the recommendations we provide are needed if we are to substantially grow the evidence base supporting self-care. Embracing a core set of principles will allow us to build on each other's work.Tweetable abstract: A core set of methodological principles is needed to substantially grow the evidence base supporting self-care. (C) 2020 The Authors. Published by Elsevier Ltd

What supervisors say in their feedback:construction of CanMEDS roles in workplace settings

The CanMEDS framework has been widely adopted in residency education and feedback processes are guided by it. It is, however, only one of many influences on what is actually discussed in feedback. The sociohistorical culture of medicine and individual supervisors' contexts, experiences and beliefs are also influential. Our aim was to find how CanMEDS roles are constructed in feedback in a postgraduate curriculum-in-action. We applied a set of discourse analytic tools to written feedback from 591 feedback forms from 7 hospitals, including 3150 feedback comments in which 126 supervisors provided feedback to 120 residents after observing their performance in authentic settings. The role of Collaborator was constructed in two different ways: a cooperative discourse of equality with other workers and patients; and a discourse, which gave residents positions of power-delegating, asserting and 'taking a firm stance'. Efficiency-being fast and to the point emerged as an important attribute of physicians. Patients were seldom part of the discourses and, when they were, they were constructed as objects of communication and collaboration rather than partners. Although some of the discourses are in line with what might be expected, others were in striking contrast to the spirit of CanMEDS. This study's findings suggest that it takes more than a competency framework, evaluation instruments, and supervisor training to change the culture of workplaces. The impact on residents of training in such demanding, efficiency-focused clinical environments is an important topic for future research

Appropriate use criteria for echocardiography in the Netherlands

Introduction Appropriate use criteria (AUC) for echocardiography based on clinical scenarios were previously published by an American Task Force. We determined whether members of the Dutch Working Group on Echocardiography (WGE) would rate these scenarios in a similar way. Methods All 32 members of the WGE were invited to judge clinical scenarios independently using a blanked version of the previously published American version of AUC for echocardiography. During a face-to-face meeting, consensus about the final rating was reached by open discussion for each indication. For reasons of simplicity, the scores were reduced from a 9-point scale to a 3-point scale (indicating an appropriate, uncertain or inappropriate echo indication, respectively). Results Nine cardiologist members of the WGE reported their judgment on the echo cases (n = 153). Seventy-one indications were rated as appropriate, 35 were rated as uncertain, and 47 were rated as inappropriate. In 5% of the cases the rating was opposite to that in the original (appropriate compared with inappropriate and vice versa), whereas in 20% judgements differed by 1 level of appropriateness. After the consensus meeting, the appropriateness of 7 (5%) cases was judged differently compared with the original paper. Conclusions Echocardiography was rated appropriate when it is applied for an initial diagnosis, a change in clinical status or a change in patient management. However, in about 5% of the listed clinical scenarios, members of the Dutch WGE rated the AUC for echocardiography differently as compared with their American counterparts. Further research is warranted to analyse this decreased external validity

Arc expression identifies the lateral amygdala fear memory trace

Memories are encoded within sparsely distributed neuronal ensembles. However, the defining cellular properties of neurons within a memory trace remain incompletely understood. Using a fluorescence-based Arc reporter, we were able to visually identify the distinct subset of lateral amygdala (LA) neurons activated during auditory fear conditioning. We found that Arc-expressing neurons have enhanced intrinsic excitability and are preferentially recruited into newly encoded memory traces. Furthermore, synaptic potentiation of thalamic inputs to the LA during fear conditioning is learning-specific, postsynaptically mediated and highly localized to Arc-expressing neurons. Taken together, our findings validate the immediate-early gene Arc as a molecular marker for the LA neuronal ensemble recruited during fear learning. Moreover, these results establish a model of fear memory formation in which intrinsic excitability determines neuronal selection, whereas learning-related encoding is governed by synaptic plasticity

Rationale, design and conduct of a randomised controlled trial evaluating a primary care-based complex intervention to improve the quality of life of heart failure patients: HICMan (Heidelberg Integrated Case Management) : study protocol

Background: Chronic congestive heart failure (CHF) is a complex disease with rising prevalence, compromised quality of life (QoL), unplanned hospital admissions, high mortality and therefore high burden of illness. The delivery of care for these patients has been criticized and new strategies addressing crucial domains of care have been shown to be effective on patients' health outcomes, although these trials were conducted in secondary care or in highly organised Health Maintenance Organisations. It remains unclear whether a comprehensive primary care-based case management for the treating general practitioner (GP) can improve patients' QoL. Methods/Design: HICMan is a randomised controlled trial with patients as the unit of randomisation. Aim is to evaluate a structured, standardized and comprehensive complex intervention for patients with CHF in a 12-months follow-up trial. Patients from intervention group receive specific patient leaflets and documentation booklets as well as regular monitoring and screening by a prior trained practice nurse, who gives feedback to the GP upon urgency. Monitoring and screening address aspects of disease-specific selfmanagement, (non)pharmacological adherence and psychosomatic and geriatric comorbidity. GPs are invited to provide a tailored structured counselling 4 times during the trial and receive an additional feedback on pharmacotherapy relevant to prognosis (data of baseline documentation). Patients from control group receive usual care by their GPs, who were introduced to guidelineoriented management and a tailored health counselling concept. Main outcome measurement for patients' QoL is the scale physical functioning of the SF-36 health questionnaire in a 12-month follow-up. Secondary outcomes are the disease specific QoL measured by the Kansas City Cardiomyopathy questionnaire (KCCQ), depression and anxiety disorders (PHQ-9, GAD-7), adherence (EHFScBS and SANA), quality of care measured by an adapted version of the Patient Chronic Illness Assessment of Care questionnaire (PACIC) and NTproBNP. In addition, comprehensive clinical data are collected about health status, comorbidity, medication and health care utilisation. Discussion: As the targeted patient group is mostly cared for and treated by GPs, a comprehensive primary care-based guideline implementation including somatic, psychosomatic and organisational aspects of the delivery of care (HICMAn) is a promising intervention applying proven strategies for optimal care. Trial registration: Current Controlled Trials ISRCTN30822978

Characteristics of self-care interventions for patients with a chronic condition: A scoping review

Background: Self-care is a fundamental element of treatment for patients with a chronic condition and a major focus of many interventions. A large body of research exists describing different types of self-care interventions, but these studies have never been compared across conditions. Examination of heterogeneous interventions could provide insights into effective approaches that should be used in diverse patient populations. Objectives: To provide a comprehensive and standardized cross-condition overview of interventions to enhance self-care in patients with a chronic condition. Specific aims were to: 1) identify what self-care concepts and behaviors are evaluated in self-care interventions; 2) classify and quantify heterogeneity in mode and type of delivery; 3) quantify the behavior change techniques used to enhance self-care behavior; and 4) assess the dose of self-care interventions delivered. Design: Scoping review DATA SOURCES: Four electronic databases - PubMed, EMBASE, PsychINFO and CINAHL - were searched from January 2008 through January 2019. Eligibility criteria for study selection: Randomized controlled trials (RCTs) with concealed allocation to the intervention were included if they compared a behavioral or educational self- care intervention to usual care or another self-care intervention and were conducted in adults. Nine common chronic conditions were included: hypertension, coronary artery disease, arthritis, chronic kidney disease, heart failure, stroke, asthma, chronic obstructive lung disease, and type 2 diabetes mellitus. Diagnoses that are psychiatric (e.g. schizophrenia), acute rather than chronic, or benefitting little from self-care (e.g. dementia) were excluded. Studies had to be reported in English with full-text available. Results: 9309 citations were considered and 233 studies were included in the final review. Most studies addressed type 2 diabetes mellitus (n = 85; 36%), hypertension (n = 32; 14%) or heart failure (n = 27; 12%). The majority (97%) focused on healthy behaviors like physical activity (70%), dietary intake (59%), and medication management (52%). Major deficits found in self-care interventions included a lack of attention to the psychological consequences of chronic illness, technology and behavior change techniques were rarely used, few studies focused on helping patients manage signs and symptoms, and the interventions were rarely innovative. Research reporting was generally poor. Conclusions: Major gaps in targeted areas of self-care were identified. Opportunities exist to improve the quality and reporting of future self-care intervention research. Registration: The study was registered in the PROSPERO database (#123,719)