Guidelines: The do's, don'ts and don't knows of direct observation of clinical skills in medical education.

IntroductionDirect observation of clinical skills is a key assessment strategy in competency-based medical education. The guidelines presented in this paper synthesize the literature on direct observation of clinical skills. The goal is to provide a practical list of Do's, Don'ts and Don't Knows about direct observation for supervisors who teach learners in the clinical setting and for educational leaders who are responsible for clinical training programs.MethodsWe built consensus through an iterative approach in which each author, based on their medical education and research knowledge and expertise, independently developed a list of Do's, Don'ts, and Don't Knows about direct observation of clinical skills. Lists were compiled, discussed and revised. We then sought and compiled evidence to support each guideline and determine the strength of each guideline.ResultsA final set of 33 Do's, Don'ts and Don't Knows is presented along with a summary of evidence for each guideline. Guidelines focus on two groups: individual supervisors and the educational leaders responsible for clinical training programs. Guidelines address recommendations for how to focus direct observation, select an assessment tool, promote high quality assessments, conduct rater training, and create a learning culture conducive to direct observation.ConclusionsHigh frequency, high quality direct observation of clinical skills can be challenging. These guidelines offer important evidence-based Do's and Don'ts that can help improve the frequency and quality of direct observation. Improving direct observation requires focus not just on individual supervisors and their learners, but also on the organizations and cultures in which they work and train. Additional research to address the Don't Knows can help educators realize the full potential of direct observation in competency-based education

Virtual patient design : exploring what works and why : a grounded theory study

Objectives: Virtual patients (VPs) are online representations of clinical cases used in medical education. Widely adopted, they are well placed to teach clinical reasoning skills. International technology standards mean VPs can be created, shared and repurposed between institutions. A systematic review has highlighted the lack of evidence to support which of the numerous VP designs may be effective, and why. We set out to research the influence of VP design on medical undergraduates. Methods: This is a grounded theory study into the influence of VP design on undergraduate medical students. Following a review of the literature and publicly available VP cases, we identified important design properties. We integrated them into two substantial VPs produced for this research. Using purposeful iterative sampling, 46 medical undergraduates were recruited to participate in six focus groups. Participants completed both VPs, an evaluation and a 1-hour focus group discussion. These were digitally recorded, transcribed and analysed using grounded theory, supported by computer-assisted analysis. Following open, axial and selective coding, we produced a theoretical model describing how students learn from VPs. Results: We identified a central core phenomenon designated ‘learning from the VP’. This had four categories: VP Construction; External Preconditions; Student–VP Interaction, and Consequences. From these, we constructed a three-layer model describing the interactions of students with VPs. The inner layer consists of the student's cognitive and behavioural preconditions prior to sitting a case. The middle layer considers the VP as an ‘encoded object’, an e-learning artefact and as a ‘constructed activity’, with associated pedagogic and organisational elements. The outer layer describes cognitive and behavioural change. Conclusions: This is the first grounded theory study to explore VP design. This original research has produced a model which enhances understanding of how and why the delivery and design of VPs influence learning. The model may be of practical use to authors, institutions and researchers

Nursing Informatics: is IT for All Nurses?

Given the definition if nursing informatics it should be a core activity for all nurses, and seen as a tool to support high quality care giving. Three studies reported in this paper show that this is not the case. Qualified nurses are perceived as having poor skills and knowledge, and as being resistant to IT as it takes them away from patient care. Educators share this lack of knowledge, and neither academics nor students consider nursing informatics to be a clinical skill. In order to use computers while on placement students were found to need confidence in their skills, and to feel that the use of computers was encouraged. Socialisation into the profession is an important part of nurse education, and currently students are being socialised into a professional role where they are not encouraged to use computers, or to consider their use to be a key nursing task. If nursing informatics is to truly become a way of improving patient care this needs to be changed, and preregistration education is a key place to start to bring this change about

The unseen and unacceptable face of digital libraries

The social and organisational aspects of digital libraries (DLs) are often overlooked, but this paper reviews how they can affect users' awareness and acceptance of DLs. An analysis of research conducted within two contrasting domains (clinical and academic) is presented which highlights issues of user interactions, work practices and organisational social structures. The combined study comprises an analysis of 98 in-depth interviews and focus groups with lecturers, librarians and hospital clinicians. The importance of current and past roles of the library, and how users interacted with it, are revealed. Web-based DLs, while alleviating most library resource and interaction problems, require a change in librarians' and DL designers' roles and interaction patterns if they are to be implemented acceptably and effectively. Without this role change, users will at best be unaware of these digital resources and at worst feel threatened by them. The findings of this paper highlight the importance of DL design and implementation of the social context and supporting user communication (i.e., collaboration and consultation) in information searching and usage activities. © Springer-Verlag 2004

Towards an interoperable healthcare information infrastructure - working from the bottom up

Historically, the healthcare system has not made effective use of information technology. On the face of things, it would seem to provide a natural and richly varied domain in which to target benefit from IT solutions. But history shows that it is one of the most difficult domains in which to bring them to fruition. This paper provides an overview of the changing context and information requirements of healthcare that help to explain these characteristics.First and foremost, the disciplines and professions that healthcare encompasses have immense complexity and diversity to deal with, in structuring knowledge about what medicine and healthcare are, how they function, and what differentiates good practice and good performance. The need to maintain macro-economic stability of the health service, faced with this and many other uncertainties, means that management bottom lines predominate over choices and decisions that have to be made within everyday individual patient services. Individual practice and care, the bedrock of healthcare, is, for this and other reasons, more and more subject to professional and managerial control and regulation.One characteristic of organisations shown to be good at making effective use of IT is their capacity to devolve decisions within the organisation to where they can be best made, for the purpose of meeting their customers' needs. IT should, in this context, contribute as an enabler and not as an enforcer of good information services. The information infrastructure must work effectively, both top down and bottom up, to accommodate these countervailing pressures. This issue is explored in the context of infrastructure to support electronic health records.Because of the diverse and changing requirements of the huge healthcare sector, and the need to sustain health records over many decades, standardised systems must concentrate on doing the easier things well and as simply as possible, while accommodating immense diversity of requirements and practice. The manner in which the healthcare information infrastructure can be formulated and implemented to meet useful practical goals is explored, in the context of two case studies of research in CHIME at UCL and their user communities.Healthcare has severe problems both as a provider of information and as a purchaser of information systems. This has an impact on both its customer and its supplier relationships. Healthcare needs to become a better purchaser, more aware and realistic about what technology can and cannot do and where research is needed. Industry needs a greater awareness of the complexity of the healthcare domain, and the subtle ways in which information is part of the basic contract between healthcare professionals and patients, and the trust and understanding that must exist between them. It is an ideal domain for deeper collaboration between academic institutions and industry

Annotated Bibliography: Understanding Ambulatory Care Practices in the Context of Patient Safety and Quality Improvement.

The ambulatory care setting is an increasingly important component of the patient safety conversation. Inpatient safety is the primary focus of the vast majority of safety research and interventions, but the ambulatory setting is actually where most medical care is administered. Recent attention has shifted toward examining ambulatory care in order to implement better health care quality and safety practices. This annotated bibliography was created to analyze and augment the current literature on ambulatory care practices with regard to patient safety and quality improvement. By providing a thorough examination of current practices, potential improvement strategies in ambulatory care health care settings can be suggested. A better understanding of the myriad factors that influence delivery of patient care will catalyze future health care system development and implementation in the ambulatory setting

Integrating interprofessional electronic medical record teaching in preregistration healthcare degrees : A case study

Background Electronic medical record (EMR) adoption across healthcare necessitates a purposeful curriculum design to prepare graduates for the delivery of safe and effective patient care in digitally-enabled environments. Objective To describe the design and development of an Interprofessional Electronic Medical Record (iEMR) subject that introduces healthcare students to its utility in clinical settings. Methods A six-stage design-based educational research framework (Focus, Formulation, Contextualisation, Definition, Implementation, Evaluation) was used to instigate the iEMR design and development in nursing and five allied health graduate entry to practice (preregistration) degrees at an Australian university. Results In the Focus process, the concept and interdisciplinary partnerships were developed. The Formulation process secured grant support for subject design and development, including a rapid literature review to accommodate various course and curriculum structures. Discipline-specific subject themes were created through the Contextualisation process. During the Definition process, learning objectives and content resources were built. The Implementation process describes the pilot implementation in the nursing program, where assessment tasks were refined, and interdisciplinary clinical case studies originated. Discussion The design and development of an iEMR subject is underpinned by internal support for educational innovation and in alignment with digital health strategies in employer organisations. Identified barriers include faculty-level changes in strategic support for teaching innovation, managerial expectations of workload, the scope of work required by academics and learning designers, and the gap between the technology platform required to support online learning and the infrastructure needed to support simulated EMR use. A key discovery was the difficulty of finding EMR software, whether designed for teaching purposes or for clinical use, that could be adapted to meet the needs of this project. Conclusion The lessons learned are relevant to educators and learning designers attempting a similar process. Issues remain surrounding the sustainability of the iEMR subject and maintaining academic responsibility for ongoing curriculum management

Redesigning the 'choice architecture' of hospital prescription charts: a mixed methods study incorporating in situ simulation testing.

Objectives: To incorporate behavioural insights into the user-centred design of an inpatient prescription chart (Imperial Drug Chart Evaluation and Adoption Study, IDEAS chart) and to determine whether changes in the content and design of prescription charts could influence prescribing behaviour and reduce prescribing errors. Design: A mixed-methods approach was taken in the development phase of the project; in situ simulation was used to evaluate the effectiveness of the newly developed IDEAS prescription chart. Setting: A London teaching hospital. Interventions/methods: A multimodal approach comprising (1) an exploratory phase consisting of chart reviews, focus groups and user insight gathering (2) the iterative design of the IDEAS prescription chart and finally (3) testing of final chart with prescribers using in situ simulation. Results: Substantial variation was seen between existing inpatient prescription charts used across 15 different UK hospitals. Review of 40 completed prescription charts from one hospital demonstrated a number of frequent prescribing errors including illegibility, and difficulty in identifying prescribers. Insights from focus groups and direct observations were translated into the design of IDEAS chart. In situ simulation testing revealed significant improvements in prescribing on the IDEAS chart compared with the prescription chart currently in use in the study hospital. Medication orders on the IDEAS chart were significantly more likely to include correct dose entries (164/164 vs 166/174; p=0.0046) as well as prescriber's printed name (163/164 vs 0/174; p<0.0001) and contact number (137/164 vs 55/174; p<0.0001). Antiinfective indication (28/28 vs 17/29; p<0.0001) and duration (26/28 vs 15/29; p<0.0001) were more likely to be completed using the IDEAS chart. Conclusions: In a simulated context, the IDEAS prescription chart significantly reduced a number of common prescribing errors including dosing errors and illegibility. Positive behavioural change was seen without prior education or support, suggesting that some common prescription writing errors are potentially rectifiable simply through changes in the content and design of prescription charts