On Regulatory and Organizational Constraints in Visualization Design and Evaluation

Problem-based visualization research provides explicit guidance toward identifying and designing for the needs of users, but absent is more concrete guidance toward factors external to a user's needs that also have implications for visualization design and evaluation. This lack of more explicit guidance can leave visualization researchers and practitioners vulnerable to unforeseen constraints beyond the user's needs that can affect the validity of evaluations, or even lead to the premature termination of a project. Here we explore two types of external constraints in depth, regulatory and organizational constraints, and describe how these constraints impact visualization design and evaluation. By borrowing from techniques in software development, project management, and visualization research we recommend strategies for identifying, mitigating, and evaluating these external constraints through a design study methodology. Finally, we present an application of those recommendations in a healthcare case study. We argue that by explicitly incorporating external constraints into visualization design and evaluation, researchers and practitioners can improve the utility and validity of their visualization solution and improve the likelihood of successful collaborations with industries where external constraints are more present.Comment: 9 pages, 2 figures, presented at BELIV workshop associated with IEEE VIS 201

Knowledge-Intensive Processes: Characteristics, Requirements and Analysis of Contemporary Approaches

Engineering of knowledge-intensive processes (KiPs) is far from being mastered, since they are genuinely knowledge- and data-centric, and require substantial flexibility, at both design- and run-time. In this work, starting from a scientific literature analysis in the area of KiPs and from three real-world domains and application scenarios, we provide a precise characterization of KiPs. Furthermore, we devise some general requirements related to KiPs management and execution. Such requirements contribute to the definition of an evaluation framework to assess current system support for KiPs. To this end, we present a critical analysis on a number of existing process-oriented approaches by discussing their efficacy against the requirements

Micro-meso-macro practice tensions in using patient-reported outcome and experience measures in hospital palliative care

This article applies a micro-meso-macro analytical framework to understand clinicians’ experiences and perspectives of using patient-reported outcome and experience measures (PROMs and PREMs) in routine hospital-based palliative care. We structure our discussion through qualitative analysis of a design and implementation project for using an electronic tablet-based tool among hospital-based palliative clinicians to assess patients’ and their family caregivers’ quality of life concerns and experiences of care. Our analysis identified three categories of practice tensions shaping clinicians’ use of PROMs and PREMs in routine care: tensions surrounding implementation, tensions in standardization and quantification, and tensions that arose from scope of practice concerns. Our findings highlight that clinicians necessarily work within the confluence of multiple system priorities, that navigating these priorities can result in irreducible practice tensions, and that awareness of these tensions is a critical consideration when integrating PROMs and PREMs into routine practice

Design and introduction of a quality of life assessment and practice support system: perspectives from palliative care settings

Background: Quality of life (QOL) assessment instruments, including patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs), are increasingly promoted as a means of enabling clinicians to enhance person-centered care. However, integration of these instruments into palliative care clinical practice has been inconsistent. This study focused on the design of an electronic Quality of Life and Practice Support System (QPSS) prototype and its initial use in palliative inpatient and home care settings. Our objectives were to ascertain desired features of a QPSS prototype and the experiences of clinicians, patients, and family caregivers in regard to the initial introduction of a QPSS in palliative care, interpreting them in context. Methods: We applied an integrated knowledge translation approach in two stages by engaging a total of 71 clinicians, 18 patients, and 17 family caregivers in palliative inpatient and home care settings. Data for Stage I were collected via 12 focus groups with clinicians to ascertain desirable features of a QPSS. Stage II involved 5 focus groups and 24 interviews with clinicians and 35 interviews with patients or family caregivers during initial implementation of a QPSS. The focus groups and interviews were recorded, transcribed, and analyzed using the qualitative methodology of interpretive description. Results: Desirable features focused on hardware (lightweight, durable, and easy to disinfect), software (simple, user-friendly interface, multi-linguistic, integration with e-health systems), and choice of assessment instruments that would facilitate a holistic assessment. Although patient and family caregiver participants were predominantly enthusiastic, clinicians expressed a mixture of enthusiasm, receptivity, and concern regarding the use of a QPSS. The analyses revealed important contextual considerations, including: (a) logistical, technical, and aesthetic considerations regarding the QPSS as a technology, (b) diversity in knowledge, skills, and attitudes of clinicians, patients, and family caregivers regarding the integration of electronic QOL assessments in care, and (c) the need to understand organizational context and priorities in using QOL assessment data. Conclusion: The process of designing and integrating a QPSS in palliative care for patients with life-limiting conditions and their family caregivers is complex and requires extensive consultation with clinicians, administrators, patients, and family caregivers to inform successful implementation

Creation of a Decision Support Tool for Expectant Parents Facing Threatened Periviable Delivery: Application of a User-Centered Design Approach

Background Shared decision-making (SDM) is optimal in the context of periviable delivery, where the decision to pursue life-support measures or palliation is both preference sensitive and value laden. We sought to develop a decision support tool (DST) prototype to facilitate SDM by utilizing a user-centered design research approach. Methods We convened four patient and provider advisory boards with women and their partners who had experienced a surviving or non-surviving periviable delivery, pregnant women who had not experienced a prior preterm birth, and obstetric providers. Each 2-h session involved design research activities to generate ideas and facilitate sharing of values, goals, and attitudes. Participant feedback shaped the design of three prototypes (a tablet application, family story videos, and a virtual reality experience) to be tested in a final session. Results Ninety-five individuals (48 mothers/partners; 47 providers) from two hospitals participated. Most participants agreed that the prototypes should include factual, unbiased outcomes and probabilities. Mothers and support partners also desired comprehensive explanations of delivery and care options, while providers wanted a tool to ease communication, help elicit values, and share patient experiences. Participants ultimately favored the tablet application and suggested that it include family testimonial videos. Conclusion Our results suggest that a DST that combines unbiased information and understandable outcomes with family testimonials would be meaningful for periviable SDM. User-centered design was found to be a useful method for creating a DST prototype that may lead to improved effectiveness, usability, uptake, and dissemination in the future, by leveraging the expertise of a wide range of stakeholders

Assessing Unmet Needs of Caregivers after Stroke: Occupational Therapist Practices and Perspectives

Background: Family caregivers of stroke survivors often feel unprepared and overwhelmed post discharge with numerous unmet needs. Occupational therapists can play an integral role in addressing family caregivers’ needs. Limited research exists on assessment practices of occupational therapists in identifying caregivers’ needs poststroke. This study explores the practices and perspectives of occupational therapists in assessing unmet caregivers’ needs. Method: A cross-sectional, mixed methods research design was used to electronically survey 15 occupational therapists. Part 1 of the survey explored participant methods for identifying caregivers’ needs and their views on using formal caregiver assessment tools. Part 2 gathered participant perspectives on three selected caregiver assessments. Descriptive statistics and thematic analysis were used to interpret the data. Results: The participants perceive formal assessments as beneficial. However, they use informal strategies to assess the unmet needs of caregivers rather than formal assessment. Reimbursement challenges, productivity pressure, and questionable necessity are barriers to conducting formal assessments. Advantages and disadvantages of each assessment are discussed. Conclusion: Occupational therapists face barriers to conducting formal assessment across settings. Implementation of recent policies is needed to further support occupational therapy’s role in addressing caregivers’ needs. This study can inform future development of assessment tools tailored to occupational therapy

Business models for sustained ehealth implementation: lessons from two continents

There is general consensus that Computers and Information Technology have the potential to enhance health systems applications, and many good examples of such applications exist all over the world. Unfortunately, with respect to eHealth and telemedicine, there is much disillusionment and scepticism. This paper describes two models that were developed separately, but had the same purpose, namely to facilitate a holistic approach to the development and implementation of eHealth solutions. The roadmap of the Centre for eHealth Research (CeHRes roadmap) was developed in the Netherlands, and the Telemedicine Maturity Model (TMMM) was developed in South Africa. The purpose of this paper is to analyse the commonalities and differences of these approaches, and to explore how they can be used to complement each other. The first part of this paper comprises of a comparison of these models in terms of origin, research domain and design principles. Case comparisons are then presented to illustrate how these models complement one another

Computerization of workflows, guidelines and care pathways: a review of implementation challenges for process-oriented health information systems

There is a need to integrate the various theoretical frameworks and formalisms for modeling clinical guidelines, workflows, and pathways, in order to move beyond providing support for individual clinical decisions and toward the provision of process-oriented, patient-centered, health information systems (HIS). In this review, we analyze the challenges in developing process-oriented HIS that formally model guidelines, workflows, and care pathways. A qualitative meta-synthesis was performed on studies published in English between 1995 and 2010 that addressed the modeling process and reported the exposition of a new methodology, model, system implementation, or system architecture. Thematic analysis, principal component analysis (PCA) and data visualisation techniques were used to identify and cluster the underlying implementation ‘challenge’ themes. One hundred and eight relevant studies were selected for review. Twenty-five underlying ‘challenge’ themes were identified. These were clustered into 10 distinct groups, from which a conceptual model of the implementation process was developed. We found that the development of systems supporting individual clinical decisions is evolving toward the implementation of adaptable care pathways on the semantic web, incorporating formal, clinical, and organizational ontologies, and the use of workflow management systems. These architectures now need to be implemented and evaluated on a wider scale within clinical settings