Using Simulation to Aid Decision Making in Managing the Usability Evaluation Process

Context: This paper is developed in the context of Usability Engineering. More specifically, it focuses on the use of modelling and simulation to help decision-making in the scope of usability evaluation. Objective: The main goal of this paper is to present UESim: a System Dynamics simulation model to help decision-making in the make-up of the usability evaluation team during the process of usability evaluation. Method: To develop this research we followed four main research phases: a) study identification, b) study development, c) running and observation and finally, d) reflexion. In relation with these phases the paper describes the literature revision, the model building and validation, the model simulation and its results and finally the reflexion on it. Results: We developed and validated a model to simulate the usability evaluation process. Through three different simulations we analysed the effects of different compositions of the evaluation team on the outcome of the evaluation. The simulation results show the utility of the model in the decision making of the usability evaluation process by changing the number and expertise of evaluators employed. Conclusion: One of the main advantages of using such a simulation model is that it allows developers to observe the evolution of the key indicators of the evaluation process over time. UESim represents a customisable tool to help decision-making in the management of the usability evaluation process, since it makes it possible to analyse how the key process indicators are affected by the main management options of the Usability Evaluation Process

Healthcare workers’ perspectives on participatory system dynamics modelling and simulation: designing safe and efficient hospital pharmacy dispensing systems together

With increasingly complex safety-critical systems like healthcare being developed and managed, there is a need for a tool that permits decision-makers to better understand the complexity, test various strategies and guide effective changes. System Dynamics (SD) modelling is an effective approach that can aid strategic decision-making in healthcare systems but has been underutilised partly due to the challenge of engaging healthcare stakeholders in the modelling process. This paper, therefore, investigates the applicability of a participatory SD approach based on healthcare workers' perspectives on ease of use (usability) and usefulness (utility). The study developed an interactive simulation dashboard platform which facilitated participatory simulation for exploring various hospital pharmacy staffing level arrangements and their impacts on interruptions, fatigue, workload, rework, productivity and safety. The findings reveal that participatory SD approach can enhance team learning by converging on a shared mental model, aid decision-making and identifying trade-offs. The implications of these findings are discussed as well as experience and lessons learned on modelling facilitation.Practitioner Summary: This paper reports the perspectives of healthcare workers, who were engaged with a participatory system dynamics modelling and simulation process for hospital pharmacy staffing level management. Evaluative feedback revealed that the participatory SD approach can be a valuable tool for participatory ergonomics by helping the participants gain a deeper understanding of the complex dynamic interactions between workload, rework, safety and efficiency

Visual analytics for supply network management: system design and evaluation

We propose a visual analytic system to augment and enhance decision-making processes of supply chain managers. Several design requirements drive the development of our integrated architecture and lead to three primary capabilities of our system prototype. First, a visual analytic system must integrate various relevant views and perspectives that highlight different structural aspects of a supply network. Second, the system must deliver required information on-demand and update the visual representation via user-initiated interactions. Third, the system must provide both descriptive and predictive analytic functions for managers to gain contingency intelligence. Based on these capabilities we implement an interactive web-based visual analytic system. Our system enables managers to interactively apply visual encodings based on different node and edge attributes to facilitate mental map matching between abstract attributes and visual elements. Grounded in cognitive fit theory, we demonstrate that an interactive visual system that dynamically adjusts visual representations to the decision environment can significantly enhance decision-making processes in a supply network setting. We conduct multi-stage evaluation sessions with prototypical users that collectively confirm the value of our system. Our results indicate a positive reaction to our system. We conclude with implications and future research opportunities.The authors would like to thank the participants of the 2015 Businessvis Workshop at IEEE VIS, Prof. Benoit Montreuil, and Dr. Driss Hakimi for their valuable feedback on an earlier version of the software; Prof. Manpreet Hora for assisting with and Georgia Tech graduate students for participating in the evaluation sessions; and the two anonymous reviewers for their detailed comments and suggestions. The study was in part supported by the Tennenbaum Institute at Georgia Tech Award # K9305. (K9305 - Tennenbaum Institute at Georgia Tech Award)Accepted manuscrip

Occupational therapists’ views of using a virtual reality interior design application within the pre-discharge home visit process

This article has been made available through the Brunel Open Access Publishing Fund.Background: A key role of Occupational Therapists (OTs) is to carry out pre-discharge home visits (PHV) and propose appropriate adaptations to the home environment, to enable patients to function independently after hospital-home discharge. However, research shows that more than 50% of specialist equipment installed as part of home adaptations is not used by patients. A key reason for this is that decisions about home adaptations are often made without adequate collaboration and consultation with the patient. Consequently, there is an urgent need to seek out new and innovative uses of technology to facilitate patient/practitioner collaboration, engagement and shared decision making in the PHV process. Virtual reality interior design applications (VRIDAs) primarily allow users to simulate the home environment and visualise changes prior to implementing them. Customised VRIDAs, which also model specialist occupational therapy equipment, could become a valuable tool to facilitate improved patient/practitioner collaboration if developed effectively and integrated into the PHV process. Objective: To explore the perceptions of occupational therapists with regards to using VRIDAs as an assistive tool within the PHV process. Methods: Task-oriented interactive usability sessions, utilising the think-aloud protocol and subsequent semi-structured interviews were carried out with seven Occupational Therapists who possessed significant experience across a range of clinical settings. Template analysis was carried out on the think-aloud and interview data. Analysis was both inductive and driven by theory, centring around the parameters that impact upon the acceptance, adoption and use of this technology in practice as indicated by the Technology Acceptance Model (TAM). Results: OTs’ perceptions were identified relating to three core themes: (1) perceived usefulness (PU), (2) perceived ease of use (PEoU), and (3) actual use (AU). Regarding PU, OTs believed VRIDAs had promising potential to increase understanding, enrich communications and patient involvement, and improved patient/practitioner shared understanding. However, it was unlikely that VRIDAs would be suitable for use with cognitively impaired patients. For PEoU, all OTs were able to use the software and complete the tasks successfully, however, participants noted numerous specialist equipment items that could be added to the furniture library. AU perceptions were positive regarding use of the application across a range of clinical settings including children/young adults, long-term conditions, neurology, older adults, and social services. However, some “fine tuning” may be necessary if the application is to be optimally used in practice. Conclusions: Participants perceived the use of VRIDAs in practice would enhance levels of patient/practitioner collaboration and provide a much needed mechanism via which patients are empowered to become more equal partners in decisions made about their care. Further research is needed to explore patient perceptions of VRIDAs, to make necessary customisations accordingly, and to explore deployment of the application in a collaborative patient/practitioner-based context

Serious Games Integrated Framework: Keep Them in the Flow

Serious games aim to improve the learner experience, allowing them to build knowledge and skills using untraditional learning tools. Supply chain management (SCM) and similar complex fields are promising areas for the adoption of such technology. Complex interrelated concepts and the difficulties faced by the student in understanding and managing the complete image of the field prompts teachers to search for alternative learning tools. This paper proposes an integrated simulation-based serious games framework and describes an implemented serious game called AuSuM (AUtomobile SUpply chain Management). The framework explains the required components and the relationships between them in order to improve engagement and motivation for students in the classroom. This framework was tested through the implemented game, and piloted in real classrooms where it demonstrated improvement in students’ engagement, motivation and knowledge development

Building capacity in climate change policy analysis and negotiation: methods and technologies

Capacity building is often cited as the reason “we cannot just pour money into developing countries” and why so many development projects fail because their design does not address local conditions. It is therefore a key technical and political concept in international development. Some of the poorest countries in the world are also some of the most vulnerable to the impacts of climate change. Their vulnerability is in part due to a lack of capacity to plan and anticipate the effects of climate change on crops, water resources, urban electricity demand etc. What capacities do these countries lack to deal with climate change? How will they cope? What steps can they take to reduce their vulnerability? This innovative and high-profile research project was part of a larger project (called C3D) and conducted with non-governmental organisations in Senegal, South Africa and Sri Lanka. The research involved several participatory workshops and a questionnaire to all three research centres

An interactive 3-D application for pain management: Results from a pilot study in spinal cord injury rehabilitation

This is the post-print version of the Article. The official published version can be accessed from the link below - Copyright @ 2012 ElevierResearch on pain following spinal cord injury (SCI) has revealed that patients not only experience several types of pain that could prove to be challenging to address, but also that each individual can interpret such pain in different subjective ways. In this paper we introduce a 3-D system for facilitating the efficient management of pain, and thus, supporting clinicians in overcoming the aforementioned challenges. This system was evaluated by a cohort of 15 SCI patients in a pilot study that took place between July and October 2010. Participants reported their experiences of using the 3-D system in an adapted version of the System Usability Scale (SUS) questionnaire. Statistically significant results were obtained with regards to the usability and efficiency of the 3-D system, with the majority of the patients finding it particularly useful to report their pain. Our findings suggest that the 3-D system can be an efficient tool in the efforts to better manage the pain experience of SCI patients