Usability Testing for Serious Games: Making Informed Design Decisions with User Data

Usability testing is a key step in the successful design of new technologies and tools, ensuring that heterogeneous populations will be able to interact easily with innovative applications. While usability testing methods of productivity tools (e.g., text editors, spreadsheets, or management tools) are varied, widely available, and valuable, analyzing the usability of games, especially educational “serious” games, presents unique usability challenges. Because games are fundamentally different than general productivity tools, “traditional” usability instruments valid for productivity applications may fall short when used for serious games. In this work we present a methodology especially designed to facilitate usability testing for serious games, taking into account the specific needs of such applications and resulting in a systematically produced list of suggested improvements from large amounts of recorded gameplay data. This methodology was applied to a case study for a medical educational game, MasterMed, intended to improve patients’ medication knowledge. We present the results from this methodology applied to MasterMed and a summary of the central lessons learned that are likely useful for researchers who aim to tune and improve their own serious games before releasing them for the general public

Assessment of Stakeholder Engagement in a Down Syndrome Research Study

There is growing recognition of the importance of engaging patients early in the design of research studies. For studies involving patients with intellectual and cognitive disabilities, researchers may consider engaging with family caregivers, health professionals, community advocates, and/or subject matter experts to provide a more multifaceted, surrogate perspective. Evaluating the engagement of these stakeholder groups in research is nascent, and tools are limited. Research studies involving these individuals provide the opportunity to test new methods of measurement of stakeholder engagement in research. We conducted a 3-year research study implementing and evaluating Down Syndrome Clinic to You, an online platform for caregivers of individuals with Down syndrome who do not have access to Down syndrome specialists. We established 3 key stakeholder groups — family caregivers, primary care physicians, and medical/scientific experts in the field — who were involved from grant-writing through preparation of the final report. To assess stakeholder engagement, we utilized the Patient Engagement in Research Scale, a validated instrument originally developed to evaluate patient engagement in arthritis research. Overall, results were suggestive of strong engagement levels by the key stakeholder groups. This study contributes to the limited available literature evaluating measures of stakeholder engagement in research

A randomized controlled trial of an online health tool about Down syndrome

PURPOSE: We sought to determine if a novel online health tool, called Down Syndrome Clinic to You (DSC2U), could improve adherence to national Down syndrome (DS) guidelines. We also sought to determine if primary care providers (PCPs) and caregivers are satisfied with this personalized online health tool. METHODS: In a national, randomized controlled trial of 230 caregivers who had children or dependents with DS without access to a DS specialist, 117 were randomized to receive DSC2U and 113 to receive usual care. The primary outcome was adherence to five health evaluations indicated by national guidelines for DS. DSC2U is completed electronically, in all mobile settings, by caregivers at home. The outputs-personalized checklists-are used during annual wellness visits with the patient\u27s PCP. RESULTS: A total of 213 participants completed a 7-month follow-up evaluation. In the intention-to-treat analysis, the intervention group had a 1.6-fold increase in the number of indicated evaluations that were recommended by the primary care provider or completed compared with controls. Both caregivers and PCPs reported high levels of satisfaction with DSC2U. CONCLUSIONS: DSC2U improved adherence to the national DS health-care guidelines with a novel modality that was highly valued by both caregivers and PCPs

Correction: A randomized controlled trial of an online health tool about Down syndrome

An amendment to this paper has been published and can be accessed via a link at the top of the paper