Evaluating the impact of physical activity apps and wearables: interdisciplinary review

Background: Although many smartphone apps and wearables have been designed to improve physical activity, their rapidly evolving nature and complexity present challenges for evaluating their impact. Traditional methodologies, such as randomized controlled trials (RCTs), can be slow. To keep pace with rapid technological development, evaluations of mobile health technologies must be efficient. Rapid alternative research designs have been proposed, and efficient in-app data collection methods, including in-device sensors and device-generated logs, are available. Along with effectiveness, it is important to measure engagement (ie, users’ interaction and usage behavior) and acceptability (ie, users’ subjective perceptions and experiences) to help explain how and why apps and wearables work. Objectives: This study aimed to (1) explore the extent to which evaluations of physical activity apps and wearables: employ rapid research designs; assess engagement, acceptability, as well as effectiveness; use efficient data collection methods; and (2) describe which dimensions of engagement and acceptability are assessed. Method: An interdisciplinary scoping review using 8 databases from health and computing sciences. Included studies measured physical activity, and evaluated physical activity apps or wearables that provided sensor-based feedback. Results were analyzed using descriptive numerical summaries, chi-square testing, and qualitative thematic analysis. Results: A total of 1829 abstracts were screened, and 858 articles read in full. Of 111 included studies, 61 (55.0%) were published between 2015 and 2017. Most (55.0%, 61/111) were RCTs, and only 2 studies (1.8%) used rapid research designs: 1 single-case design and 1 multiphase optimization strategy. Other research designs included 23 (22.5%) repeated measures designs, 11 (9.9%) nonrandomized group designs, 10 (9.0%) case studies, and 4 (3.6%) observational studies. Less than one-third of the studies (32.0%, 35/111) investigated effectiveness, engagement, and acceptability together. To measure physical activity, most studies (90.1%, 101/111) employed sensors (either in-device [67.6%, 75/111] or external [23.4%, 26/111]). RCTs were more likely to employ external sensors (accelerometers: P=.005). Studies that assessed engagement (52.3%, 58/111) mostly used device-generated logs (91%, 53/58) to measure the frequency, depth, and length of engagement. Studies that assessed acceptability (57.7%, 64/111) most often used questionnaires (64%, 42/64) and/or qualitative methods (53%, 34/64) to explore appreciation, perceived effectiveness and usefulness, satisfaction, intention to continue use, and social acceptability. Some studies (14.4%, 16/111) assessed dimensions more closely related to usability (ie, burden of sensor wear and use, interface complexity, and perceived technical performance). Conclusions: The rapid increase of research into the impact of physical activity apps and wearables means that evaluation guidelines are urgently needed to promote efficiency through the use of rapid research designs, in-device sensors and user-logs to assess effectiveness, engagement, and acceptability. Screening articles was time-consuming because reporting across health and computing sciences lacked standardization. Reporting guidelines are therefore needed to facilitate the synthesis of evidence across disciplines

Study protocol for the Anesthesiology Control Tower—Feedback Alerts to Supplement Treatments (ACTFAST-3) trial: A pilot randomized controlled trial in intraoperative telemedicine [version 1; referees: 2 approved]

Background: Each year, over 300 million people undergo surgical procedures worldwide. Despite efforts to improve outcomes, postoperative morbidity and mortality are common. Many patients experience complications as a result of either medical error or failure to adhere to established clinical practice guidelines. This protocol describes a clinical trial comparing a telemedicine-based decision support system, the Anesthesiology Control Tower (ACT), with enhanced standard intraoperative care. Methods: This study is a pragmatic, comparative effectiveness trial that will randomize approximately 12,000 adult surgical patients on an operating room (OR) level to a control or to an intervention group. All OR clinicians will have access to decision support software within the OR as a part of enhanced standard intraoperative care. The ACT will monitor patients in both groups and will provide additional support to the clinicians assigned to intervention ORs. Primary outcomes include blood glucose management and temperature management. Secondary outcomes will include surrogate, clinical, and economic outcomes, such as incidence of intraoperative hypotension, postoperative respiratory compromise, acute kidney injury, delirium, and volatile anesthetic utilization. Ethics and dissemination: The ACTFAST-3 study has been approved by the Human Resource Protection Office (HRPO) at Washington University in St. Louis and is registered at clinicaltrials.gov (NCT02830126). Recruitment for this protocol began in April 2017 and will end in December 2018. Dissemination of the findings of this study will occur via presentations at academic conferences, journal publications, and educational materials

Development of grid frameworks for clinical trials and epidemiological studies

E-Health initiatives such as electronic clinical trials and epidemiological studies require access to and usage of a range of both clinical and other data sets. Such data sets are typically only available over many heterogeneous domains where a plethora of often legacy based or in-house/bespoke IT solutions exist. Considerable efforts and investments are being made across the UK to upgrade the IT infrastructures across the National Health Service (NHS) such as the National Program for IT in the NHS (NPFIT) [1]. However, it is the case that currently independent and largely non-interoperable IT solutions exist across hospitals, trusts, disease registries and GP practices – this includes security as well as more general compute and data infrastructures. Grid technology allows issues of distribution and heterogeneity to be overcome, however the clinical trials domain places special demands on security and data which hitherto the Grid community have not satisfactorily addressed. These challenges are often common across many studies and trials hence the development of a re-usable framework for creation and subsequent management of such infrastructures is highly desirable. In this paper we present the challenges in developing such a framework and outline initial scenarios and prototypes developed within the MRC funded Virtual Organisations for Trials and Epidemiological Studies (VOTES) project [2]

Wearable Haptic Devices for Gait Re-education by Rhythmic Haptic Cueing

This research explores the development and evaluation of wearable haptic devices for gait sensing and rhythmic haptic cueing in the context of gait re-education for people with neurological and neurodegenerative conditions. Many people with long-term neurological and neurodegenerative conditions such as Stroke, Brain Injury, Multiple Sclerosis or Parkinson’s disease suffer from impaired walking gait pattern. Gait improvement can lead to better fluidity in walking, improved health outcomes, greater independence, and enhanced quality of life. Existing lab-based studies with wearable devices have shown that rhythmic haptic cueing can cause immediate improvements to gait features such as temporal symmetry, stride length, and walking speed. However, current wearable systems are unsuitable for self-managed use for in-the-wild applications with people having such conditions. This work aims to investigate the research question of how wearable haptic devices can help in long-term gait re-education using rhythmic haptic cueing. A longitudinal pilot study has been conducted with a brain trauma survivor, providing rhythmic haptic cueing using a wearable haptic device as a therapeutic intervention for a two-week period. Preliminary results comparing pre and post-intervention gait measurements have shown improvements in walking speed, temporal asymmetry, and stride length. The pilot study has raised an array of issues that require further study. This work aims to develop and evaluate prototype systems through an iterative design process to make possible the self-managed use of such devices in-the-wild. These systems will directly provide therapeutic intervention for gait re-education, offer enhanced information for therapists, remotely monitor dosage adherence and inform treatment and prognoses over the long-term. This research will evaluate the use of technology from the perspective of multiple stakeholders, including clinicians, carers and patients. This work has the potential to impact clinical practice nationwide and worldwide in neuro-physiotherapy

Usability and feasibility of consumer-facing technology to reduce unsafe medication use by older adults

Background Mobile health technology can improve medication safety for older adults, for instance, by educating patients about the risks associated with anticholinergic medication use. Objective This study's objective was to test the usability and feasibility of Brain Buddy, a consumer-facing mobile health technology designed to inform and empower older adults to consider the risks and benefits of anticholinergics. Methods Twenty-three primary care patients aged ≥60 years and using anticholinergic medications participated in summative, task-based usability testing of Brain Buddy. Self-report usability was assessed by the System Usability Scale and performance-based usability data were collected for each task through observation. A subset of 17 participants contributed data on feasibility, assessed by self-reported attitudes (feeling informed) and behaviors (speaking to a physician), with confirmation following a physician visit. Results Overall usability was acceptable or better, with 100% of participants completing each Brain Buddy task and a mean System Usability Scale score of 78.8, corresponding to “Good” to “Excellent” usability. Observed usability issues included higher rates of errors, hesitations, and need for assistance on three tasks, particularly those requiring data entry. Among participants contributing to feasibility data, 100% felt better informed after using Brain Buddy and 94% planned to speak to their physician about their anticholinergic related risk. On follow-up, 82% reported having spoken to their physician, a rate independently confirmed by physicians. Conclusion Consumer-facing technology can be a low-cost, scalable intervention to improve older adults’ medication safety, by informing and empowering patients. User-centered design and evaluation with demographically heterogeneous clinical samples uncovers correctable usability issues and confirms the value of interventions targeting consumers as agents in shared decision making and behavior change

Patient-based mobile alerting systems- requirements and expectations

Patients with chronic conditions are not well supported by technical systems in managing their conditions. However, such systems could help patients to self-reliantly comply with their treatment. This help could be rendered in the form of alerting patients about condition-relevant issues, transmitting relevant parameters to healthcare providers and analysing these parameters according to guidelines specified by both patients and healthcare staff. If necessary, this analysis of condition parameters triggers the alerting of patients and healthcare providers about actions to be taken. In this paper, we present the results of a survey we have undertaken to verify and extend requirements we have identified for the design of a Mobile Alerting System for patients with chronic conditions. First of all, the results show that a Mobile Alerting System is desired by patients. Moreover, due to the inter- and intra-user variance of patients and healthcare staff, the system has to work in a context-aware manner and allow for personalised parameters in order to be adaptable to every user’s needs

Spatial filters selection towards a rehabilitation BCI

Introducing BCI technology in supporting motor imagery (MI) training has revealed the rehabilitative potential of MI, contributing to significantly better motor functional outcomes in stroke patients. To provide the most accurate and personalized feedback during the treatment, several stages of the electroencephalographic signal processing have to be optimized, including spatial filtering. This study focuses on data-independent approaches to optimize spatial filtering step. Specific aims were: i) assessment of spatial filters' performance in relation to the hand and foot scalp areas; ii) evaluation of simultaneous use of multiple spatial filters; iii) minimization of the number of electrodes needed for training. Our findings indicate that different spatial filters showed different performance related to the scalp areas considered. The simultaneous use of EEG signals conditioned with different spatial filters could either improve classification performance or, at same level of performance could lead to a reduction of the number of electrodes needed for successive training, thus improving usability of BCIs in clinical rehabilitation context

Increasing the Capacity of Primary Care Through Enabling Technology.

Primary care is the foundation of effective and high-quality health care. The role of primary care clinicians has expanded to encompass coordination of care across multiple providers and management of more patients with complex conditions. Enabling technology has the potential to expand the capacity for primary care clinicians to provide integrated, accessible care that channels expertise to the patient and brings specialty consultations into the primary care clinic. Furthermore, technology offers opportunities to engage patients in advancing their health through improved communication and enhanced self-management of chronic conditions. This paper describes enabling technologies in four domains (the body, the home, the community, and the primary care clinic) that can support the critical role primary care clinicians play in the health care system. It also identifies challenges to incorporating these technologies into primary care clinics, care processes, and workflow

E-infrastructures fostering multi-centre collaborative research into the intensive care management of patients with brain injury

Clinical research is becoming ever more collaborative with multi-centre trials now a common practice. With this in mind, never has it been more important to have secure access to data and, in so doing, tackle the challenges of inter-organisational data access and usage. This is especially the case for research conducted within the brain injury domain due to the complicated multi-trauma nature of the disease with its associated complex collation of time-series data of varying resolution and quality. It is now widely accepted that advances in treatment within this group of patients will only be delivered if the technical infrastructures underpinning the collection and validation of multi-centre research data for clinical trials is improved. In recognition of this need, IT-based multi-centre e-Infrastructures such as the Brain Monitoring with Information Technology group (BrainIT - www.brainit.org) and Cooperative Study on Brain Injury Depolarisations (COSBID - www.cosbid.de) have been formed. A serious impediment to the effective implementation of these networks is access to the know-how and experience needed to install, deploy and manage security-oriented middleware systems that provide secure access to distributed hospital based datasets and especially the linkage of these data sets across sites. The recently funded EU framework VII ICT project Advanced Arterial Hypotension Adverse Event prediction through a Novel Bayesian Neural Network (AVERT-IT) is focused upon tackling these challenges. This chapter describes the problems inherent to data collection within the brain injury medical domain, the current IT-based solutions designed to address these problems and how they perform in practice. We outline how the authors have collaborated towards developing Grid solutions to address the major technical issues. Towards this end we describe a prototype solution which ultimately formed the basis for the AVERT-IT project. We describe the design of the underlying Grid infrastructure for AVERT-IT and how it will be used to produce novel approaches to data collection, data validation and clinical trial design is also presented

Ambulatory assessment in neuropsychology : applications in multiple sclerosis research

Peer reviewedPostprin