Evaluating the impact of physical activity apps and wearables: interdisciplinary review

Background: Although many smartphone apps and wearables have been designed to improve physical activity, their rapidly evolving nature and complexity present challenges for evaluating their impact. Traditional methodologies, such as randomized controlled trials (RCTs), can be slow. To keep pace with rapid technological development, evaluations of mobile health technologies must be efficient. Rapid alternative research designs have been proposed, and efficient in-app data collection methods, including in-device sensors and device-generated logs, are available. Along with effectiveness, it is important to measure engagement (ie, users’ interaction and usage behavior) and acceptability (ie, users’ subjective perceptions and experiences) to help explain how and why apps and wearables work. Objectives: This study aimed to (1) explore the extent to which evaluations of physical activity apps and wearables: employ rapid research designs; assess engagement, acceptability, as well as effectiveness; use efficient data collection methods; and (2) describe which dimensions of engagement and acceptability are assessed. Method: An interdisciplinary scoping review using 8 databases from health and computing sciences. Included studies measured physical activity, and evaluated physical activity apps or wearables that provided sensor-based feedback. Results were analyzed using descriptive numerical summaries, chi-square testing, and qualitative thematic analysis. Results: A total of 1829 abstracts were screened, and 858 articles read in full. Of 111 included studies, 61 (55.0%) were published between 2015 and 2017. Most (55.0%, 61/111) were RCTs, and only 2 studies (1.8%) used rapid research designs: 1 single-case design and 1 multiphase optimization strategy. Other research designs included 23 (22.5%) repeated measures designs, 11 (9.9%) nonrandomized group designs, 10 (9.0%) case studies, and 4 (3.6%) observational studies. Less than one-third of the studies (32.0%, 35/111) investigated effectiveness, engagement, and acceptability together. To measure physical activity, most studies (90.1%, 101/111) employed sensors (either in-device [67.6%, 75/111] or external [23.4%, 26/111]). RCTs were more likely to employ external sensors (accelerometers: P=.005). Studies that assessed engagement (52.3%, 58/111) mostly used device-generated logs (91%, 53/58) to measure the frequency, depth, and length of engagement. Studies that assessed acceptability (57.7%, 64/111) most often used questionnaires (64%, 42/64) and/or qualitative methods (53%, 34/64) to explore appreciation, perceived effectiveness and usefulness, satisfaction, intention to continue use, and social acceptability. Some studies (14.4%, 16/111) assessed dimensions more closely related to usability (ie, burden of sensor wear and use, interface complexity, and perceived technical performance). Conclusions: The rapid increase of research into the impact of physical activity apps and wearables means that evaluation guidelines are urgently needed to promote efficiency through the use of rapid research designs, in-device sensors and user-logs to assess effectiveness, engagement, and acceptability. Screening articles was time-consuming because reporting across health and computing sciences lacked standardization. Reporting guidelines are therefore needed to facilitate the synthesis of evidence across disciplines

Design Lessons from an RCT to Test Efficacy of a Hybrid eHealth Solution for Work Site Health

Work site healthy lifestyle interventions hold promise for improving health and employability. As part of a larger employer vitality program and a work site RCT (Randomized Controlled Trial, n=59 intervention arm) to assess cardiac risk impacts, we conducted a design analysis on a hybrid eHealth solution. The control condition was a six weeks waiting list and then start of the hybrid eHealth support (n=57). Based on preliminary 6 week- and 3 month-results, the hybrid eHealth support generated statistically significant risk factors improvement (like LDL cholesterol). The waiting list condition yielded no significant improvements. The late start after the waiting list did yield significant improvements, but not as large as a direct start. The direct start also appears to yield higher satisfaction and intention to recommend. Our analysis supports three types of conclusions. First, the hybrid eHealth intervention did significantly improve physical risk factor variables after 6 weeks. Motivation and measurement alone (waiting list) did not. Second, theory on timing of health support for patient appeared generalizable to employees: it did help to offer support at a moment of high motivation, instead of later. Third, a design analysis was conducted regarding service mix efficacy in relation to key requirements for designing ICT-enabled lifestyle interventions. This resulted in several recommendations and improved service adoption

User interface design for mobile-based sexual health interventions for young people: Design recommendations from a qualitative study on an online Chlamydia clinical care pathway

Background: The increasing pervasiveness of mobile technologies has given potential to transform healthcare by facilitating clinical management using software applications. These technologies may provide valuable tools in sexual health care and potentially overcome existing practical and cultural barriers to routine testing for sexually transmitted infections. In order to inform the design of a mobile health application for STIs that supports self-testing and self-management by linking diagnosis with online care pathways, we aimed to identify the dimensions and range of preferences for user interface design features among young people. Methods: Nine focus group discussions were conducted (n=49) with two age-stratified samples (16 to 18 and 19 to 24 year olds) of young people from Further Education colleges and Higher Education establishments. Discussions explored young people's views with regard to: the software interface; the presentation of information; and the ordering of interaction steps. Discussions were audio recorded and transcribed verbatim. Interview transcripts were analysed using thematic analysis. Results: Four over-arching themes emerged: privacy and security; credibility; user journey support; and the task-technology-context fit. From these themes, 20 user interface design recommendations for mobile health applications are proposed. For participants, although privacy was a major concern, security was not perceived as a major potential barrier as participants were generally unaware of potential security threats and inherently trusted new technology. Customisation also emerged as a key design preference to increase attractiveness and acceptability. Conclusions: Considerable effort should be focused on designing healthcare applications from the patient's perspective to maximise acceptability. The design recommendations proposed in this paper provide a valuable point of reference for the health design community to inform development of mobile-based health interventions for the diagnosis and treatment of a number of other conditions for this target group, while stimulating conversation across multidisciplinary communities

Attitudes towards the use and acceptance of eHealth technologies : a case study of older adults living with chronic pain and implications for rural healthcare

Acknowledgements The research described here is supported by the award made by the RCUK Digital Economy programme to the dot.rural Digital Economy Hub; award reference: EP/G066051/1. MC’s time writing the paper is funded by the Scottish Government’s Rural and Environmental Science and Analytical Services Division (RESAS) under Theme 8 ‘Vibrant Rural Communities’ of the Food, Land and People Programme (2011–2016). MC is also an Honorary Research Fellow at the Division of Applied Health Sciences, University of Aberdeen. The input of other members of the TOPS research team, Alastair Mort, Fiona Williams, Sophie Corbett, Phil Wilson and Paul MacNamee who contributed to be wider study and discussed preliminary findings reported here with the authors of the paper is acknowledged. We acknowledge the feedback on earlier versions of this paper provided by members of the Trans-Atlantic Rural Research Network, especially Stefanie Doebler and Carmen Hubbard. We also thank Deb Roberts for her comments.Peer reviewedPublisher PD

Users’ Continuance Participation in the Online Peer-to-peer Healthcare Community: A Text Mining Approach

The online peer-to-peer healthcare communities are known as the platform where dispersed groups of patients and their families query information, seek and offer support, and connect with others. The success of such communities relies on users’ ongoing involvement to generate benefits for both individuals and the communities. This study attempts to understand users’ continuance participation in online peer-to-peer healthcare community by classifying users’ goals of participation based on the user-generated text contents. We proposed a rule-based classification framework to categorize users’ goals of posting contents into four categories: information seeking, experience sharing, information sharing, and social interaction. We formalize and test the relationship between users’ continuance participation and all four posting goals, and find that the first three goals have significant impact on users’ continuance participation. Our findings can help researchers and practitioners better understand users’ behavior in the online peer-to-peer healthcare community

Where can teens find health information? A survey of web portals designed for teen health information seekers

The Web is an important source for health information for most teens with access to the Web (Gray et al, 2005a; Kaiser, 2001). While teens are likely to turn to the Web for health information, research has indicated that their skills in locating, evaluating and using health information are weak (Hansen et al, 2003; Skinner et al, 2003, Gray et al, 2005b). This behaviour suggests that the targeted approach to finding health information that is offered by web portals would be useful to teens. A web portal is the entry point for information on the Web. It is the front end, and often the filter, that users must pass through in order to link to actual content. Unlike general search engines such as Google, content that is linked to a portal has usually been pre-selected and even created by the organization that hosts the portal, assuring some level of quality control. The underlying architecture of the portal is structured and thus offers an organized approach to exploring a specific health topic. This paper reports on an environmental scan of the Web, the purpose of which was to identify and describe portals to general health information, in English and French, designed specifically for teens. It answers two key questions. First of all, what portals exist? And secondly, what are their characteristics? The portals were analyzed through the lens of four attributes: Usability, interactivity, reliability and findability. Usability is a term that incorporates concepts of navigation, layout and design, clarity of concept and purpose, underlying architecture, in-site assistance and, for web content with text, readability. Interactivity relates to the type of interactions and level of engagement required by the user to access health information on a portal. Interaction can come in the form of a game, a quiz, a creative experience, or a communication tool such as an instant messaging board, a forum or blog. Reliability reflects the traditional values of accuracy, currency, credibility and bias, and in the web-based world, durabililty. Findability is simply the ease with which a portal can be discovered by a searcher using the search engine that is most commonly associated with the Web by young people - Google - and using terms related to teen health. Findability is an important consideration since the majority of teens begin their search for health information using search engines (CIBER, 2008; Hansen et al, 2003). The content linked to by the portals was not evaluated, nor was the portals’ efficacy as a health intervention. Teens looking for health information on the Web in English have a wide range of choices available but French-language portals are much rarer and harder to find. A majority of the portals found and reviewed originated from hospitals, associations specializing in a particular disease, and governmental agencies, suggesting that portals for teens on health related topics are generally reliable. However, only a handful of the portals reviewed were easy to find, suggesting that valuable resources for teens remain buried in the Web

Securing recruitment and obtaining informed consent in minority ethnic groups in the UK

Background: Previous health research has often explicitly excluded individuals from minority ethnic backgrounds due to perceived cultural and communication difficulties, including studies where there might be language/literacy problems in obtaining informed consent. This study addressed these difficulties by developing audio-recorded methods of obtaining informed consent and recording data. This report outlines 1) our experiences with securing recruitment to a qualitative study investigating alternative methods of data collection, and 2) the development of a standardised process for obtaining informed consent from individuals from minority ethnic backgrounds whose main language does not have an agreed written form. Methods: Two researchers from South Asian backgrounds recruited adults with Type 2 diabetes whose main language was spoken and not written, to attend a series of focus groups. A screening tool was used at recruitment in order to assess literacy skills in potential participants. Informed consent was obtained using audio-recordings of the patient information and recording patients' verbal consent. Participants' perceptions of this method of obtaining consent were recorded. Results: Recruitment rates were improved by using telephone compared to face-to-face methods. The screening tool was found to be acceptable by all potential participants. Audio-recorded methods of obtaining informed consent were easy to implement and accepted by all participants. Attrition rates differed according to ethnic group. Snowballing techniques only partly improved participation rates. Conclusion: Audio-recorded methods of obtaining informed consent are an acceptable alternative to written consent in study populations where literacy skills are variable. Further exploration of issues relating to attrition is required, and a range of methods may be necessary in order to maximise response and participation

Metabolic Syndrome Screening in Seriously Mentally Ill Patients: A Quality Improvement Project

A Project Submitted in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE in Nursing ScienceSeriously mentally ill patients who are taking second-generation antipsychotics have a high risk of metabolic complications, including obesity, diabetes mellitus type II, hypertension, and hyperlipidemia. Guidelines to screen for metabolic syndrome were established by the American Diabetes Association, American Psychiatric Association, American Association of Clinical Endocrinologists, and North American Association for the Study of Obesity (Clark, 2004). Compliance with implementing the guidelines to screen and monitor for metabolic syndrome vary from regular monitoring to little or none. This quality improvement project provided an educational intervention on screening and monitoring for metabolic syndrome in patients who were seriously mentally ill. The educational interventions were attended by 21 psychiatric-mental health nurse practitioners. After the educational intervention was completed, there was significant improvement in provider knowledge as well as motivation to screen and monitor patients taking second-generation antipsychotic medications for metabolic syndrome. Education may motivate mental health providers to increase the use of metabolic screening guidelines for patients taking second-generation antipsychotic medications potentially improving long term outcomes for this patient population.Title Page / Abstract / Table of Contents / List of Appendices / Metabolic Syndrome in Seriously Mentally Ill Patients: A Quality Improvement Project / Background Significance / Literature Review / Purpose / Educational Intervention using an Evidence Based Practice Model / Methods / Dissemination / Significance to Nursing / Limitations / Summary and Conclusions / References / Appendice

Enhancing diabetes self-management through mobile phone application

Mary Adu adopted a systematic health behavioural framework and user engagement process to develop and explore the efficacy of a novel mobile-phone app for diabetes self-management. Reported benefits of the app provide empirical evidence of support for its multi-feature functionality and comprehensive interventional role in diabetes self-management education and support