Evaluating the impact of physical activity apps and wearables: interdisciplinary review

Background: Although many smartphone apps and wearables have been designed to improve physical activity, their rapidly evolving nature and complexity present challenges for evaluating their impact. Traditional methodologies, such as randomized controlled trials (RCTs), can be slow. To keep pace with rapid technological development, evaluations of mobile health technologies must be efficient. Rapid alternative research designs have been proposed, and efficient in-app data collection methods, including in-device sensors and device-generated logs, are available. Along with effectiveness, it is important to measure engagement (ie, users’ interaction and usage behavior) and acceptability (ie, users’ subjective perceptions and experiences) to help explain how and why apps and wearables work. Objectives: This study aimed to (1) explore the extent to which evaluations of physical activity apps and wearables: employ rapid research designs; assess engagement, acceptability, as well as effectiveness; use efficient data collection methods; and (2) describe which dimensions of engagement and acceptability are assessed. Method: An interdisciplinary scoping review using 8 databases from health and computing sciences. Included studies measured physical activity, and evaluated physical activity apps or wearables that provided sensor-based feedback. Results were analyzed using descriptive numerical summaries, chi-square testing, and qualitative thematic analysis. Results: A total of 1829 abstracts were screened, and 858 articles read in full. Of 111 included studies, 61 (55.0%) were published between 2015 and 2017. Most (55.0%, 61/111) were RCTs, and only 2 studies (1.8%) used rapid research designs: 1 single-case design and 1 multiphase optimization strategy. Other research designs included 23 (22.5%) repeated measures designs, 11 (9.9%) nonrandomized group designs, 10 (9.0%) case studies, and 4 (3.6%) observational studies. Less than one-third of the studies (32.0%, 35/111) investigated effectiveness, engagement, and acceptability together. To measure physical activity, most studies (90.1%, 101/111) employed sensors (either in-device [67.6%, 75/111] or external [23.4%, 26/111]). RCTs were more likely to employ external sensors (accelerometers: P=.005). Studies that assessed engagement (52.3%, 58/111) mostly used device-generated logs (91%, 53/58) to measure the frequency, depth, and length of engagement. Studies that assessed acceptability (57.7%, 64/111) most often used questionnaires (64%, 42/64) and/or qualitative methods (53%, 34/64) to explore appreciation, perceived effectiveness and usefulness, satisfaction, intention to continue use, and social acceptability. Some studies (14.4%, 16/111) assessed dimensions more closely related to usability (ie, burden of sensor wear and use, interface complexity, and perceived technical performance). Conclusions: The rapid increase of research into the impact of physical activity apps and wearables means that evaluation guidelines are urgently needed to promote efficiency through the use of rapid research designs, in-device sensors and user-logs to assess effectiveness, engagement, and acceptability. Screening articles was time-consuming because reporting across health and computing sciences lacked standardization. Reporting guidelines are therefore needed to facilitate the synthesis of evidence across disciplines

A systematic review of digital interventions for improving the diet and physical activity behaviors of adolescents

Many adolescents have poor diet and physical activity behaviors, which can lead to the development of noncommunicable diseases in later life. Digital platforms offer inexpensive means of delivering health interventions, but little is known about their effectiveness. This systematic review was conducted to synthesize evidence on the effectiveness of digital interventions to improve diet quality and increase physical activity in adolescents, to effective intervention components and to assess the cost-effectiveness of these interventions. Following a systematic search, abstracts were assessed against inclusion criteria, and data extraction and quality assessment were performed for included studies. Data were analyzed to identify key features that are associated with significant improvement in behavior. A total of 27 studies met inclusion criteria. Most (n = 15) were Web site interventions. Other delivery methods were text messages, games, multicomponent interventions, emails, and social media. Significant behavior change was often seen when interventions included education, goal setting, self-monitoring, and parental involvement. None of the publications reported cost-effectiveness. Due to heterogeneity of studies, meta-analysis was not feasible.It is possible to effect significant health behavior change in adolescents through digital interventions that incorporate education, goal setting, self-monitoring, and parental involvement. Most of the evidence relates to Web sites and further research into alternate media is needed, and longer term outcomes should be evaluated. There is a paucity of data on the cost-effectiveness of digital health interventions, and future trials should report these data

Development of a Coding Instrument to Assess the Quality and Content of Anti-Tobacco Video Games

Previous research has shown the use of electronic video games as an effective method for increasing content knowledge about the risks of drugs and alcohol use for adolescents. Although best practice suggests that theory, health communication strategies, and game appeal are important characteristics for developing games, no instruments are currently available to examine the quality and content of tobacco prevention and cessation electronic games. This study presents the systematic development of a coding instrument to measure the quality, use of theory, and health communication strategies of tobacco cessation and prevention electronic games. Using previous research and expert review, a content analysis coding instrument measuring 67 characteristics was developed with three overarching categories: type and quality of games, theory and approach, and type and format of messages. Two trained coders applied the instrument to 88 games on four platforms (personal computer, Nintendo DS, iPhone, and Android phone) to field test the instrument. Cohen's kappa for each item ranged from 0.66 to 1.00, with an average kappa value of 0.97. Future research can adapt this coding instrument to games addressing other health issues. In addition, the instrument questions can serve as a useful guide for evidence-based game development.Food and Drug Administration (FDA) Center for Tobacco ProductsNational Cancer Institute (NCI) Office of Communication and EducationCommunication Studie

Exploring Challenges in Conducting E-Mental Health Research Among Asian American Women

In this discussion paper, we explore the challenges of conducting e-mental health intervention research among Asian American women and propose a model for addressing these barriers. Based on an extensive literature review, we identify two main types of barriers to conducting e-mental health intervention research among Asian American women: recruitment barriers and adherence barriers. Recruitment barriers are further subcategorized into those related to (1) stigmatized cultural beliefs about mental illness and mental health services; (2) lack of awareness about mental health services; and (3) language barrier. As to adherence barriers, the two identified subtypes concern (1) acuity and severity of mental health condition; and (2) lack of time. In order to enhance recruitment and adherence in e-mental health intervention research among the studied population, we formulate the following three main research strategies, namely: (1) considering the cultural and social contexts of Asian American women in the development of e-mental health interventions; (2) determining appropriate program length; and (3) conducting feasibility studies to test e-mental health interventions. We suggest that nurse researchers integrate our proposed model in conducting e-mental health interventions among Asian American women. Our proposed model also implies that nurses play an important role in encouraging Asian American women’s acceptance of and adherence to e-mental health interventions. In order to overcome the obstacles to conducting e-mental health research among Asian American women, we recommend that nurses familiarize themselves with credible, relevant, and evidence-based e-mental health resources and integrate online mental health services and information within their nursing practice

Mobile Phone Apps for Quality of Life and Well-Being Assessment in Breast and Prostate Cancer Patients: Systematic Review

Background: Mobile phone health apps are increasingly gaining attention in oncological care as potential tools for supporting cancer patients. Although the number of publications and health apps focusing on cancer is increasing, there are still few specifically designed for the most prevalent cancers diagnosed: breast and prostate cancers. There is a need to review the effect of these apps on breast and prostate cancer patients’ quality of life (QoL) and well-being. Objective: The purposes of this study were to review the scientific literature on mobile phone apps targeting breast or prostate cancer patients and involving QoL and well-being (anxiety and depression symptoms) and analyze the clinical and technological characteristics, strengths, and weaknesses of these apps, as well as patients’ user experience with them. Methods: We conducted a systematic review of peer-reviewed literature from The Cochrane Library, Excerpta Medica Database, PsycINFO, PubMed, Scopus, and MEDLINE to identify studies involving apps focused on breast and/or prostate cancer patients and QoL and/or well-being published between January 1, 2000, and July 12, 2017. Only trial studies which met the inclusion criteria were selected. The systematic review was completed with a critical analysis of the apps previously identified in the health literature research that were available from the official app stores. Results: The systematic review of the literature yielded 3862 articles. After removal of duplicates, 3229 remained and were evaluated on the basis of title and abstract. Of these, 3211 were discarded as not meeting the inclusion criteria, and 18 records were selected for full text screening. Finally, 5 citations were included in this review, with a total of 644 patients, mean age 52.16 years. Four studies targeted breast cancer patients and 1 focused on prostate cancer patients. Four studies referred to apps that assessed QoL. Only 1 among the 5 analyzed apps was available from the official app store. In 3 studies, an app-related intervention was carried out, and 2 of them reported an improvement on QoL. The lengths of the app-related interventions varied from 4 to 12 weeks. Because 2 of the studies only tracked use of the app, no effect on QoL or well-being was found. Conclusions: Despite the existence of hundreds of studies involving cancer-focused mobile phone apps, there is a lack of rigorous trials regarding the QoL and/or well-being assessment in breast and/or prostate cancer patients. A strong and collective effort should be made by all health care providers to determine those cancer-focused apps that effectively represent useful, accurate, and reliable tools for cancer patients’ disease management.European Union's Horizon 2020 No 72201

Efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour : a systematic review

Background: Health and fitness applications (apps) have gained popularity in interventions to improve diet, physical activity and sedentary behaviours but their efficacy is unclear. This systematic review examined the efficacy of interventions that use apps to improve diet, physical activity and sedentary behaviour in children and adults. Methods: Systematic literature searches were conducted in five databases to identify papers published between 2006 and 2016. Studies were included if they used a smartphone app in an intervention to improve diet, physical activity and/or sedentary behaviour for prevention. Interventions could be stand-alone interventions using an app only, or multi-component interventions including an app as one of several intervention components. Outcomes measured were changes in the health behaviours and related health outcomes (i.e., fitness, body weight, blood pressure, glucose, cholesterol, quality of life). Study inclusion and methodological quality were independently assessed by two reviewers. Results: Twenty-seven studies were included, most were randomised controlled trials (n = 19; 70%). Twenty-three studies targeted adults (17 showed significant health improvements) and four studies targeted children (two demonstrated significant health improvements). Twenty-one studies targeted physical activity (14 showed significant health improvements), 13 studies targeted diet (seven showed significant health improvements) and five studies targeted sedentary behaviour (two showed significant health improvements). More studies (n = 12; 63%) of those reporting significant effects detected between-group improvements in the health behaviour or related health outcomes, whilst fewer studies (n = 8; 42%) reported significant within-group improvements. A larger proportion of multi-component interventions (8 out of 13; 62%) showed significant between-group improvements compared to stand-alone app interventions (5 out of 14; 36%). Eleven studies reported app usage statistics, and three of them demonstrated that higher app usage was associated with improved health outcomes. Conclusions: This review provided modest evidence that app-based interventions to improve diet, physical activity and sedentary behaviours can be effective. Multi-component interventions appear to be more effective than standalone app interventions, however, this remains to be confirmed in controlled trials. Future research is needed on the optimal number and combination of app features, behaviour change techniques, and level of participant contact needed to maximise user engagement and intervention efficacy

Identification of behaviour change techniques and engagement strategies to design a smartphone app to reduce alcohol consumption using a formal consensus method

Background: Digital interventions to reduce excessive alcohol consumption have the potential to have a broader reach and be more cost-effective than traditional brief interventions. However, there is not yet a strong evidence base on their ability to engage users or on their effectiveness. Objective: This study aimed to identify the behaviour change techniques (BCTs) and engagement strategies most worthy of further study by inclusion in a smartphone application (app) to reduce alcohol consumption, using formal expert consensus methods. Methods: The first phase of the study consisted of a Delphi exercise with three rounds. It was conducted with seven international experts in the field of alcohol and/or behaviour change. In the first round, experts identified BCTs most likely to be effective at reducing alcohol consumption and strategies most likely to engage users with an app; these were rated in the second round; and those rated as effective by at least four out of seven participants were ranked in the third round. The rankings were analysed using Kendall’s W coefficient of concordance, which indicates consensus between participants. The second phase consisted of a new, independent group of experts (n=43) ranking the BCTs that were identified in the first phase. The correlation between the rankings of the two groups was assessed using Spearman’s rank correlation coefficient. Results: Twelve BCTs were identified as likely to be effective. There was moderate agreement among the experts over their ranking (W=.465, χ2(11)=35.77, P<.001) and the BCTs receiving the highest mean rankings were self-monitoring, goal-setting, action planning, and feedback in relation to goals. There was a significant correlation between the ranking of the BCTs by the group of experts who identified them and a second independent group of experts (Spearman’s rho=.690, P=.01). Seventeen responses were generated for strategies likely to engage users. There was moderate agreement among experts on the ranking of these engagement strategies (W=.563, χ2(15)=59.16, P<.001) and those with the highest mean rankings were ease of use, design – aesthetic, feedback, function, design – ability to change design to suit own preferences, tailored information, and unique smartphone features. Conclusions: The BCTs with greatest potential to include in a smartphone app to reduce alcohol consumption were judged by experts to be self-monitoring, goal-setting, action planning, and feedback in relation to goals. The strategies most likely to engage users were ease of use, design, tailoring of design and information, and unique smartphone features

Cognitive and affective perspectives on immersive technology in education

This research explains the rationale behind the utilization of mobile learning technologies. It involves a qualitative study among children to better understand their opinions and perceptions toward the use of educational applications (apps) that are available on their mobile devices, including smartphones and tablets. The researchers organized semi-structured, face-to-face interview sessions with primary school students who were using mobile technologies at their primary school. The students reported that their engagement with the educational apps has improved their competencies. They acquired relational and communicative skills as they collaborated in teams. On the other hand, there were a few students who were not perceiving the usefulness and the ease of use of the educational apps on their mobile device. This study indicates that the research participants had different skillsets as they exhibited different learning abilities. In conclusion, this contribution opens-up avenues for future research in this promising field of study.peer-reviewe