Applicability of the user engagement scale to mobile health : a survey-based quantitative study

Background: There has recently been exponential growth in the development and use of health apps on mobile phones. As with most mobile apps, however, the majority of users abandon them quickly and after minimal use. One of the most critical factors for the success of a health app is how to support users’ commitment to their health. Despite increased interest from researchers in mobile health, few studies have examined the measurement of user engagement with health apps. Objective: User engagement is a multidimensional, complex phenomenon. The aim of this study was to understand the concept of user engagement and, in particular, to demonstrate the applicability of a user engagement scale (UES) to mobile health apps. Methods: To determine the measurability of user engagement in a mobile health context, a UES was employed, which is a psychometric tool to measure user engagement with a digital system. This was adapted to Ada, developed by Ada Health, an artificial intelligence–powered personalized health guide that helps people understand their health. A principal component analysis (PCA) with varimax rotation was conducted on 30 items. In addition, sum scores as means of each subscale were calculated. Results: Survey data from 73 Ada users were analyzed. PCA was determined to be suitable, as verified by the sampling adequacy of Kaiser-Meyer-Olkin=0.858, a significant Bartlett test of sphericity (χ2300=1127.1; P<.001), and communalities mostly within the 0.7 range. Although 5 items had to be removed because of low factor loadings, the results of the remaining 25 items revealed 4 attributes: perceived usability, aesthetic appeal, reward, and focused attention. Ada users showed the highest engagement level with perceived usability, with a value of 294, followed by aesthetic appeal, reward, and focused attention. Conclusions: Although the UES was deployed in German and adapted to another digital domain, PCA yielded consistent subscales and a 4-factor structure. This indicates that user engagement with health apps can be assessed with the German version of the UES. These results can benefit related mobile health app engagement research and may be of importance to marketers and app developers

The elicitation of key performance indicators of e-government providers: A bottom-up approach

Copyright @ 2013 EMCIS.Delivering an adequate e-Government service (e-service) is becoming more of a necessity in today's digital world. In order to improve e-services and increase the engagement of both users' and providers' side, studies on the performance evaluation of such provided e-services are taking places. However a clear identification of the key performance indicators from the e-Government providers’ side is not well explored. This shortcoming hampers the conduct of a holistic evaluation of an e-service provision from the perspective of its stakeholders in order to improve e-services as well as to increase e-services take-ups. In this paper, a systematic process to identify indicators is implemented based on a bottom-up approach. The process used three focus-group meetings with providers, users, and academics in Qatar, Lebanon and UK to collect, identify and validate key indicators from the perspective of e-services’ providers. The approach resulted in the identification of five factors levels (service, technology, employees, policy and management and social responsibilities) with fifteen sub-categories of SMART variables. Hence, leading to the development of a new model, STEPS, that can fully explain and predict e-government success from the providers’ point of view. It will work as a strategic management tool to align various stakeholders on common goal and values based on evidence based evaluation of e-services using smart measurable indicators for the improvement of an e-service at the engagement level in the field of e-government. In addition, other fields can benefit from the outcome of this work, such as logistics service providers, who make their services available across new and existing relationships between the Internet commerce firms, their customers, and their vendors

Measuring Youth Program Quality: A Guide to Assessment Tools

Thanks to growing interest in the subject of youth program quality, many tools are now available to help organizations and systems assess and improve quality. Given the size and diversity of the youth-serving sector, it is unrealistic to expect that any one tool or process will fit all programs or circumstances. This report compares the purpose, history, structure, methodology, content and technical properties of nine different program observation tools

Fulfilling Lives: Supporting people with multiple needs, Evaluation Report, Year 1

This report is prepared for the Big Lottery Fund (the Fund) by the national evaluationteam and provides emerging findings and lessons learned from the first year of thenational evaluation of the Fulfilling Lives: Supporting people with multiple needsinitiative hereafter referred to as Fulfilling Lives (multiple needs).The national evaluation has been designed to determine the degree to which the initiativeis successfully achieving its aims and how they are being achieved. The evaluation will beboth formative and summative in nature, in that, it will inform the ongoing design and delivery of Fulfilling Lives (multiple needs) and its component projects as well as assessoverall achievements and value for money to inform future decision and policy making.Within this context, the evaluation has a number of objectives:— To track and assess the achievements of the initiative and to estimate the extent to whichthese are attributable to the projects and interventions delivered.— To calculate the costs of the projects and the corresponding value of benefits to theexchequer and wider society. This will enable an assessment of value for money of theprogramme and for individual interventions.— To identify what interventions and approaches work well, for which people, families andcommunities and in which circumstances and contexts.— To assess the extent to which the Big Lottery Fund's principles are incorporated into projectdesign and delivery and to determine the degree to which these principles affect successfuldelivery and outcomes.— To explore project implementation, understand problems faced and to facilitate theidentification of solutions and lessons learned

Improving the normalization of complex interventions: measure development based on normalization process theory (NoMAD): study protocol

&lt;b&gt;Background&lt;/b&gt; Understanding implementation processes is key to ensuring that complex interventions in healthcare are taken up in practice and thus maximize intended benefits for service provision and (ultimately) care to patients. Normalization Process Theory (NPT) provides a framework for understanding how a new intervention becomes part of normal practice. This study aims to develop and validate simple generic tools derived from NPT, to be used to improve the implementation of complex healthcare interventions.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Objectives&lt;/b&gt; The objectives of this study are to: develop a set of NPT-based measures and formatively evaluate their use for identifying implementation problems and monitoring progress; conduct preliminary evaluation of these measures across a range of interventions and contexts, and identify factors that affect this process; explore the utility of these measures for predicting outcomes; and develop an online users’ manual for the measures.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Methods&lt;/b&gt; A combination of qualitative (workshops, item development, user feedback, cognitive interviews) and quantitative (survey) methods will be used to develop NPT measures, and test the utility of the measures in six healthcare intervention settings.&lt;p&gt;&lt;/p&gt; &lt;b&gt;Discussion&lt;/b&gt; The measures developed in the study will be available for use by those involved in planning, implementing, and evaluating complex interventions in healthcare and have the potential to enhance the chances of their implementation, leading to sustained changes in working practices