Best practice in undertaking and reporting health technology assessments : Working Group 4 report

[Executive Summary] The aim of Working Group 4 has been to develop and disseminate best practice in undertaking and reporting assessments, and to identify needs for methodologic development. Health technology assessment (HTA) is a multidisciplinary activity that systematically examines the technical performance, safety, clinical efficacy, and effectiveness, cost, costeffectiveness, organizational implications, social consequences, legal, and ethical considerations of the application of a health technology (18). HTA activity has been continuously increasing over the last few years. Numerous HTA agencies and other institutions (termed in this report “HTA doers”) across Europe are producing an important and growing amount of HTA information. The objectives of HTA vary considerably between HTA agencies and other actors, from a strictly political decision making–oriented approach regarding advice on market licensure, coverage in benefits catalogue, or investment planning to information directed to providers or to the public. Although there seems to be broad agreement on the general elements that belong to the HTA process, and although HTA doers in Europe use similar principles (41), this is often difficult to see because of differences in language and terminology. In addition, the reporting of the findings from the assessments differs considerably. This reduces comparability and makes it difficult for those undertaking HTA assessments to integrate previous findings from other HTA doers in a subsequent evaluation of the same technology. Transparent and clear reporting is an important step toward disseminating the findings of a HTA; thus, standards that ensure high quality reporting may contribute to a wider dissemination of results. The EUR-ASSESS methodologic subgroup already proposed a framework for conducting and reporting HTA (18), which served as the basis for the current working group. New developments in the last 5 years necessitate revisiting that framework and providing a solid structure for future updates. Giving due attention to these methodologic developments, this report describes the current “best practice” in both undertaking and reporting HTA and identifies the needs for methodologic development. It concludes with specific recommendations and tools for implementing them, e.g., by providing the structure for English-language scientific summary reports and a checklist to assess the methodologic and reporting quality of HTA reports

Influences on the Uptake of and Engagement With Health and Well-Being Smartphone Apps: Systematic Review

Background: The public health impact of health and well-being digital interventions is dependent upon sufficient real-world uptake and engagement. Uptake is currently largely dependent on popularity indicators (eg, ranking and user ratings on app stores), which may not correspond with effectiveness, and rapid disengagement is common. Therefore, there is an urgent need to identify factors that influence uptake and engagement with health and well-being apps to inform new approaches that promote the effective use of such tools. Objective: This review aimed to understand what is known about influences on the uptake of and engagement with health and well-being smartphone apps among adults. Methods: We conducted a systematic review of quantitative, qualitative, and mixed methods studies. Studies conducted on adults were included if they focused on health and well-being smartphone apps reporting on uptake and engagement behavior. Studies identified through a systematic search in Medical Literature Analysis and Retrieval System Online, or MEDLARS Online (MEDLINE), EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsychINFO, Scopus, Cochrane library databases, DataBase systems and Logic Programming (DBLP), and Association for Computing Machinery (ACM) Digital library were screened, with a proportion screened independently by 2 authors. Data synthesis and interpretation were undertaken using a deductive iterative process. External validity checking was undertaken by an independent researcher. A narrative synthesis of the findings was structured around the components of the capability, opportunity, motivation, behavior change model and the theoretical domains framework (TDF). Results: Of the 7640 identified studies, 41 were included in the review. Factors related to uptake (U), engagement (E), or both (B) were identified. Under capability, the main factors identified were app literacy skills (B), app awareness (U), available user guidance (B), health information (E), statistical information on progress (E), well-designed reminders (E), features to reduce cognitive load (E), and self-monitoring features (E). Availability at low cost (U), positive tone, and personalization (E) were identified as physical opportunity factors, whereas recommendations for health and well-being apps (U), embedded health professional support (E), and social networking (E) possibilities were social opportunity factors. Finally, the motivation factors included positive feedback (E), available rewards (E), goal setting (E), and the perceived utility of the app (E). Conclusions: Across a wide range of populations and behaviors, 26 factors relating to capability, opportunity, and motivation appear to influence the uptake of and engagement with health and well-being smartphone apps. Our recommendations may help app developers, health app portal developers, and policy makers in the optimization of health and well-being apps

Using Meta-Ethnography to Synthesize Relevant Studies: Capturing the Bigger Picture in Dementia with Challenging Behavior within Families

In understanding the range and depth of people’s experiences, it is important to include the wide range of approaches which capture the richness within a given knowledge base. However, systematic reviews using quantitative data alone risk missing findings that can contribute to a better understanding of a research question. In response, meta-ethnography has emerged as a potentially useful method to synthesize and integrate both qualitative and quantitative data from different perspectives using qualitative methodology. In this case study, we describe how we have used meta-ethnography to better understand how families experience dementia. We address a particular issue of selecting the highest quality evidence across a range of epistemologies

Qualitative software engineering research -- reflections and guidelines

Researchers are increasingly recognizing the importance of human aspects in software development and since qualitative methods are used to, in-depth, explore human behavior, we believe that studies using such techniques will become more common. Existing qualitative software engineering guidelines do not cover the full breadth of qualitative methods and knowledge on using them found in the social sciences. The aim of this study was thus to extend the software engineering research community's current body of knowledge regarding available qualitative methods and provide recommendations and guidelines for their use. With the support of an epistemological argument and a literature review, we suggest that future research would benefit from (1) utilizing a broader set of research methods, (2) more strongly emphasizing reflexivity, and (3) employing qualitative guidelines and quality criteria. We present an overview of three qualitative methods commonly used in social sciences but rarely seen in software engineering research, namely interpretative phenomenological analysis, narrative analysis, and discourse analysis. Furthermore, we discuss the meaning of reflexivity in relation to the software engineering context and suggest means of fostering it. Our paper will help software engineering researchers better select and then guide the application of a broader set of qualitative research methods.Comment: 30 page

Developing standards for reporting implementation studies of complex interventions (StaRI): a systematic review and e-Delphi

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited