A Framework for Guiding and Evaluating Literature Reviews

Given that the synthesis of cumulated knowledge is an essential condition for any field to grow and develop, we believe that the enhanced role of IS reviews requires that this expository form be given careful scrutiny. Over the past decade, several senior scholars have made calls for more review papers in our field. While the number of IS review papers has substantially increased in recent years, no prior research has attempted to develop a general framework to conduct and evaluate the rigor of standalone reviews. In this paper, we fill this gap. More precisely, we present a set of guidelines for guiding and evaluating IS literature reviews and specify to which review types they apply. To do so, we first distinguish between four broad categories of review papers and then propose a set of guidelines that are grouped according to the generic phases and steps of the review process. We hope our work will serve as a valuable source for those conducting, evaluating, and/or interpreting reviews in our field

Designing, Developing, Evaluating, and Implementing a Smartphone-Delivered, Rule-Based Conversational Agent (DISCOVER): Development of a Conceptual Framework

Background: Conversational agents (CAs), also known as chatbots, are computer programs that simulate human conversations by using predetermined rule-based responses or artificial intelligence algorithms. They are increasingly used in health care, particularly via smartphones. There is, at present, no conceptual framework guiding the development of smartphone-based, rule-based CAs in health care. To fill this gap, we propose structured and tailored guidance for their design, development, evaluation, and implementation. Objective: The aim of this study was to develop a conceptual framework for the design, evaluation, and implementation of smartphone-delivered, rule-based, goal-oriented, and text-based CAs for health care. Methods: We followed the approach by Jabareen, which was based on the grounded theory method, to develop this conceptual framework. We performed 2 literature reviews focusing on health care CAs and conceptual frameworks for the development of mobile health interventions. We identified, named, categorized, integrated, and synthesized the information retrieved from the literature reviews to develop the conceptual framework. We then applied this framework by developing a CA and testing it in a feasibility study. Results: The Designing, Developing, Evaluating, and Implementing a Smartphone-Delivered, Rule-Based Conversational Agent (DISCOVER) conceptual framework includes 8 iterative steps grouped into 3 stages, as follows: design, comprising defining the goal, creating an identity, assembling the team, and selecting the delivery interface; development, including developing the content and building the conversation flow; and the evaluation and implementation of the CA. They were complemented by 2 cross-cutting considerations-user-centered design and privacy and security-that were relevant at all stages. This conceptual framework was successfully applied in the development of a CA to support lifestyle changes and prevent type 2 diabetes. Conclusions: Drawing on published evidence, the DISCOVER conceptual framework provides a step-by-step guide for developing rule-based, smartphone-delivered CAs. Further evaluation of this framework in diverse health care areas and settings and for a variety of users is needed to demonstrate its validity. Future research should aim to explore the use of CAs to deliver health care interventions, including behavior change and potential privacy and safety concerns. Keywords: chatbot; conceptual framework; conversational agent; digital health; mHealth; mobile health; mobile phone

NorthStar, a support tool for the design and evaluation of quality improvement interventions in healthcare

Background: The Research-Based Education and Quality Improvement (ReBEQI) European partnership aims to establish a framework and provide practical tools for the selection, implementation, and evaluation of quality improvement (QI) interventions. We describe the development and preliminary evaluation of the software tool NorthStar, a major product of the ReBEQI project. Methods: We focused the content of NorthStar on the design and evaluation of QI interventions. A lead individual from the ReBEQI group drafted each section, and at least two other group members reviewed it. The content is based on published literature, as well as material developed by the ReBEQI group. We developed the software in both a Microsoft Windows HTML help system version and a web-based version. In a preliminary evaluation, we surveyed 33 potential users about the acceptability and perceived utility of NorthStar. Results: NorthStar consists of 18 sections covering the design and evaluation of QI interventions. The major focus of the intervention design sections is on how to identify determinants of practice (factors affecting practice patterns), while the major focus of the intervention evaluation sections is on how to design a cluster randomised trial. The two versions of the software can be transferred by email or CD, and are available for download from the internet. The software offers easy navigation and various functions to access the content. Potential users (55% response rate) reported above-moderate levels of confidence in carrying out QI research related tasks if using NorthStar, particularly when developing a protocol for a cluster randomised trial Conclusion: NorthStar is an integrated, accessible, practical, and acceptable tool to assist developers and evaluators of QI interventions

Evidence-Based Health Care for Children: What Are We Missing?

Proposes a new framework for evaluating evidence in health care that takes into account interventions in child health promotion, which aim to change children's physical, social, or emotional environment and may take longer for the effects to show

Evaluating Development Co-operation: Summary of Key Norms and Standards

This is a best practice that offers guidance in developing norms and standards for evaluation in an effort to improve humanitarian aid programs and policy. The approach offers a core set of principles, along with five evaluation criteria: relevance, effectiveness, efficiency, impact, sustainability, and a framework for peer reviews and assessment

Developing a digital intervention for cancer survivors: an evidence-, theory- and person-based approach

This paper illustrates a rigorous approach to developing digital interventions using an evidence-, theory- and person-based approach. Intervention planning included a rapid scoping review which identified cancer survivors’ needs, including barriers and facilitators to intervention success. Review evidence (N=49 papers) informed the intervention’s Guiding Principles, theory-based behavioural analysis and logic model. The intervention was optimised based on feedback on a prototype intervention through interviews (N=96) with cancer survivors and focus groups with NHS staff and cancer charity workers (N=31). Interviews with cancer survivors highlighted barriers to engagement, such as concerns about physical activity worsening fatigue. Focus groups highlighted concerns about support appointment length and how to support distressed participants. Feedback informed intervention modifications, to maximise acceptability, feasibility and likelihood of behaviour change. Our systematic method for understanding user views enabled us to anticipate and address important barriers to engagement. This methodology may be useful to others developing digital interventions

How does the composition of public spending matter?

Public spending has effects which are complex to trace and difficult to quantify. But the composition of public expenditure has become the key instrument by which development agencies seek to promote economic development. In recent years, the development assistance to heavily indebted poor countries (HIPCs) hasbeen made conditional on increased expenditure on categories that are thought to be"pro-poor". This paper responds to the growing concern being expressed about the conceptual foundations and the empirical basis for the belief that poverty can be reduced through targeted public spending. While it is widely accepted that growth and redistribution are important sources of reduction in absolute poverty, a review of the literature confirms the lack of an appropriate theoretical framework for assessing the impact of public spending on growth as well as poverty. There is a need to combine principles of both public economics and growth theory to develop appropriate theoretical guidance for public expenditure policy. This paper identifies a number of approaches that are beginning to address this gap. Building on these approaches, it proposes a framework that has its foundation in a broadly articulated development strategy and its economic goals such as growth, equity, and poverty reduction. It recommends the use of public economics principles to clarify the roles of the private and public sectors and to recognize the complementarity of spending, taxation, and regulatory instruments available to affect public policy. With regard to the impact of any given type of public spending, policy recommendations must be tailored to countries and be based on empirical analysis that takes account of the lags and leads in their effects on equity and growth and ultimately on poverty. The paper sketches out such a framework as the first step in what will have to be a longer-term research agenda to provide theoretically and empirically robust and verifiable guidance to public spending policy.Poverty Assessment,Achieving Shared Growth,Environmental Economics&Policies,Health Economics&Finance,Governance Indicators