Best practice in undertaking and reporting health technology assessments : Working Group 4 report

[Executive Summary] The aim of Working Group 4 has been to develop and disseminate best practice in undertaking and reporting assessments, and to identify needs for methodologic development. Health technology assessment (HTA) is a multidisciplinary activity that systematically examines the technical performance, safety, clinical efficacy, and effectiveness, cost, costeffectiveness, organizational implications, social consequences, legal, and ethical considerations of the application of a health technology (18). HTA activity has been continuously increasing over the last few years. Numerous HTA agencies and other institutions (termed in this report “HTA doers”) across Europe are producing an important and growing amount of HTA information. The objectives of HTA vary considerably between HTA agencies and other actors, from a strictly political decision making–oriented approach regarding advice on market licensure, coverage in benefits catalogue, or investment planning to information directed to providers or to the public. Although there seems to be broad agreement on the general elements that belong to the HTA process, and although HTA doers in Europe use similar principles (41), this is often difficult to see because of differences in language and terminology. In addition, the reporting of the findings from the assessments differs considerably. This reduces comparability and makes it difficult for those undertaking HTA assessments to integrate previous findings from other HTA doers in a subsequent evaluation of the same technology. Transparent and clear reporting is an important step toward disseminating the findings of a HTA; thus, standards that ensure high quality reporting may contribute to a wider dissemination of results. The EUR-ASSESS methodologic subgroup already proposed a framework for conducting and reporting HTA (18), which served as the basis for the current working group. New developments in the last 5 years necessitate revisiting that framework and providing a solid structure for future updates. Giving due attention to these methodologic developments, this report describes the current “best practice” in both undertaking and reporting HTA and identifies the needs for methodologic development. It concludes with specific recommendations and tools for implementing them, e.g., by providing the structure for English-language scientific summary reports and a checklist to assess the methodologic and reporting quality of HTA reports

Family Preservation Research: Where We\u27ve Been, Where We Should Be Going

Although the literature has provided many critiques of research done on family preservation programs, these critiques have usually been limited to the studies \u27 assumptions, approach, or methodology. Because of the nature of these critiques, suggestions for future research in this field of practice have been scattered throughout the literature and have not benefitted from a wider historical perspective. This paper examines the historical evolution of family preservation studies in child welfare and suggests future directions for research in the field. Among the suggestions the authors posit are (1) research questions should be framed by what we know about improvements in the lives of families and children served by family preservation programs; (2) future explorations should include areas that have received relatively little attention in current research, including the impact of organizational conditions on service fidelity and worker performance; (3) newer treatment models, particularly those that provide both intensive services during a crisis period and less intensive services for maintenance, should be tested; (4) data collection points in longitudinal studies should be guided by theory, and measures should change over time to reflect the theoretically expected changes in families; (5) complex measures of placement prevention and other measures that capture changes in family functioning, child well-being, and child safety, should be utilized to obtain a full picture of program effects; and (6) multiple informants should be used to provide data about program effectiveness. In addition, the authors will argue that the field should carefully consider the amount of change that should be expected from the service models delivered

Measuring the Impact of Youth Voluntary Service Programs

Summary and Conclusions of a meeting of international experts hosted by the World Bank and Innovations in Civic Participation to discuss evaluation of the impact of youth civic engagement on development

Factors associated with the decision to investigate child protective services referrals: a systematic review

Background: Limited resources for child protection create challenging decision situations for child protective services (CPS) workers at the point of intake. A body of research has examined the factors associated with worker decisions and processes using a variety of methodological approaches to gain knowledge on decision-making. However, few attempts have been made to systematically review this literature. Objective: As part of a larger project on decision-making at intake, this systematic review addressed the question of the factors associated with worker decisions to investigate alleged maltreatment referrals. Methods: Quantitative studies that examined factors associated with screening decisions in CPS practice settings were included in the review. Database and other search methods were used to identify research published in English over a 35-year period (1980-2015). Findings: Of 1,147 identified sources, 18 studies were selected for full data extraction. The studies were conducted in the U.S., Canada, and Sweden and varied in methodological quality. Most studies examined case factors with few studies examining other domains. Conclusions: To inform CPS policy and practice, additional research is needed to examine the relationships between decision-making factors and case outcomes. Greater attention needs to be given to the organizational and external factors that influence decision-making

Integrating case study and survey research methods: An example in information systems

The case for combining research methods generally, and more specifically that for combining qualitative and quantitative methods, is strong. Yet, research designs that extensively integrate both fieldwork (e.g. case studies) and survey research are rare. More¬over, some journals tend tacitly to specialize by methodology thereby encouraging purity of method. The multi-method model of research while not new, has not been appreciated. In this respect it is useful to articulate and describe its usage through example. By reference to a recently completed study of IS consultant engagement success factors this paper presents an analysis of the benefits of integrating case study and survey research methods. The emphasis is on the qualitative case study method and how it can compliment more quantitative survey research. Benefits are demonstrated through specific examples from the reference study.</i

Feasibility study on utilization of palm fibre waste into fired clay brick

Malaysia is the second largest of palm oil producer after Indonesia, which contribute to 50 % of palm oil production. With this demand, the increasing of palm oil plantation over the years has led to the large production of agricultural waste, for example palm fibre waste. This study investigates different percentages of palm fibre (0 %, 1 %, 5 % and 10 %) to be incorporated into fired clay brick. Manufactured bricks were fired at 1 °C/min heating rate up to 1050 °C. The effects of manufacture bricks on the physical and mechanical properties of manufactured brick were also determined. All brick samples were tested due to the physical and mechanical properties which include dry density, firing shrinkage, initial rate of suction (IRS), water absorption, porosity and compressive strength. Findings show that increasing palm fibre waste affected the properties of brick, which decreased their density, besides increased firing shrinkage, IRS, water absorption, porosity and compressive strength. However, all the manufactured brick still followed the requirement

Tensions and paradoxes in electronic patient record research: a systematic literature review using the meta-narrative method

Background: The extensive and rapidly expanding research literature on electronic patient records (EPRs) presents challenges to systematic reviewers. This literature is heterogeneous and at times conflicting, not least because it covers multiple research traditions with different underlying philosophical assumptions and methodological approaches. Aim: To map, interpret and critique the range of concepts, theories, methods and empirical findings on EPRs, with a particular emphasis on the implementation and use of EPR systems. Method: Using the meta-narrative method of systematic review, and applying search strategies that took us beyond the Medline-indexed literature, we identified over 500 full-text sources. We used ‘conflicting’ findings to address higher-order questions about how the EPR and its implementation were differently conceptualised and studied by different communities of researchers. Main findings: Our final synthesis included 24 previous systematic reviews and 94 additional primary studies, most of the latter from outside the biomedical literature. A number of tensions were evident, particularly in relation to: [1] the EPR (‘container’ or ‘itinerary’); [2] the EPR user (‘information-processer’ or ‘member of socio-technical network’); [3] organizational context (‘the setting within which the EPR is implemented’ or ‘the EPR-in-use’); [4] clinical work (‘decision-making’ or ‘situated practice’); [5] the process of change (‘the logic of determinism’ or ‘the logic of opposition’); [6] implementation success (‘objectively defined’ or ‘socially negotiated’); and [7] complexity and scale (‘the bigger the better’ or ‘small is beautiful’). Findings suggest that integration of EPRs will always require human work to re-contextualize knowledge for different uses; that whilst secondary work (audit, research, billing) may be made more efficient by the EPR, primary clinical work may be made less efficient; that paper, far from being technologically obsolete, currently offers greater ecological flexibility than most forms of electronic record; and that smaller systems may sometimes be more efficient and effective than larger ones. Conclusions: The tensions and paradoxes revealed in this study extend and challenge previous reviews and suggest that the evidence base for some EPR programs is more limited than is often assumed. We offer this paper as a preliminary contribution to a much-needed debate on this evidence and its implications, and suggest avenues for new research

Evaluating Workforce Programs: A Guide to What Policymakers Need to Know to Structure Effective, User-Friendly Evaluations

This brief discusses the value and purpose of program evaluations, highlights different evaluation tools and techniques, and illustrates how policy makers and program managers can structure and implement evaluations of workforce development programs