Interorganizational Policy Studies: Lessons Drawn from Implementation Research

Contingency approaches to organizing suggest that policy objectives are more likely to be achieved if the structures employed for implementation mesh with the policy objectives being sought. Interorganizational arrangements are used increasingly in carrying out public programs, and contingency logic can be used to assess the degree of match between policy objective and interunit structure. Such a perspective would seem to offer an approach of practical significance. Here the contingency logic as applied to interorganizational implementation is reviewed and its assumptions identified. To probe these assumptions, empirical evidence is analyzed from one policy sector which would seem especially promising. The findings suggest that even under highly favorable conditions, a contingency perspective provides only limited help. The research demonstrates the need for additional conceptual clarification and theoretical care in reaching conclusions about the impact of interorganizational structures on policy settings

An implementation research on software defect prediction using machine learning techniques

Software defect prediction is the process of improving software testing process by identifying defects in the software. It is accomplished by using supervised machine learning with software metrics and defect data as variables. While the theory behind software defect prediction has been validated in previous studies, it has not widely been implemented into practice. In this thesis, a software defect prediction framework is implemented for improving testing process resource allocation and software release time optimization at RELEX Solutions. For this purpose, code and change metrics are collected from RELEX software. The used metrics are selected with the criteria of their frequency of usage in other software defect prediction studies, and availability of the metric in metric collection tools. In addition to metric data, defect data is collected from issue tracker. Then, a framework for classifying the collected data is implemented and experimented on. The framework leverages existing machine learning algorithm libraries to provide classification functionality, using classifiers which are found to perform well in similar software defect prediction experiments. The results from classification are validated utilizing commonly used classifier performance metrics, in addition to which the suitability of the predictions is verified from a use case point of view. It is found that software defect prediction does work in practice, with the implementation achieving comparable results to other similar studies when measuring by classifier performance metrics. When validating against the defined use cases, the performance is found acceptable, however the performance varies between different data sets. It is thus concluded that while results are tentatively positive, further monitoring with future software versions is needed to verify performance and reliability of the framework

Building capacity for dissemination and implementation research: One university’s experience

Abstract Background While dissemination and implementation (D&I) science has grown rapidly, there is an ongoing need to understand how to build and sustain capacity in individuals and institutions conducting research. There are three inter-related domains for capacity building: people, settings, and activities. Since 2008, Washington University in St. Louis has dedicated significant attention and resources toward building D&I research capacity. This paper describes our process, challenges, and lessons with the goal of informing others who may have similar aims at their own institution. Activities An informal collaborative, the Washington University Network for Dissemination and Implementation Research (WUNDIR), began with a small group and now has 49 regular members. Attendees represent a wide variety of settings and content areas and meet every 6 weeks for half-day sessions. A logic model organizes WUNDIR inputs, activities, and outcomes. A mixed-methods evaluation showed that the network has led to new professional connections and enhanced skills (e.g., grant and publication development). As one of four, ongoing, formal programs, the Dissemination and Implementation Research Core (DIRC) was our first major component of D&I infrastructure. DIRC’s mission is to accelerate the public health impact of clinical and health services research by increasing the engagement of investigators in later stages of translational research. The aims of DIRC are to advance D&I science and to develop and equip researchers with tools for D&I research. As a second formal component, the Washington University Institute for Public Health has provided significant support for D&I research through pilot projects and a small grants program. In a third set of formal programs, two R25 training grants (one in mental health and one in cancer) support post-doctoral scholars for intensive training and mentoring in D&I science. Finally, our team coordinates closely with D&I functions within research centers across the university. We share a series of challenges and potential solutions. Conclusion Our experience in developing D&I research at Washington University in St. Louis shows how significant capacity can be built in a relatively short period of time. Many of our ideas and ingredients for success can be replicated, tailored, and improved upon by others

Efficacious, effective, and embedded interventions: Implementation research in infectious disease control

Background: Research in infectious disease control is heavily skewed towards high end technology; development of new drugs, vaccines and clinical interventions. Oft ignored, is the evidence to inform the best strategies that ensure the embedding of interventions into health systems and amongst populations. In this paper we undertake an analysis of the challenge in the development of research for the sustainable implementation of disease control interventions. Results: We highlight the fundamental differences between the research paradigms associated with the development of technologies and interventions for disease control on the one hand and the research paradigms required for enhancing the sustainable uptake of those very same interventions within the communities on the other. We provide a definition for implementation research in an attempt to underscore its critical role and explore the multidisciplinary science needed to address the challenges in disease control. Conclusion: The greatest value for money in health research lies in the sustainable and effective implementation of already proven, efficacious solutions. The development of implementation research that can help provide some solutions on how this can be achieved is sorely needed

Connecting the Dots: Case Studies and EU Implementation Research

This paper is an accompanying text to the Compliance Database – the database of case studies of transposition, implementation, and compliance with EU law. (stract http://www.eif.oeaw.ac.at/compliance/). The database contains the results from the literature survey in a form that enables detailed overviews of individual studies as well as easy comparisons across studies. The database has been developed with the support of the Institute for European Integration Research at the Austrian Academy of Sciences and it is a free and regularly updated resource. The conclusions of this paper are based as much on the inferences that the database offers, as on the original articles and books that have been reviewed.implementation; political science

An implementation research agenda.

In October 2006, the Chief Medical Officer (CMO) of England asked Professor Sir John Tooke to chair a High Level Group on Clinical Effectiveness in response to the chapter 'Waste not, want not' in the CMOs 2005 annual report 'On the State of the Public Health'. The high level group made recommendations to the CMO to address possible ways forward to improve clinical effectiveness in the UK National Health Service (NHS) and promote clinical engagement to deliver this. The report contained a short section on research needs that emerged from the process of writing the report, but in order to more fully identify the relevant research agenda Professor Sir John Tooke asked Professor Martin Eccles to convene an expert group - the Clinical Effectiveness Research Agenda Group (CERAG) - to define the research agenda. The CERAG's terms of reference were 'to further elaborate the research agenda in relation to pursuing clinically effective practice within the (UK) National Health Service'. This editorial presents the summary of the CERAG report and recommendations

Ethical issues in implementation research: a discussion of the problems in achieving informed consent

Background: Improved quality of care is a policy objective of health care systems around the world. Implementation research is the scientific study of methods to promote the systematic uptake of clinical research findings into routine clinical practice, and hence to reduce inappropriate care. It includes the study of influences on healthcare professionals' behaviour and methods to enable them to use research findings more effectively. Cluster randomized trials represent the optimal design for evaluating the effectiveness of implementation strategies. Various codes of medical ethics, such as the Nuremberg Code and the Declaration of Helsinki inform medical research, but their relevance to cluster randomised trials in implementation research is unclear. This paper discusses the applicability of various ethical codes to obtaining consent in cluster trials in implementation research. Discussion: The appropriate application of biomedical codes to implementation research is not obvious. Discussion of the nature and practice of informed consent in implementation research cluster trials must consider the levels at which consent can be sought, and for what purpose it can be sought. The level at which an intervention is delivered can render the idea of patient level consent meaningless. Careful consideration of the ownership of information, and rights of access to and exploitation of data is required. For health care professionals and organizations, there is a balance between clinical freedom and responsibility to participate in research. Summary: While ethical justification for clinical trials relies heavily on individual consent, for implementation research aspects of distributive justice, economics, and political philosophy underlie the debate. Societies may need to trade off decisions on the choice between individualized consent and valid implementation research. We suggest that social sciences codes could usefully inform the consideration of implementation research by members of Research Ethics Committees

Implementation of Diversity Management Programs in Public Organizations: Lessons from Policy Implementation Research

The U.S. workforce is becoming more diverse, particularly in the public sector. As a result, a number of public-sector employers have initiated diversity management programs aimed to assist different types of employees in their needs at work. While much of the public administration literature has focused on these programs and what makes them work, it has largely ignored a cognate area of study that has much to say about the success of such programs: the policy implementation literature. This paper uses policy implementation research to develop five guidelines for public managers who wish to develop a successful diversity management initiative. Working Paper 06-1

Setting implementation research priorities to reduce preterm births and stillbirths at the community level.

Asha George and colleagues from the GAPPS group report the implementation research priorities to address prematurity and stillbirths at the community level that resulted from their recent expert consensus exercise