Can programme theory be used as a 'translational tool’ to optimise health service delivery in a national early years’ initiative in Scotland: a case study

Background Theory-based evaluation (TBE) approaches are heralded as supporting formative evaluation by facilitating increased use of evaluative findings to guide programme improvement. It is essential that learning from programme implementation is better used to improve delivery and to inform other initiatives, if interventions are to be as effective as they have the potential to be. Nonetheless, few studies describe formative feedback methods, or report direct instrumental use of findings resulting from TBE. This paper uses the case of Scotland’s, National Health Service, early years’, oral health improvement initiative (Childsmile) to describe the use of TBE as a framework for providing feedback on delivery to programme staff and to assess its impact on programmatic action.<p></p> Methods In-depth, semi-structured interviews and focus groups with key stakeholders explored perceived deviations between the Childsmile programme 'as delivered’ and its Programme Theory (PT). The data was thematically analysed using constant comparative methods. Findings were shared with key programme stakeholders and discussions around likely impact and necessary actions were facilitated by the authors. Documentary review and ongoing observations of programme meetings were undertaken to assess the extent to which learning was acted upon.<p></p> Results On the whole, the activities documented in Childsmile’s PT were implemented as intended. This paper purposefully focuses on those activities where variation in delivery was evident. Differences resulted from the stage of roll-out reached and the flexibility given to individual NHS boards to tailor local implementation. Some adaptations were thought to have diverged from the central features of Childsmile’s PT, to the extent that there was a risk to achieving outcomes. The methods employed prompted national service improvement action, and proposals for local action by individual NHS boards to address this.<p></p> Conclusions The TBE approach provided a platform, to direct attention to areas of risk within a national health initiative, and to agree which intervention components were 'core’ to its hypothesised success. The study demonstrates that PT can be used as a 'translational tool’ to facilitate instrumental use of evaluative findings to optimise implementation within a complex health improvement programme.<p></p&gt

From External Evaluation, to School Self-evaluation, to Peer Review

Most modern systems of school education around the world now have highly developed evaluation processes. Following quickly in the wake of external evaluation policies have followed calls for schools to develop their own capacities for self-review. An OECD report (2013) describes a number of ways in which developing school evaluation capacity should be a priority for school improvement. Among the report’s suggestions are promoting peer learning among schools (pp. 469–470). This chapter describes the research on external evaluation, internal evaluation and the relationship between these two. It then moves on to define and describes peer review and chart its growth. The accountability dimension of peer review is also explored. Finally the existing evidence on peer review is presented from the vocational and schools sectors to show key findings so far, and key conditions for effective peer review are described

Evaluating a complex research capacity-building intervention: reflections on an evaluation of the African Institutions Initiative

Increasing policy demand for realist evaluations of research and capacity-building programmes reflects a recognition of the management, governance and impact gains that can result from evaluation. However, the evidence base on how to successfully implement realist evaluations of complex interventions in international development efforts is scarce. We know little about the associated merits, limitations and ways to mitigate challenges. There is a need for reflective work which considers the methodology in context. This paper shares learning from the experience of conducting a realist, theory-of-change driven evaluation of the African Institutions Initiative, a Wellcome Trust funded programme which aimed to build sustainable health research capacity in Africa at institutional and network levels, across seven research consortia. We reflect on the key challenges experienced throughout the evaluation and recommend ways of managing them, highlight opportunities and critical success factors associated with this evaluation approach, as well as elaborate on alternative evaluation approaches

Infantile zinc deficiency: Association with autism spectrum disorders

Elucidation of the pathogenesis and effective treatment of autism spectrum disorders is one of the challenges today. In this study, we examine hair zinc concentrations for 1,967 children with autistic disorders (1,553 males and 414 females), and show considerable association with zinc deficiency. Histogram of hair zinc concentration was non-symmetric with tailing in lower range, and 584 subjects were found to have lower zinc concentrations than −2 standard deviation level of its reference range (86.3–193ppm). The incidence rate of zinc deficiency in infant group aged 0–3 year-old was estimated 43.5 % in male and 52.5 % in female. The lowest zinc concentration of 10.7 ppm was detected in a 2-year-old boy, corresponding to about 1/12 of the control mean level. These findings suggest that infantile zinc deficiency may epigenetically contribute to the pathogenesis of autism and nutritional approach may yield a novel hope for its treatment and prevention

Participatory monitoring and evaluation approaches that influence decision-making: lessons from a maternal and newborn study in Eastern Uganda

BACKGROUND: The use of participatory monitoring and evaluation (M&E) approaches is important for guiding local decision-making, promoting the implementation of effective interventions and addressing emerging issues in the course of implementation. In this article, we explore how participatory M&E approaches helped to identify key design and implementation issues and how they influenced stakeholders’ decision-making in eastern Uganda. METHOD: The data for this paper is drawn from a retrospective reflection of various M&E approaches used in a maternal and newborn health project that was implemented in three districts in eastern Uganda. The methods included qualitative and quantitative M&E techniques such as key informant interviews, formal surveys and supportive supervision, as well as participatory approaches, notably participatory impact pathway analysis. RESULTS: At the design stage, the M&E approaches were useful for identifying key local problems and feasible local solutions and informing the activities that were subsequently implemented. During the implementation phase, the M&E approaches provided evidence that informed decision-making and helped identify emerging issues, such as weak implementation by some village health teams, health facility constraints such as poor use of standard guidelines, lack of placenta disposal pits, inadequate fuel for the ambulance at some facilities, and poor care for low birth weight infants. Sharing this information with key stakeholders prompted them to take appropriate actions. For example, the sub-county leadership constructed placenta disposal pits, the district health officer provided fuel for ambulances, and health workers received refresher training and mentorship on how to care for newborns. CONCLUSION: Diverse sources of information and perspectives can help researchers and decision-makers understand and adapt evidence to contexts for more effective interventions. Supporting districts to have crosscutting, routine information generating and sharing platforms that bring together stakeholders from different sectors is therefore crucial for the successful implementation of complex development interventions

Widespread environmental contamination with Mycobacterium tuberculosis complex revealed by a molecular detection protocol

Environmental contamination with Mycobacterium tuberculosis complex (MTC) has been considered crucial for bovine tuberculosis persistence in multi-host-pathogen systems. However, MTC contamination has been difficult to detect due to methodological issues. In an attempt to overcome this limitation we developed an improved protocol for the detection of MTC DNA. MTC DNA concentration was estimated by the Most Probable Number (MPN) method. Making use of this protocol we showed that MTC contamination is widespread in different types of environmental samples from the Iberian Peninsula, which supports indirect transmission as a contributing mechanism for the maintenance of bovine tuberculosis in this multi-host-pathogen system. The proportion of MTC DNA positive samples was higher in the bovine tuberculosis-infected than in presumed negative area (0.32 and 0.18, respectively). Detection varied with the type of environmental sample and was more frequent in sediment from dams and less frequent in water also from dams (0.22 and 0.05, respectively). The proportion of MTC-positive samples was significantly higher in spring (p<0.001), but MTC DNA concentration per sample was higher in autumn and lower in summer. The average MTC DNA concentration in positive samples was 0.82 MPN/g (CI95 0.70-0.98 MPN/g). We were further able to amplify a DNA sequence specific of Mycobacterium bovis/caprae in 4 environmental samples from the bTB-infected area

Increased production of IL-4 and IL-12p40 from bronchoalveolar lavage cells are biomarkers of Mycobacterium tuberculosis in the sputum

BACKGROUND: Tuberculosis (TB) causes 1.45 million deaths annually world wide, the majority of which occur in the developing world. Active TB disease represents immune failure to control latent infection from airborne spread. Acid-fast bacillus (AFB) seen on sputum smear is a biomarker for contagiousness. METHODS: We enrolled 73 tuberculosis patients with extensive infiltrates into a research study using bronchoalveolar lavage (BAL) to sample lung immune cells and assay BAL cell cytokine production. All patients had sputum culture demonstrating Mycobacterium tuberculosis and 59/73 (81%) had AFB identified by microscopy of the sputum. Compared with smear negative patients, smear positive patients at presentation had a higher proportion with smoking history, a higher proportion with temperature >38.5 0 C, higher BAL cells/ml, lower percent lymphocytes in BAL, higher IL-4 and IL-12p40 in BAL cell supernatants. There was no correlation between AFB smear and other BAL or serum cytokines. Increasing IL-4 was associated with BAL PMN and negatively associated with BAL lymphocytes. Each 10-fold increase in BAL IL-4 and IL-12p40 increased the odds of AFB smear positivity by 7.4 and 2.2-fold, respectively, in a multi-variable logistic model. CONCLUSION: Increasing IL-4 and IL-12p40 production by BAL cells are biomarkers for AFB in sputum of patients who present with radiographically advanced TB. They likely reflect less effective immune control of pathways for controlling TB, leading to patients with increased infectiousness

X-ray emission from the Sombrero galaxy: discrete sources

We present a study of discrete X-ray sources in and around the bulge-dominated, massive Sa galaxy, Sombrero (M104), based on new and archival Chandra observations with a total exposure of ~200 ks. With a detection limit of L_X = 1E37 erg/s and a field of view covering a galactocentric radius of ~30 kpc (11.5 arcminute), 383 sources are detected. Cross-correlation with Spitler et al.'s catalogue of Sombrero globular clusters (GCs) identified from HST/ACS observations reveals 41 X-rays sources in GCs, presumably low-mass X-ray binaries (LMXBs). We quantify the differential luminosity functions (LFs) for both the detected GC and field LMXBs, whose power-low indices (~1.1 for the GC-LF and ~1.6 for field-LF) are consistent with previous studies for elliptical galaxies. With precise sky positions of the GCs without a detected X-ray source, we further quantify, through a fluctuation analysis, the GC LF at fainter luminosities down to 1E35 erg/s. The derived index rules out a faint-end slope flatter than 1.1 at a 2 sigma significance, contrary to recent findings in several elliptical galaxies and the bulge of M31. On the other hand, the 2-6 keV unresolved emission places a tight constraint on the field LF, implying a flattened index of ~1.0 below 1E37 erg/s. We also detect 101 sources in the halo of Sombrero. The presence of these sources cannot be interpreted as galactic LMXBs whose spatial distribution empirically follows the starlight. Their number is also higher than the expected number of cosmic AGNs (52+/-11 [1 sigma]) whose surface density is constrained by deep X-ray surveys. We suggest that either the cosmic X-ray background is unusually high in the direction of Sombrero, or a distinct population of X-ray sources is present in the halo of Sombrero.Comment: 11 figures, 5 tables, ApJ in pres