The practice of 'doing' evaluation: Lessons learned from nine complex intervention trials in action

Background: There is increasing recognition among trialists of the challenges in understanding how particular 'real-life' contexts influence the delivery and receipt of complex health interventions. Evaluations of interventions to change health worker and/or patient behaviours in health service settings exemplify these challenges. When interpreting evaluation data, deviation from intended intervention implementation is accounted for through process evaluations of fidelity, reach, and intensity. However, no such systematic approach has been proposed to account for the way evaluation activities may deviate in practice from assumptions made when data are interpreted.Methods: A collective case study was conducted to explore experiences of undertaking evaluation activities in the real-life contexts of nine complex intervention trials seeking to improve appropriate diagnosis and treatment of malaria in varied health service settings. Multiple sources of data were used, including in-depth interviews with investigators, participant-observation of studies, and rounds of discussion and reflection.Results and discussion: From our experiences of the realities of conducting these evaluations, we identified six key 'lessons learned' about ways to become aware of and manage aspects of the fabric of trials involving the interface of researchers, fieldworkers, participants and data collection tools that may affect the intended production of data and interpretation of findings. These lessons included: foster a shared understanding across the study team of how individual practices contribute to the study goals; promote and facilitate within-team communications for ongoing reflection on the progress of the evaluation; establish processes for ongoing collaboration and dialogue between sub-study teams; the importance of a field research coordinator bridging everyday project management with scientific oversight; collect and review reflective field notes on the progress of the evaluation to aid interpretation of outcomes; and these approaches should help the identification of and reflection on possible overlaps between the evaluation and intervention.Conclusion: The lessons we have drawn point to the principle of reflexivity that, we argue, needs to become part of standard practice in the conduct of evaluations of complex interventions to promote more meaningful interpretations of the effects of an intervention and to better inform future implementation and decision-making. © 2014 Reynolds et al.; licensee BioMed Central Ltd

Medical Students' and Residents' preferred site characteristics and preceptor behaviours for learning in the ambulatory setting: a cross-sectional survey

BACKGROUND: Medical training is increasingly occurring in the ambulatory setting for final year medical students and residents. This study looks to identify if gender, school, level of training, or speciality affects learner's (final year medical students and residents) preferred site characteristics and preceptor behaviours for learning in the ambulatory setting. METHODS: All final year medical students and residents at the five medical schools in Ontario (N = 3471) were surveyed about the site characteristics and preceptor behaviours most enhancing their learning in the ambulatory setting. Preferred site characteristics and preceptor behaviours were rank ordered. Factor analysis grouped the site characteristics and preceptor behaviours into themes which were then correlated with gender, school, level of training, and speciality. RESULTS: Having an adequate number and variety of patients while being supervised by enthusiastic preceptors who give feedback and are willing to discuss their reasoning processes and delegate responsibility are site characteristics and preceptor behaviours valued by almost all learners. Some teaching strategies recently suggested to improve efficiency in the ambulatory teaching setting, such as structuring the interview for the student and teaching and reviewing the case in front of the patient, were found not to be valued by learners. There was a striking degree of similarity in what was valued by all learners but there were also some educationally significant differences, particularly between learners at different levels and in different specialities. Key findings between the different levels include preceptor interaction being most important for medical students as opposed to residents who most value issues pertaining to patient logistics. Learning resources are less valued early and late in training. Teaching and having the case reviewed in front of the patient becomes increasingly less valued as learners advance in their training. As one approaches the end of ones' training office management instruction becomes increasingly valued. Differences between specialities pertain most to the type of practice residents will ultimately end up in (ie: office based specialties particularly valuing instruction in office management and health care system interaction). CONCLUSIONS: Preceptors need to be aware of, and make efforts to provide, teaching strategies such as feedback and discussing clinical reasoning, that learners have identified as being helpful for learning. If strategies identified as not being valued for learning, such as teaching in front of the patient, must continue it will be important to explore the barriers they present to learning. Although what all learners want from their preceptors and clinic settings to enhance their learning is remarkably similar, being aware of the educationally significant differences, particularly for learners at different levels and in different specialities, will enhance teaching in the ambulatory setting

Effects of co-administered dexamethasone and diclofenac potassium on pain, swelling and trismus following third molar surgery

BACKGROUND: The apparent interactions between the mechanisms of action of non-steroidal anti-inflammatory drugs (NSAIDS) and steroids suggest that co-therapy may provide beneficial inflammatory and pain relief in the absence of side effects. The aim of the study was to compare the effect of co-administered dexamethasone and diclofenac potassium (diclofenac K) with diclofenac K alone on the postoperative pain, swelling and trismus after surgical removal of third molars. PATIENTS AND METHODS: A prospective randomized double-blind study was conducted at the Department of Oral and Maxillofacial Surgery, Lagos University Teaching Hospital, Nigeria. A total of 100 patients were randomly allocated to two treatment groups of dexamethasone (prophylactic 8 mg and postoperative 4 mg IV) and diclofenac K (50 mg Oral before and after surgery), and diclofenac K alone (as with first group). The overall analgesic efficacy of the drug combinations was assessed postoperatively by determination of pain intensity using a category rating scale. Facial swelling was measured using a tape measure placed from tragus to gonion to tragus, while interincisal mouth-opening of patients was measured using a vernier calibrated caliper pre-operatively and post-operatively. RESULTS: Co-administration of dexamethasone and diclofenac K was significantly superior to diclofenac alone for the relief of pain (P < 0.05), and facial swelling up to post-operative 48 hour (P < 0.05). However, there was no significant difference for trismus relief between the two medication protocols (P > 0.05). CONCLUSION: This study illustrates enhanced effects of co-administered dexamethasone and diclofenac K on short-term post-operative pain and swelling, compared to diclofenac potassium alone in third molar surgery

Reduced endocytosis and altered lysosome function in cisplatin-resistant cell lines

We isolated human KB adenocarcinoma cisplatin-resistant (CP-r) cell lines with multidrug-resistance phenotypes because of reduced accumulation of cisplatin and other cytotoxic compounds such as methotrexate and heavy metals. The uptake of horseradish peroxidase (HRPO) and Texas Red dextran was decreased several-fold in KB-CP-r cells, indicating a general defect in fluid-phase endocytosis. In contrast, although EGF receptors were decreased in amount, the kinetics of EGF uptake, a marker of receptor-mediated endocytosis, was similar in sensitive and resistant cells. However, 40–60% of the 125I-EGF released into the medium after uptake into lysosomes of KB-CP-r cells was TCA precipitable as compared to only 10% released by sensitive cells. These results indicate inefficient degradation of internalised 125I-EGF in the lysosomes of KB-CP-r cells, consistent with slower processing of cathepsin L, a lysosomal cysteine protease. Treatment of KB cells by bafilomycin A1, a known inhibitor of the vacuolar proton pump, mimicked the phenotype seen in KB-CP-r cells with reduced uptake of HRPO, 125I-EGF, 14C-carboplatin, and release of TCA precipitable 125I-EGF. KB-CP-r cells also had less acidic lysosomes. KB-CP-r cells were crossresistant to Pseudomonas exotoxin, and Pseudomonas exotoxin-resistant KB cells were crossresistant to cisplatin. Since cells with endosomal acidification defects are known to be resistant to Pseudomonas exotoxin and blocking of endosomal acidification mimics the CP-r phenotype, we conclude that defective endosomal acidification may contribute to acquired cisplatin resistance

Naturopathic Care for Anxiety: A Randomized Controlled Trial ISRCTN78958974

BACKGROUND: Anxiety is a serious personal health condition and represents a substantial burden to overall quality of life. Additionally anxiety disorders represent a significant cost to the health care system as well as employers through benefits coverage and days missed due to incapacity. This study sought to explore the effectiveness of naturopathic care on anxiety symptoms using a randomized trial. METHODS: Employees with moderate to severe anxiety of longer than 6 weeks duration were randomized based on age and gender to receive naturopathic care (NC) (n = 41) or standardized psychotherapy intervention (PT) (n = 40) over a period of 12 weeks. Blinding of investigators and participants during randomization and allocation was maintained. Participants in the NC group received dietary counseling, deep breathing relaxation techniques, a standard multi-vitamin, and the herbal medicine, ashwagandha (Withania somnifera) (300 mg b.i.d. standardized to 1.5% with anolides, prepared from root). The PT intervention received psychotherapy, and matched deep breathing relaxation techniques, and placebo. The primary outcome measure was the Beck Anxiety Inventory (BAI) and secondary outcome measures included the Short Form 36 (SF-36), Fatigue Symptom Inventory (FSI), and Measure Yourself Medical Outcomes Profile (MY-MOP) to measure anxiety, mental health, and quality of life respectively. Participants were blinded to the placebo-controlled intervention. RESULTS: Seventy-five participants (93%) were followed for 8 or more weeks on the trial. Final BAI scores decreased by 56.5% (p<0.0001) in the NC group and 30.5% (p<0.0001) in the PT group. BAI group scores were significantly decreased in the NC group compared to PT group (p = 0.003). Significant differences between groups were also observed in mental health, concentration, fatigue, social functioning, vitality, and overall quality of life with the NC group exhibiting greater clinical benefit. No serious adverse reactions were observed in either group. RELEVANCE: Many patients seek alternatives and/or complementary care to conventional anxiety treatments. To date, no study has evaluated the potential of a naturopathic treatment protocol to effectively treat anxiety. Knowledge of the efficacy, safety or risk of natural health products, and naturopathic treatments is important for physicians and the public in order to make informed decisions. INTERPRETATION: Both NC and PT led to significant improvements in patients' anxiety. Group comparison demonstrated a significant decrease in anxiety levels in the NC group over the PT group. Significant improvements in secondary quality of life measures were also observed in the NC group as compared to PT. The whole system of naturopathic care for anxiety needs to be investigated further including a closer examination of the individual components within the context of their additive effect. TRIAL REGISTRATION: Controlled-Trials.com ISRCTN78958974

Drug-induced caspase 8 upregulation sensitises cisplatin-resistant ovarian carcinoma cells to rhTRAIL-induced apoptosis

BACKGROUND: Drug resistance is a major problem in ovarian cancer. Triggering apoptosis using death ligands such as tumour necrosis factor-related apoptosis inducing ligand (TRAIL) might overcome chemoresistance. METHODS: We investigated whether acquired cisplatin resistance affects sensitivity to recombinant human (rh) TRAIL alone or in combination with cisplatin in an ovarian cancer cell line model consisting of A2780 and its cisplatin-resistant subline CP70. RESULTS: Combining cisplatin and rhTRAIL strongly enhanced apoptosis in both cell lines. CP70 expressed less caspase 8 protein, whereas mRNA levels were similar compared with A2780. Pre-exposure of particularly CP70 to cisplatin resulted in strongly elevated caspase 8 protein and mRNA levels. Caspase 8 mRNA turnover and protein stability in the presence or absence of cisplatin did not differ between both cell lines. Cisplatin-induced caspase 8 protein levels were essential for the rhTRAIL-sensitising effect as demonstrated using caspase 8 small-interfering RNA (siRNA) and caspase-8 overexpressing constructs. Cellular FLICE-inhibitory protein (c-FLIP) and p53 siRNA experiments showed that neither an altered caspase 8/c-FLIP ratio nor a p53-dependent increase in DR5 membrane expression following cisplatin were involved in rhTRAIL sensitisation. CONCLUSION: Cisplatin enhances rhTRAIL-induced apoptosis in cisplatin-resistant ovarian cancer cells, and induction of caspase 8 protein expression is the key factor of rhTRAIL sensitisation. British Journal of Cancer (2011) 104, 1278-1287. doi:10.1038/bjc.2011.84 www.bjcancer.com (C) 2011 Cancer Research U

Transcriptional upregulation of human tissue kallikrein 6 in ovarian cancer: clinical and mechanistic aspects

The human tissue kallikrein family (KLK for protein; KLK for gene) includes 15 members. Twelve kallikreins, including KLK6, are concurrently upregulated in ovarian cancer. However, the mechanism of this phenomenon remains unclear. In this study, we measured KLK6 expression in a large series of ovarian tissue cytosols and examined possible mechanisms of KLK6 up-regulation in ovarian cancer. Using a newly developed enzyme-linked immunosorbent assay (ELISA) with two monoclonal antibodies, we quantified KLK6 expression in ovarian tissue cytosols, and confirmed the upregulation of KLK6 in ovarian cancer and its unfavourable prognostic value. We then examined KLK6 mRNA expression using reverse transcription–polymerase chain reaction and established its good concordance with KLK6 protein expression. This finding suggested that the KLK6 gene is under transcriptional regulation. We then scrutinised a few mechanisms that could explain KLK6 upregulation. The relative abundance of two KLK6 mRNA transcripts was studied; we found the same differential expression pattern in all samples, regardless of KLK6 levels. Genomic mutation screening of all exons and the 5′-flanking region of the KLK6 gene identified two linked single-nucleotide polymorphisms in the 5′-untranslated region, but neither correlated with KLK6 expression. Ovarian cell lines were separately treated with five steroid hormones. None of the treatments produced significant effects on KLK6 expression. We conclude that KLK6 is transcriptionally upregulated in ovarian cancer, but probably not through alternative mRNA transcript expression, genomic mutation, or steroid hormone induction