Assessment of the learning curve in health technologies: a systematic review

Objective: We reviewed and appraised the methods by which the issue of the learning curve has been addressed during health technology assessment in the past. Method: We performed a systematic review of papers in clinical databases (BIOSIS, CINAHL, Cochrane Library, EMBASE, HealthSTAR, MEDLINE, Science Citation Index, and Social Science Citation Index) using the search term "learning curve:" Results: The clinical search retrieved 4,571 abstracts for assessment, of which 559 (12%) published articles were eligible for review. Of these, 272 were judged to have formally assessed a learning curve. The procedures assessed were minimal access (51%), other surgical (41%), and diagnostic (8%). The majority of the studies were case series (95%). Some 47% of studies addressed only individual operator performance and 52% addressed institutional performance. The data were collected prospectively in 40%, retrospectively in 26%, and the method was unclear for 31%. The statistical methods used were simple graphs (44%), splitting the data chronologically and performing a t test or chi-squared test (60%), curve fitting (12%), and other model fitting (5%). Conclusions: Learning curves are rarely considered formally in health technology assessment. Where they are, the reporting of the studies and the statistical methods used are weak. As a minimum, reporting of learning should include the number and experience of the operators and a detailed description of data collection. Improved statistical methods would enhance the assessment of health technologies that require learning

Assessing the learning curve effect in health technologies: Lessons from the non-clinical literature

Introduction: Many health technologies exhibit some form of learning effect, and this represents a barrier to rigorous assessment. It has been shown that the statistical methods used are relatively crude. Methods to describe learning curves in fields outside medicine, for example, psychology and engineering, may be better. Methods: To systematically search non–health technology assessment literature (for example, PsycLit and Econlit databases) to identify novel statistical techniques applied to learning curves. Results: The search retrieved 9,431 abstracts for assessment, of which 18 used a statistical technique for analyzing learning effects that had not previously been identified in the clinical literature. The newly identified methods were combined with those previously used in health technology assessment, and categorized into four groups of increasing complexity: a) exploratory data analysis; b) simple data analysis; c) complex data analysis; and d) generic methods. All the complex structured data techniques for analyzing learning effects were identified in the nonclinical literature, and these emphasized the importance of estimating intra- and interindividual learning effects. Conclusion: A good dividend of more sophisticated methods was obtained by searching in nonclinical fields. These methods now require formal testing on health technology data sets

Directed evolution and targeted mutagenesis to murinize listeria monocytogenes internalin A for enhanced infectivity in the murine oral infection model

BACKGROUND: Internalin A (InlA) is a critical virulence factor which mediates the initiation of Listeria monocytogenes infection by the oral route in permissive hosts. The interaction of InlA with the host cell ligand E-cadherin efficiently stimulates L. monocytogenes entry into human enterocytes, but has only a limited interaction with murine cells. RESULTS: We have created a surface display library of randomly mutated InlA in a non-invasive heterologous host Lactococcus lactis in order to create and screen novel variants of this invasion factor. After sequential passage through a murine cell line (CT-26), multiple clones with enhanced invasion characteristics were identified. Competitive index experiments were conducted in mice using selected mutations introduced into L. monocytogenes EGD-e background. A novel single amino acid change was identified which enhanced virulence by the oral route in the murine model and will form the basis of further engineering approaches. As a control a previously described EGD-InlA(m) murinized strain was also re-created as part of this study with minor modifications and designated EGD-e InlA(m)*. The strain was created using a procedure that minimizes the likelihood of secondary mutations and incorporates Listeria-optimized codons encoding the altered amino acids. L. monocytogenes EGD-e InlA(m)* yielded consistently higher level murine infections by the oral route when compared to EGD-e, but did not display the two-fold increased invasion into a human cell line that was previously described for the EGD-InlA(m) strain. CONCLUSIONS: We have used both site-directed mutagenesis and directed evolution to create variants of InlA which may inform future structure-function analyses of this protein. During the course of the study we engineered a murinized strain of L. monocytogenes EGD-e which shows reproducibly higher infectivity in the intragastric murine infection model than the wild type, but does not display enhanced entry into human cells as previously observed. This murinized L. monocytogenes strain will provide a useful tool for the analysis of the gastrointestinal phase of listeriosis

Development of multiple strain competitive index assays for Listeria monocytogenes using pIMC; a new site-specific integrative vector

<p>Abstract</p> <p>Background</p> <p>The foodborne, gram-positive pathogen, <it>Listeria monocytogenes</it>, is capable of causing lethal infections in compromised individuals. In the post genomic era of <it>L. monocytogenes </it>research, techniques are required to identify and validate genes involved in the pathogenicity and environmental biology of the organism. The aim here was to develop a widely applicable method to tag <it>L. monocytogenes </it>strains, with a particular emphasis on the development of multiple strain competitive index assays.</p> <p>Results</p> <p>We have constructed a new site-specific integrative vector, pIMC, based on pPL2, for the selection of <it>L. monocytogenes </it>from complex samples. The pIMC vector was further modified through the incorporation of IPTG inducible markers (antibiotic and phenotypic) to produce a suite of four vectors which allowed the discrimination of multiple strains from a single sample. We were able to perform murine infection studies with up to four EGDe isolates within a single mouse and showed that the tags did not impact upon growth rate or virulence. The system also allowed the identification of subtle differences in virulence between strains of <it>L. monocytogenes </it>commonly used in laboratory studies.</p> <p>Conclusion</p> <p>This study has developed a competitive index assay that can be broadly applied to all <it>L. monocytogenes </it>strains. Improved statistical robustness of the data was observed, resulting in fewer mice being required for virulence assays. The competitive index assays provide a powerful method to analyse the virulence or fitness of <it>L. monocytogenes </it>in complex biological samples.</p

Development of multiple strain competitive index assays for Listeria monocytogenes using pIMC; a new site-specific integrative vector

The foodborne, gram-positive pathogen, Listeria monocytogenes, is capable of causing lethal infections in compromised individuals. In the post genomic era of L. monocytogenes research, techniques are required to identify and validate genes involved in the pathogenicity and environmental biology of the organism. The aim here was to develop a widely applicable method to tag L. monocytogenes strains, with a particular emphasis on the development of multiple strain competitive index assays

Unstable chromosome rearrangements in Staphylococcus aureus cause phenotype switching associated with persistent infections

Staphylococcus aureus small-colony variants (SCVs) are associated with unusually chronic and persistent infections despite active antibiotic treatment. The molecular basis for this clinically important phenomenon is poorly understood, hampered by the instability of the SCV phenotype. Here we investigated the genetic basis for an unstable S. aureus SCV that arose spontaneously while studying rifampicin resistance. This SCV showed no nucleotide differences across its genome compared with a normal-colony variant (NCV) revertant, yet the SCV presented the hallmarks of S. aureus linked to persistent infection: down-regulation of virulence genes and reduced hemolysis and neutrophil chemotaxis, while exhibiting increased survival in blood and ability to invade host cells. Further genome analysis revealed chromosome structural variation uniquely associated with the SCV. These variations included an asymmetric inversion across half of the S. aureus chromosome via recombination between type I restriction modification system (T1RMS) genes, and the activation of a conserved prophage harboring the immune evasion cluster (IEC). Phenotypic reversion to the wild-type–like NCV state correlated with reversal of the chromosomal inversion (CI) and with prophage stabilization. Further analysis of 29 complete S. aureus genomes showed strong signatures of recombination between hsdMS genes, suggesting that analogous CI has repeatedly occurred during S. aureus evolution. Using qPCR and long-read amplicon deep sequencing, we detected subpopulations with T1RMS rearrangements causing CIs and prophage activation across major S. aureus lineages. Here, we have discovered a previously unrecognized and widespread mechanism of reversible genomic instability in S. aureus associated with SCV generation and persistent infections.A.H. is supported by the H2020-MSCA-Global Fellowship (Grant 657766). Doherty Applied Microbial Genomics is funded by the Department of Microbiology and Immunology at The University of Melbourn

Manipulation of autophagy in phagocytes facilitates <i>Staphylococcus aureus</i> bloodstream infection

The capacity for intracellular survival within phagocytes is likely a critical factor facilitating the dissemination of Staphylococcus aureus in the host. To date, the majority of work on S. aureus-phagocyte interactions has focused on neutrophils and, to a lesser extent, macrophages, yet we understand little about the role played by dendritic cells (DCs) in the direct killing of this bacterium. Using bone marrow-derived DCs (BMDCs), we demonstrate for the first time that DCs can effectively kill S. aureus but that certain strains of S. aureus have the capacity to evade DC (and macrophage) killing by manipulation of autophagic pathways. Strains with high levels of Agr activity were capable of causing autophagosome accumulation, were not killed by BMDCs, and subsequently escaped from the phagocyte, exerting significant cytotoxic effects. Conversely, strains that exhibited low levels of Agr activity failed to accumulate autophagosomes and were killed by BMDCs. Inhibition of the autophagic pathway by treatment with 3-methyladenine restored the bactericidal effects of BMDCs. Using an in vivo model of systemic infection, we demonstrated that the ability of S. aureus strains to evade phagocytic cell killing and to survive temporarily within phagocytes correlated with persistence in the periphery and that this effect is critically Agr dependent. Taken together, our data suggest that strains of S. aureus exhibiting high levels of Agr activity are capable of blocking autophagic flux, leading to the accumulation of autophagosomes. Within these autophagosomes, the bacteria are protected from phagocytic killing, thus providing an intracellular survival niche within professional phagocytes, which ultimately facilitates dissemination

Staphylococcus aureus small colony variants impair host immunity by activating host cell glycolysis and inducing necroptosis

Staphylococcus aureus small colony variants (SCVs) are frequently associated with chronic infection, yet they lack expression of many virulence determinants associated with the pathogenicity of wild-type strains. We found that both wild-type S. aureus and a ΔhemB SCV prototype potently activate glycolysis in host cells. Glycolysis and the generation of mitochondrial reactive oxygen species were sufficient to induce necroptosis, a caspase-independent mechanism of host cell death that failed to eradicate S. aureus and instead promoted ΔhemB SCV pathogenicity. To support ongoing glycolytic activity, the ΔhemB SCV induced over a 100-fold increase in the expression of fumC, which encodes an enzyme that catalyses the degradatin of fumarate, an inhibitor of glycolysis. Consistent with fumC-dependent depletion of local fumarate, the ΔhemB SCV failed to elicit trained immunity and protection from a secondary infectious challenge in the skin. The reliance of the S. aureus SCV population on glycolysis accounts for much of its role in the pathogenesis of S. aureus skin infection