Standardisation of data from real-time quantitative PCR methods – evaluation of outliers and comparison of calibration curves

BACKGROUND: As real-time quantitative PCR (RT-QPCR) is increasingly being relied upon for the enforcement of legislation and regulations dependent upon the trace detection of DNA, focus has increased on the quality issues related to the technique. Recent work has focused on the identification of factors that contribute towards significant measurement uncertainty in the real-time quantitative PCR technique, through investigation of the experimental design and operating procedure. However, measurement uncertainty contributions made during the data analysis procedure have not been studied in detail. This paper presents two additional approaches for standardising data analysis through the novel application of statistical methods to RT-QPCR, in order to minimise potential uncertainty in results. RESULTS: Experimental data was generated in order to develop the two aspects of data handling and analysis that can contribute towards measurement uncertainty in results. This paper describes preliminary aspects in standardising data through the application of statistical techniques to the area of RT-QPCR. The first aspect concerns the statistical identification and subsequent handling of outlying values arising from RT-QPCR, and discusses the implementation of ISO guidelines in relation to acceptance or rejection of outlying values. The second aspect relates to the development of an objective statistical test for the comparison of calibration curves. CONCLUSION: The preliminary statistical tests for outlying values and comparisons between calibration curves can be applied using basic functions found in standard spreadsheet software. These two aspects emphasise that the comparability of results arising from RT-QPCR needs further refinement and development at the data-handling phase. The implementation of standardised approaches to data analysis should further help minimise variation due to subjective judgements. The aspects described in this paper will help contribute towards the development of a set of best practice guidelines regarding standardising handling and interpretation of data arising from RT-QPCR experiments

Considerations for accurate gene expression measurement by reverse transcription quantitative PCR when analysing clinical samples

Reverse transcription quantitative PCR is an established, simple and effective method for RNA measurement. However, technical standardisation challenges combined with frequent insufficient experimental detail render replication of many published findings challenging. Consequently, without adequate consideration of experimental standardisation, such findings may be sufficient for a given publication but cannot be translated to wider clinical application. This article builds on earlier standardisation work and the MIQE guidelines, discussing processes that need consideration for accurate, reproducible analysis when dealing with patient samples. By applying considerations common to the science of measurement (metrology), one can maximise the impact of gene expression studies, increasing the likelihood of their translation to clinical tools

Evaluation of a novel approach for the measurement of RNA quality

<p>Abstract</p> <p>Background</p> <p>Microarray data interpretation can be affected by sample RNA integrity. The ScreenTape Degradation Value (SDV) is a novel RNA integrity metric specific to the ScreenTape^®platform (Lab901). To characterise the performance of the ScreenTape^®platform for RNA analysis and determine the robustness of the SDV metric, a panel of intentionally degraded RNA samples was prepared. These samples were used to evaluate the ScreenTape^®platform against an alternative approach for measuring RNA integrity (Agilent Bioanalyzer RIN value). The samples were also subjected to microarray analysis and the resulting data correlated to the RNA integrity metrics.</p> <p>Findings</p> <p>Measurement of SDV for a panel of intentionally degraded RNA samples ranged from 0 for intact RNA to 37 for degraded RNA, with corresponding RIN values ranging from 10 to 4 for the same set of samples. SDV and RIN scales both demonstrated comparable discrimination between differently treated samples (RIN 10 to 7, SDV 0 to 15), with the SDV exhibiting better discrimination at higher degradation levels. Increasing SDV values correlated with a decrease in microarray sample labelling efficiency and an increase in numbers of differentially expressed genes.</p> <p>Conclusions</p> <p>The ScreenTape^®platform is comparable to the Bioanalyzer platform in terms of reproducibility and discrimination between different levels of RNA degradation. The robust nature of the SDV metric qualifies it as an alternative metric for RNA sample quality control, and a useful predictor of downstream microarray performance.</p

Interlaboratory evaluation of quality control methods for circulating cell-free DNA extraction

: Analysis of circulating cell-free DNA (ccfDNA) isolated from liquid biopsies is rapidly being implemented into clinical practice. However, diagnostic accuracy is significantly impacted by sample quality and standardised approaches for assessing the quality of ccfDNA are not yet established. In this study we evaluated the application of nucleic acid "spike-in" control materials to aid quality control (QC) and standardisation of cfDNA isolation for use in in vitro diagnostic assays. We describe an approach for the design and characterisation of in-process QC materials, illustrating it with a spike-in material containing an exogenous Arabidopsis sequence and DNA fragments approximating to ccfDNA and genomic DNA lengths. Protocols for inclusion of the spike-in material in plasma ccfDNA extraction and quantification of its recovery by digital PCR (dPCR) were assessed for their suitability for process QC in an inter-laboratory study between five expert laboratories, using a range of blood collection devices and ccfDNA extraction methods. The results successfully demonstrated that spiking plasmid-derived material into plasma did not deleteriously interfere with endogenous ccfDNA recovery. The approach performed consistently across a range of commonly-used extraction protocols and was able to highlight differences in efficiency and variability between the methods, with the dPCR quantification assay performing with good repeatability (generally CV <5%). We conclude that initial findings demonstrate that this approach appears "fit for purpose" and spike-in recovery can be combined with other extraction QC metrics for monitoring the performance of a process over time, or in the context of external quality assessment. AVAILABILITY OF DATA AND MATERIALS: Processed data is available in Supplementary File 4. Raw data available upon request. Declaration of Competing Interest

Quantification of epigenetic biomarkers:an evaluation of established and emerging methods for DNA methylation analysis

BACKGROUND: DNA methylation is an important epigenetic mechanism in several human diseases, most notably cancer. The quantitative analysis of DNA methylation patterns has the potential to serve as diagnostic and prognostic biomarkers, however, there is currently a lack of consensus regarding the optimal methodologies to quantify methylation status. To address this issue we compared five analytical methods: (i) MethyLight qPCR, (ii) MethyLight digital PCR (dPCR), methylation-sensitive and -dependent restriction enzyme (MSRE/MDRE) digestion followed by (iii) qPCR or (iv) dPCR, and (v) bisulfite amplicon next generation sequencing (NGS). The techniques were evaluated for linearity, accuracy and precision. RESULTS: MethyLight qPCR displayed the best linearity across the range of tested samples. Observed methylation measured by MethyLight- and MSRE/MDRE-qPCR and -dPCR were not significantly different to expected values whilst bisulfite amplicon NGS analysis over-estimated methylation content. Bisulfite amplicon NGS showed good precision, whilst the lower precision of qPCR and dPCR analysis precluded discrimination of differences of < 25% in methylation status. A novel dPCR MethyLight assay is also described as a potential method for absolute quantification that simultaneously measures both sense and antisense DNA strands following bisulfite treatment. CONCLUSIONS: Our findings comprise a comprehensive benchmark for the quantitative accuracy of key methods for methylation analysis and demonstrate their applicability to the quantification of circulating tumour DNA biomarkers by using sample concentrations that are representative of typical clinical isolates. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/1471-2164-15-1174) contains supplementary material, which is available to authorized users

A pilot study to evaluate the application of a generic protein standard panel for quality control of biomarker detection technologies

<p>Abstract</p> <p>Background</p> <p>Protein biomarker studies are currently hampered by a lack of measurement standards to demonstrate quality, reliability and comparability across multiple assay platforms. This is especially pertinent for immunoassays where multiple formats for detecting target analytes are commonly used.</p> <p>Findings</p> <p>In this pilot study a generic panel of six non-human protein standards (50 - 10^7 pg/mL) of varying abundance was prepared as a quality control (QC) material. Simulated "normal" and "diseased" panels of proteins were prepared in pooled human plasma and incorporated into immunoassays using the Meso Scale Discovery^®(MSD^®) platform to illustrate reliable detection of the component proteins. The protein panel was also evaluated as a spike-in material for a model immunoassay involving detection of ovarian cancer biomarkers within individual human plasma samples. Our selected platform could discriminate between two panels of the proteins exhibiting small differences in abundance. Across distinct experiments, all component proteins exhibited reproducible signal outputs in pooled human plasma. When individual donor samples were used, half the proteins produced signals independent of matrix effects. These proteins may serve as a generic indicator of platform reliability.</p> <p>Each of the remaining proteins exhibit differential signals across the distinct samples, indicative of sample matrix effects, with the three proteins following the same trend. This subset of proteins may be useful for characterising the degree of matrix effects associated with the sample which may impact on the reliability of quantifying target diagnostic biomarkers.</p> <p>Conclusions</p> <p>We have demonstrated the potential utility of this panel of standards to act as a generic QC tool for evaluating the reproducibility of the platform for protein biomarker detection independent of serum matrix effects.</p

Development of a highly sensitive liquid biopsy platform to detect clinically-relevant cancer mutations at low allele fractions in cell-free DNA.

INTRODUCTION: Detection and monitoring of circulating tumor DNA (ctDNA) is rapidly becoming a diagnostic, prognostic and predictive tool in cancer patient care. A growing number of gene targets have been identified as diagnostic or actionable, requiring the development of reliable technology that provides analysis of multiple genes in parallel. We have developed the InVision™ liquid biopsy platform which utilizes enhanced TAm-Seq™ (eTAm-Seq™) technology, an amplicon-based next generation sequencing method for the identification of clinically-relevant somatic alterations at low frequency in ctDNA across a panel of 35 cancer-related genes. MATERIALS AND METHODS: We present analytical validation of the eTAm-Seq technology across two laboratories to determine the reproducibility of mutation identification. We assess the quantitative performance of eTAm-Seq technology for analysis of single nucleotide variants in clinically-relevant genes as compared to digital PCR (dPCR), using both established DNA standards and novel full-process control material. RESULTS: The assay detected mutant alleles down to 0.02% AF, with high per-base specificity of 99.9997%. Across two laboratories, analysis of samples with optimal amount of DNA detected 94% mutations at 0.25%-0.33% allele fraction (AF), with 90% of mutations detected for samples with lower amounts of input DNA. CONCLUSIONS: These studies demonstrate that eTAm-Seq technology is a robust and reproducible technology for the identification and quantification of somatic mutations in circulating tumor DNA, and support its use in clinical applications for precision medicine

Applicability of RNA standards for evaluating RT-qPCR assays and platforms

The availability of diverse RT-qPCR assay formats and technologies hinder comparability of data between platforms. Reference standards to facilitate platform evaluation and comparability are needed. We have explored using universal RNA standards for comparing the performance of a novel qPCR platform (Fluidigm® BioMark™) against the widely used ABI 7900HT system. Our results show that such standards may form part of a toolkit to evaluate the key performance characteristics of platforms

Comparison of microfluidic digital PCR and conventional quantitative PCR for measuring copy number variation

One of the benefits of Digital PCR (dPCR) is the potential for unparalleled precision enabling smaller fold change measurements. An example of an assessment that could benefit from such improved precision is the measurement of tumour-associated copy number variation (CNV) in the cell free DNA (cfDNA) fraction of patient blood plasma. To investigate the potential precision of dPCR and compare it with the established technique of quantitative PCR (qPCR), we used breast cancer cell lines to investigate HER2 gene amplification and modelled a range of different CNVs. We showed that, with equal experimental replication, dPCR could measure a smaller CNV than qPCR. As dPCR precision is directly dependent upon both the number of replicate measurements and the template concentration, we also developed a method to assist the design of dPCR experiments for measuring CNV. Using an existing model (based on Poisson and binomial distributions) to derive an expression for the variance inherent in dPCR, we produced a power calculation to define the experimental size required to reliably detect a given fold change at a given template concentration. This work will facilitate any future translation of dPCR to key diagnostic applications, such as cancer diagnostics and analysis of cfDNA

Inter-laboratory assessment of different digital PCR platforms for quantification of human cytomegalovirus DNA

Quantitative PCR (qPCR) is an important tool in pathogen detection. However, the use of different qPCR components, calibration materials and DNA extraction methods reduces comparability between laboratories, which can result in false diagnosis and discrepancies in patient care. The wider establishment of a metrological framework for nucleic acid tests could improve the degree of standardisation of pathogen detection and the quantification methods applied in the clinical context. To achieve this, accurate methods need to be developed and implemented as reference measurement procedures, and to facilitate characterisation of suitable certified reference materials. Digital PCR (dPCR) has already been used for pathogen quantification by analysing nucleic acids. Although dPCR has the potential to provide robust and accurate quantification of nucleic acids, further assessment of its actual performance characteristics is needed before it can be implemented in a metrological framework, and to allow adequate estimation of measurement uncertainties. Here, four laboratories demonstrated reproducibility (expanded measurement uncertainties below 15%) of dPCR for quantification of DNA from human cytomegalovirus, with no calibration to a common reference material. Using whole-virus material and extracted DNA, an intermediate precision (coefficients of variation below 25%) between three consecutive experiments was noted. Furthermore, discrepancies in estimated mean DNA copy number concentrations between laboratories were less than twofold, with DNA extraction as the main source of variability. These data demonstrate that dPCR offers a repeatable and reproducible method for quantification of viral DNA, and due to its satisfactory performance should be considered as candidate for reference methods for implementation in a metrological framework. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1007/s00216-017-0206-0) contains supplementary material, which is available to authorized users