Automated recognition of cell phenotypes in histology images based on membrane- and nuclei-targeting biomarkers

<p>Abstract</p> <p>Background</p> <p>Three-dimensional <it>in vitro </it>culture of cancer cells are used to predict the effects of prospective anti-cancer drugs <it>in vivo</it>. In this study, we present an automated image analysis protocol for detailed morphological protein marker profiling of tumoroid cross section images.</p> <p>Methods</p> <p>Histologic cross sections of breast tumoroids developed in co-culture suspensions of breast cancer cell lines, stained for E-cadherin and progesterone receptor, were digitized and pixels in these images were classified into five categories using <it>k</it>-means clustering. Automated segmentation was used to identify image regions composed of cells expressing a given biomarker. Synthesized images were created to check the accuracy of the image processing system.</p> <p>Results</p> <p>Accuracy of automated segmentation was over 95% in identifying regions of interest in synthesized images. Image analysis of adjacent histology slides stained, respectively, for Ecad and PR, accurately predicted regions of different cell phenotypes. Image analysis of tumoroid cross sections from different tumoroids obtained under the same co-culture conditions indicated the variation of cellular composition from one tumoroid to another. Variations in the compositions of cross sections obtained from the same tumoroid were established by parallel analysis of Ecad and PR-stained cross section images.</p> <p>Conclusion</p> <p>Proposed image analysis methods offer standardized high throughput profiling of molecular anatomy of tumoroids based on both membrane and nuclei markers that is suitable to rapid large scale investigations of anti-cancer compounds for drug development.</p

A TMA De-Arraying Method for High Throughput Biomarker Discovery in Tissue Research

BACKGROUND: Tissue MicroArrays (TMAs) represent a potential high-throughput platform for the analysis and discovery of tissue biomarkers. As TMA slides are produced manually and subject to processing and sectioning artefacts, the layout of TMA cores on the final slide and subsequent digital scan (TMA digital slide) is often disturbed making it difficult to associate cores with their original position in the planned TMA map. Additionally, the individual cores can be greatly altered and contain numerous irregularities such as missing cores, grid rotation and stretching. These factors demand the development of a robust method for de-arraying TMAs which identifies each TMA core, and assigns them to their appropriate coordinates on the constructed TMA slide. METHODOLOGY: This study presents a robust TMA de-arraying method consisting of three functional phases: TMA core segmentation, gridding and mapping. The segmentation of TMA cores uses a set of morphological operations to identify each TMA core. Gridding then utilises a Delaunay Triangulation based method to find the row and column indices of each TMA core. Finally, mapping correlates each TMA core from a high resolution TMA whole slide image with its name within a TMAMap. CONCLUSION: This study describes a genuine robust TMA de-arraying algorithm for the rapid identification of TMA cores from digital slides. The result of this de-arraying algorithm allows the easy partition of each TMA core for further processing. Based on a test group of 19 TMA slides (3129 cores), 99.84% of cores were segmented successfully, 99.81% of cores were gridded correctly and 99.96% of cores were mapped with their correct names via TMAMaps. The gridding of TMA cores were also extensively tested using a set of 113 pseudo slide (13,536 cores) with a variety of irregular grid layouts including missing cores, rotation and stretching. 100% of the cores were gridded correctly

Development and evaluation of a virtual microscopy application for automated assessment of Ki-67 expression in breast cancer

<p>Abstract</p> <p>Background</p> <p>The aim of the study was to develop a virtual microscopy enabled method for assessment of Ki-67 expression and to study the prognostic value of the automated analysis in a comprehensive series of patients with breast cancer.</p> <p>Methods</p> <p>Using a previously reported virtual microscopy platform and an open source image processing tool, ImageJ, a method for assessment of immunohistochemically (IHC) stained area and intensity was created. A tissue microarray (TMA) series of breast cancer specimens from 1931 patients was immunostained for Ki-67, digitized with a whole slide scanner and uploaded to an image web server. The extent of Ki-67 staining in the tumour specimens was assessed both visually and with the image analysis algorithm. The prognostic value of the computer vision assessment of Ki-67 was evaluated by comparison of distant disease-free survival in patients with low, moderate or high expression of the protein.</p> <p>Results</p> <p>1648 evaluable image files from 1334 patients were analysed in less than two hours. Visual and automated Ki-67 extent of staining assessments showed a percentage agreement of 87% and weighted kappa value of 0.57. The hazard ratio for distant recurrence for patients with a computer determined moderate Ki-67 extent of staining was 1.77 (95% CI 1.31-2.37) and for high extent 2.34 (95% CI 1.76-3.10), compared to patients with a low extent. In multivariate survival analyses, automated assessment of Ki-67 extent of staining was retained as a significant prognostic factor.</p> <p>Conclusions</p> <p>Running high-throughput automated IHC algorithms on a virtual microscopy platform is feasible. Comparison of visual and automated assessments of Ki-67 expression shows moderate agreement. In multivariate survival analysis, the automated assessment of Ki-67 extent of staining is a significant and independent predictor of outcome in breast cancer.</p

Non-parametric algorithms for evaluating gene expression in cancer using DNA microarray technology

Microarray technology has transformed the field of cancer biology by enabling the simultaneous evaluation of tens of thousands mRNA expression levels in a single experiment. This technology has been applied to medical science in order to find gene expression markers that cluster diseased and normal tissues, genes affected by treatments, and gene network interactions. All methods of microarray data analysis can be summarized as a study of differential gene expression. This study addresses three questions, 1) the roles of selectively expressed genes for the classification of cancer, 2) issues of accounting for both experimental and biological noise, and 3) issues of comparing data derived from different research groups using the Affymetrix GeneChipTM platform. A key finding of this study is that selectively expressed genes are very powerful when used for disease classification. A model was designed to reduce noise and eliminate false positives from true results. With this approach, data from different research groups can be integrated to increase information and enable a better understanding of cancer

Genetic algorithm-neural network: feature extraction for bioinformatics data.

With the advance of gene expression data in the bioinformatics field, the questions which frequently arise, for both computer and medical scientists, are which genes are significantly involved in discriminating cancer classes and which genes are significant with respect to a specific cancer pathology. Numerous computational analysis models have been developed to identify informative genes from the microarray data, however, the integrity of the reported genes is still uncertain. This is mainly due to the misconception of the objectives of microarray study. Furthermore, the application of various preprocessing techniques in the microarray data has jeopardised the quality of the microarray data. As a result, the integrity of the findings has been compromised by the improper use of techniques and the ill-conceived objectives of the study. This research proposes an innovative hybridised model based on genetic algorithms (GAs) and artificial neural networks (ANNs), to extract the highly differentially expressed genes for a specific cancer pathology. The proposed method can efficiently extract the informative genes from the original data set and this has reduced the gene variability errors incurred by the preprocessing techniques. The novelty of the research comes from two perspectives. Firstly, the research emphasises on extracting informative features from a high dimensional and highly complex data set, rather than to improve classification results. Secondly, the use of ANN to compute the fitness function of GA which is rare in the context of feature extraction. Two benchmark microarray data have been taken to research the prominent genes expressed in the tumour development and the results show that the genes respond to different stages of tumourigenesis (i.e. different fitness precision levels) which may be useful for early malignancy detection. The extraction ability of the proposed model is validated based on the expected results in the synthetic data sets. In addition, two bioassay data have been used to examine the efficiency of the proposed model to extract significant features from the large, imbalanced and multiple data representation bioassay data

<em>SurfaceSlide</em>: A Multitouch Digital Pathology Platform

Background: Digital pathology provides a digital environment for the management and interpretation of pathological images and associated data. It is becoming increasing popular to use modern computer based tools and applications in pathological education, tissue based research and clinical diagnosis. Uptake of this new technology is stymied by its single user orientation and its prerequisite and cumbersome combination of mouse and keyboard for navigation and annotation.Methodology: In this study we developed SurfaceSlide, a dedicated viewing platform which enables the navigation and annotation of gigapixel digitised pathological images using fingertip touch. SurfaceSlide was developed using the Microsoft Surface, a 30 inch multitouch tabletop computing platform. SurfaceSlide users can perform direct panning and zooming operations on digitised slide images. These images are downloaded onto the Microsoft Surface platform from a remote server on-demand. Users can also draw annotations and key in texts using an on-screen virtual keyboard. We also developed a smart caching protocol which caches the surrounding regions of a field of view in multi-resolutions thus providing a smooth and vivid user experience and reducing the delay for image downloading from the internet. We compared the usability of SurfaceSlide against Aperio ImageScope and PathXL online viewer.Conclusion: SurfaceSlide is intuitive, fast and easy to use. SurfaceSlide represents the most direct, effective and intimate human–digital slide interaction experience. It is expected that SurfaceSlide will significantly enhance digital pathology tools and applications in education and clinical practice

AI in Medical Imaging Informatics: Current Challenges and Future Directions

This paper reviews state-of-the-art research solutions across the spectrum of medical imaging informatics, discusses clinical translation, and provides future directions for advancing clinical practice. More specifically, it summarizes advances in medical imaging acquisition technologies for different modalities, highlighting the necessity for efficient medical data management strategies in the context of AI in big healthcare data analytics. It then provides a synopsis of contemporary and emerging algorithmic methods for disease classification and organ/ tissue segmentation, focusing on AI and deep learning architectures that have already become the de facto approach. The clinical benefits of in-silico modelling advances linked with evolving 3D reconstruction and visualization applications are further documented. Concluding, integrative analytics approaches driven by associate research branches highlighted in this study promise to revolutionize imaging informatics as known today across the healthcare continuum for both radiology and digital pathology applications. The latter, is projected to enable informed, more accurate diagnosis, timely prognosis, and effective treatment planning, underpinning precision medicine

Establishment of predictive blood-based signatures in medical large scale genomic data sets : Development of novel diagnostic tests

Increasing data has led to tremendous success in discovering molecular biomarkers based on high throughput data. However, the translation of these so-called genomic signatures into clinical practice has been limited. The complexity and volume of genomic profiling requires heightened attention to robust design, methodological details, and avoidance of bias. During this thesis, novel strategies aimed at closing the gap from initially promising pilot studies to the clinical application of novel biomarkers are evaluated. First, a conventional process for genomic biomarker development comprising feature selection, algorithm and parameter optimization, and performance assessment was established. Using this approach, a RNA-stabilized whole blood diagnostic classifier for non-small cell lung cancer was built in a training set that can be used as a biomarker to discriminate between patients and control samples. Subsequently, this optimized classifier was successfully applied to two independent and blinded validation sets. Extensive permutation analysis using random feature lists supports the specificity of the established transcriptional classifier. Next, it was demonstrated that a combined approach of clinical trial simulation and adaptive learning strategies can be used to speed up biomarker development. As a model, genome-wide expression data derived from over 4,700 individuals in 37 studies addressing four clinical endpoints were used to assess over 1,800,000 classifiers. In addition to current approaches determining optimal classifiers within a defined study setting, randomized clinical trial simulation unequivocally uncovered the overall variance in the prediction performance of potential disease classifiers to predict the outcome of a large biomarker validation study from a pilot trial. Furthermore, most informative features were identified by feature ranking according to an individual classification performance score. Applying an adaptive learning strategy based on data extrapolation led to a datadriven prediction of the study size required for larger validation studies based on small pilot trials and an estimate of the expected statistical performance during validation. With these significant improvements, exceedingly robust and clinically applicable gene signatures for the diagnosis and detection of acute myeloid leukemia, active tuberculosis, HIV infection, and non-small cell lung cancer are established which could demonstrate disease-related enrichment of the obtained signatures and phenotype-related feature ranking. In further research, platform requirements for blood-based biomarker development were exemplarily examined for micro RNA expression profiling. The performance as well as the technical sample handling to provide reliable strategies for platform implementation in clinical applications were investigated. Overall, all introduced methods improve and accelerate the development of biomarker signatures for molecular diagnostics and can easily be extended to other high throughput data and other disease settings

The potential of optical proteomic technologies to individualize prognosis and guide rational treatment for cancer patients

Genomics and proteomics will improve outcome prediction in cancer and have great potential to help in the discovery of unknown mechanisms of metastasis, ripe for therapeutic exploitation. Current methods of prognosis estimation rely on clinical data, anatomical staging and histopathological features. It is hoped that translational genomic and proteomic research will discriminate more accurately than is possible at present between patients with a good prognosis and those who carry a high risk of recurrence. Rational treatments, targeted to the specific molecular pathways of an individual’s high-risk tumor, are at the core of tailored therapy. The aim of targeted oncology is to select the right patient for the right drug at precisely the right point in their cancer journey. Optical proteomics uses advanced optical imaging technologies to quantify the activity states of and associations between signaling proteins by measuring energy transfer between fluorophores attached to specific proteins. Förster resonance energy transfer (FRET) and fluorescence lifetime imaging microscopy (FLIM) assays are suitable for use in cell line models of cancer, fresh human tissues and formalin-fixed paraffin-embedded tissue (FFPE). In animal models, dynamic deep tissue FLIM/FRET imaging of cancer cells in vivo is now also feasible. Analysis of protein expression and post-translational modifications such as phosphorylation and ubiquitination can be performed in cell lines and are remarkably efficiently in cancer tissue samples using tissue microarrays (TMAs). FRET assays can be performed to quantify protein-protein interactions within FFPE tissue, far beyond the spatial resolution conventionally associated with light or confocal laser microscopy. Multivariate optical parameters can be correlated with disease relapse for individual patients. FRET-FLIM assays allow rapid screening of target modifiers using high content drug screens. Specific protein-protein interactions conferring a poor prognosis identified by high content tissue screening will be perturbed with targeted therapeutics. Future targeted drugs will be identified using high content/throughput drug screens that are based on multivariate proteomic assays. Response to therapy at a molecular level can be monitored using these assays while the patient receives treatment: utilizing re-biopsy tumor tissue samples in the neoadjuvant setting or by examining surrogate tissues. These technologies will prove to be both prognostic of risk for individuals when applied to tumor tissue at first diagnosis and predictive of response to specifically selected targeted anticancer drugs. Advanced optical assays have great potential to be translated into real-life benefit for cancer patients