CellCognition : time-resolved phenotype annotation in high-throughput live cell imaging

Author Posting. © The Authors, 2010. This is the author's version of the work. It is posted here by permission of Nature Publishing Group for personal use, not for redistribution. The definitive version was published in Nature Methods 7 (2010): 747-754, doi:10.1038/nmeth.1486.Fluorescence time-lapse imaging has become a powerful tool to investigate complex dynamic processes such as cell division or intracellular trafficking. Automated microscopes generate time-resolved imaging data at high throughput, yet tools for quantification of large-scale movie data are largely missing. Here, we present CellCognition, a computational framework to annotate complex cellular dynamics. We developed a machine learning method that combines state-of-the-art classification with hidden Markov modeling for annotation of the progression through morphologically distinct biological states. The incorporation of time information into the annotation scheme was essential to suppress classification noise at state transitions, and confusion between different functional states with similar morphology. We demonstrate generic applicability in a set of different assays and perturbation conditions, including a candidate-based RNAi screen for mitotic exit regulators in human cells. CellCognition is published as open source software, enabling live imaging-based screening with assays that directly score cellular dynamics.Work in the Gerlich laboratory is supported by Swiss National Science Foundation (SNF) research grant 3100A0-114120, SNF ProDoc grant PDFMP3_124904, a European Young Investigator (EURYI) award of the European Science Foundation, an EMBO YIP fellowship, and a MBL Summer Research Fellowship to D.W.G., an ETH TH grant, a grant by the UBS foundation, a Roche Ph.D. fellowship to M.H.A.S, and a Mueller fellowship of the Molecular Life Sciences Ph.D. program Zurich to M.H. M.H. and M.H.A.S are fellows of the Zurich Ph.D. Program in Molecular Life Sciences. B.F. was supported by European Commission’s seventh framework program project Cancer Pathways. Work in the Ellenberg laboratory is supported by a European Commission grant within the Mitocheck consortium (LSHG-CT-2004-503464). Work in the Peter laboratory is supported by the ETHZ, Oncosuisse, SystemsX.ch (LiverX) and the SNF

Detecting cells and analyzing their behaviors in microscopy images using deep neural networks

The computer-aided analysis in the medical imaging field has attracted a lot of attention for the past decade. The goal of computer-vision based medical image analysis is to provide automated tools to relieve the burden of human experts such as radiologists and physicians. More specifically, these computer-aided methods are to help identify, classify and quantify patterns in medical images. Recent advances in machine learning, more specifically, in the way of deep learning, have made a big leap to boost the performance of various medical applications. The fundamental core of these advances is exploiting hierarchical feature representations by various deep learning models, instead of handcrafted features based on domain-specific knowledge. In the work presented in this dissertation, we are particularly interested in exploring the power of deep neural network in the Circulating Tumor Cells detection and mitosis event detection. We will introduce the Convolutional Neural Networks and the designed training methodology for Circulating Tumor Cells detection, a Hierarchical Convolutional Neural Networks model and a Two-Stream Bidirectional Long Short-Term Memory model for mitosis event detection and its stage localization in phase-contrast microscopy images”--Abstract, page iii

Context based mixture model for cell phase identification in automated fluorescence microscopy

BACKGROUND: Automated identification of cell cycle phases of individual live cells in a large population captured via automated fluorescence microscopy technique is important for cancer drug discovery and cell cycle studies. Time-lapse fluorescence microscopy images provide an important method to study the cell cycle process under different conditions of perturbation. Existing methods are limited in dealing with such time-lapse data sets while manual analysis is not feasible. This paper presents statistical data analysis and statistical pattern recognition to perform this task. RESULTS: The data is generated from Hela H2B GFP cells imaged during a 2-day period with images acquired 15 minutes apart using an automated time-lapse fluorescence microscopy. The patterns are described with four kinds of features, including twelve general features, Haralick texture features, Zernike moment features, and wavelet features. To generate a new set of features with more discriminate power, the commonly used feature reduction techniques are used, which include Principle Component Analysis (PCA), Linear Discriminant Analysis (LDA), Maximum Margin Criterion (MMC), Stepwise Discriminate Analysis based Feature Selection (SDAFS), and Genetic Algorithm based Feature Selection (GAFS). Then, we propose a Context Based Mixture Model (CBMM) for dealing with the time-series cell sequence information and compare it to other traditional classifiers: Support Vector Machine (SVM), Neural Network (NN), and K-Nearest Neighbor (KNN). Being a standard practice in machine learning, we systematically compare the performance of a number of common feature reduction techniques and classifiers to select an optimal combination of a feature reduction technique and a classifier. A cellular database containing 100 manually labelled subsequence is built for evaluating the performance of the classifiers. The generalization error is estimated using the cross validation technique. The experimental results show that CBMM outperforms all other classifies in identifying prophase and has the best overall performance. CONCLUSION: The application of feature reduction techniques can improve the prediction accuracy significantly. CBMM can effectively utilize the contextual information and has the best overall performance when combined with any of the previously mentioned feature reduction techniques

Spatiotemporal Identification of Cell Divisions Using Symmetry Properties in Time-Lapse Phase Contrast Microscopy

A variety of biological and pharmaceutical studies, such as for anti-cancer drugs, require the quantification of cell responses over long periods of time. This is performed with time-lapse video microscopy that gives a long sequence of frames. For this purpose, phase contrast imaging is commonly used since it is minimally invasive. The cell responses of interest in this study are the mitotic cell divisions. Their manual measurements are tedious, subjective, and restrictive. This study introduces an automated method for these measurements. The method starts with preprocessing for restoration and reconstruction of the phase contrast time-lapse sequences. The data are first restored from intensity non-uniformities. Subsequently, the circular symmetry of the contour of the mitotic cells in phase contrast images is used by applying a Circle Hough Transform (CHT) to reconstruct the entire cells. The CHT is also enhanced with the ability to “vote” exclusively towards the center of curvature. The CHT image sequence is then registered for misplacements between successive frames. The sequence is subsequently processed to detect cell centroids in individual frames and use them as starting points to form spatiotemporal trajectories of cells along the positive as well as along the negative time directions, that is, anti-causally. The connectivities of different trajectories enhanced by the symmetry of the trajectories of the daughter cells provide as topological by-products the events of cell divisions together with the corresponding entries into mitoses as well as exits from cytokineses. The experiments use several experimental video sequences from three different cell lines with many cells undergoing mitoses and divisions. The quantitative validations of the results of the processing demonstrate the high performance and efficiency of the method

AN EFFECTIVE MITOSIS RECOGNITION AND SEGMENTATION TOOL FOR STEM CELL EXPLORATION

ABSTRACT Stem cells, on regenerative medicine, has enormous potential and impact, lead to the rapidly growing interest for tools to analyze and characterize the behaviors of these cells in-vitro in an automated and high throughput fashion. Measurement of the proliferative behaviors of cells in-vitro is important to many biomedical applications for the measurement of the accurate counting and localization of occurrences of mitosis, or cell division, in a cell culture. In this paper, the performance analysis of clustering for segmenting the mitosis detection is proposed. It is possible to manually identify incidents of mitosis because mitotic cells in culture tend to exhibit intensified surrounding halos under phase contrast illumination. This halo artifact is eliminated by using Diffusion corona filter. Using this method of segmentation precision of 97.1% is obtained which is 1.3% higher when compared with the semi Markov process of segmentation