Detecting cells and analyzing their behaviors in microscopy images using deep neural networks

The computer-aided analysis in the medical imaging field has attracted a lot of attention for the past decade. The goal of computer-vision based medical image analysis is to provide automated tools to relieve the burden of human experts such as radiologists and physicians. More specifically, these computer-aided methods are to help identify, classify and quantify patterns in medical images. Recent advances in machine learning, more specifically, in the way of deep learning, have made a big leap to boost the performance of various medical applications. The fundamental core of these advances is exploiting hierarchical feature representations by various deep learning models, instead of handcrafted features based on domain-specific knowledge. In the work presented in this dissertation, we are particularly interested in exploring the power of deep neural network in the Circulating Tumor Cells detection and mitosis event detection. We will introduce the Convolutional Neural Networks and the designed training methodology for Circulating Tumor Cells detection, a Hierarchical Convolutional Neural Networks model and a Two-Stream Bidirectional Long Short-Term Memory model for mitosis event detection and its stage localization in phase-contrast microscopy images”--Abstract, page iii

Ethyl methanesulfonate mutant library construction in Neopyropia yezoensis to provide germplasm resources for next-generation genome-selection breeding

With the development of the laver industry, germplasm depression has become a serious issue, and current cultivars cannot adapt to different aquaculture regions. In order to increasing the genetic diversity and developing more germplasm sources, it is urgent and reasonable to construct a mutant library with more new germplasms. In this research, a mutant library was constructed by ethyl methanesulfonate (EMS)-mutagenized archeospores, and the most optimal treatment procedure was determined by performing different mutagen concentrations (2.25%) and treatment times (30 min). A total of 1860 haploid thalli were produced as the M1 mutant population and further cultured into conchocelis clones for the reservation of germplasm resources. Among these, 667 individual thalli were evaluated for their phenotypic traits, including thallus length, thallus width, length/width, thallus shape, photosynthesis ability, thallus color, thallus margin, and specific growth speed. The mutation frequency of the length/width ratio was 17.39%, Fv/Fm and NPQ were 21.84% and 29.35%, respectively, and SGR was 13.59%. The mutation frequency of thallus color was 0.91%. This work may not only provide a basic practical reference guide for EMS-based mutant library construction for other seaweeds but, more importantly, also serve as a valuable resource for functional genomics research and laver breeding

A Hierarchical Convolutional Neural Network for Mitosis Detection in Phase-Contrast Microscopy Images

We propose a Hierarchical Convolution Neural Network (HCNN) for mitosis event detection in time-lapse phase contrast microscopy. Our method contains two stages: first,we extract candidate spatial-temporal patch sequences in the input image sequences which potentially contain mitosis events. Then,we identify if each patch sequence contains mitosis event or not using a hieratical convolutional neural network. In the experiments,we validate the design of our proposed architecture and evaluate the mitosis event detection performance. Our method achieves 99.1% precision and 97.2% recall in very challenging image sequences of multipolar-shaped C3H10T1/2 mesenchymal stem cells and outperforms other state-of-the-art methods. Furthermore,the proposed method does not depend on hand-crafted feature design or cell tracking. It can be straightforwardly adapted to event detection of other different cell types

Training a Scene-Specific Pedestrian Detector using Tracklets

A generic pedestrian detector trained from generic datasets cannot solve all the varieties in different scenarios, thus its performance may not be as good as a scene-specific detector. In this paper, we propose a new approach to automatically train scene-specific pedestrian detectors based on track lets (chains of tracked samples). First, a generic pedestrian detector is applied on the specific scene, which also generates many false positives and miss detections, second, we consider multi-pedestrian tracking as a data association problem and link detected samples into track lets, third, track let features are extracted to label track lets into positive, negative and uncertain ones, and uncertain track lets are further labeled by comparing them with the positive and negative pools. By using track lets, we extract more reliable features than individual samples, and those informative uncertain samples around the classification boundaries are well labeled by label propagation within individual track lets and among different track lets. The labeled samples in the specific scene are combined with generic datasets to train scene-specific detectors. We test the proposed approach on three datasets. Our approach outperforms the state-of-the-art scene-specific detector and shows the effectiveness to adapt to specific scenes without human annotations

Cell Mitosis Event Analysis in Phase Contrast Microscopy Images using Deep Learning

In this paper, we solve the problem of mitosis event localization and its stage localization in time-lapse phase-contrast microscopy images. Our method contains three steps: first, we formulate a Low-Rank Matrix Recovery (LRMR) model to find salient regions from microscopy images and extract candidate patch sequences, which potentially contain mitosis events; second, we classify each candidate patch sequence by our proposed Hierarchical Convolution Neural Network (HCNN) with visual appearance and motion cues; third, for the detected mitosis sequences, we further segment them into four temporal stages by our proposed Two-stream Bidirectional Long-Short Term Memory (TS-BLSTM). In the experiments, we validate our system (LRMR, HCNN, and TS-BLSTM) and evaluate the mitosis event localization and stage localization performance. The proposed method outperforms state-of-the-arts by achieving 99.2% precision and 98.0% recall for mitosis event localization and 0.62 frame error on average for mitosis stage localization in five challenging image sequences