Automated Segmentation of HeLa Nuclear Envelope from Electron Microscopy Images

This paper describes an image-processing pipeline for the automatic segmentation of the nuclear envelope of HeLcells observed through Electron Microscopy. The pipeline was applied to a 3D stack of 300 images. The intermediate results of neighbouring slices are further combined to improve the final results. Comparison with a handsegmented ground truth reported Jaccard similarity values between 94-98% on the central slices with a decrease towards the edges of the cell where the structure was considerably more complex. The processing is unsupervised and each 2D slice is processed in about 5-10 seconds running on a MacBook Pro. No systematic attempt to make the code faster was made. These encouraging results could be further used to provide data for more complex segmentation techniques like Deep Learning, which require a considerable amount of data to train architectures like Convolutional Neural Networks. The code is freely available from https://github.com/reyesaldasoro/HeLa-Cell-Segmentatio

Segmentation and Modelling of the Nuclear Envelope of HeLa Cells Imaged with Serial Block Face Scanning Electron Microscopy

This paper describes an unsupervised algorithm, which segments the nuclear envelope of HeLa cells imaged by Serial Block Face Scanning Electron Microscopy. The algorithm exploits the variations of pixel intensity in different cellular regions by calculating edges, which are then used to generate superpixels. The superpixels are morphologically processed and those that correspond to the nuclear region are selected through the analysis of size, position, and correspondence with regions detected in neighbouring slices. The nuclear envelope is segmented from the nuclear region. The three-dimensional segmented nuclear envelope is then modelled against a spheroid to create a two-dimensional (2D) surface. The 2D surface summarises the complex 3D shape of the nuclear envelope and allows the extraction of metrics that may be relevant to characterise the nature of cells. The algorithm was developed and validated on a single cell and tested in six separate cells, each with 300 slices of 2000 × 2000 pixels. Ground truth was available for two of these cells, i.e., 600 hand-segmented slices. The accuracy of the algorithm was evaluated with two similarity metrics: Jaccard Similarity Index and Mean Hausdorff distance. Jaccard values of the first/second segmentation were 93%/90% for the whole cell, and 98%/94% between slices 75 and 225, as the central slices of the nucleus are more regular than those on the extremes. Mean Hausdorff distances were 9/17 pixels for the whole cells and 4/13 pixels for central slices. One slice was processed in approximately 8 s and a whole cell in 40 min. The algorithm outperformed active contours in both accuracy and time

Segmentation and modelling of hela nuclear envelope

This paper describes an algorithm to segment the 3D nuclear envelope of HeLa cancer cells from electron microscopy images and model the volumetric shape of the nuclear envelope against an ellipsoid. The algorithm was trained on a single cell and then tested in six separate cells. To assess the algorithm, Jaccard similarity index and Hausdorff distance against a manually-delineated gold standard were calculated on two cells. The mean Jaccard value and Hausdorff distance that the segmentation achieved for central slices were 98% and 4 pixels for the first cell and 94% and 13 pixels for the second cell and outperformed segmentation with active contours. The modelling projects a 3D to a 2D surface that summarises the complexity of the shape in an intuitive result. Measurements extracted from the modelled surface may be useful to correlate shape with biological characteristics. The algorithm is unsupervised, fully automatic, fast and processes one image in less than 10 seconds. Code and data are freely available at https://github.com/reyesaldasoro/Hela-Cell-Segmentation and http://dx.doi.org/10.6019/EMPIAR-10094

Semantic segmentation of HeLa cells: An objective comparison between one traditional algorithm and four deep-learning architectures

The quantitative study of cell morphology is of great importance as the structure and condition of cells and their structures can be related to conditions of health or disease. The first step towards that, is the accurate segmentation of cell structures. In this work, we compare five approaches, one traditional and four deep-learning, for the semantic segmentation of the nuclear envelope of cervical cancer cells commonly known as HeLa cells. Images of a HeLa cancer cell were semantically segmented with one traditional image-processing algorithm and four three deep learning architectures: VGG16, ResNet18, Inception-ResNet-v2, and U-Net. Three hundred slices, each 2000 × 2000 pixels, of a HeLa Cell were acquired with Serial Block Face Scanning Electron Microscopy. The first three deep learning architectures were pre-trained with ImageNet and then fine-tuned with transfer learning. The U-Net architecture was trained from scratch with 36, 000 training images and labels of size 128 × 128. The image-processing algorithm followed a pipeline of several traditional steps like edge detection, dilation and morphological operators. The algorithms were compared by measuring pixel-based segmentation accuracy and Jaccard index against a labelled ground truth. The results indicated a superior performance of the traditional algorithm (Accuracy = 99%, Jaccard = 93%) over the deep learning architectures: VGG16 (93%, 90%), ResNet18 (94%, 88%), Inception-ResNet-v2 (94%, 89%), and U-Net (92%, 56%)

Geometric differences between nuclear envelopes of Wild-type and Chlamydia trachomatis-infected HeLa cells

In this work, the geometrical characteristics of two different types of cells observed with Electron Microscopy were analysed. The nuclear envelope of Wild-type HeLa cells and Chlamydia trachomatis-infected HeLa cells were automatically segmented and then modelled against a spheroid and converted to a two-dimensional surface. Geometric measurements from this surface and the volumetric nuclear envelope were extracted to compare the two types of cells. The measurements included the nuclear volume, the sphericity of the nucleus, its flatness or spikiness. In total 13 different cells were segmented: 7 Wild-type and 6 Chlamydia trachomatis-infected. The cells were statistically different in the following measurements. Wild-type HeLa cells have greater volumes than that of Chlamydia trachomatis-infected HeLa cells and they are more spherical as Jaccard index suggests. Standard deviation (σ), and range of values for the nuclear envelope, which shows the distance of the highest peaks and deepest valleys from the spheroid, were also extracted from the modelling against a spheroid and these metrics were used to compare two different data sets in order to draw conclusions

Automated Correlative Light and Electron Microscopy using FIB-SEM as a tool to screen for ultrastructural phenotypes

In Correlative Light and Electron Microscopy (CLEM), two imaging modalities are combined to take advantage of the localization capabilities of light microscopy (LM) to guide the capture of high-resolution details in the electron microscope (EM). However, traditional approaches have proven to be very laborious, thus yielding a too low throughput for quantitative or exploratory studies of populations. Recently, in the electron microscopy field, FIB-SEM (Focused Ion Beam -Scanning Electron Microscope) tomography has emerged as a flexible method that enables semi-automated 3D volume acquisitions. During my thesis, I developed CLEMSite, a tool that takes advantage of the semi-automation and scanning capabilities of the FIB-SEM to automatically acquire volumes of adherent cultured cells. CLEMSite is a combination of computer vision and machine learning applications with a library for controlling the microscope ( product from a collaboration with Carl Zeiss GmbH and Fibics Inc.). Thanks to this, the microscope was able to automatically track, find and acquire cell regions previously identified in the light microscope. More specifically, two main modules were implemented. First, a correlation module was designed to detect and record reference points from a grid pattern present on the culture substrate in both modalities (LM and EM). Second, I designed a module that retrieves the regions of interest in the FIB-SEM and that drives the acquisition of image stacks between different targets in an unattended fashion. The automated CLEM approach is demonstrated on a project where 3D EM volumes are examined upon multiple siRNA treatments for knocking down genes involved in the morphogenesis of the Golgi apparatus. Additionally, the power of CLEM approaches using FIB-SEM is demonstrated with the detailed structural analysis of two events: the breakage of the nuclear envelope within constricted cells and an intriguing catastrophic DNA Damage Response in binucleated cells. Our results demonstrate that executing high throughput volume acquisition in electron microscopy is possible and that EM can provide incredible insights to guide new biological discoveries

Pathogen-host reorganization during Chlamydia invasion revealed by cryo-electron tomography

Invasion of host cells is a key early event during bacterial infection, but the underlying pathogen-host interactions are yet to be fully visualised in three-dimensional detail. We have captured snapshots of the early stages of bacterial-mediated endocytosis in situ by exploiting the small size of chlamydial elementary bodies (EBs) for whole cell cryo-electron tomography. Chlamydiae are obligate intracellular bacteria that infect eukaryotic cells and cause sexually transmitted infections and trachoma, the leading cause of preventable blindness. We demonstrate that Chlamydia trachomatis LGV2 EBs are intrinsically polarised. One pole is characterised by a tubular inner membrane invagination, while the other exhibits asymmetric periplasmic expansion to accommodate an array of type III secretion systems (T3SSs). Strikingly, EBs orient with their T3SS-containing pole facing target cells, enabling the T3SSs to directly contact the cellular plasma membrane. This contact induces enveloping macropinosomes, actin-rich filopodia and phagocytic cups to zipper tightly around the internalising bacteria. Once encapsulated into tight early vacuoles, EB polarity and the T3SSs are lost. Our findings reveal previously undescribed structural transitions in both pathogen and host during the initial steps of chlamydial invasion

Formation of the postmitotic nuclear envelope from extended ER cisternae precedes nuclear pore assembly

During mitosis, the nuclear envelope merges with the endoplasmic reticulum (ER), and nuclear pore complexes are disassembled. In a current model for reassembly after mitosis, the nuclear envelope forms by a reshaping of ER tubules. For the assembly of pores, two major models have been proposed. In the insertion model, nuclear pore complexes are embedded in the nuclear envelope after their formation. In the prepore model, nucleoporins assemble on the chromatin as an intermediate nuclear pore complex before nuclear envelope formation. Using live-cell imaging and electron microscope tomography, we find that the mitotic assembly of the nuclear envelope primarily originates from ER cisternae. Moreover, the nuclear pore complexes assemble only on the already formed nuclear envelope. Indeed, all the chromatin-associated Nup 107–160 complexes are in single units instead of assembled prepores. We therefore propose that the postmitotic nuclear envelope assembles directly from ER cisternae followed by membrane-dependent insertion of nuclear pore complexes

Volumetric analysis of HeLa cancer cells imaged with serial block face scanning electron microscopy

This dissertation investigates the volumetric analysis of a variety of cervical cancer cells called HeLa cells. HeLa cells were derived from cervical cancer cells taken from Henrietta Lacks at the Johns Hopkins Hospital and hence the name HeLa remains. The shape of cells is important as the regular or irregular shape of the cell and its structures can be related to some conditions of health or disease. In this dissertation, a traditional image processing algorithm to segment the nuclear envelope of HeLa cells imaged with Serial Block Face Scanning Electron Microscopy is proposed. The algorithm is fast, robust and accurate and it was compared against different deep learning architectures. Three deep learning architectures were deployed through transfer learning and U-Net was trained from scratch for semantic segmentation of HeLa cells. The algorithm outperformed all four deep learning architectures and active contours (snakes) in both accuracy and time as suggested by the similarity metrics. The segmented nuclear envelope was further investigated through a visualisation technique to obtain a graphical model. This model provides volume and surface metrics which can be used to compare different cells. Wild-type of HeLa cells were compared against Chlamydia trachomatis-infected HeLa cells and geometric differences were revealed. The open-source image processing algorithm, developed in programming environment of Matlab® (The MathworksTM, Natick, USA), provides cell segmentation in a fraction of manual segmentation time therefore it is an alternative to expensive commercial software and manual segmentation, which is still widely used despite the significant disadvantages of time and inter- and intra-user variability

Volumetric Semantic Instance Segmentation of the Plasma Membrane of HeLa Cells

In this work, an unsupervised volumetric semantic instance segmentation of the plasma membrane of HeLa cells as observed with serial block face scanning electron microscopy is described. The resin background of the images was segmented at different slices of a 3D stack of 518 slices with 8192 × 8192 pixels each. The background was used to create a distance map, which helped identify and rank the cells by their size at each slice. The centroids of the cells detected at different slices were linked to identify them as a single cell that spanned a number of slices. A subset of these cells, i.e., the largest ones and those not close to the edges were selected for further processing. The selected cells were then automatically cropped to smaller regions of interest of 2000 × 2000 × 300 voxels that were treated as cell instances. Then, for each of these volumes, the nucleus was segmented, and the cell was separated from any neighbouring cells through a series of traditional image processing steps that followed the plasma membrane. The segmentation process was repeated for all the regions of interest previously selected. For one cell for which the ground truth was available, the algorithm provided excellent results in Accuracy (AC) and the Jaccard similarity Index (JI): nucleus: JI =0.9665, AC =0.9975, cell including nucleus JI =0.8711, AC =0.9655, cell excluding nucleus JI =0.8094, AC =0.9629. A limitation of the algorithm for the plasma membrane segmentation was the presence of background. In samples with tightly packed cells, this may not be available. When tested for these conditions, the segmentation of the nuclear envelope was still possible. All the code and data were released openly through GitHub, Zenodo and EMPIAR