Automated Neuron Reconstruction from 3D Fluorescence Microscopy Images Using Sequential Monte Carlo Estimation

Microscopic images of neuronal cells provide essential structural information about the key constituents of the brain and form the basis of many neuroscientific studies. Computational analyses of the morphological properties of the captured neurons require first converting the structural information into digital tree-like reconstructions. Many dedicated computational methods and corresponding software tools have been and are continuously being developed with the aim to automate this step while achieving human-comparable reconstruction accuracy. This pursuit is hampered by the immense diversity and intricacy of neuronal morphologies as well as the often low quality and ambiguity of the images. Here we present a novel method we developed in an effort to improve the robustness of digital reconstruction against these complicating factors. The method is based on probabilistic filtering by sequential Monte Carlo estimation and uses prediction and update models designed specifically for tracing neuronal branches in microscopic image stacks. Moreover, it uses multiple probabilistic traces to arrive at a more robust, ensemble reconstruction. The proposed method was evaluated on fluorescence microscopy image stacks of single neurons and dense neuronal networks with expert manual annotations serving as the gold standard, as well as on synthetic images with known ground truth. The results indicate that our method performs well under varying experimental conditions and compares favorably to state-of-the-art alternative methods

Methods for Automated Neuron Image Analysis

Knowledge of neuronal cell morphology is essential for performing specialized analyses in the endeavor to understand neuron behavior and unravel the underlying principles of brain function. Neurons can be captured with a high level of detail using modern microscopes, but many neuroscientific studies require a more explicit and accessible representation than offered by the resulting images, underscoring the need for digital reconstruction of neuronal morphology from the images into a tree-like graph structure. This thesis proposes new computational methods for automated detection and reconstruction of neurons from fluorescence microscopy images. Specifically, the successive chapters describe and evaluate original solutions to problems such as the detection of landmarks (critical points) of the neuronal tree, complete tracing and reconstruction of the tree, and the detection of regions containing neurons in high-content screens

Modern Statistical/Machine Learning Techniques for Bio/Neuro-imaging Applications

Developments in modern bio-imaging techniques have allowed the routine collection of a vast amount of data from various techniques. The challenges lie in how to build accurate and efficient models to draw conclusions from the data and facilitate scientific discoveries. Fortunately, recent advances in statistics, machine learning, and deep learning provide valuable tools. This thesis describes some of our efforts to build scalable Bayesian models for four bio-imaging applications: (1) Stochastic Optical Reconstruction Microscopy (STORM) Imaging, (2) particle tracking, (3) voltage smoothing, (4) detect color-labeled neurons in c elegans and assign identity to the detections

Motion Analysis of Live Objects by Super-Resolution Fluorescence Microscopy

Motion analysis plays an important role in studing activities or behaviors of live objects in medicine, biotechnology, chemistry, physics, spectroscopy, nanotechnology, enzymology, and biological engineering. This paper briefly reviews the developments in this area mostly in the recent three years, especially for cellular analysis in fluorescence microscopy. The topic has received much attention with the increasing demands in biomedical applications. The tasks of motion analysis include detection and tracking of objects, as well as analysis of motion behavior, living activity, events, motion statistics, and so forth. In the last decades, hundreds of papers have been published in this research topic. They cover a wide area, such as investigation of cell, cancer, virus, sperm, microbe, karyogram, and so forth. These contributions are summarized in this review. Developed methods and practical examples are also introduced. The review is useful to people in the related field for easy referral of the state of the art

Modelo de arborización dendrítica basado en reconstrucciones de motoneuronas frénicas en ratas adultas

El área superficial de las dendritas en motoneuronas frénicas (PhrMNs) ha sido estimada anteriormente mediante técnicas estereológicas basadas en suposiciones geométricas, y medida en tres dimensiones (3D) utilizando microscopía confocal. Dado que el 97% del área receptora de una motoneurona corresponde a sus dendritas, la ramificación y extensión dendrítica son fisiológicamente importantes para determinar la salida de sus campos receptivos. Sin embargo, limitaciones inherentes a las estimaciones basadas en morfología neuronal y la tinción incompleta de los árboles dendríticos mediante técnicas retrógradas han dificultado los estudios sistemáticos de la morfología dendrítica en PhrMNs. En este estudio, se utilizó una nueva técnica que mejora la tinción dendrítica de las PhrMNs en preparaciones fijadas ligeramente. La reconstrucción dendrítica en 3D se logró con gran precisión utilizando microscopía confocal en PhrMNs de ratas adultas. Luego de una etapa de pre-procesamiento, la segmentación de los árboles dendríticos se realizó semi-automáticamente en 3D y usando mediciones directas del área superficial, se derivó un modelo cuadrático para estimar dicha área partiendo del diámetro de la dendrita primaria (r2 = 0.932; p<0.0001). Este método podría mejorar la evaluación de la plasticidad neuronal en respuesta a trauma u otras enfermedades permitiendo la estimación de la arborización dendrítica en PhrMNs, ya que el diámetro de la dendrita primaria puede obtenerse confiablemente de numerosas técnicas de tinción retrógrada.Stereological techniques that rely on morphological assumptions and direct three-dimensional (3D) confocal measurements have been previously used to estimate the dendritic surface areas of phrenic motoneurons (PhrMNs). Given that 97% of a motoneuron’s receptive area is provided by dendrites, dendritic branching and overall extension are physiologically important in determining the output of their synaptic receptive fields. However, limitations intrinsic to shape-based estimations and incomplete labeling of dendritic trees by retrograde techniques have hindered systematic approaches to examine dendritic morphology of PhrMNs. In this study, a novel method that improves dendritic filling of PhrMNs in lightly-fixed samples was used. Confocal microscopy allowed accurate 3D reconstruction of dendritic arbors from adult rat PhrMNs. Following pre-processing, segmentation was semi-automatically performed in 3D, and direct measurements of dendritic surface area were obtained. A quadratic model for estimating dendritic tree surface area based on measurements of primary dendrite diameter was derived (r2 = 0.932; p<0.0001). This method may enhance interpretation of motoneuron plasticity in response to injury or disease by permitting estimations of dendritic arborization of PhrMNs since measurements of primary dendrite diameter can be reliably obtained from a number of retrograde labeling techniques

AUTOMATED ANALYSIS OF NEURONAL MORPHOLOGY: DETECTION, MODELING AND RECONSTRUCTION

Ph.DDOCTOR OF PHILOSOPH

Mapping the spatiotemporal dynamics of calcium signaling in cellular neural networks using optical flow

An optical flow gradient algorithm was applied to spontaneously forming net- works of neurons and glia in culture imaged by fluorescence optical microscopy in order to map functional calcium signaling with single pixel resolution. Optical flow estimates the direction and speed of motion of objects in an image between subsequent frames in a recorded digital sequence of images (i.e. a movie). Computed vector field outputs by the algorithm were able to track the spatiotemporal dynamics of calcium signaling pat- terns. We begin by briefly reviewing the mathematics of the optical flow algorithm, and then describe how to solve for the displacement vectors and how to measure their reliability. We then compare computed flow vectors with manually estimated vectors for the progression of a calcium signal recorded from representative astrocyte cultures. Finally, we applied the algorithm to preparations of primary astrocytes and hippocampal neurons and to the rMC-1 Muller glial cell line in order to illustrate the capability of the algorithm for capturing different types of spatiotemporal calcium activity. We discuss the imaging requirements, parameter selection and threshold selection for reliable measurements, and offer perspectives on uses of the vector data.Comment: 23 pages, 5 figures. Peer reviewed accepted version in press in Annals of Biomedical Engineerin

Deep Tissue Light Delivery and Fluorescence Tomography with Applications in Optogenetic Neurostimulation

Study of the brain microcircuits using optogenetics is an active area of research. This method has a few advantages over the conventional electrical stimulation including the bi-directional control of neural activity, and more importantly, specificity in neuromodulation. The first step in all optogenetic experiments is to express certain light sensitive ion channels/pumps in the target cell population and then confirm the proper expression of these proteins before running any experiment. Fluorescent bio-markers, such as green fluorescent protein (GFP), have been used for this purpose and co-expressed in the same cell population. The fluorescent signal from such proteins provides a monitory mechanism to evaluate the expression of optogenetic opsins over time. The conventional method to confirm the success in gene delivery is to sacrifice the animal, retract and slice the brain tissue, and image the corresponding slices using a fluorescent microscope. Obviously, determining the level of expression over time without sacrificing the animal is highly desirable. Also, optogenetics can be combined with cell-type specific optical recording of neural activity for example by imaging the fluorescent signal of genetically encoded calcium indicators. One challenging step in any optogenetic experiment is delivering adequate amount of light to target areas for proper stimulation of light sensitive proteins. Delivering sufficient light density to a target area while minimizing the off-target stimulation requires a precise estimation of the light distribution in the tissue. Having a good estimation of the tissue optical properties is necessary for predicting the distribution of light in any turbid medium. The first objective of this project was the design and development of a high resolution optoelectronic device to extract optical properties of rats\u27 brain tissue (including the absorption coefficient, scattering coefficient, and anisotropy factor) for three different wavelengths: 405nm, 532nm and 635nm and three different cuts: transverse, sagittal, and coronal. The database of the extracted optical properties was linked to a 3D Monte Carlo simulation software to predict the light distribution for different light source configurations. This database was then used in the next phase of the project and in the development of a fluorescent tomography scanner. Based on the importance of the fluorescent imaging in optogenetics, another objective of this project was to design a fluorescence tomography system to confirm the expression of the light sensitive proteins and optically recording neural activity using calcium indicators none or minimally invasively. The method of fluorescence laminar optical tomography (FLOT) has been used successfully in imaging superficial areas up to 2mm deep inside a scattering medium with the spatial resolution of ~200µm. In this project, we developed a FLOT system which was specifically customized for in-vivo brain imaging experiments. While FLOT offers a relatively simple and non-expensive design for imaging superficial areas in the brain, still it has imaging depth limited to 2mm and its resolution drops as the imaging depth increases. To address this shortcoming, we worked on a complementary system based on the digital optical phase conjugation (DOPC) method which was shown previously that is capable of performing fluorescent tomography up to 4mm deep inside a biological tissue with lateral resolution of ~50 µm. This system also provides a non-invasive method to deliver light deep inside the brain tissue for neurostimulation applications which are not feasible using conventional techniques because of the high level of scattering in most tissue samples. In the developed DOPC system, the performance of the system in focusing light through and inside scattering mediums was quantified. We also showed how misalignments and imperfections of the optical components can immensely reduce the capability of a DOPC setup. Then, a systematic calibration algorithm was proposed and experimentally applied to our DOPC system to compensate main aberrations such as reference beam aberrations and also the backplane curvature of the spatial light modulator. In a highly scattering sample, the calibration algorithm achieved up to 8 fold increase in the PBR