Modeling Brain Circuitry over a Wide Range of Scales

If we are ever to unravel the mysteries of brain function at its most fundamental level, we will need a precise understanding of how its component neurons connect to each other. Electron Microscopes (EM) can now provide the nanometer resolution that is needed to image synapses, and therefore connections, while Light Microscopes (LM) see at the micrometer resolution required to model the 3D structure of the dendritic network. Since both the topology and the connection strength are integral parts of the brain's wiring diagram, being able to combine these two modalities is critically important. In fact, these microscopes now routinely produce high-resolution imagery in such large quantities that the bottleneck becomes automated processing and interpretation, which is needed for such data to be exploited to its full potential. In this paper, we briefly review the Computer Vision techniques we have developed at EPFL to address this need. They include delineating dendritic arbors from LM imagery, segmenting organelles from EM, and combining the two into a consistent representation

Segmentation des structures vasculaires en imagerie TDM par filtrage localement connexe

International audienceLa segmentation vasculaire est souvent une étape essentielle lors de l’analyse d’images médicales, et ce pour de diverses modalités d’imagerie. Malgré la grande richesse de la littérature dans le domaine, les méthodes proposées requièrent pour la plupart une adaptation selon le problème posé et sont, parfois, en deçà de l’exactitude souhaitée en termes de sensibilité et spécificité . Cet article propose une méthode générale de segmentation vasculaire, basée sur du filtrage localement connexe (FLC) multirésolution. L’approche de filtrage opère une détection et une suppression progressive des vaisseaux à partir du relief de l’image et ce à chaque niveau de résolution en combinant des filtres directionnels 2D - 3D. Le résultat de l’approche proposée est démontré sur différentes modalités d’images en imagerie pulmonaire, hépatique et coronair

Automatic liver vessel segmentation using 3D region growing and hybrid active contour model

This paper proposes a new automatic method for liver vessel segmentation by exploiting intensity and shape constraints of 3D vessels. The core of the proposed method is to apply two different strategies: 3D region growing facilitated by bi-Gaussian filter for thin vessel segmentation, and hybrid active contour model combined with K-means clustering for thick vessel segmentation. They are then integrated to generate final segmentation results. The proposed method is validated on abdominal computed tomography angiography (CTA) images, and obtains an average accuracy, sensitivity, specificity, Dice, Jaccard, and RMSD of 98.2%, 68.3%, 99.2%, 73.0%, 66.1%, and 2.56 mm, respectively. Experimental results show that our method is capable of segmenting complex liver vessels with more continuous and complete thin vessel details, and outperforms several existing 3D vessel segmentation algorithms

Steerable3D: An ImageJ plugin for neurovascular enhancement in 3-D segmentation

PurposeImage processing plays a fundamental role in the study of central nervous system, for example in the analysis of the vascular network in neurodegenerative diseases. Synchrotron X-ray Phase-contrast micro-Tomography (SXPCT) is a very attractive method to study weakly absorbing samples and features, such as the vascular network in the spinal cord (SC). However, the identification and segmentation of vascular structures in SXPCT images is seriously hampered by the presence of image noise and strong contrast inhomogeneities, due to the sensitivity of the technique to small electronic density variations. In order to help with these tasks, we implemented a user-friendly ImageJ plugin based on a 3D Gaussian steerable filter, tuned up for the enhancement of tubular structures in SXPCT images.MethodsThe developed 3D Gaussian steerable filter plugin for ImageJ is based on the steerability properties of Gaussian derivatives. We applied it to SXPCT images of ex-vivo mouse SCs acquired at different experimental conditions.ResultsThe filter response shows a strong amplification of the source image contrast-to-background ratio (CBR), independently of structures orientation. We found that after the filter application, the CBR ratio increases by a factor ranging from ~6 to ~60. In addition, we also observed an increase of 35% of the contrast to noise ratio in the case of injured mouse SC.ConclusionThe developed tool can generally facilitate the detection/segmentation of capillaries, veins and arteries that were not clearly observable in non-filtered SXPCT images. Its systematic application could allow obtaining quantitative information from pre-clinical and clinical images

Multiscale Centerline Detection

Finding the centerline and estimating the radius of linear structures is a critical first step in many applications, ranging from road delineation in 2D aerial images to modeling blood vessels, lung bronchi, and dendritic arbors in 3D biomedical image stacks. Existing techniques rely either on filters designed to respond to ideal cylindrical structures or on classification techniques. The former tend to become unreliable when the linear structures are very irregular while the latter often has difficulties distinguishing centerline locations from neighboring ones, thus losing accuracy. We solve this problem by reformulating centerline detection in terms of a \emph{regression} problem. We first train regressors to return the distances to the closest centerline in scale-space, and we apply them to the input images or volumes. The centerlines and the corresponding scale then correspond to the regressors local maxima, which can be easily identified. We show that our method outperforms state-of-the-art techniques for various 2D and 3D datasets. Moreover, our approach is very generic and also performs well on contour detection. We show an improvement above recent contour detection algorithms on the BSDS500 dataset

Multiscale Bi-Gaussian Filter for Adjacent Curvilinear Structures Detection With Application to Vasculature Images

Cardiovascular Aspects of Radiolog

Enhanced Augmented Reality Framework for Sports Entertainment Applications

Augmented Reality (AR) superimposes virtual information on real-world data, such as displaying useful information on videos/images of a scene. This dissertation presents an Enhanced AR (EAR) framework for displaying useful information on images of a sports game. The challenge in such applications is robust object detection and recognition. This is even more challenging when there is strong sunlight. We address the phenomenon where a captured image is degraded by strong sunlight. The developed framework consists of an image enhancement technique to improve the accuracy of subsequent player and face detection. The image enhancement is followed by player detection, face detection, recognition of players, and display of personal information of players. First, an algorithm based on Multi-Scale Retinex (MSR) is proposed for image enhancement. For the tasks of player and face detection, we use adaptive boosting algorithm with Haar-like features for both feature selection and classification. The player face recognition algorithm uses adaptive boosting with the LDA for feature selection and nearest neighbor classifier for classification. The framework can be deployed in any sports where a viewer captures images. Display of players-specific information enhances the end-user experience. Detailed experiments are performed on 2096 diverse images captured using a digital camera and smartphone. The images contain players in different poses, expressions, and illuminations. Player face recognition module requires players faces to be frontal or up to ?350 of pose variation. The work demonstrates the great potential of computer vision based approaches for future development of AR applications.COMSATS Institute of Information Technolog

Tree Topology Estimation

<p>Tree-like structures are fundamental in nature. A wide variety of two-dimensional imaging techniques allow us to image trees. However, an image of a tree typically includes spurious branch crossings and the original relationships of ancestry among edges may be lost. We present a methodology for estimating the most likely topology of a rooted, directed, three-dimensional tree given a single two-dimensional image of it. We regularize this inverse problem via a prior parametric tree-growth model that realistically captures the morphology of a wide variety of trees. We show that the problem of estimating the optimal tree has linear complexity if ancestry is known, but is NP-hard if it is lost. For the latter case, we present both a greedy approximation algorithm and a heuristic search algorithm that effectively explore the space of possible trees. Experimental results on retinal vessel, plant root, and synthetic tree datasets show that our methodology is both accurate and efficient.</p>Dissertatio

Multiscale Centerline Extraction Based on Regression and Projection onto the Set of Elongated Structures

Automatically extracting linear structures from images is a fundamental low-level vision problem with numerous applications in different domains. Centerline detection and radial estimation are the first crucial steps in most Computer Vision pipelines aiming to reconstruct linear structures. Existing techniques rely either on hand-crafted filters, designed to respond to ideal profiles of the linear structure, or on classification-based approaches, which automatically learn to detect centerline points from data. Hand-crafted methods are the most accurate when the content of the image fulfills the ideal model they rely on. However, they lose accuracy in the presence of noise or when the linear structures are irregular and deviate from the ideal case. Machine learning techniques can alleviate this problem. However, they are mainly based on a classification framework. In this thesis, we show that classification is not the best formalism to solve the centerline detection problem. In fact, since the appearance of a centerline point is very similar to the points immediately next to it, the output of a classifier trained to detect centerlines presents low localization accuracy and double responses on the body of the linear structure. To solve this problem, we propose a regression-based formulation for centerline detection. We rely on the distance transform of the centerlines to automatically learn a function whose local maxima correspond to centerline points. The output of our method can be used to directly estimate the location of the centerline, by a simple Non-Maximum Suppression operation, or it can be used as input to a tracing pipeline to reconstruct the graph of the linear structure. In both cases, our method gives more accurate results than state-of-the-art techniques on challenging 2D and 3D datasets. Our method relies on features extracted by means of convolutional filters. In order to process large amount of data efficiently, we introduce a general filter bank approximation scheme. In particular, we show that a generic filter bank can be approximated by a linear combination of a smaller set of separable filters. Thanks to this method, we can greatly reduce the computation time of the convolutions, without loss of accuracy. Our approach is general, and we demonstrate its effectiveness by applying it to different Computer Vision problems, such as linear structure detection and image classification with Convolutional Neural Networks. We further improve our regression-based method for centerline detection by taking advantage of contextual image information. We adopt a multiscale iterative regression approach to efficiently include a large image context in our algorithm. Compared to previous approaches, we use context both in the spatial domain and in the radial one. In this way, our method is also able to return an accurate estimation of the radii of the linear structures. The idea of using regression can also be beneficial for solving other related Computer Vision problems. For example, we show an improvement compared to previous works when applying it to boundary and membrane detection. Finally, we focus on the particular geometric properties of the linear structures. We observe that most methods for detecting them treat each pixel independently and do not model the strong relation that exists between neighboring pixels. As a consequence, their output is geometrically inconsistent. In this thesis, we address this problem by considering the projection of the score map returned by our regressor onto the set of all geometrically admissible ground truth images. We propose an efficient patch-wise approximation scheme to compute the projection. Moreover, we provide conditions under which the projection is exact. We demonstrate the advantage of our method by applying it to four different problems