Generalizable automated pixel-level structural segmentation of medical and biological data

Over the years, the rapid expansion in imaging techniques and equipments has driven the demand for more automation in handling large medical and biological data sets. A wealth of approaches have been suggested as optimal solutions for their respective imaging types. These solutions span various image resolutions, modalities and contrast (staining) mechanisms. Few approaches generalise well across multiple image types, contrasts or resolution. This thesis proposes an automated pixel-level framework that addresses 2D, 2D+t and 3D structural segmentation in a more generalizable manner, yet has enough adaptability to address a number of specific image modalities, spanning retinal funduscopy, sequential fluorescein angiography and two-photon microscopy. The pixel-level segmentation scheme involves: i ) constructing a phase-invariant orientation field of the local spatial neighbourhood; ii ) combining local feature maps with intensity-based measures in a structural patch context; iii ) using a complex supervised learning process to interpret the combination of all the elements in the patch in order to reach a classification decision. This has the advantage of transferability from retinal blood vessels in 2D to neural structures in 3D. To process the temporal components in non-standard 2D+t retinal angiography sequences, we first introduce a co-registration procedure: at the pairwise level, we combine projective RANSAC with a quadratic homography transformation to map the coordinate systems between any two frames. At the joint level, we construct a hierarchical approach in order for each individual frame to be registered to the global reference intra- and inter- sequence(s). We then take a non-training approach that searches in both the spatial neighbourhood of each pixel and the filter output across varying scales to locate and link microvascular centrelines to (sub-) pixel accuracy. In essence, this \link while extract" piece-wise segmentation approach combines the local phase-invariant orientation field information with additional local phase estimates to obtain a soft classification of the centreline (sub-) pixel locations. Unlike retinal segmentation problems where vasculature is the main focus, 3D neural segmentation requires additional exibility, allowing a variety of structures of anatomical importance yet with different geometric properties to be differentiated both from the background and against other structures. Notably, cellular structures, such as Purkinje cells, neural dendrites and interneurons, all display certain elongation along their medial axes, yet each class has a characteristic shape captured by an orientation field that distinguishes it from other structures. To take this into consideration, we introduce a 5D orientation mapping to capture these orientation properties. This mapping is incorporated into the local feature map description prior to a learning machine. Extensive performance evaluations and validation of each of the techniques presented in this thesis is carried out. For retinal fundus images, we compute Receiver Operating Characteristic (ROC) curves on existing public databases (DRIVE & STARE) to assess and compare our algorithms with other benchmark methods. For 2D+t retinal angiography sequences, we compute the error metrics ("Centreline Error") of our scheme with other benchmark methods. For microscopic cortical data stacks, we present segmentation results on both surrogate data with known ground-truth and experimental rat cerebellar cortex two-photon microscopic tissue stacks.Open Acces

Steerable Filters from Erlang Functions

Scale and orientation steerable 2D filters are constructed using a frame of Erlang functions in the Fourier domain. Erlang forms for the radial frequency characteristic are shown to provide complex quadrature filters which can be steered in a scale parameter, #. Oriented, spatial domain filters are constructed by imposing an appropriate angular selectivity in the frequency domain. A filter bank is designed, and outputs of the filters of the bank are steered to construct an oriented scale-space decomposition of an image subband. Some applications are discussed. 1 Introduction The use of sub-band methods in image analysis is perhaps not as widespread as for coding. Nevertheless, quite successful and powerful analysis algorithms have been demonstrated [1]. One can make good use of sub-band processing when image features exist at several scales, so that operators of different sizes must be employed: a key issue then becomes the design of these operators. This paper, in a manner similar to..

Steerable Filters from Erlang Functions

Scale and orientation steerable 2D filters are constructed using a frame of Erlang functions in the Fourier domain. Erlang forms for the radial frequency characteristic are shown to provide complex quadrature filters which can be steered in a scale parameter, #. Oriented, spatial domain filters are constructed by imposing an appropriate angular selectivity in the frequency domain. A filter bank is designed, and outputs of the filters of the bank are steered to construct an oriented scale-space decomposition of an image subband. Some applications are discussed. 1 Introduction The use of sub-band methods in image analysis is perhaps not as widespread as for coding. Nevertheless, quite successful and powerful analysis algorithms have been demonstrated [1]. One can make good use of sub-band processing when image features exist at several scales, so that operators of different sizes must be employed: a key issue then becomes the design of these operators. This paper, in a manner similar to..