A dynamic-shape-prior guided snake model with application in visually tracking dense cell populations

This paper proposes a dynamic-shape-prior guided snake (DSP G-snake) model that is designed to improve the overall stability of the point-based snake model. The dynamic shape prior is first proposed for snakes, that efficiently unifies different types of high-level priors into a new force term. To be specific, a global-topology regularity is first introduced that settles the inherent self-intersection problem with snakes. The problem that a snake’s snaxels tend to unevenly distribute along the contour is also handled, leading to good parameterization. Unlike existing methods that employ learning templates or commonly enforce hard priors, the dynamic-template scheme strongly respects the deformation flexibility of the model, while retaining a decent global topology for the snake. It is verified by experiments that the proposed algorithm can effectively prevent snakes from selfcrossing, or automatically untie an already self-intersected contour. In addition, the proposed model is combined with existing forces and applied to the very challenging task of tracking dense biological cell populations. The DSP G-snake model has enabled an improvement of up to 30% in tracking accuracy with respect to regular model-based approaches. Through experiments on real cellular datasets, with highly dense populations and relatively large displacements, it is confirmed that the proposed approach has enabled superior performance, in comparison to modern active-contour competitors as well as the state-of-the-art cell tracking frameworks

Multi-scale active shape description in medical imaging

Shape description in medical imaging has become an increasingly important research field in recent years. Fast and high-resolution image acquisition methods like Magnetic Resonance (MR) imaging produce very detailed cross-sectional images of the human body - shape description is then a post-processing operation which abstracts quantitative descriptions of anatomically relevant object shapes. This task is usually performed by clinicians and other experts by first segmenting the shapes of interest, and then making volumetric and other quantitative measurements. High demand on expert time and inter- and intra-observer variability impose a clinical need of automating this process. Furthermore, recent studies in clinical neurology on the correspondence between disease status and degree of shape deformations necessitate the use of more sophisticated, higher-level shape description techniques. In this work a new hierarchical tool for shape description has been developed, combining two recently developed and powerful techniques in image processing: differential invariants in scale-space, and active contour models. This tool enables quantitative and qualitative shape studies at multiple levels of image detail, exploring the extra image scale degree of freedom. Using scale-space continuity, the global object shape can be detected at a coarse level of image detail, and finer shape characteristics can be found at higher levels of detail or scales. New methods for active shape evolution and focusing have been developed for the extraction of shapes at a large set of scales using an active contour model whose energy function is regularized with respect to scale and geometric differential image invariants. The resulting set of shapes is formulated as a multiscale shape stack which is analysed and described for each scale level with a large set of shape descriptors to obtain and analyse shape changes across scales. This shape stack leads naturally to several questions in regard to variable sampling and appropriate levels of detail to investigate an image. The relationship between active contour sampling precision and scale-space is addressed. After a thorough review of modem shape description, multi-scale image processing and active contour model techniques, the novel framework for multi-scale active shape description is presented and tested on synthetic images and medical images. An interesting result is the recovery of the fractal dimension of a known fractal boundary using this framework. Medical applications addressed are grey-matter deformations occurring for patients with epilepsy, spinal cord atrophy for patients with Multiple Sclerosis, and cortical impairment for neonates. Extensions to non-linear scale-spaces, comparisons to binary curve and curvature evolution schemes as well as other hierarchical shape descriptors are discussed

Improving the accuracy of weed species detection for robotic weed control in complex real-time environments

Alex Olsen applied deep learning and machine vision to improve the accuracy of weed species detection in real time complex environments. His robotic weed control prototype, AutoWeed, presents a new efficient tool for weed management in crop and pasture and has launched a startup agricultural technology company

Understanding object motion encoding in the mammalian retina.

Phototransduction, transmission of visual information down the optic nerve incurs delays on the order of 50 – 100ms. This implies that the neuronal representation of a moving object should lag behind the object’s actual position. However, studies have demonstrated that the visual system compensates for neuronal delays using a predictive mechanism called phase advancing, which shifts the population response toward the leading edge of a moving object’s retinal image. To understand how this compensation is achieved in the retina, I investigated cellular and synaptic mechanisms that drive phase advancing. I used three approaches, each testing phase advancing at a different organizational level within the mouse retina. First, I studied phase advancing at the level of ganglion cell populations, using two-photon imaging of visually evoked calcium responses. I found populations of phase advancing OFF-type, ON-type, ON-OFF type, and horizontally tuned directionally selective ganglion cells. Second, I measured synaptic current responses of individual ganglion cells with patch-clamp electrophysiology, and I used a computational model to compare the observed responses to simulated responses based on the ganglion cell’s spatio-temporal receptive fields. Third, I tested whether phase advancing originates presynaptic to ganglion cells, by assessing phase advancing at the level of bipolar cell glutamate release using two-photon imaging of the glutamate biosensor iGluSnFR expressed in the inner plexiform layer. Based on the results of my experiments, I conclude that bipolar and ganglion cell receptive field structure generates phase advanced responses and acts to compensate for neuronal delays within the retina

Change blindness: eradication of gestalt strategies

Arrays of eight, texture-defined rectangles were used as stimuli in a one-shot change blindness (CB) task where there was a 50% chance that one rectangle would change orientation between two successive presentations separated by an interval. CB was eliminated by cueing the target rectangle in the first stimulus, reduced by cueing in the interval and unaffected by cueing in the second presentation. This supports the idea that a representation was formed that persisted through the interval before being 'overwritten' by the second presentation (Landman et al, 2003 Vision Research 43149–164]. Another possibility is that participants used some kind of grouping or Gestalt strategy. To test this we changed the spatial position of the rectangles in the second presentation by shifting them along imaginary spokes (by ±1 degree) emanating from the central fixation point. There was no significant difference seen in performance between this and the standard task [F(1,4)=2.565, p=0.185]. This may suggest two things: (i) Gestalt grouping is not used as a strategy in these tasks, and (ii) it gives further weight to the argument that objects may be stored and retrieved from a pre-attentional store during this task

Non-invasive ultrasound monitoring of regional carotid wall structure and deformation in atherosclerosis

Thesis (Ph. D.)--Harvard--Massachusetts Institute of Technology Division of Health Sciences and Technology, 2001.Includes bibliographical references (p. 223-242).Atherosclerosis is characterized by local remodeling of arterial structure and distensibility. Developing lesions either progress gradually to compromise tissue perfusion or rupture suddenly to cause catastrophic myocardial infarction or stroke. Reliable measurement of changes in arterial structure and composition is required for assessment of disease progression. Non-invasive carotid ultrasound can image the heterogeneity of wall structure and distensibility caused by atherosclerosis. However, this capability has not been utilized for clinical monitoring because of speckle noise and other artifacts. Clinical measures focus instead on average wall thickness and diameter distension in the distal common carotid to reduce sensitivity to noise. The goal of our research was to develop an effective system for reliable regional structure and deformation measurements since these are more sensitive indicators of disease progression. We constructed a system for freehand ultrasound scanning based on custom software which simultaneously acquires real-time image sequences and 3D frame localization data from an electromagnetic spatial localizer. With finite element modeling, we evaluated candidate measures of regional wall deformation.(cont.) Finally, we developed a multi-step scheme for robust estimation of local wall structure and deformation. This new strategy is based on a directionally-sensitive segmentation functional and a motion-region-of-interest constrained optical flow algorithm. We validated this estimator with simulated images and clinical ultrasound data. The results show structure estimates that are accurate and precise, with inter- and intra-observer reproducibility surpassing existing methods. Estimates of wall velocity and deformation likewise show good overall accuracy and precision. We present results from a proof-of-principle evaluation conducted in a pilot study of normal subjects and clinical patients. For one example, we demonstrate the combination of 2D image processing with 3D frame localization for visualization of the carotid volume. With slice localization, estimates of carotid wall structure and deformation can be derived for all axial positions along the carotid artery. The elements developed here provide the tools necessary for reliable quantification of regional wall structure and composition changes which result from atherosclerosis.by Raymond C. Chan.Ph.D

The impact of changes in snow cover on snowshoe hare camouflage

Climate change is regarded as a primary threat to global biodiversity. One avenue in which climate change is influencing survival is through the minimisation of the efficacy of anti-predator defences. Background matching camouflage is an anti-predator defence whereby an organism remains undetectable even when in plain sight. Within seasonal coat colour species, species which undergo a colour changing biannual moult thought to provide anti-predator colouration in their seasonally variable environment, the occurrence of camouflage mismatch is beginning to be recorded. The primary subject of this camouflage mismatch research has been the snowshoe hare (Lepus americanus). However, whilst this mismatch is being observed in nature and is impacting survival rate in snowshoe hares and other seasonal coat colour species, no research as of yet has examined whether these seasonal moults provide background-matching camouflage. In addition, no previous research has examined the impact of camouflage mismatch on detectability from an ecologically relevant visual system, such as the most common mammalian visual system: dichromatism. Within this thesis, both of these gaps in knowledge are explored through computer detection experiments and eye movement analysis in humans. In chapter two, I investigate the impact of predator visual system, camouflage efficacy, background complexity, coat colour, and seasonal background type on the detection rate of snowshoe hares. Participants were displayed 15 randomly generated images of snowshoe hares on a natural landscape and located the snowshoe hares as quickly as possible. Snowshoe hares were detected more rapidly when their camouflage was ineffective, both in colour and brightness. In addition, more complex backgrounds resulted in longer search times. Although visual systems did not differ in overall detection times, simulated dichromatic vision resulted in longer search times for brightness camouflaged snowshoe hares. Within chapter three, I build upon the findings of chapter two, utilising eye-tracking equipment to examine participant visual attention and search mechanisms whilst locating snowshoe hares. I found that simulated dichromatic and trichromatic visual systems differ dramatically in the mechanisms used within the detection and discrimination of a camouflaged target. I also found that camouflage efficacy and background complexity function primarily as a method to reduce detectability, but do not influence the discriminability of a snowshoe hare from its background. This thesis provides support to previous research indicating that climate change will have a significant negative impact on the efficacy of seasonal coat colour camouflage and thus survival. The effects of this are already being recorded in the wild, with mismatched snowshoe hares experiencing elevated predation rates. This thesis supports that the primary reason for the increased predation is ineffective background-matching camouflage. Many aspects of camouflage and prey detection are explored within this thesis which are yet to be tested in seasonal coat colour species in the wild. In particular, how background complexity influences detectability, and the importance of considering an ecologically relevant predator visual system when examining camouflage. Overall, this thesis indicates that as the camouflage efficacy of seasonal coat colour species further decreases due to climate change, detectability, and thus predation risk, will increase

Automatic extraction of bronchus and centerline determination from CT images for three dimensional virtual bronchoscopy.

Law Tsui Ying.Thesis (M.Phil.)--Chinese University of Hong Kong, 2000.Includes bibliographical references (leaves 64-70).Abstracts in English and Chinese.Acknowledgments --- p.iiChapter 1 --- Introduction --- p.1Chapter 1.1 --- Structure of Bronchus --- p.3Chapter 1.2 --- Existing Systems --- p.4Chapter 1.2.1 --- Virtual Endoscope System (VES) --- p.4Chapter 1.2.2 --- Virtual Reality Surgical Simulator --- p.4Chapter 1.2.3 --- Automated Virtual Colonoscopy (AVC) --- p.5Chapter 1.2.4 --- QUICKSEE --- p.5Chapter 1.3 --- Organization of Thesis --- p.6Chapter 2 --- Three Dimensional Visualization in Medicine --- p.7Chapter 2.1 --- Acquisition --- p.8Chapter 2.1.1 --- Computed Tomography --- p.8Chapter 2.2 --- Resampling --- p.9Chapter 2.3 --- Segmentation and Classification --- p.9Chapter 2.3.1 --- Segmentation by Thresholding --- p.10Chapter 2.3.2 --- Segmentation by Texture Analysis --- p.10Chapter 2.3.3 --- Segmentation by Region Growing --- p.10Chapter 2.3.4 --- Segmentation by Edge Detection --- p.11Chapter 2.4 --- Rendering --- p.12Chapter 2.5 --- Display --- p.13Chapter 2.6 --- Hazards of Visualization --- p.13Chapter 2.6.1 --- Adding Visual Richness and Obscuring Important Detail --- p.14Chapter 2.6.2 --- Enhancing Details Incorrectly --- p.14Chapter 2.6.3 --- The Picture is not the Patient --- p.14Chapter 2.6.4 --- Pictures-'R'-Us --- p.14Chapter 3 --- Overview of Advanced Segmentation Methodologies --- p.15Chapter 3.1 --- Mathematical Morphology --- p.15Chapter 3.2 --- Recursive Region Search --- p.16Chapter 3.3 --- Active Region Models --- p.17Chapter 4 --- Overview of Centerline Methodologies --- p.18Chapter 4.1 --- Thinning Approach --- p.18Chapter 4.2 --- Volume Growing Approach --- p.21Chapter 4.3 --- Combination of Mathematical Morphology and Region Growing Schemes --- p.22Chapter 4.4 --- Simultaneous Borders Identification Approach --- p.23Chapter 4.5 --- Tracking Approach --- p.24Chapter 4.6 --- Distance Transform Approach --- p.25Chapter 5 --- Automated Extraction of Bronchus Area --- p.27Chapter 5.1 --- Basic Idea --- p.27Chapter 5.2 --- Outline of the Automated Extraction Algorithm --- p.28Chapter 5.2.1 --- Selection of a Start Point --- p.28Chapter 5.2.2 --- Three Dimensional Region Growing Method --- p.29Chapter 5.2.3 --- Optimization of the Threshold Value --- p.29Chapter 5.3 --- Retrieval of Start Point Algorithm Using Genetic Algorithm --- p.29Chapter 5.3.1 --- Introduction to Genetic Algorithm --- p.30Chapter 5.3.2 --- Problem Modeling --- p.31Chapter 5.3.3 --- Algorithm for Determining a Start Point --- p.33Chapter 5.3.4 --- Genetic Operators --- p.33Chapter 5.4 --- Three Dimensional Painting Algorithm --- p.34Chapter 5.4.1 --- Outline of the Three Dimensional Painting Algorithm --- p.34Chapter 5.5 --- Optimization of the Threshold Value --- p.36Chapter 6 --- Automatic Centerline Determination Algorithm --- p.38Chapter 6.1 --- Distance Transformations --- p.38Chapter 6.2 --- End Points Retrieval --- p.41Chapter 6.3 --- Graph Based Centerline Algorithm --- p.44Chapter 7 --- Experiments and Discussion --- p.48Chapter 7.1 --- Experiment of Automated Determination of Bronchus Algorithm --- p.48Chapter 7.2 --- Experiment of Automatic Centerline Determination Algorithm --- p.54Chapter 8 --- Conclusion --- p.62Bibliography --- p.6