형태 지식을 사용한 영상 분할을 위한 변분법적 접근

학위논문 (박사)-- 서울대학교 대학원 : 수리과학부, 2014. 8. 강명주.이 논문에서 우리는 형태 사전 지식을 사용한 레벨 셋 방법에 기초해서분할 알고리즘을 다룬다. 기본적인 분할 모델은 대상이 가려져 있거나 일부분이 누락된 경우에 배경에서 바람직한 대상을 분할하지 못한다. 이런어려움을 극복하기 위해서 부분 및 전체 이미지 정보를 이용해서 만든 에너지 함수를 형태 사전 지식과 통합한다. 이 방법은 다른 문헌에서 제시된방법들을 향상 시켜서 심지어 이미지가 누락돼있거나 가려짐, 잡음, 낮은명암을 가진 불균일한 강도의 이미지도 분할한다. 우리는 두 가지 경우를고려한다. 하나는 형태 사전 지식이 원하는 개체의 위치에 정확하게 배치되고, 다른 하나는 형태 사전 지식이 임의의 위치에 배치된다. 우리는 다양한이미지에 우리 방법을 테스트하고 기존의 다른 방법과 비교한다. 실험 결과들로 우리 방법이 정확하고 계산이 효율적일뿐만 아니라 기존의 방법들보다 더 빠르다는 것을 볼 수 있다.In this dissertation, we discuss segmentation algorithms based on the level set method that incorporates shape prior knowledge. Fundamental segmentation models fail to segment desirable objects from a background when the objects are occluded by others or missing parts of their whole. To overcome these difficulties, we incorporate shape prior knowledge into a new segmentation energy that, uses global and local image information to construct the energy functional. This method improves upon other methods found in the literature and segments images with intensity inhomogeneity, even when images have missing or misleading information due to occlusions, noise, or low-contrast. We consider the case when the shape prior is placed exactly at the locations of the desired objects and the case when the shape prior is placed at arbitrary locations. We test our methods on various images and compare them to other existing methods. Experimental results show that our methods are not only accurate and computationally efficient, but faster than existing methods as well.Abstract 1 Introduction 1.1 Research background 1.2 Outline of thesis 2 Previous works 2.1 Level set method 2.2 Fundamental models for image segmentation 2.3 Segmentation models for images with intensity inhomogeneity 2.4 Shape prior segmentation models 3 Proposed models 3.1 Global and local image fitting energy 3.2 Global and local image fitting energy with shape prior 4 Experimental results 5 Conclusion Abstract (in Korean) AcknowledgementsDocto

Hybrid machine learning approaches for scene understanding: From segmentation and recognition to image parsing

We alleviate the problem of semantic scene understanding by studies on object segmentation/recognition and scene labeling methods respectively. We propose new techniques for joint recognition, segmentation and pose estimation of infrared (IR) targets. The problem is formulated in a probabilistic level set framework where a shape constrained generative model is used to provide a multi-class and multi-view shape prior and where the shape model involves a couplet of view and identity manifolds (CVIM). A level set energy function is then iteratively optimized under the shape constraints provided by the CVIM. Since both the view and identity variables are expressed explicitly in the objective function, this approach naturally accomplishes recognition, segmentation and pose estimation as joint products of the optimization process. For realistic target chips, we solve the resulting multi-modal optimization problem by adopting a particle swarm optimization (PSO) algorithm and then improve the computational efficiency by implementing a gradient-boosted PSO (GB-PSO). Evaluation was performed using the Military Sensing Information Analysis Center (SENSIAC) ATR database, and experimental results show that both of the PSO algorithms reduce the cost of shape matching during CVIM-based shape inference. Particularly, GB-PSO outperforms other recent ATR algorithms, which require intensive shape matching, either explicitly (with pre-segmentation) or implicitly (without pre-segmentation). On the other hand, under situations when target boundaries are not obviously observed and object shapes are not preferably detected, we explored some sparse representation classification (SRC) methods on ATR applications, and developed a fusion technique that combines the traditional SRC and a group constrained SRC algorithm regulated by a sparsity concentration index for improved classification accuracy on the Comanche dataset. Moreover, we present a compact rare class-oriented scene labeling framework (RCSL) with a global scene assisted rare class retrieval process, where the retrieved subset was expanded by choosing scene regulated rare class patches. A complementary rare class balanced CNN is learned to alleviate imbalanced data distribution problem at lower cost. A superpixels-based re-segmentation was implemented to produce more perceptually meaningful object boundaries. Quantitative results demonstrate the promising performances of proposed framework on both pixel and class accuracy for scene labeling on the SIFTflow dataset, especially for rare class objects

Shape-driven segmentation of the arterial wall in intravascular ultrasound images

Segmentation of arterial wall boundaries from intravascular images is an important problem for many applications in the study of plaque characteristics, mechanical properties of the arterial wall, its 3D reconstruction, and its measurements such as lumen size, lumen radius, and wall radius. We present a shape-driven approach to segmentation of the arterial wall from intravascular ultrasound images in the rectangular domain. In a properly built shape space using training data, we constrain the lumen and media-adventitia contours to a smooth, closed geometry, which increases the segmentation quality without any tradeoff with a regularizer term. In addition to a shape prior, we utilize an intensity prior through a non-parametric probability density based image energy, with global image measurements rather than pointwise measurements used in previous methods. Furthermore, a detection step is included to address the challenges introduced to the segmentation process by side branches and calcifications. All these features greatly enhance our segmentation method. The tests of our algorithm on a large dataset demonstrate the effectiveness of our approach

Shape-driven segmentation of the arterial wall in intravascular ultrasound images

Segmentation of arterial wall boundaries from intravascular images is an important problem for many applications in the study of plaque characteristics, mechanical properties of the arterial wall, its 3D reconstruction, and its measurements such as lumen size, lumen radius, and wall radius. We present a shape-driven approach to segmentation of the arterial wall from intravascular ultrasound images in the rectangular domain. In a properly built shape space using training data, we constrain the lumen and media-adventitia contours to a smooth, closed geometry, which increases the segmentation quality without any tradeoff with a regularizer term. In addition to a shape prior, we utilize an intensity prior through a non-parametric probability density based image energy, with global image measurements rather than pointwise measurements used in previous methods. Furthermore, a detection step is included to address the challenges introduced to the segmentation process by side branches and calcifications. All these features greatly enhance our segmentation method. The tests of our algorithm on a large dataset demonstrate the effectiveness of our approach

A Framework for Image Segmentation Using Shape Models and Kernel Space Shape Priors

©2008 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or distribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. In most cases, these works may not be reposted without the explicit permission of the copyright holder.DOI: 10.1109/TPAMI.2007.70774Segmentation involves separating an object from the background in a given image. The use of image information alone often leads to poor segmentation results due to the presence of noise, clutter or occlusion. The introduction of shape priors in the geometric active contour (GAC) framework has proved to be an effective way to ameliorate some of these problems. In this work, we propose a novel segmentation method combining image information with prior shape knowledge, using level-sets. Following the work of Leventon et al., we propose to revisit the use of PCA to introduce prior knowledge about shapes in a more robust manner. We utilize kernel PCA (KPCA) and show that this method outperforms linear PCA by allowing only those shapes that are close enough to the training data. In our segmentation framework, shape knowledge and image information are encoded into two energy functionals entirely described in terms of shapes. This consistent description permits to fully take advantage of the Kernel PCA methodology and leads to promising segmentation results. In particular, our shape-driven segmentation technique allows for the simultaneous encoding of multiple types of shapes, and offers a convincing level of robustness with respect to noise, occlusions, or smearing