Chuong Ngoc Duy Hung

Hashimoto Itsuko

Ito Takahiro

Nakane Kazuaki

It is known that, the state of the capillaries represents the health condition. Recently, a device has been developed which can take the image of the capillaries at the base of the nail of the middle ﬁnger. If the state of the capillaries can be quantiﬁed mathematically, we can use it as an indicator of health. In this report, a level set method is developed to extract the outline of the capillary effectively. We have applied this method to two distinctive types of capillary, and calculated the value of average curvature. The results coincide with the diagnosis of the medical doctor

中根 和昭

橋本 伊都子

Kanazawa University Repository for Academic Resources

Sci. Rep.Kanazawa Univ.Vol. 56, pp. 35–44, 2012Classification of capillary images based on theaverage curvature estimationCHUONG Ngoc Duy Hung1, Kazuaki NAKANE2,Takahiro ITO3, Itsuko HASHIMOTO1;41 Graduate School of Natural Science and Technology, Kanazawa University,Kanazawa 920-1192, JapanE-mail: chuongngocduyhung@gmail.com2 Graduate School of Medicine, Osaka University, Suita 565-0871, Japan3 Department of Computational Science School of Mathematics and Physics,Kanazawa University, Kanazawa 920-1192, Japan4 Osaka City University Advanced Mathematical Institute,Osaka 558-8585, Japan(Received December 26, 2012 and accepted in revised form February 12, 2013)Abstract It is known that, the state of the capillaries represents the health condition.Recently, a device has been developed which can take the image of the capillaries atthe base of the nail of the middle finger. If the state of the capillaries can be quantifiedmathematically, we can use it as an indicator of health. In this report, a level set method isdeveloped to extract the outline of the capillary effectively. We have applied this methodto two distinctive types of capillary, and calculated the value of average curvature. Theresults coincide with the diagnosis of the medical doctor.Key words: image processing method, capillaries, average curvature1 IntroductionCapillaries send fresh blood to all the corners of a human body. If the capillaries arefunctioning properly, metabolism is carried out smoothly, and it is possible to maintaina healthy condition. The state of the capillaries is often changed by mental stress andirregular life and eating habits. These factors disturb the balance of autonomic nervesand cause abnormal state of capillaries. According to the theory of medical doctor S.Ogawa ([7]), the information on the state of capillaries in the whole body is collected oncapillaries in the left third finger ([3]). From such a medical background, in recent years,the medical examination by investigating the capillary of a fingertip is performed in some36 Classification of capillary images based on the average curvature estimationmedical institutions.Figure 1: Example of images of capillaries, (Left) a normal state, (Right) an abnormal state, the capillariesare bent and the flow seems to be not smooth. The images are taken by a special device ([3]).We can see different states of capillaries in Figure 1. From the diagnosis point ofview, a healthy person has capillaries with the shape of straight line like in Figure 1(Left). On the other hand, capillaries of an unhealthy person become wiggling like inFigure 1 (Right).The purpose of this paper is to establish a method of extracting the outline of a cap-illary from digital images, and to give an index which expresses its state. Therefore, theindex should be the value related to the curvature of the outline of a capillary. Generally,images contain noise and various artifacts. We should eliminate them and define an indexwhich coincides with the medical diagnose.Approximation method by solving the heat equation is often used to this kind prob-lems. Let W be a domain in R2 on which the image is drawn. The function u(t;x)expresses a monochrome or a certain color shade. Because we treat digital images, thevalue of u is between 0 and 255. Here, by normalization, we suppose 0  u  1, whereu(t;x) = 0 implies the color is white, while u(t;x) = 1 means x is black.The heat equation approach considers the initial value problem with Neumann bound-ary condition:8>>><>>>:¶u¶ t= Du; in (0;¥)W;u(0;x) = u0(x); in W;¶u¶n= 0; in (0;T )¶W:(1.1)If W= R2, it is known that the solution of (1.1) is written asu(t;x) = (Gt u0)(x)=ZR214pte jx h j24t u0(h)dh :(1.2)Chuong Ngoc Duy Hung et al. 37According to the feature of heat equation, the solution u of the problem (1.1) is dif-fused as time passes. For this reason, noise is immediately swallowed by the surroundinginformation, and the whole image will also fade simultaneously. In fact, solution of(1.1) tends to 1jWjRW u0(x)dx as time goes to infinity, where the symbol jWj means theLebesgue measure of W. It is possible to smooth the boundaries, however, the image isblurred quickly.In this paper, we have applied the level set method to pick up the outline of the capil-lary. By using this method, the boundaries do not blur, moreover, small noise and artifactscan be eliminated. Therefore, we can get the curvature index effectively.This paper is organized as follows. In Section 2, we formulate our problem by meansof level set equation and state some preliminaries. We also discretize the formulatedproblem. In Section 3, we show the image-processing result of a capillary image by usingthe method which is explained in Section 2. Finally we state conclusion in Section 4.2 Proposed methodIn this section, we will first introduce an outline of the level set method and some math-ematical results. Then we describe the discretization method.2.1 Level-set equationLet Gt be a family of closed curves which is located in the region W in R2, where t is aparameter of time. Let V denote the velocity in the direction of outward-directed normalvector n on Gt . Let H = H(t;x) denote the curvature of Gt on x. The following equalityon Gt is called the mean curvature flow equation:V = H; (on Gt): (2.1)We rewrite (2.1) by means of n asV = div n; (on Gt):In order to be able to deal with mean-curvature flow even after singular point arise,the method of level sets came to be used widely after 1990 ([1]). The method of levelsets expresses Gt as the level set of a scalar function u, and analyzes the movement of acurved surface by solving a PDE related to u. Let Gt be the zero level set of the functionu. Now define the positive direction of the normal vector n on Gt to be towards u< 0 andthe negative to be towards u> 0.Then we have the velocity V in the direction n as38 Classification of capillary images based on the average curvature estimationV =¶u¶ tjÑuj ; (on Gt ):Noting that H = div n= div( ÑujÑuj), then we rewrite (2.1) as¶u¶ t= jÑujdivÑujÑuj: (2.2)(2.2) is the so called level set equation. Here we introduce the main features of thisequation (for details see [1] ).(A1) Comparison principleLet u01 and u02 be initial values of the solutions u1 and u2, thenu01  u02 ) u1(t) u2(t); ( f or all t > 0):(A2) DenoisingArbitrary closed curve turns into a convex one, then tends to a circle, and finallydisappears in finite time.(A3) Local unevennessLocal unevenness is flattened. In particular, we call this motion “curve shorteningflow” (in 2-dimensional case).(A2) and (A3) are related to the level sets. We apply the above properties (A1-3) of (2.2)to “elimination of spots”, “maintenance of sharp edges” and “smoothing of edges” inimage processing.2.2 Discritization methodWe use explicit finite difference method as a procedure for discretization. We considerthe level set equation for 0 t  T . We suppose that h and t are the step size of space andtime variables, respectively. Furthermore, let x j = jh, j = 0;1;2;    ;M, yk = kh,k= 0;1;2;    ;K, tn = nt , n= 0;1;2    ;N. The approximate value of u at the point(tn;x j;yk) is written as unj;k. We discretize the following smoothed level set equation (2.2)¶u¶ t= jÑujdiv Ñupd + jÑuj2!; (2.3)Chuong Ngoc Duy Hung et al. 39where d is a small positive constant introduced to avoid the case that the denominator of(2.3) is 0. To carry out numerical computation, we set d = 1:0 10 6. The followingsymbols are introduced:Dtunj;k =un+1j;k  unj;kt; D+1 unj;k =unj+1;k unj;kh; D+2 unj;k =unj;k+1 unj;kh;D 1 unj;k =unj 1;k unj;kh; D 2 unj;k =unj;k 1 unj;kh:By using the above symbols, we can write central difference asD1unj;k =D+1 unj;k D 1 unj;k2; D2unj;k =D+2 unj;k D 2 unj;k2:Next, we approximate jÑuj using both forward difference and backward difference, sinceotherwise there is an example where approximate solutions do not converge.jÑuj(tn;x j;yk) =s¶u¶x2+¶u¶y2(tn;x j;yk)24 åi=1;2 jD+i unj;kj+ jD i unj;kj2!235 12 =: gnj;k:Now, we introduce symbols of difference approximation for the second order differenti-ation asD11unj;k =D+1 unj;k+D 1 unj;kh; D22unj;k =D+2 unj;k+D 2 unj;kh;D12unj;k =D1unj;k+1 D1unj;k 12h:Noting that divÑupd+jÑuj2is rewritten asdiv Ñupd + jÑuj2!=¶¶x0@ uxqd +(u2x+u2y)1A+ ¶¶y0@ uyqd +(u2x+u2y)1A=uxx(d +u2y)+uyy(d +u2x) 2uxuyuxy(d +(u2x+u2y))3=2;40 Classification of capillary images based on the average curvature estimationand using the above symbols, we can describe the difference scheme of (2.3) as follows:Dtunj;k = gnj;k F;where F is defined asF =(D11unj;k)(d +(D2unj;k)2)+(D22unj;k)(d +(D1unj;k)2) 2(D1unj;k)(D2unj;k)(D12unj;k)(d +(gnj;k)2)3=2:3 Image processing and numerical calculationIn this section, the procedure of image processing is explained. At first, we extract thecontour of the capillary boundaries from the original image. We define the average cur-vature index, and present numerical results.3.1 Extraction of boundaryIn the images, there are areas where the capillaries are clearly visible and areas wherethey are smeared. This is due to change of transparency of the liquid around the cap-illary, depending on the health condition. Information on this transparency may alsobecome an indicator of health condition, but we treat here the shape of capillaries only.Health condition can be estimated from the curvature of the contour of the capillary. Theextraction of the contour of capillary is carried out from the relatively clearly visible area.To do this, we have used the free software GIMP (see Figure 2).Figure 2: The result of image processing of Figure 1, (Left) normal capillaries, (Right) abnormal capillaries.3.2 Application of level set methodThe level set method described in Section 2.2 is applied to the image of capillaries ob-tained in Section 3.1. Here we select the two distinctive capillaries and calculate theiraverage curvature. We regard the shading of the image as the level set function, andperform noise removal and edge smoothing.Finally, the curvature is calculated by approximating the smoothed boundary of thecapillary with circles (see (C1-3)). Figure 3 shows the images of distinctive capillarieswhich are cut out from Figure 2. In the following text, the left capillary in Figure 3 isChuong Ngoc Duy Hung et al. 41called “normal” and the right one “meandering”. Throughout this paper, we assume thatthe scale size of these two pictures is the same.Figure 3: Two distinctive capillaries, (Left) normal capillary, (Right) abnormal capillary.We explain the procedure for calculating the average curvature of the contour of thecapillaries in Figure 3. The average curvature will be defined in (C3).(B1) We fill the area surrounded by the capillary with black color (Figure 4).(B2) By using the level set equation, we perform isotropic smoothing of the capillaryedge.Figure 4: The results of (B1), (Left) normal capillary, (Right) abnormal capillary.It is known from observation that the width of the capillary wall is about 1/5 of thecapillary tube. Therefore irregularities less than 1/5 of the width of the capillary areassumed to be noise. We take Figure 4 as the initial values for the level set equation, andnumerical calculation is carried out 100 time steps. Then Figure 5 was obtained.In numerical calculation, we setM= 63, K = 198 and T =K 2=6:0, for the “normal”image. Similarly, for the meandering image, we setM= 136, K = 168 and T =K 2=6:0.42 Classification of capillary images based on the average curvature estimationFigure 5: The results of (B2) (100 time steps), (Left) normal capillary, (Right) abnormal capillary.Since the irregularities are eliminated, the curvature of the boundary can be calculatedprecisely. If we continue the numerical computation further more, the image is blurred.Figure 6 shows the shape after 500 time steps of numerical calculation.Figure 6: The results of (B2) (500 time steps), (Left) normal capillary, (Right) abnormal capillary.Finally, the method for curvature calculation is explained. Here, we focus on twoexamples shown in Figure 3. In general case, a more precise definition of the averagecurvature will be required. There are several ways to calculate the curvature (see [5]).This time we have used a technique that seems to be most straightforward.(C1) For each image of Figure 5, let a0 be the left point which intersects with the bottomof the image and the capillary. We take points ai (1 i I; I 2N) on the contour inthe counterclockwise direction. To compensate for the difference in depth from theskin of a capillary, we define the interval between the points as the average widthof the capillary ((Left) 10px and (Right) 12px)), see Figure 7. This also guaranteesthe scale-independence of the curvature index.(C2) We approximate the curve (ai 1;ai;ai+1) by a circle. Let Ci be the reciprocal ofthe radius of the circle (1 i I 1).Chuong Ngoc Duy Hung et al. 43(C3) Calculation of average curvatureWe define the average curvature Curv byCurv 1I 1I 1åi=1Ci:Figure 7: Division points faig on the contour.3.3 Numerical resultsAfter the above procedure, the curvature densities are obtained for the image “normal”and “meandering” as in Table 1.normal 1:3110 2meandering 2:8910 2Table 1: The average curvature Curv.We can see that the introduced index curve is able to clearly distinguish the differencein the curvedness of the two capillaries, since the result for the meandering capillary ismore than two times bigger than for the normal one.4 ConclusionCapillaries run throughout the human body and they are supplying oxygen and nutrients,while at the same time discharging to the outside the unnecessary ingredients. This fea-ture may change depending on the health condition. The state of the capillary can bedirectly observed from the base of the nail of the middle finger. If it can be expressed inthe form of a mathematical indicator, it could be medically useful as confirmation of theeffect of a drug, etc.44 Classification of capillary images based on the average curvature estimationIn this work, we calculate average curvature of capillaries from digital images. Theimages contain noise and various artifacts due to capillaries and other structures appear-ing in the background. To extract the outline of the capillary, we have used the level setmethod. By using this method, we can smooth the boundary and eliminate noise andartifacts. This allows an effective calculation of average curvature. The results coincidewith the diagnosis of the medical doctor.In the future, we will apply this method to a large number of cases and carefullyanalyze the relation between our index and the medical diagnosis.5 AcknowledgmentThe authors express their appreciation to Professor Seiro Omata for his constructive sug-gestions. We also would like to express our gratitude to Professor Karel Svadlenka andProfessor Elliott Ginder for their assistance.References[1] Yoshikazu Giga and Yun Gang Chen, “Ugoku kyokumen wo oikakete”, Nihon Hyoron-sha, (1996).[2] H. Ishii, “Perron’s method for Hamilton-Jacobi equations”, Duke Math J. 55, (1987) 369-384.[3] Kekkan Bijin, http://www.kekkan-bijin.com.[4] L. C. Evans and J. Spruck, “Motion of level sets by mean curvature I”, J. Differential Geometry 33,(1991) 635-681.[5] N. Ono and R. Takiyama, “On calculations of curvature of Sampled curves”, TECHNICAL REPORTOF IEICE IE93-74, (1993) 7-14.[6] M. G. Crandall, H. Ishii and P. L. Lions, “User’s guide to viscosity solutions of second order partialdifferential equations”, Bulletin of the American Mathematical Society 27, (1992).[7] Saburo Ogawa, “Mousaikekkanzou to rinshou”, Toriumi shobo, (1994).[8] Azusa Suzuki, “Evaluation of the image-processing method to various noises ”, Master thesis ofGraduate School of Natural Science and Technology, Kanazawa University, (2012).

Classification of capillary images based on the average curvature estimation

https://kanazawa-u.repo.nii.ac.jp/?action=repository_action_common_download&item_id=11129&item_no=1&attribute_id=26&file_no=1

Classification of capillary images based on the average curvature estimation

Abstract

Similar works

Full text

Available Versions

Kanazawa University Repository for Academic Resources