هذا العمل يعتمد مرحلتين, المرحلة الاولى&nbsp; يستخدم خوارزمية&nbsp; "التجميع" &nbsp;والتي تستخدم لتحديد العلاقات بين عناصر البيانات لكي يبنى النظام, بحيث كل نقطه في البيانات تجمع مع نقاط اخرى ذات نفس المواصفات لكي تكوﱠن مجاميع.
هذه المجاميع (العناقيد) سوف تستخدم في المرحلة الثانية من العمل لبناء مجموعة من القواعد المضببة والتي يصطلح عليها&nbsp; (IF…THEN rules). والتي ستحدد مسار عمل النظام.
عدد القواعد ومتغيرات الادخال والاخراج لديها تعتمد على المجاميع (العناقيد) المتولدة في المرحلة الاولى&nbsp; بينما يستخدم نظام الاستدلال المسمى(King TSK-Sugeno). طﹹبق العمل لتشخيص مرض القلب.This work depends on two stages. First one, "subtractive method", clustering algorithm, used for identifying the relationships between data points in order to build system, where the data point gathers with other points to make cluster of the same features. These groups will be used in the second part of the work to construct fuzzy IF…THEN rules, which controls how the system works. The number of rules and its parts depend on these clusters. While the Takagi-Sugeno Kang (TSK) fuzzy inference modal was used. The scope of this work is applied to heart disease diagnosis

Lafta, Hussen Ateya

Mohammed, Zahraa A.

Journal of University of Babylon for Pure and Applied Sciences

English

Journals of University of Babylon

Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 250  Generation of Fuzzy Rules by Subtractive  Clustering  Hussen Ateya Lafta Department of computer science, collage of science for woman, Babylon University. am.2222@yahoo.com Zahraa A. Mohammed Department of software, College of Information Technology, Babylon Universit A_zahraa_t@yahoo.com  Abstract  This work depends on two stages. First one, "subtractive method", clustering algorithm, used for identifying the relationships between data points in order to build system, where the data point gathers with other points to make cluster of the same features. These groups will be used in the second part of the work to construct fuzzy IF…THEN rules, which controls how the system works. The number of rules and its parts depend on these clusters. While the Takagi-Sugeno Kang (TSK) fuzzy inference modal was used. The scope of this work is applied to heart disease diagnosis.  Key word: Fuzzy rules, First_order (TSK) fuzzy inference, Subtractive clustering, Heart disease diagnoses.  اةصلاخل  لمعلا اذى ,نيتمحرم دمتعي ولاا ةمحرملا "عيمجتلا"  ةيمزراوخ مدختسي  ىل حتل مدختست يتلاو تانايبلا رصانع نيب تاقلاعلا ديد يكلقن عم عمجت تانايبلا يف وطقن لك ثيحب ,ماظنلا ىنبي سفن تاذ ىرخا طايكل تافصاوملا وكتَّعيماجم ن. مجم ءانبل لمعلا نم ةيناثلا ةمحرملا يف مدختست فوس )ديقانعلا( عيماجملا هذىاييمع حمطصي يتلاو ةببضملا دعاوقلا نم ةعو  (IF…THEN rules) ..ماظنلا لمع راسم ددحتس يتلاو   عيماجملا ىمع دمتعت اييدل جارخلااو لاخدلاا تاريغتمو دعاوقلا ددعلا )ديقانعلا(مدختسي امنيب  ىلولاا ةمحرملا يف ةدلوتم ماظن ىمسملا للادتسلاا(King TSK-Sugeno)ط .ـُ قبلمعلا بمقلا ضرم صيخشتل.   :ةيحاتفملا تاممكلا ببضملا للادتسلاا ,ةببضملا دعاوقلا  First-order TSK.بمقلا ضرم صيخشت ,عيمجتلا ةيمزراوخ ,   1. Introduction  Fuzzy system is an interesting way to deal with data and with any type of features even there are undesirable features like imprecise, noisy or missing input information [Keshavarzi, et al, 2012], also with complex system since it depends on input-output high dimensional data rather than human experience, which maybe uncertain or unavailable, or complex mathematical equations to describe the manner of the system and build its rules [Berneti,  2011].  In general, clustering (hard clustering) concept is each data point is belonging to only one cluster according to some measures, while in fuzzy clustering (soft clustering) the data points may belong to more than one group, or to all groups in some ratio according to membership degree, and the cluster with high value, the data point is assigned .  Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 251  There are many clustering algorithms are K-mean, C-mean, Mountain and Subtractive clustering. These algorithms belong to hard or soft clustering, but each one has its limitations like initial cluster center selection, pre-knowledge of number of clusters, dead unit problem, multiple cluster membership and premature convergence to local optima [Ghorpade, 2014].  Subtractive clustering algorithm is a suitable way to solve these limitations because it doesn't need to know the number of cluster or estimate the cluster center. It depends on some parameters that influence the result like radius, squash ratio, accept ratio, reject ratio [Keshavarzi, et al., 2012].After finding all the clusters in the data, the work is going toward generation rules. The number of rules is equal to the number of clusters. The antecedent of rule takes from clusters data (input data) and the consequent part of the rule represents the behavior of the system [Engineering, 2006], this is according to Takagi-Sugeno-Kang (TSK) fuzzy inference which may be a linear function and this type is called first-order Sugeno fuzzy mode, or zero-order Sugeno fuzzy model if that consequent is constant [Farias, et al., 2011].  2. The Previous Work    Diagnose heart disease is sensitive and important. Earlier diagnose of this disease is one of the treatment ways and the correct diagnoses leads to save the patient's life. One choice of this diagnoses is usually done in the hospital by the doctors depending on the taking information from the patient and making test. Recent science techniques are used. Fuzzy logic can help successfully in this space such as Fuzzy Petri Net, one of these techniques. This used petri net to evaluate the patient case to determine if he is ill and the degree of the illness. Genetic algorithm is also used to generate fuzzy rules. Particle Swarm Optimization (PSO) algorithm is another way used in fuzzy rule extraction space. Fuzzy clustering, which is used in this paper can build rules base to determine the infected according to the symptoms of the sick person.   3. The Proposed Subtractive Clustering algorithm  The steps of Subtractive clustering algorithm are:  Step1 Normalization: starting by handling multidimensional input data, N dimensions, M attributes, like Xi ={x1, x2,…, xm} where Xi is a vector of inputs, data is normalized to interval [0,1] ,by equation 1 [Priyono, Ridwan, et al.,2005].              =                      …….. (1) Where i=1,2,…,n; j=1,2,…,m.  Step2 Assigned: constant parameters are given carefully according to the work's modality and data's type, the parameters are radius, squash factor (η), accept ratio, and Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 252  reject ratio (ℇ ). Radius ra (influences range of cluster center), affects the number of rules seriously, since the number of rules depends on number of clusters. So large radius value means few number of clusters and vice versa [Berneti, 2012; Priyono et al., 2005].  Step3: Compute center:    A-compute first potential: The subtractive clustering algorithm differs from other clustering algorithms; it is not interested in early knowing of number of clusters, therefore the algorithm works based on consideration of each data points as a cluster center [Berneti SM]. Thus the measure of density to each point is achieved and the potential is computed by equation 2 [Farias et al., 2011; Ghorpade-aher & Metre, 2014].       i=∑                  ………. (2( Where         .  ||.|| denotes the Euclidean distance.  ra: is positive constant defined as cluster center range.     B-Compute first center: when the data point's potential is the biggest one (ρ1*) compared with the other potentials (ρi1), first cluster center χ1* is declared [Farias, et al., 2011; Chiu, 1997].  C-Compute the other centers: trying to find the next center, subtract a potential of other data (ρi*) from the potential of  first cluster (ρ1*), if the difference is big, this means it is far from influence of center 1 and input value regarding with this potential is candidate to be next center. This is achieved by equation 3 [Priyono et al., 2006; Farias et al., 2011].       ρi = ρi- ρ1* exp (-          ) ………(3) Where    β=4/rb2  rb=    η= squash factor  D-Compute k-center: after k-time the equation above becomes as the equation below… [Berneti,  2011; Farias et al., 2011]       ρi = ρi- ρk*  exp (-          ) ………(4) Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 253  Where   χ k* =center of the kth cluster.  ρk* = its potential value.  Step4-Testing: each data point is candidate to be cluster center and must be tested in some formula which specify it as a center point or not [Keshavarzi , Sarmadian et al,2012],[ Priyono , Ridwan et al, 2005] These formulas are:   Formula 1-    Where dmin=smallest distance from center i to all earlier found centers [Keshavarzi et al., 2012; Farias et al., 2011].  If the data point with high potential realizes that condition, then it is successfully declared as a new center.  Formula 2-   Where:    =reject ratio. The algorithm is terminated if this condition is not satisfied [ Farias, et al., 2011]. Many parameters are adapted in this algorithm these are:   Radius: a range of numbers found in the cluster of that center.  Accept ratio: gives its agreement to the candidate center to be center I, if condition 1 is true with that data points. Otherwise, potential of data point assign to zero and begin with another candidate.   Reject ratio: each cluster center yield (χk *), its potential compared with the potential of center i, with the reject ratio (P*K <  P*i). And the result determines continuous generation centers or stop and begin to show the result [Keshavarziet al., 2012].       𝑑𝑚𝑖𝑛𝑟𝑎  + 𝜌𝑘 𝜌𝑘    > 1 𝜌𝑘  < 𝜀 𝜌𝑖  Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 254  The algorithm can be summarized as:                          4. Generation fuzzy rules:  A clusters are building. Depending on clustering algorithm results, the fuzzy rules then must be created. Number of rules associates with number of clusters .So the rule for class Ci can take the form: (Abonyi, 2003; Farias et al., 2011).   Rule i: IF X  is about χi* THEN class is C1. Step1: by eq2.calculate the potential ρi of each data point 1≤i≤n. Step2: find center i by find the value Xi with max potential ρi.  Step3: revise the potential value of each data point by eq3.  Step4: if                Accept Xi as center and continue.             Else if             Reject Xi and stop.  Else  Let d_min =shortest of the distances between Xk* and all previously found cluster centers. If   Accept Xi as center and continue.  else  reject Xi and set the potential at Xi to 0.   Select the data point with the next highest potential as the new Xi and reset.   end if  end if.  𝜌𝑘  > 𝜀 𝜌𝑖  𝑑𝑚𝑖𝑛𝑟𝑎  + 𝜌𝑘 𝜌𝑘    > 1 𝜌𝑘  < 𝜀 𝜌𝑖  Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 255  So to be ready to generate fuzzy rules the formula above can be more conventional form [Chiu, 1997]:   Rule i: IF X1 is Ӕi1 And X2 is Ӕi2 And … THEN class is C1   Where:  Xj=input data element.  j=1…n, n is number of input.   i=1…m, m is number of cluster.  Ӕij=membership function related with each xj in rule i (linguistic variable).  The membership can be calculated by the equation below, where Gaussian function applies [Abonyi , Szeifert,2003].  Ӕij(Xj) =exp{( 𝑗−𝜒𝑖𝑗  𝛿𝑖𝑗 ) 2} ……..(5) Where   χ*ij = the center.  xj=the j element with xi input.  δij= sigma value generated from subtractive clustering method.  If there is more than one feature to consist the individual rule then the connective tool, And, Or, Not, is used. And each one has its effects on the result [Keshavarzi , Sarmadian, 2012].  And the degree of fulfillment of each rule also called firing strength is computed by using (Samsudin, Ruhidah).       (  )               (    )…….. (6) Wi is weight of the rule and in most time it is equal to 1.  The consequent of the rule that describes the system behavior, as mentioned before, and according to (TSK) fuzzy inference, is either polynomial equation in first order (TSK) fuzzy inference as      Rule i- if X is Æ1 and Y is Æ2 then A=SX+TY+V  Where x, y are input features.  Or be constant in zero order (TSK) fuzzy inference so the equation above becomes:   Rule i- if X is Æ1 and Y is Æ2 then A=V.  Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 256  Where parameters S and T are equal to 0   5. Testing Rules Now rules base is formed from train input data set .by implementing of these rules, on test data set, and rule base is created before. One or more rule reacts to such case. After applying these set of rules and the results are computed according to connective tool, to tight the antecedent parts together, used. The output is acquired as the formula below [Samsudin, 2009]:   C=∑           ∑       ………… (7) Where  C=centroid  N: number of trigged rules.  Ai=minimum value of each rule.  Ci=result of each rule.  The figure below shows all previous steps of proposed system:     Figure 1: Sugeno fuzzy inference processing model.  6. Experimental Results  Heart disease with its database can be applied in this system .By takeing 10 symptoms of the disease for 100 patients.  First, subtractive clustering algorithm is applied and clusters are built according to centers created. Giving radius, squash factor (η), accept ratio, and reject ratio ( ) its value as 0.5, 0.25, 0.5, 0.15, respectively. So the results are: number of centers is 56 centers. As shown in figure (2).  Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 257   Figure (2): The centers value of subtractive clustering algorithm.  And the sigma values, which their numbers are related to number of column (symptoms), are shown in figure 3:  Figure (3): The sigma values for subtractive clustering algorithm.  Sigma values are used in additional to the set of centers, to contribute the rule. The fuzzy rules formed depended on this set of centers and can be shown in the figure below.     Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 258   Figure (4): Set of fuzzy rules for heart disease.  By using Gaussian membership function which depend on centers and sigma's value and the using formula of   C=∑           ∑         The final output is made. And it approximately can diagnose the case, where the accuracy rate =76.43    7. Conclusion  This paper has shown the act of a TSK fuzzy inference with using Subtractive clustering technique. This approach has been tested with database of heart disease in order to diagnose the case of the patient whether infected or not.  As shown from the result of this works that subtractive clustering algorithm and by using some parameters like radii, accept and reject ratio is preferred to build efficient fuzzy rule and give much betters result for many problems.     Reference  Berneti SM. (2011); “Design of Fuzzy Subtractive Clustering Model using Particle Swarm Optimization for the Permeability Prediction of the Reservoir”. International Journal of Computer Applications (0975 – 8887) Volume 29– No.11.  Chiu SL. (1997); “An Efficient Method for Extracting Fuzzy Classification Rules from High Dimensional Data”. J. Advanced Computational Intelligence, Vol. 1, No. 1, 1997. Engineering M (2006). “Type-2 Takagi-Sugeno-Kang Fuzzy Logic Modeling using Subtractive Clustering”. IEEE Xplore, DOI: 10.1109/NAFIPS.2006.365871 .  Farahbod F, Eftekhari M. (2013) “A NEW CLUSTERING-BASED APPROACH FOR MODELING FUZZY RULE-BASED CLASSIFICATION SYSTEMS”, IJSTE,Volume 37, Issue 1, May and June 2013, Page 67-77  .   Farias MS, Nedjah N, Mourelle LDM. (2011) “RADIONUCLIDE IDENTIFICATION USING SUBTRACTIVE”.INAC. Journal of Babylon University/Pure and Applied Sciences/ No.(2)/ Vol.(26): 2018 259  Ghorpade-aher J, Metre VA. (2014)  “Clustering Multidimensional Data with PSO based Algorithm”, Soft Computing and Artificial Intelligenc . Janos Abonyi, Ference Szeifert. (2003) “Supervised fuzzy clustering for the identification of fuzzy classifiers”. Pattern Recognit Letter.; 24(14):2195-2207.   Keshavarzi A, Sarmadian F, Rahmani A, Ahmadi A, Labbafi R, Iqbal MA. (2012), “Fuzzy clustering analysis for modeling of soil cation exchange capacity”. Australain Journal of Agricultural Engineering. AJAE 3(1):27-33.  Priyono a, Ridwan M, Alias A.( 2005). “Generation of fuzzy rules with subtractive clustering”.http://www.jurnalteknologi.utm.my/index.php/jurnalteknologi/article/view/782;43(D):143-153.  Samsudin R. Rice Yields,( 2009),”Time Series Forecasting Using ANFIS”.   

Generation of Fuzzy Rules by Subtractive ‎ Clustering

Abstract

Similar works

Full text

Available Versions

Journals of University of Babylon