* The research is supported partly by INTAS: 04-77-7173 project, http://www.intas.bePattern recognition (classification) algorithmic models and related structures were considered and
discussed since 70s: – one, which is formally related to the similarity treatment and so - to the discrete
isoperimetric property, and the second, - logic based and introduced in terms of Reduced Disjunctive Normal
Forms of Boolean Functions. A series of properties of structures appearing in Logical Models are listed and
interpreted. This brings new knowledge on formalisms and ontology when a logic based hypothesis is the model
base for Pattern Recognition (classification)

Aslanyan, Levon

Castellanos, Juan

Bulgarian Digital Mathematics Library at IMI-BAS

International Journal "Information Theories & Applications" Vol.14 / 2007   206 LOGIC BASED PATTERN RECOGNITION - ONTOLOGY CONTENT (1) 1 Levon Aslanyan, Juan Castellanos  Abstract: Pattern recognition (classification) algorithmic models and related structures were considered and discussed since 70s: – one, which is formally related to the similarity treatment and so - to the discrete isoperimetric property, and the second, - logic based and introduced in terms of Reduced Disjunctive Normal Forms of Boolean Functions. A series of properties of structures appearing in Logical Models are listed and interpreted. This brings new knowledge on formalisms and ontology when a logic based hypothesis is the model base for Pattern Recognition (classification). ACM Classification Keywords: I.5.1 Pattern Recognition: Models 1. Introduction Pattern Recognition is in reasonable formalization (ontology) of informal relations between objects visible/measurable properties and of object classification by an automatic or a learnable procedure. Among the means of formalization (hypotheses) - metric and logic based ones are the content of series of articles started by the current one. The stage of pattern recognition algorithmic design in 70s dealt with algorithmic models – which are huge parametric structures, combined with diverse optimization tools. Algorithmic Models cover and integrate wide groups of existing algorithms, integrating their definitions, and multiplying their resolution power. Well known example of this kind is algorithmic model of estimation of analogies (AEA) given by Yu. I. Zhuravlev [1]. This model is based indirectly on compactness hypothesis, which is theoretically related to the well known discrete isoperimetric problem (3). The optimization problem of isoperimetry is a separate theoretical issue and its pattern recognition implementations are linked alternatively to the general ideas of potential functions [4]. We present the logical separation (LSA) algorithmic model, as it is described below, to be one of the generalizations of algorithmic model of estimation of analogies. For AEA models a number of useful combinatorial formulas (algorithms) to calculate the analogy measure of objects and of objects and classes were proven [2]. These are the basic values for the decision making rules in AEA. In these models large number of parameters appears, being consecutively approximated using the appropriate optimization procedures. For this reason, a special control set besides the learning set is considered having the same formal structure as the learning set. Considering classification correctness conditions for the set of given objects by the decision procedure we get a system of restrictions/inequalities, which may not be consistent. In the simplest case a system of linear inequalities appear and then we receive a problem of approximating the maximal consistent subsystem of this basic requirements system. In terms of Boolean functions this is equivalent to the well known optimization problem of determining of one of the maximal upper zeros of a Monotone Boolean function when it is given by an operator. LSA is based on implementation of additional logical treatments on learning set elements, and above the AEA specific metric considerations. Some formalization of additional properties on classification in this case is related to the terms of Boolean functions and especially - to the reduced disjunctive normal forms of them. Let us consider a set of logical variables (properties) nx,...,x,x 21  and let we have two types/classes for classification: 1K  and 2K . Let 1K∈β , and 2K∈γ , and α  is an unknown object in the sense of classification. We say, that γ  is separated by the information of β  for α  if αβγβ ⊕≤⊕ , where ⊕  is summation by 2mod  operation. After this assumption we get, that the reduced disjunctive normal forms of two complementary partially defined Boolean functions describe the structure of information enlargement of the learning set. This construction is extending the model of estimation of analogies. It was shown that the logical separators divide the object sets into three subsets, where only one of them needs the treatment by AEA. This set is large enough for almost all weakly                                                           1 The research is supported partly by INTAS: 04-77-7173 project, http://www.intas.be  International Journal "Information Theories & Applications" Vol.14 / 2007   207defined Boolean functions, but for the functions with the property of compactness it is small. Let, for nkk ≤<≤ 100  10 k,k,nF  is the set of all Boolean functions consisting of pair of 0k  and 1kn −  spheres centered at 0  and 1  respectively as the sets of zeros and ones of the function. On the remainder part of vertices of n -cube the assignment/evaluation of the functions are arbitrary. This functions satisfy the compactness assumptions, and their quantity is not less thann)n( 22ε  for an appropriate 0→)n(ε  with 0→n . For these functions, also, it is enough learning set, consisting of any n)n(nn ε−2  or more arbitrary points for recovering the full classification by means of logical separators procedure. This is an example of postulations considered. The given one is relating the metric and logic structures and suppositions, although separately oriented postulations are listed as. The follow up articles will describe the mixed hierarchy of recognition metric-logic interpretable hypotheses, which helps to allocate classification algorithms to the application problems. 2. Logic Based Model Solving the main problem of pattern recognition or classification assumes that indirect or informal information or data on classification lK,...,K,K 21  is given. Often this information is in form of appropriate conditions in an analogy to the compactness hypothesis, which in the very common shapes assumes, that given a metric in the space of all objects Μ  and that closer values of classification predicate Κ  corresponds to the pairs of "near" objects of Μ . We assume that objects of Μ  are coded - characterized by the collections of values of n  properties nx,...,x,x 21 . Then each object is identified with the corresponding point of the n -dimensional characteristic space. So under the compactness of classes we assume the geometrical compactness of sets of points in the characteristic space, which corresponds to the elements of classes lK,...,K,K 21  and the consecutive adjustments of this property can be given in the following descriptive form: closer neighborhoods of class elements belong to the same class; the distance increase from a class element increases the class change probability; for elements pairs of different classes there exist simple paths in three parts – classes and a limited transition area in the middle. Above we already considered the general formalization models of hypothesis by metrics and by logic. More formalizations move to more restricted sets of allowable classifications and in this regard it is extremely important to determine the level of formalisms applied. During the practical classification problem arrangements it is to check the satisfaction level of the application problem to the metric and/or logic hypothesis. Resolution is conditioned by the properties of the given learning set Ulii1=Μ . On the other hand there are more different conditions and methods of classification, which are very far in similarity to the model of compactness. These structures require and use other formalisms, providing the solution tools to the wide amounts of practical of pattern recognition problems. Such are the classes of algorithms of estimation of analogies, test's algorithms [2] potential function methods [4], etc. Note that the arbitrary pattern recognition class problems can be reduced to the others, with the satisfaction of compactness type hypothesis. However this doesn't mean that the compactness hypothesis is universal because the pattern recognition problem's solution for the given space or creation of appropriate transformations to the other problems are the equivalent problems. Now let us formulate the condition 0F , which will formalize the additional to the compactness hypothesis properties of classes. We'll consider the case of two classes ( 2=l ) intending the formalism simplifications. Particularly, in case of completing of partially defined predicate P , we will base on condition 0F . We'll apply a correspondence of considered object properties and the set of binary variables nx,...,x,x 21 , and the same time between the partial predicate P  - and it's characteristic function )x,...,x,x(f n21 , and will solve the modeled problem of determining (completing) of the target Boolean function F .  Let Μ∈= ),...,,(~ nαααα 21 . International Journal "Information Theories & Applications" Vol.14 / 2007   208 Consider the determination (completion) of function f  in α~ . Take the arbitrary γ~ , 1Μ∈γ~ . If there exists such a point β~ , 0Μ∈β~ , that αγβγ ~~~~ ⊕≤⊕  (so the β~  is different of γ~  on a subset of the set of properties, where are different α~  and γ~ ), then we conclude that β~  logically separates α~  from γ~ ,  and the information, that 1=)~(f γ  doesn't affect on the determination of the value of the function f  in the point α~  by 1 . In the opposite case we'll call α~  allowable in respect to the point γ~  and to the set 1Μ  and decide, that information 1=)~(f γ  influence on the determination of α~  by one, and the real measure of that is given by the value of the object similarity measures.  Consider the following classes of points of the n --dimensional unit cube:   f0Ν  -- the set of all Μ∈α~ , which are allowable for the set 0Μ  and not allowable for 1Μ ,   f1Ν  -- the set of all Μ∈α~ , which are allowable for the set 1Μ  and not allowable for 0Μ ,   f2Ν   -- the set of all Μ∈α~ , which are not allowable for the sets 0Μ  and 1Μ ,   f3Ν  -- the set of all Μ∈α~ , which are allowable for both the 0Μ  and 1Μ .   [3] pointed out the general relation of condition 0F  with the notion of the reduced disjunctive normal form of Boolean functions. To see this relation let us consider the functions f  and its negation f , and let fℜ , fℜ  correspondingly are the reduced forms for these functions. Denote by: f0Μ --the collection of all points α~  for which 0=ℜ α~f )( , 1=ℜ α~f )( , f1Μ --the collection of all points α~  for which 1=ℜ α~f )( , 0=ℜ α~f )( , f2Μ --the collection of all points α~  for which 0=ℜ α~f )( , 0=ℜ α~f )( , f3Μ --the collection of all points α~  for which 1=ℜ α~f )( , 1=ℜ α~f )( ,  Proposition 1. ....i,fifi 3210=Μ≡Ν   Proposition 2. If 010 ≠Μ∪Μ , then f2Μ  is empty, in opposite case Μ≡Μ f2 .  It is simply to prove this and some of the consecutive propositions and by this reason we omit the complete proofs and give the main idea of that. So, to prove proposition 2 consider an arbitrary point Μ∈α~ . If 010 ≠Μ∪Μ , then let us take the distance of α~  to the set 10 Μ∪Μ  (which equals the minimal possible distance of α~  from any of the points of 010 ≠Μ∪Μ ), which is in some point 10 Μ∪Μ∈β~ . Suppose, without loss of generality, that 0Μ∈β~ . Then the interval (binary subcube) )~,~( βαΕ , constructed on base of points α~  and β~  does not contain points from the set 1Μ . From here, on base of definition of reduced disjunctive normal form implies, that the point Μ∈α~  is allowable in respect to the set 0Μ .   Proposition 3. If 0f  is an appropriate completion of function f , constructed on base of condition 0F , then ))~(f(~ f 000 =Μ∈∀ αα and ))~(f(~ f 101 =Μ∈∀ ββ .  Proposition 4. f00 Μ⊆Μ  and f11 Μ⊆Μ .  International Journal "Information Theories & Applications" Vol.14 / 2007   209As a consequence from these two propositions we get, that the arbitrary completion of function f , which is made on base of condition 0F  , constructs the function, allowable in respect of f . In terms of pattern recognition problems this means that arbitrary methods of recognition, which are based on the condition 0F , couldn't be "false" on the elements of the learning set 10 Μ∪Μ . Write out the minimal completions of the function f , constructed on base of the condition 0F :  ⎪⎩⎪⎨⎧Μ=Μ∪ΜΜ∈Μ∈Μ∈=fffnfnfnn)(\)x,...,x,x(if)x,...,x,x(if)x,...,x,x(ifedminerdetnotis,)x,...,x,x(f31021121021211 10 So we get some "enlargement" for the basic function f . There arose a question -- might 1f  be the new starting point (learning set, function) for the completion on base of condition 0F , and how close we can approach by this steps the final goal? The answer gives the  Proposition 5. If 1+if  is completion of partial function if , constructed on base of condition 0F , ,...,i 21= ,  then ,...,k,ff k 211 =≡ .  Let us now analyze the conditions, related to the successful continuation on base of 0F  of a partial Boolean function (that is the case of the solvable problems). Let f -- is a partially defined Boolean function and τϕϕϕ ,...,, 21  -- all that functions of class )n(P2  which might appear as a continuation of function f , constructed by the given assumptions. Then we are interested in conditions, when extension 1f  is allowable in respect to each of functions τϕϕϕ ,...,, 21 .  Consider the function 0f , defined in the following way:  ⎪⎩⎪⎨⎧=====casesotherin,...,,i,)x,...,x,x(if,...,,i,)x,...,x,x(ifdefinednotis,,)x,...,x,x(f ninin τϕτϕ211210102121210   Denote by )f( 00Μ  and  )f( 01Μ sets of all n --cube vertices, where function 0f  achieves values 0  and 1  respectively. Then our requirement can be formulated as the following: )f(f 000 Μ⊆Μ  and  )f(f 011 Μ⊆Μ . Here )(\ fff 103 Μ∪ΜΜ=Μ  and ))f()f((\f 01003 Μ∪ΜΜ⊇Μ  so that this partial continuation doesn't violate the continuality of starting function to the each of functions τϕϕϕ ,...,, 21 . It is to mention that the conditions )f(f 000 Μ⊆Μ  and  )f(f 011 Μ⊆Μ are not convenient, which is related to the applied information on the final goal (the functions τϕϕϕ ,...,, 21 ). Supposing the case of continuation for needs of pattern recognition problems let us show that practically useful conditions of the given type might be formulated.  Consider the structural behavior, when ∞→n  and suppose a parameter 0→θ  given as. Suppose )n(Pf 20 ∈  (note, that the results below are true in more general cases and in more general forms). Here are some preliminary results. .1  Consider the concept )f(Hk 0−  introduced by Glagolev [7]. )f(Hk 0−  equals the number of vertices nE~∈α , where 10 =)~(f α , and which are covered by (involved in) maximal intervals of function 0f  of sizes not exceeding k . It was proven [7] that for almost all functions )n(Pf 20 ∈  )(o)f(H nk 20 =−  when ∞→n  and 11 −=≤ nloglogkk . International Journal "Information Theories & Applications" Vol.14 / 2007   210 .2  We'll say, [5] that the cube vertices prick the intervals including these vertexes. The set A  of vertices of n -dimensional unit cube is a pricking set for the set kB -all of the k -size intervals, if each k -subcube is pricked at least by one of the vertices of A . Denote by )k,n(K  the minimal number of vertices, forming a pricking set for k -subcubes. By [5] knkn )n()k,n(K −− +≤≤ 212 . We will use the upper bound by this formulae but in our case 11 −=≤ nloglogkk  and a better estimation is possible as follows [4] (an extended survey on pricking is included in [6]). Let us denote by )~(Ai α  the set of all of n -cube vertices, which lay in respect to the given vertex α~  on layers with numbers )k(modi, 1+≡ττ , nk,k,...,,i ≤= 10 .  Let kE -is an arbitrary k -subcube of an n -cube. Points of subcube kE  are placed exactly in the 1+k  consecutive layers of nE  in respect to it's arbitrary vertex α~ . It is correct to post the   Proposition 6. Each of the sets k,...,,i,E~),~(A ni 10=∈αα  are pricking for the set kB -all of the k -subcubes of n -cube, and 122 +≤≤− k/)k,n(K nkn .  Proposition 7. 0F  implemented in continuation of almost all functions )n(Pf 20 ∈  yields the accuracy, tending to 1  as ∞→n , if for the initial function f  holds the condition )~(Ai α⊇Μ∪Μ 10  at least for any ,...,i,i 21=  and vertices nE~∈α , where )~(Ai α  is constructed for a 1−≤ ]nlog[logk .  Note, that the proposiition 7 postulation is constructive, and it implies to the "sufficient" learning set, consisted no more that from nloglog/n2  points (which is )(o n2 ) as ∞→n . However, basically, in the pattern recognition problems it is impossible to obtain the learning set arbitrarily. Often it is formed as a random collection of any fixed size of the main collection of the studying objects. Conclusion Logic Separation is an element of pattern recognition hypotheses and formalisms. Structures appear in this relation based and introduced in terms of Reduced Disjunctive Normal Forms of Boolean Functions. An initial set of properties of these structures were introduced in propositions 1-7.  Bibliography 1. Zhuravlev Yu. I. On an algorithmic approach to the problems of recognition and classification. Problemi Kibernetiki, 33, (1978) 5--68. 2. Zhuravlev Yu. I. Selected Scientific Works, Publishing House Magister, Moscow, (1998) 417p. 3. Aslanyan L. H. On a pattern recognition method based on the separation by the disjunctive normal forms. Kibernetika, 5, (1975), 103--110. 4. Vapnik V. and Chervonenkis A. Theory of Pattern Recognition. “Nauka”, 1974. 5. Aslanyan L. H. The Discrete Isoperimetric Problem and Related Extremal Problems for Discrete Spaces. Problemy Kibernetiki, 36, (1979), 85--128. 6. Nechiporuk E. I. On topological principles of self-correcting. Problemy Kibernetiki, 21, (1969), 5--102. 7. Graham N., Harary F., Livingston M. and Stout Q. Subcube Fault-Tolerance in Hypercubes. Information and Computation 102 (1993), pp. 280{314. 8. Glagolev V. V. Some Estimations of D.N.F. for functions of Algebra of Logic. Problemy Kibernetiki, 19, (1967), 75--94. Authors' Information Levon Aslanyan – Institute for Informatics and Automation Problems, NAS Armenia, P.Sevak St. 1,  Yerevan-14, Armenia; e-mail:  lasl@sci.am   Juan Castellanos – Dpto. Intelligencia Artificial – Facultad de Informatica – Universidad Politecnica de Madrid 28660 Boadilla del Monte – Madrid, Spain; e-mail: J.Castellanos@fi.upm.es  

Logic Based Pattern Recognition - Ontology Content (1)

http://sci-gems.math.bas.bg/jspui/bitstream/10525/681/1/ijita14-3-p02.pdf

Logic Based Pattern Recognition - Ontology Content (1)

Abstract

Similar works

Full text

Available Versions

Bulgarian Digital Mathematics Library at IMI-BAS