Clusters, Concepts, and Pseudometrics

Abstract

AbstractThe fields of cluster analysis and concept analysis are both used to identify patterns in data. Concept analysis identifies similarities between sets of objects based on their attributes. Cluster analysis groups objects with related characteristics based on some notion of distance.In this paper, we investigate connections between these two approaches. In particular, for each binary relation defined on a set of objects O and attributes, we define distance functions ρ (on the power set of) and δ (on O).We prove that ρ and δ are pseudometrics and use them to specify a clustering algorithm that computes a subset of the concept latticediscover new interpretations of basic notions in concept analysis.In particular, we characterize concepts in terms of ρ and characterize a family of concept lattices based on all subsets with a fixed cardinality bound in terms of δ.Our clustering algorithm differs from the classical algorithms since, first, the values of ρ, not δ, determine which pairs of sets are combined at each level, and second, the clusters defined at each level in the algorithm are generally anti-chains and may not be partitions. Therefore, the analysis of the algorithm depends on the metric-geometry of ρ and is more involved than the analysis of the classical algorithms.We have developed a software environment that permits the execution of the algorithm on finite relations and the storage and analysis of the resulting clusters. The algorithm has been run on relations generated from a variety of sources ranging from medical research to sporting events. Our results indicate that the number of iterations of the clustering algorithm is linear in the size of O and produces a linear number of clusters that are concepts. Hence the algorithm can be a useful tool for computing a tractable subset of a very large concept lattice