A maximal clique based multiobjective evolutionary algorithm for overlapping community detection

Detecting community structure has become one im-portant technique for studying complex networks. Although many community detection algorithms have been proposed, most of them focus on separated communities, where each node can be-long to only one community. However, in many real-world net-works, communities are often overlapped with each other. De-veloping overlapping community detection algorithms thus be-comes necessary. Along this avenue, this paper proposes a maxi-mal clique based multiobjective evolutionary algorithm for over-lapping community detection. In this algorithm, a new represen-tation scheme based on the introduced maximal-clique graph is presented. Since the maximal-clique graph is defined by using a set of maximal cliques of original graph as nodes and two maximal cliques are allowed to share the same nodes of the original graph, overlap is an intrinsic property of the maximal-clique graph. Attributing to this property, the new representation scheme al-lows multiobjective evolutionary algorithms to handle the over-lapping community detection problem in a way similar to that of the separated community detection, such that the optimization problems are simplified. As a result, the proposed algorithm could detect overlapping community structure with higher partition accuracy and lower computational cost when compared with the existing ones. The experiments on both synthetic and real-world networks validate the effectiveness and efficiency of the proposed algorithm

An Enhanced Multi-Objective Biogeography-Based Optimization Algorithm for Automatic Detection of Overlapping Communities in a Social Network with Node Attributes

Community detection is one of the most important and interesting issues in social network analysis. In recent years, simultaneous considering of nodes' attributes and topological structures of social networks in the process of community detection has attracted the attentions of many scholars, and this consideration has been recently used in some community detection methods to increase their efficiencies and to enhance their performances in finding meaningful and relevant communities. But the problem is that most of these methods tend to find non-overlapping communities, while many real-world networks include communities that often overlap to some extent. In order to solve this problem, an evolutionary algorithm called MOBBO-OCD, which is based on multi-objective biogeography-based optimization (BBO), is proposed in this paper to automatically find overlapping communities in a social network with node attributes with synchronously considering the density of connections and the similarity of nodes' attributes in the network. In MOBBO-OCD, an extended locus-based adjacency representation called OLAR is introduced to encode and decode overlapping communities. Based on OLAR, a rank-based migration operator along with a novel two-phase mutation strategy and a new double-point crossover are used in the evolution process of MOBBO-OCD to effectively lead the population into the evolution path. In order to assess the performance of MOBBO-OCD, a new metric called alpha_SAEM is proposed in this paper, which is able to evaluate the goodness of both overlapping and non-overlapping partitions with considering the two aspects of node attributes and linkage structure. Quantitative evaluations reveal that MOBBO-OCD achieves favorable results which are quite superior to the results of 15 relevant community detection algorithms in the literature

Multi-objective community detection applied to social and COVID-19 constructed networks

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University LondonCommunity Detection plays an integral part in network analysis, as it facilitates understanding the structures and functional characteristics of the network. Communities organize real-world networks into densely connected groups of nodes. This thesis provides a critical analysis of the Community Detection and highlights the main areas including algorithms, evaluation metrics, applications, and datasets in social networks. After defining the research gap, this thesis proposes two Attribute-Based Label Propagation algorithms that maximizes both Modularity and homogeneity. Homogeneity is considered as an objective function one time, and as a constraint another time. To better capture the homogeneity of real-world networks, a new Penalized Homogeneity degree (PHd) is proposed, that can be easily personalized based on the network characteristics. For the first time, COVID-19 tracing data are utilized to form two dataset networks: one is based on the virus transition between the world countries. While the second dataset is an attributed network based on the virus transition among the contact-tracing in the Kingdom of Bahrain. This type of networks that is concerned in tracking a disease was not formed based on COVID-19 virus and has never been studied as a community detection problem. The proposed datasets are validated and tested in several experiments. The proposed Penalized Homogeneity measure is personalized and used to evaluate the proposed attributed network. Extensive experiments and analysis are carried out to evaluate the proposed methods and benchmark the results with other well-known algorithms. The results are compared in terms of Modularity, proposed PHd, and accuracy measures. The proposed methods have achieved maximum performance among other methods, with 26.6% better performance in Modularity, and 33.96% in PHd on the proposed dataset, as well as noteworthy results on benchmarking datasets with improvement in Modularity measures of 7.24%, and 4.96% respectively, and proposed PHd values 27% and 81.9%

Deep Learning in Social Networks for Overlappering Community Detection

The collection of nodes is termed as community in any network system that are tightly associated to the other nodes. In network investigation, identifying the community structure is crucial task, particularly for exposing connections between certain nodes. For community overlapping, network discovery, there are numerous methodologies described in the literature. Numerous scholars have recently focused on network embedding and feature learning techniques for node clustering. These techniques translate the network into a representation space with fewer dimensions. In this paper, a deep neural network-based model for learning graph representation and stacked auto-encoders are given a nonlinear embedding of the original graph to learn the model. In order to extract overlapping communities, an AEOCDSN algorithm is used. The efficiency of the suggested model is examined through experiments on real-world datasets of various sizes and accepted standards. The method outperforms various well-known community detection techniques, according to empirical findings

Community Detection in Networks using Bio-inspired Optimization: Latest Developments, New Results and Perspectives with a Selection of Recent Meta-Heuristics

Detecting groups within a set of interconnected nodes is a widely addressed prob- lem that can model a diversity of applications. Unfortunately, detecting the opti- mal partition of a network is a computationally demanding task, usually conducted by means of optimization methods. Among them, randomized search heuristics have been proven to be efficient approaches. This manuscript is devoted to pro- viding an overview of community detection problems from the perspective of bio-inspired computation. To this end, we first review the recent history of this research area, placing emphasis on milestone studies contributed in the last five years. Next, we present an extensive experimental study to assess the performance of a selection of modern heuristics over weighted directed network instances. Specifically, we combine seven global search heuristics based on two different similarity metrics and eight heterogeneous search operators designed ad-hoc. We compare our methods with six different community detection techniques over a benchmark of 17 Lancichinetti-Fortunato-Radicchi network instances. Ranking statistics of the tested algorithms reveal that the proposed methods perform com- petitively, but the high variability of the rankings leads to the main conclusion: no clear winner can be declared. This finding aligns with community detection tools available in the literature that hinge on a sequential application of different algorithms in search for the best performing counterpart. We end our research by sharing our envisioned status of this area, for which we identify challenges and opportunities which should stimulate research efforts in years to come

Genetic algorithm with a local search strategy for discovering communities in complex networks

In order to further improve the performance of current genetic algorithms aiming at discovering communities, a local search based genetic algorithm GALS is here proposed. The core of GALS is a local search based mutation technique. In order to overcome the drawbacks of traditional mutation methods, the paper develops the concept of marginal gene and then the local monotonicity of modularity function Q is deduced from each nodes local view. Based on these two elements, a new mutation method combined with a local search strategy is presented. GALS has been evaluated on both synthetic benchmarks and several real networks, and compared with some presently competing algorithms. Experimental results show that GALS is highly effective and efficient for discovering community.Thanks are due to the referees for helpful comments. This work was supported by National Natural Science Foundation of China (60873149, 60973088, 61133011, 61202308), Scholarship Award for Excellent Doctoral Student granted by Ministry of Education (450060454018), Program for New Century Excellent Talents in University (NCET-11-0204), and Jilin University Innovation Project (450060481084)

A review of clustering techniques and developments

© 2017 Elsevier B.V. This paper presents a comprehensive study on clustering: exiting methods and developments made at various times. Clustering is defined as an unsupervised learning where the objects are grouped on the basis of some similarity inherent among them. There are different methods for clustering the objects such as hierarchical, partitional, grid, density based and model based. The approaches used in these methods are discussed with their respective states of art and applicability. The measures of similarity as well as the evaluation criteria, which are the central components of clustering, are also presented in the paper. The applications of clustering in some fields like image segmentation, object and character recognition and data mining are highlighted

Evolutionary Computation for Overlapping Community Detection in Social and Graph-based Information

Tesis doctoral inédita leída en la Universidad Autónoma de Madrid, Escuela Politécnica Superior, Departamento de Ingeniería Informática. Fecha de lectura : 26-06-2017Esta tesis tiene embargado el acceso al texto completo hasta el 26-12-201

Community Detection in Complex Networks

Finding communities of connected individuals in social networks is essential for understanding our society and interactions within the network. Recently attention has turned to analyse these communities in complex network systems. In this thesis, we study three challenges. Firstly, analysing and evaluating the robustness of new and existing score functions as these functions are used to assess the community structure for a given network. Secondly, unfolding community structures in static social networks. Finally, detecting the dynamics of communities that change over time. The score functions are evaluated on different community structures. The behaviour of these functions is studied by migrating nodes randomly from their community to a random community in a given true partition until all nodes will be migrated far from their communities. Then Multi-Objective Evolutionary Algorithm Based Community Detection in Social Networks (MOEA-CD) is used to capture the intuition of community identi cation with dense connections within the community and sparse with others. This algorithm redirects the design of objective functions according to the nodes' relations within community and with other communities. This new model includes two new contradictory objectives, the rst is to maximise the internal neighbours for each node within a community and the second is to minimise the maximum external links for each node within a community with respect to its internal neighbours. Both of these objectives are optimised simultaneously to nd a set of estimated Pareto-optimal solutions where each solution corresponds to a network partition. Moreover, we propose a new local heuristic search, namely, the Neighbour Node Centrality (NNC) strategy which is combined with the proposed model to improve the performance of MOEA-CD to nd a local optimal solution. We also design an algorithm which produces community structures that evolve over time. Recognising that there may be many possible community structures that ex- plain the observed social network at each time step, in contrast to existing methods, which generally treat this as a coupled optimisation problem, we formulate the prob- lem in a Hidden Markov Model framework, which allows the most likely sequence of communities to be found using the Viterbi algorithm where there are many candi- date community structures which are generated using Multi-Objective Evolutionary Algorithm. To demonstrate that our study is effective, it is evaluated on synthetic and real-life dynamic networks and it is used to discover the changing Twitter communities of MPs preceding the Brexit referendum

Community Detection in Complex Networks

Finding communities of connected individuals in social networks is essential for understanding our society and interactions within the network. Recently attention has turned to analyse these communities in complex network systems. In this thesis, we study three challenges. Firstly, analysing and evaluating the robustness of new and existing score functions as these functions are used to assess the community structure for a given network. Secondly, unfolding community structures in static social networks. Finally, detecting the dynamics of communities that change over time. The score functions are evaluated on different community structures. The behaviour of these functions is studied by migrating nodes randomly from their community to a random community in a given true partition until all nodes will be migrated far from their communities. Then Multi-Objective Evolutionary Algorithm Based Community Detection in Social Networks (MOEA-CD) is used to capture the intuition of community identi cation with dense connections within the community and sparse with others. This algorithm redirects the design of objective functions according to the nodes' relations within community and with other communities. This new model includes two new contradictory objectives, the rst is to maximise the internal neighbours for each node within a community and the second is to minimise the maximum external links for each node within a community with respect to its internal neighbours. Both of these objectives are optimised simultaneously to nd a set of estimated Pareto-optimal solutions where each solution corresponds to a network partition. Moreover, we propose a new local heuristic search, namely, the Neighbour Node Centrality (NNC) strategy which is combined with the proposed model to improve the performance of MOEA-CD to nd a local optimal solution. We also design an algorithm which produces community structures that evolve over time. Recognising that there may be many possible community structures that ex- plain the observed social network at each time step, in contrast to existing methods, which generally treat this as a coupled optimisation problem, we formulate the prob- lem in a Hidden Markov Model framework, which allows the most likely sequence of communities to be found using the Viterbi algorithm where there are many candi- date community structures which are generated using Multi-Objective Evolutionary Algorithm. To demonstrate that our study is effective, it is evaluated on synthetic and real-life dynamic networks and it is used to discover the changing Twitter communities of MPs preceding the Brexit referendum