A hybrid, auto-adaptive, and rule-based multi-agent approach using evolutionary algorithms for improved searching

Selecting the most appropriate heuristic for solving a specific problem is not easy, for many reasons. This article focuses on one of these reasons: traditionally, the solution search process has operated in a given manner regardless of the specific problem being solved, and the process has been the same regardless of the size, complexity and domain of the problem. To cope with this situation, search processes should mould the search into areas of the search space that are meaningful for the problem. This article builds on previous work in the development of a multi-agent paradigm using techniques derived from knowledge discovery (data-mining techniques) on databases of so-far visited solutions. The aim is to improve the search mechanisms, increase computational efficiency and use rules to enrich the formulation of optimization problems, while reducing the search space and catering to realistic problems.Izquierdo Sebastián, J.; Montalvo Arango, I.; Campbell, E.; Pérez García, R. (2015). A hybrid, auto-adaptive, and rule-based multi-agent approach using evolutionary algorithms for improved searching. Engineering Optimization. 1-13. doi:10.1080/0305215X.2015.1107434S113Becker, U., & Fahrmeir, L. (2001). Bump Hunting for Risk: a New Data Mining Tool and its Applications. Computational Statistics, 16(3), 373-386. doi:10.1007/s001800100073Bouguessa, M., & Shengrui Wang. (2009). Mining Projected Clusters in High-Dimensional Spaces. IEEE Transactions on Knowledge and Data Engineering, 21(4), 507-522. doi:10.1109/tkde.2008.162Chong, I.-G., & Jun, C.-H. (2005). Performance of some variable selection methods when multicollinearity is present. Chemometrics and Intelligent Laboratory Systems, 78(1-2), 103-112. doi:10.1016/j.chemolab.2004.12.011CHONG, I., & JUN, C. (2008). Flexible patient rule induction method for optimizing process variables in discrete type. Expert Systems with Applications, 34(4), 3014-3020. doi:10.1016/j.eswa.2007.05.047Cole, S. W., Galic, Z., & Zack, J. A. (2003). Controlling false-negative errors in microarray differential expression analysis: a PRIM approach. Bioinformatics, 19(14), 1808-1816. doi:10.1093/bioinformatics/btg242FRIEDMAN, J. H., & FISHER, N. I. (1999). Statistics and Computing, 9(2), 123-143. doi:10.1023/a:1008894516817Geem, Z. W. (2006). Optimal cost design of water distribution networks using harmony search. Engineering Optimization, 38(3), 259-277. doi:10.1080/03052150500467430Goncalves, L. B., Vellasco, M. M. B. R., Pacheco, M. A. C., & Flavio Joaquim de Souza. (2006). Inverted hierarchical neuro-fuzzy BSP system: a novel neuro-fuzzy model for pattern classification and rule extraction in databases. IEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 36(2), 236-248. doi:10.1109/tsmcc.2004.843220Hastie, T., Friedman, J., & Tibshirani, R. (2001). The Elements of Statistical Learning. Springer Series in Statistics. doi:10.1007/978-0-387-21606-5Chih-Ming Hsu, & Ming-Syan Chen. (2009). On the Design and Applicability of Distance Functions in High-Dimensional Data Space. IEEE Transactions on Knowledge and Data Engineering, 21(4), 523-536. doi:10.1109/tkde.2008.178Hwang, S.-F., & He, R.-S. (2006). A hybrid real-parameter genetic algorithm for function optimization. Advanced Engineering Informatics, 20(1), 7-21. doi:10.1016/j.aei.2005.09.001Izquierdo, J., Montalvo, I., Pérez, R., & Fuertes, V. S. (2008). Design optimization of wastewater collection networks by PSO. Computers & Mathematics with Applications, 56(3), 777-784. doi:10.1016/j.camwa.2008.02.007Javadi, A. A., Farmani, R., & Tan, T. P. (2005). A hybrid intelligent genetic algorithm. Advanced Engineering Informatics, 19(4), 255-262. doi:10.1016/j.aei.2005.07.003Jin, X., Zhang, J., Gao, J., & Wu, W. (2008). Multi-objective optimization of water supply network rehabilitation with non-dominated sorting Genetic Algorithm-II. Journal of Zhejiang University-SCIENCE A, 9(3), 391-400. doi:10.1631/jzus.a071448Johns, M. B., Keedwell, E., & Savic, D. (2014). Adaptive locally constrained genetic algorithm for least-cost water distribution network design. Journal of Hydroinformatics, 16(2), 288-301. doi:10.2166/hydro.2013.218Jourdan, L., Corne, D., Savic, D., & Walters, G. (2005). Preliminary Investigation of the ‘Learnable Evolution Model’ for Faster/Better Multiobjective Water Systems Design. Evolutionary Multi-Criterion Optimization, 841-855. doi:10.1007/978-3-540-31880-4_58Kamwa, I., Samantaray, S. R., & Joos, G. (2009). Development of Rule-Based Classifiers for Rapid Stability Assessment of Wide-Area Post-Disturbance Records. IEEE Transactions on Power Systems, 24(1), 258-270. doi:10.1109/tpwrs.2008.2009430Kang, D., & Lansey, K. (2012). Revisiting Optimal Water-Distribution System Design: Issues and a Heuristic Hierarchical Approach. Journal of Water Resources Planning and Management, 138(3), 208-217. doi:10.1061/(asce)wr.1943-5452.0000165Keedwell, E., & Khu, S.-T. (2005). A hybrid genetic algorithm for the design of water distribution networks. Engineering Applications of Artificial Intelligence, 18(4), 461-472. doi:10.1016/j.engappai.2004.10.001Kehl, V., & Ulm, K. (2006). Responder identification in clinical trials with censored data. Computational Statistics & Data Analysis, 50(5), 1338-1355. doi:10.1016/j.csda.2004.11.015Liu, X., Minin, V., Huang, Y., Seligson, D. B., & Horvath, S. (2004). Statistical Methods for Analyzing Tissue Microarray Data. Journal of Biopharmaceutical Statistics, 14(3), 671-685. doi:10.1081/bip-200025657Marchi, A., Dandy, G., Wilkins, A., & Rohrlach, H. (2014). Methodology for Comparing Evolutionary Algorithms for Optimization of Water Distribution Systems. Journal of Water Resources Planning and Management, 140(1), 22-31. doi:10.1061/(asce)wr.1943-5452.0000321Martínez-Rodríguez, J. B., Montalvo, I., Izquierdo, J., & Pérez-García, R. (2011). Reliability and Tolerance Comparison in Water Supply Networks. Water Resources Management, 25(5), 1437-1448. doi:10.1007/s11269-010-9753-2McClymont, K., Keedwell, E., Savić, D., & Randall-Smith, M. (2013). A general multi-objective hyper-heuristic for water distribution network design with discolouration risk. Journal of Hydroinformatics, 15(3), 700-716. doi:10.2166/hydro.2012.022McClymont, K., Keedwell, E. C., Savić, D., & Randall-Smith, M. (2014). Automated construction of evolutionary algorithm operators for the bi-objective water distribution network design problem using a genetic programming based hyper-heuristic approach. Journal of Hydroinformatics, 16(2), 302-318. doi:10.2166/hydro.2013.226Michalski, R. S. (2000). Machine Learning, 38(1/2), 9-40. doi:10.1023/a:1007677805582Montalvo, I., Izquierdo, J., Pérez-García, R., & Herrera, M. (2014). Water Distribution System Computer-Aided Design by Agent Swarm Optimization. Computer-Aided Civil and Infrastructure Engineering, 29(6), 433-448. doi:10.1111/mice.12062Montalvo, I., Izquierdo, J., Schwarze, S., & Pérez-García, R. (2010). Multi-objective particle swarm optimization applied to water distribution systems design: An approach with human interaction. Mathematical and Computer Modelling, 52(7-8), 1219-1227. doi:10.1016/j.mcm.2010.02.017Nguyen, V. V., Hartmann, D., & König, M. (2012). A distributed agent-based approach for simulation-based optimization. Advanced Engineering Informatics, 26(4), 814-832. doi:10.1016/j.aei.2012.06.001Nicklow, J., Reed, P., Savic, D., Dessalegne, T., Harrell, L., … Chan-Hilton, A. (2010). State of the Art for Genetic Algorithms and Beyond in Water Resources Planning and Management. Journal of Water Resources Planning and Management, 136(4), 412-432. doi:10.1061/(asce)wr.1943-5452.0000053Onwubolu, G. C., & Babu, B. V. (2004). New Optimization Techniques in Engineering. Studies in Fuzziness and Soft Computing. doi:10.1007/978-3-540-39930-8Pelikan, M., Goldberg, D. E., & Lobo, F. G. (2002). Computational Optimization and Applications, 21(1), 5-20. doi:10.1023/a:1013500812258Reed, P. M., Hadka, D., Herman, J. D., Kasprzyk, J. R., & Kollat, J. B. (2013). Evolutionary multiobjective optimization in water resources: The past, present, and future. Advances in Water Resources, 51, 438-456. doi:10.1016/j.advwatres.2012.01.005Shang, W., Zhao, S., & Shen, Y. (2009). A flexible tolerance genetic algorithm for optimal problems with nonlinear equality constraints. Advanced Engineering Informatics, 23(3), 253-264. doi:10.1016/j.aei.2008.09.001Vrugt, J. A., & Robinson, B. A. (2007). Improved evolutionary optimization from genetically adaptive multimethod search. Proceedings of the National Academy of Sciences, 104(3), 708-711. doi:10.1073/pnas.0610471104Vrugt, J. A., Robinson, B. A., & Hyman, J. M. (2009). Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces. IEEE Transactions on Evolutionary Computation, 13(2), 243-259. doi:10.1109/tevc.2008.924428Xie, X.-F., & Liu, J. (2008). Graph coloring by multiagent fusion search. Journal of Combinatorial Optimization, 18(2), 99-123. doi:10.1007/s10878-008-9140-6Xiao-Feng Xie, & Jiming Liu. (2009). Multiagent Optimization System for Solving the Traveling Salesman Problem (TSP). IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 39(2), 489-502. doi:10.1109/tsmcb.2008.2006910Zheng, F., Simpson, A. R., & Zecchin, A. C. (2013). A decomposition and multistage optimization approach applied to the optimization of water distribution systems with multiple supply sources. Water Resources Research, 49(1), 380-399. doi:10.1029/2012wr013160Zheng, F., Simpson, A. R., & Zecchin, A. C. (2014). Coupled Binary Linear Programming–Differential Evolution Algorithm Approach for Water Distribution System Optimization. Journal of Water Resources Planning and Management, 140(5), 585-597. doi:10.1061/(asce)wr.1943-5452.000036

Recent Advances in Graph Partitioning

We survey recent trends in practical algorithms for balanced graph partitioning together with applications and future research directions

Spatio-Temporal Context in Agent-Based Meeting Scheduling

Meeting scheduling is a common task for organizations of all sizes. It involves searching for a time and place when and where all the participants can meet. However, scheduling a meeting is generally difficult in that it attempts to satisfy the preferences of all participants. Negotiation tends to be an iterative and time consuming task. Proxy agents can handle the negotiation on behalf of the individuals without sacrificing their privacy or overlooking their preferences. This thesis examines the implications of formalizing meeting scheduling as a spatiotemporal negotiation problem. The “Children in the Rectangular Forest” (CRF) canonical model is applied to meeting scheduling. By formalizing meeting scheduling within the CRF model, a generalized problem emerges that establishes a clear relationship with other spatiotemporal distributed scheduling problems. The thesis also examines the implications of the proposed formalization to meeting scheduling negotiations. A protocol for meeting location selection is presented and evaluated using simulations

Online Social Networks: Measurements, Analysis and Solutions for Mining Challenges

In the last decade, online social networks showed enormous growth. With the rise of these networks and the consequent availability of wealth social network data, Social Network Analysis (SNA) led researchers to get the opportunity to access, analyse and mine the social behaviour of millions of people, explore the way they communicate and exchange information. Despite the growing interest in analysing social networks, there are some challenges and implications accompanying the analysis and mining of these networks. For example, dealing with large-scale and evolving networks is not yet an easy task and still requires a new mining solution. In addition, finding communities within these networks is a challenging task and could open opportunities to see how people behave in groups on a large scale. Also, the challenge of validating and optimizing communities without knowing in advance the structure of the network due to the lack of ground truth is yet another challenging barrier for validating the meaningfulness of the resulting communities. In this thesis, we started by providing an overview of the necessary background and key concepts required in the area of social networks analysis. Our main focus is to provide solutions to tackle the key challenges in this area. For doing so, first, we introduce a predictive technique to help in the prediction of the execution time of the analysis tasks for evolving networks through employing predictive modeling techniques to the problem of evolving and large-scale networks. Second, we study the performance of existing community detection approaches to derive high quality community structure using a real email network through analysing the exchange of emails and exploring community dynamics. The aim is to study the community behavioral patterns and evaluate their quality within an actual network. Finally, we propose an ensemble technique for deriving communities using a rich internal enterprise real network in IBM that reflects real collaborations and communications between employees. The technique aims to improve the community detection process through the fusion of different algorithms

Swarm intelligence techniques for optimization and management tasks insensor networks

The main contributions of this thesis are located in the domain of wireless sensor netorks. More in detail, we introduce energyaware algorithms and protocols in the context of the following topics: self-synchronized duty-cycling in networks with energy harvesting capabilities, distributed graph coloring and minimum energy broadcasting with realistic antennas. In the following, we review the research conducted in each case. We propose a self-synchronized duty-cycling mechanism for sensor networks. This mechanism is based on the working and resting phases of natural ant colonies, which show self-synchronized activity phases. The main goal of duty-cycling methods is to save energy by efficiently alternating between different states. In the case at hand, we considered two different states: the sleep state, where communications are not possible and energy consumption is low; and the active state, where communication result in a higher energy consumption. In order to test the model, we conducted an extensive experimentation with synchronous simulations on mobile networks and static networks, and also considering asynchronous networks. Later, we extended this work by assuming a broader point of view and including a comprehensive study of the parameters. In addition, thanks to a collaboration with the Technical University of Braunschweig, we were able to test our algorithm in the real sensor network simulator Shawn (http://shawn.sf.net). The second part of this thesis is devoted to the desynchronization of wireless sensor nodes and its application to the distributed graph coloring problem. In particular, our research is inspired by the calling behavior of Japanese tree frogs, whose males use their calls to attract females. Interestingly, as female frogs are only able to correctly localize the male frogs when their calls are not too close in time, groups of males that are located nearby each other desynchronize their calls. Based on a model of this behavior from the literature, we propose a novel algorithm with applications to the field of sensor networks. More in detail, we analyzed the ability of the algorithm to desynchronize neighboring nodes. Furthermore, we considered extensions of the original model, hereby improving its desynchronization capabilities.To illustrate the potential benefits of desynchronized networks, we then focused on distributed graph coloring. Later, we analyzed the algorithm more extensively and show its performance on a larger set of benchmark instances. The classical minimum energy broadcast (MEB) problem in wireless ad hoc networks, which is well-studied in the scientific literature, considers an antenna model that allows the adjustment of the transmission power to any desired real value from zero up to the maximum transmission power level. However, when specifically considering sensor networks, a look at the currently available hardware shows that this antenna model is not very realistic. In this work we re-formulate the MEB problem for an antenna model that is realistic for sensor networks. In this antenna model transmission power levels are chosen from a finite set of possible ones. A further contribution concerns the adaptation of an ant colony optimization algorithm --currently being the state of the art for the classical MEB problem-- to the more realistic problem version, the so-called minimum energy broadcast problem with realistic antennas (MEBRA). The obtained results show that the advantage of ant colony optimization over classical heuristics even grows when the number of possible transmission power levels decreases. Finally we build a distributed version of the algorithm, which also compares quite favorably against centralized heuristics from the literature.Las principles contribuciones de esta tesis se encuentran en el domino de las redes de sensores inalámbricas. Más en detalle, introducimos algoritmos y protocolos que intentan minimizar el consumo energético para los siguientes problemas: gestión autosincronizada de encendido y apagado de sensores con capacidad para obtener energía del ambiente, coloreado de grafos distribuido y broadcasting de consumo mínimo en entornos con antenas reales. En primer lugar, proponemos un sistema capaz de autosincronizar los ciclos de encendido y apagado de los nodos de una red de sensores. El mecanismo está basado en las fases de trabajo y reposo de las colonias de hormigas tal y como estas pueden observarse en la naturaleza, es decir, con fases de actividad autosincronizadas. El principal objectivo de este tipo de técnicas es ahorrar energía gracias a alternar estados de forma eficiente. En este caso en concreto, consideramos dos estados diferentes: el estado dormido, en el que los nodos no pueden comunicarse y el consumo energético es bajo; y el estado activo, en el que las comunicaciones propician un consumo energético elevado. Con el objetivo de probar el modelo, se ha llevado a cabo una extensa experimentación que incluye tanto simulaciones síncronas en redes móviles y estáticas, como simulaciones en redes asíncronas. Además, este trabajo se extendió asumiendo un punto de vista más amplio e incluyendo un detallado estudio de los parámetros del algoritmo. Finalmente, gracias a la colaboración con la Technical University of Braunschweig, tuvimos la oportunidad de probar el mecanismo en el simulador realista de redes de sensores, Shawn (http://shawn.sf.net). La segunda parte de esta tesis está dedicada a la desincronización de nodos en redes de sensores y a su aplicación al problema del coloreado de grafos de forma distribuida. En particular, nuestra investigación está inspirada por el canto de las ranas de árbol japonesas, cuyos machos utilizan su canto para atraer a las hembras. Resulta interesante que debido a que las hembras solo son capaces de localizar las ranas macho cuando sus cantos no están demasiado cerca en el tiempo, los grupos de machos que se hallan en una misma región desincronizan sus cantos. Basado en un modelo de este comportamiento que se encuentra en la literatura, proponemos un nuevo algoritmo con aplicaciones al campo de las redes de sensores. Más en detalle, analizamos la habilidad del algoritmo para desincronizar nodos vecinos. Además, consideramos extensiones del modelo original, mejorando su capacidad de desincronización. Para ilustrar los potenciales beneficios de las redes desincronizadas, nos centramos en el problema del coloreado de grafos distribuido que tiene relación con diferentes tareas habituales en redes de sensores. El clásico problema del broadcasting de consumo mínimo en redes ad hoc ha sido bien estudiado en la literatura. El problema considera un modelo de antena que permite transmitir a cualquier potencia elegida (hasta un máximo establecido por el dispositivo). Sin embargo, cuando se trabaja de forma específica con redes de sensores, un vistazo al hardware actualmente disponible muestra que este modelo de antena no es demasiado realista. En este trabajo reformulamos el problema para el modelo de antena más habitual en redes de sensores. En este modelo, los niveles de potencia de transmisión se eligen de un conjunto finito de posibilidades. La siguiente contribución consiste en en la adaptación de un algoritmo de optimización por colonias de hormigas a la versión más realista del problema, también conocida como broadcasting de consumo mínimo con antenas realistas. Los resultados obtenidos muestran que la ventaja de este método sobre heurísticas clásicas incluso crece cuando el número de posibles potencias de transmisión decrece. Además, se ha presentado una versión distribuida del algoritmo, que también se compara de forma bastante favorable contra las heurísticas centralizadas conocidas