Multi-robot task planning problem with uncertainty in game theoretic framework

The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-642-31665-4_6An efficiency of an multi-robot systems depends on proper coordinating tasks of all robots. This paper presents a game theoretic approach to modelling and solving the pick-up and collection problem. The classical form of this problem is modified in order to introduce the aspect of an uncertainty related to an information about the workspace inside of which robots are intended to perform the task. The process of modelling the problem in game theoretic framework, as well as cooperative solution to the problem is discussed in these paper. Results of exemplary simulations are presented to prove the suitability of the approach presented.Skrzypczyk, K.; Mellado Arteche, M. (2013). Multi-robot task planning problem with uncertainty in game theoretic framework. En Advanced Technologies for Intelligent Systems of National Border Security. Springer. 69-80. doi:10.1007/978-3-642-31665-4_6S6980Alami, R., et al.: Toward human-aware robot task planning. In: Proc. of AAAI Spring Symposium, Stanford (USA), pp. 39–46 (2006)Baioletti, M., Marcugini, S., Milani, A.: Task Planning and Partial Order Planning: A Domain Transformation Approach. In: Steel, S. (ed.) ECP 1997. LNCS, vol. 1348. Springer, Heidelberg (1997)Desouky, S.F., Schwartz, H.M.: Self-learning Fuzzy logic controllers for pursuit-evasion differential games. Robotics and Autonomous Systems (2010), doi:10.1016/j.robot.2010.09.006Harmati, I., Skrzypczyk, K.: Robot team coordination for target tracking using fuzzy logic controller in game theoretic framework. Robotics and Autonomous Systems 57(1) (2009)Kaminka, G.A., Erusalimchik, D., Kraus, S.: Adaptive Multi-Robot Coordination: A Game-Theoretic Perspective. In: Proc. of IEEE International Conference on Robotics and Automation, Anchorage, Alaska, USA (2002)Kok, J.R., Spaan, M.T.J., Vlassis, N.: Non-communicative multi-robot coordination in dynamic environments. Robotics and Autonomous Systems 50(2-3), 99–114 (2005)Klusch, M., Gerber, A.: Dynamic coalition formation among rational agents. IEEE Intelligent Systems 17(3), 42–47 (2002)Kraus, S., Winkfeld, J., Zlotkin, G.: Multiagent negotiation under time constraints. Artificial Intelligence 75, 297–345 (1995)Kraus, S.: Negotiation and cooperation in multiagent environments. Artificial Intelligence 94(1-2), 79–98 (1997)Mataric, M., Sukhatme, G., Ostergaard, E.: Multi-Robot Task Allocation in Uncertain Environments. Autonomous Robots (14), 255–263 (2003)Meng, Y.: Multi-Robot Searching using Game-Theory Based Approach. International Journal of Advanced Robotic Systems 5(4) (2008)Jones, C., Mataric, M.: Adaptive Division of Labor in Large-Scale Minimalist Multi-Robot Systems. In: Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems, Las Vegas, USA, pp. 1969–1974 (2003)Sariel, S., Balch, T., Erdogan, N.: Incremental Multi-Robot Task Selection for Resource Constrained and Interrelated Tasks. In: Proc. of 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA (2007)Schneider-Fontan, M., Mataric, M.J.: Territorial Multi-Robot Task Division. IEEE Transactions on Robotics and Automation 14(5), 815–822 (1998)Song, M., Gu, G., Zhang, R., Wang, X.: A method of multi-robot formation with the least total cost. International Journal of Information and System Science 1(3-4), 364–371 (2005)Cheng, X., Shen, J., Liu, H., Gu, G.-c.: Multi-robot Cooperation Based on Hierarchical Reinforcement Learning. In: Shi, Y., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds.) ICCS 2007. LNCS, vol. 4489, pp. 90–97. Springer, Heidelberg (2007

Modelado, detección de colisiones y planificación de movimientos en sistemas robotizados mediante volúmenes esféricos

[EN] The efficiency of free-collision motion planning results very sensible on robot and obstacle modelling technique selected. In this way, many works have been oriented to define models with proper throughput to speed up the collision detection proccess. This dissertation presents a new approach to the problem, whose complexity is reduced notably by means of using enveloping models of real objects, allowing security regions or distances. This objective is reached by means of the definition of a spherical model, composed of infinite spheres, generated from the application of linear or polynomial equations to a reduced number of control spheres, giving the so-called poly-spheres and spheroids respectively. These models, with evident simplicity, present a high modelling power, adapt easily to the requirements need in collision-detection and path planning applications for robotics systems. In order to represent a complete multi-robot cell, an extended hierarchical structure has been defined, in form of an AND-OR graph, with different degrees of accuracy, according to the different approximation model used. In order to generate automatically this structure, a procedure has been developed to compute the minimum volume enveloping spherical model in an off-line process with two levels based on Downhill Simplex method and Hough transform. This procedure can be greatly speed up by using clustering techniques to obtain appropiate initial conditions, allowing an on-line use. With a hierarchical structure computed in such a way, a fast procedure for collision detection in a multi-robot cell is introduced, based on several algorithms for distance computation including polyspheres and spheroids. This methodology presents a fast and anticipativa response, in the sense that every movement of a system has been validated before its execution, implying that not necessarily must be done in an off-line simulation. The use of spherical models, in addition to their fast distance computation, results suitable for the definition of artificial potential fields allowing a path planning in robotics systems with up to six degrees of freedom, including three for translation and three for rotation. The definition of these new potential fields and the study of new planning techniques based on classical optimisation methods allow their application straight forward in Cartesian space, with all their advantages. Last but not least, with the help of some systems for robot programming, simulation and control, the correctness of these contributions have been validated in a set of prototype applications, covering from robot-obstacle and multi-robot collision detection, to motion planning for a robot-arm or an auto-guided vehicle.[ES] La eficiencia de la planificación de movimientos libres de colisión resulta muy sensible al modelado de los robots y obstáculos que se consideren, por lo que, frente al modelado tradicional con politopos, muchos trabajos en robótica han estado orientados a la definición de unos modelos que presenten buenas prestaciones de cara a acelerar el proceso de detección de colisiones. En esta Tesis se presenta una nueva perspectiva del problema, cuya complejidad queda reducida notablemente al utilizar envolventes de los objetos reales, lo que permite definir zonas o distancias de seguridad. Para ello se han definido unos modelos esféricos, compuestos de infinitas esferas generadas a partir de la aplicación de unas relaciones lineales o polinómicas a un número reducido de esferas de control, dando lugar a las llamadas poli-esferas y esferoides respectivamente. Estos modelos, de sencillez clara, presentan una potencia de modelado elevada, adaptándose fácilmente a los requisitos necesarios en las aplicaciones de detección de colisiones y planificación de movimientos en sistemas robotizados. Para la representación de una célula multi-robot completa, se ha definido una estructura jerárquica extendida, en forma de grafo AND-OR, con diferentes grados de precisión, mediante diferentes modelos de aproximación. De cara a generar automáticamente esta estructura, se ha desarrollado un procedimiento para generar el modelo esférico envolvente de mínimo volumen en un proceso off-line con dos niveles, basados en el método de minimización Downhill Simplex y en la transformada de Hough. Este procedimiento se acelera enormemente al utilizar técnicas de agrupamiento para obtener condiciones iniciales apropiadas, permitiendo su uso on-line. Con una estructura jerárquica generada de esta forma, se introduce un procedimiento rápido de detección de colisiones aplicable a una célula multi-robot, basado en algoritmos básicos de cálculo de distancias que pueden considerar poli-esferas y esferoides. Esta metodología presenta una respuesta rápida y anticipativa, entendiendo por tal que todo movimiento de cualquier sistema ha sido validado antes de su ejecución, por lo que no necesariamente debe realizarse en una simulación off-line. La utilización de modelos esféricos, así como el rápido cálculo de distancias entre ellos, resulta idónea para la definición de campos potenciales artificiales que permitan una planificación de movimientos en sistemas robotizados con hasta seis grados de libertad, incluyendo tres de traslación y tres de rotación. La definición de estos nuevos campos potenciales y el estudio de nuevas técnicas de planificación basados en métodos clásicos de optimización permiten su aplicación directamente en el espacio cartesiano, con las claras ventajas que esto conlleva. Finalmente, con la ayuda de varios sistemas de programación, simulación y control de robots, se ha demostrado la validez de estas aportaciones en una serie de aplicaciones prototipo que van desde la detección de colisiones de un robot con un obstáculo o entre sistemas multi-robot, a la planificación de movimientos de un brazo-robot o un vehículo autoguiado.Mellado Arteche, M. (1996). Modelado, detección de colisiones y planificación de movimientos en sistemas robotizados mediante volúmenes esféricos [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/5662

Robot Soccer Strategy Based on Hierarchical Finite State Machine to Centralized Architectures

© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works[EN] Coordination among the robots allows a robot soccer team to perform better through coordinated behaviors. This requires that team strategy is designed in line with the conditions of the game. This paper presents the architecture for robot soccer team coordination, involving the dynamic assignment of roles among the players. This strategy is divided into tactics, which are selected by a Hierarchical State Machine. Once a tactic has been selected, it is assigned roles to players, depending on the game conditions. Each role performs defined behaviors selected by the Hierarchical State Machine. To carry out the behaviors, robots are controlled by the lowest level of the Hierarchical State Machine. The architecture proposed is designed for robot soccer teams with a central decision-making body, with global perception. 200 games were performed against a team with constant roles, winning the 92.5% of the games, scoring more goals on average that the opponent, and showing a higher percent of ball possession. Student s t-test shows better matching with measurement uncertainty of the strategy proposed. This architecture allowed an intuitive design of the robot soccer strategy, facilitating the design of the rules for role selection and behaviors performed by the players, depending on the game conditions. Collaborative behaviors and uniformity within the players behaviors during the tactics and behaviors transitions were observedJose Guillermo Guarnizo ha sido financiado por una beca del Departamento Administrativo de Ciencia, Tecnología e Innovación COLCIENCIAS, Colombia.Guarnizo, JG.; Mellado Arteche, M. (2016). Robot Soccer Strategy Based on Hierarchical Finite State Machine to Centralized Architectures. IEEE Latin America Transactions. 14(8):3586-3596. doi:10.1109/TLA.2016.7786338S3586359614

Handling uncertainty of resource division in multi agent system using game against nature

This paper addresses the problem of resource division for robotic agents in the framework of Multi Agent System. Knowledge of the environment represented in the system is uncertain, incomplete and distributed among the individual agents that have both limited sensing and communication abilities. The pick-up-and-collection problem is considered in order to illustrate the idea presented. In this paper a framework for cooperative task assignment to individual agents is discussed. The process of negotiating access to common resources by intercommunicating agents is modeled and solved as a game against Nature. The working of the proposed system was verified by multiple simulations. Selected, exemplary simulations are presented in the paper to illustrate the approach discussed.This study is partially supported by IMPA (Inspection & Manipulation of Food Products) project (ref. DPI2010-20286), funded by the Spanish Government MICINN and by Programa de Apoyo a la Investigacion y Desarrollo (PAID-02-11) of the Universitat Politecnica de Valencia.Skrzypczyk, K.; Mellado Arteche, M. (2014). Handling uncertainty of resource division in multi agent system using game against nature. Archives of Control Sciences. 24(3):351-373. https://doi.org/10.2478/acsc-2014-0021S35137324

Tactile Sensing with Accelerometers in Prehensile Grippers for Robots

This is the author’s version of a work that was accepted for publication in Mechatronics. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Mechatronics, Vol. 33, (2016)] DOI 10.1016/j.mechatronics.2015.11.007.Several pneumatic grippers with accelerometers attached to their fingers have been developed and tested. The first gripper is able to classify the hardness of different cylinders, estimate the pneumatic pressure, monitor the position and speed of the gripper fingers, and study the phases of the action of grasping and the influence of the relative position between the gripper and the cylinders. The other grippers manipulate and assess the firmness of eggplants and mangoes. To achieve a gentle manipulation, the grippers employ fingers with several degrees of freedom in different configurations and have a membrane filled with a fluid that allows their hardness to be controlled by means of the jamming transition of the granular fluid inside it. To assess the firmness of eggplants and mangoes and avoid the influence of the relative position between product and gripper, the firmness is estimated while the products are being held by the fingers. Better performance of the accelerometers is achieved when the finger employs the granular fluid. The article presents methods for designing grippers capable of assessing the firmness of irregular products with accelerometers. At the same time, it also studies the possibilities that accelerometers, attached to different pneumatic robot gripper fingers, offer as tactile sensors. (C) 2015 Elsevier Ltd. All rights reserved.This research is supported by the MANI-DACSA project (Grant number RTA2012-00062-C04-02), which is partially funded by the Spanish Government (Ministerio de Economia y Competitividad.).Blanes Campos, C.; Mellado Arteche, M.; Beltrán Beltrán, P. (2016). Tactile Sensing with Accelerometers in Prehensile Grippers for Robots. Mechatronics. 33:1-12. https://doi.org/10.1016/j.mechatronics.2015.11.007S1123

Arquitectura Basada en Roles Aplicada en Equipos de Fútbol de Robots con Control Centralizado

[EN] Borrar Robot soccer offers an adequate domain in order to design and validate architectures for robot-coordination. One classification refers to centralized architectures, which correspond to robot soccer environments with global perception and centralized control of the robots, using only one decision-making system. In this paper it is presented a centralized robot soccer architecture based on roles, where one role is assigned to each player in order to select a specific behaviour depending on game conditions. Roles are assigned using an assignment function, which is activated when the ball changes of the quadrant in the playing field. This strategy has been compared by simulation in games against an opposition team with constant roles, and other team with a hierarchical strategy which assigns roles depending on a tactic previously selected. The results showed a better performance in the team with the role-based[ES] El fútbol de robots ofrece un entorno adecuado para el diseño y la validación de arquitecturas de sistemas multi-robot. Al clasificar las ligas de fútbol de robots existentes se encuentran ligas con arquitecturas centralizadas que poseen percepción global del entorno y donde los robots son controlados desde un ordenador a través de un único sistema de toma de decisiones. En este artículo se presenta una arquitectura basada en roles para equipos de fútbol de robots con percepción global y control centralizado. En esta arquitectura un rol es seleccionado para cada jugador por medio de una función. A partir de este rol y de las condiciones de juego presentes se selecciona un comportamiento que el jugador deberá ejecutar. La función que es utilizada para la asignación de roles es activada cuando el balón cambia de cuadrante en el campo de juego. La estrategia presentada es comparada en simulación realizando partidos contra un equipo que posee una estrategia de roles constantes y un equipo con una estrategia jerárquica basada en selección de tácticas y posteriormente asignación de roles a partir de la táctica seleccionada. Los resultados mostraron no solo un mejor rendimiento del equipo con la estrategia basada en roles, sino también uniformidad en los comportamientos realizados por los jugadores del equipo durante las transiciones de roles y comportamientos.Jose Guillermo Guarnizo há sido financiado por una beca del Departamento Administrativo de Ciencia, Tecnologia e Innovación COLCIENCIAS, Colombia.Guarnizo Marín, JG.; Mellado Arteche, M. (2016). Arquitectura Basada en Roles Aplicada en Equipos de Fútbol de Robots con Control Centralizado. Revista Iberoamericana de Automática e Informática Industrial RIAI. 13(3):370-380. doi:10.1016/j.riai.2016.05.005S37038013

Strategy planning for collaborative humanoid soccer robots based on principle solution

The final publication is available at Springer via http://dx.doi.org/10.1007/s11740-012-0416-4[EN] Collaborative humanoid soccer robots are currently under the lime light in the rapidly advancing research area of multi-robot systems. With new functionalities of software and hardware, they are becoming more versatile, robust and agile in response to the changes in the environment under dynamic conditions. This work focuses on a new approach for strategy planning of humanoid soccer robot teams as in the RoboCup Standard Platform League. The key element of the approach is a holistic system model of the principle solution encompassing various strategies of a soccer robot team. The benefits of the model-based approach are twofold¿it enables intuitive behavioral specification of the humanoid soccer robots in line with the team strategies envisaged by the system developers, and it systematizes the realization of their collaborative behaviors based on the principle solution. The principle solution is modeled with the newly developed specification technique CONSENS for the conceptual design of mechatronic and self-optimizing systems.The specification technique CONSENS was developed in the course of the Collaborative Research Center 614 ‘‘Self-Optimizing Concepts and Structures in Mechanical Engineering’’ funded by the German Research Foundation (DFG) under grant number SFB 614. The first two authors are funded by the Ministry of Higher Education Malaysia under the grant number 600-RMI/ST/ FRGS 5/3/Fst (256/2010) and 600-RMI/ERGS 5/3 (23/2011).Low, CY.; Aziz, N.; Aldemir, M.; Dumitrescu, R.; Anacker, H.; Mellado Arteche, M. (2013). Strategy planning for collaborative humanoid soccer robots based on principle solution. Production Engineering. 7(1):23-34. https://doi.org/10.1007/s11740-012-0416-4S233471Asada M, Kitano H (1999) The RoboCup challenge. Rob Auton Syst 29:3–12Spaan MTJ, Groen FCA (2002) Team coordination through roles, positioning and coordinated procedures. RoboCupLau N, Lopes LS, Corrente G, Nelson F (2009) Multi-robot team coordination through roles, positionings and coordinated procedures. In: 2009 IEEE/RSJ international conference on intelligent robots and systems, October 11–15, St. Louis, USAIocchi L, Nardi D, Piaggo M, Sgorbissa A (2003) Distributed coordination in heterogeneous multi-robot systems. Auton Robots 15:155–168Almeida F, Lau N, Reis LP (2010) A survey on coordination methodologies for simulated robotic soccer teams, multi-agent logics, languages, and organisations federated workshops (MALLOW 2010). Lyon, FranceLückel J, Hestermeyer T, Liu-Henke X (2001) Generalization of the Cascade principle in view of structured form of mechatronic systems. In: IEEE/ASME international conference on advanced intelligent mechatronics (AIM 2001), Villa Olmo, Como, ItalyInternational Council on Systems Engineering (INCOSE) (2007) Systems engineering vision 2020. Incose-TP-2004-004-02, SeptemberGausemeier J, Frank U, Donoth J, Kahl S (2009) Specification technique for the description of self-optimizing mechatronic systems. Res Eng Des 20(4):201–223Cyberbotics Ltd., Webots overview. 20 September 2012 at http://www.cyberbotics.com/overviewBirkhofer H (1980) Analyse und Synthese der FunktionenTechnischerProdukte. Dissertation, TechnischeUniversitätBraunschweigLanglotz G (2000) Ein Beitrag zur Funktionsstrukturentwicklung Innovativer Produkte. Dissertation, Institut fuerr Rechneranwendung in Planung und Konstruktion, Universitaet Karlsruhe, Shaker-Verlag, Band 2/2000, AachenPostel J (1980) User Datagram Protocol. RFC 760, USC/Information Sciences Institut

A Robot-Soccer-Coordination Inspired Control Architecture Applied to Islanded Microgrids

© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Nowadays islanded microgrids present a high interest due to the increasing penetration of renewable energy resources, especially in remote areas, or for improving the local energy reliability. A microgrid can operate in gridconnected or islanded mode, being necessary the use of energy storage systems under islanded operation, in order to ensure the generation/consumption power balance and smooth uncertainties in the dynamics of the renewable energy sources. Particularly, in islanded operation at least one of the distributed energy resources should assume the regulation of the common bus. In a microgrid, every distributed energy resource may be able to cooperate with the grid regulation in accordance to its particular operational conditions. In this sense, a centralized unit with a global perception of the load demand, the power provided by the renewable energy sources, and the storage capacity of the energy storage systems, may ensure proper and reliable operation of the microgrid. This paper proposes a structured architecture based on tactics, roles and behaviors for a coordinated operation of islanded microgrids. The architecture is inspired on a robot soccer strategy with global perception and centralized control, which determines the changes among operation modes for the distributed energy resources in an islanded ac microgrid.The work of N. L. Diaz and J. G. Guarnizo was supported by a scholarship from the Administrative Department of Science, Technology and Innovation COLCIENCIAS, Colombia.Díaz Aldana, NL.; Guarnizo Marín, JG.; Mellado Arteche, M.; Vasquez, JC.; Guerrero, JM. (2016). A Robot-Soccer-Coordination Inspired Control Architecture Applied to Islanded Microgrids. IEEE Transactions on Power Electronics. PP(99):1-15. doi:10.1109/TPEL.2016.2572262S115PP9

Integration of simultaneous tactile sensing and visible and near-infrared reflectance spectroscopy in a robot gripper for mango quality assessment

[EN] Development of non-destructive tools for determining mango ripeness would improve the quality of industrial production of the postharvest processes. This study addresses the creation of a new sensor that combines the capability of obtaining mechanical and optical properties of the fruit simultaneously. It has been integrated into a robot gripper that can handle the fruit obtaining non-destructive measurements of firmness, incorporating two spectrometer probes to simultaneously obtain reflectance properties in the visible and near-infrared, and two accelerometers attached to the rear side of two fingers. Partial least square regression was applied to different combinations of the spectral data obtained from the different sensors to determine the combination that provides the best results. Best prediction of ripening index was achieved using both spectral measurements and two finger accelerometer signals, with R2 P ¿ 0:832 and RMSEP of 0.520. These results demonstrate that simultaneous measurement and analysis of the data fusion set improve the robot gripper features, allowing assessment of the quality of the mangoes during pick and place operations.This work has been partially funded by the Instituto Nacional de Investigacion y Tecnologia Agraria y Alimentaria de Espana (INIA) and FEDER through research projects RTA2012-00062-C04-01, RTA2012-00062-C04-02, RTA2012-00062-C04-03, and by the Conselleria d' Educacio, Investigacio, Cultura i Esport, Generalitat Valenciana, through the project AICO/2015/122. V. Cortes thanks the Spanish MEC for the FPU grant (FPU13/04202).Cortes-Lopez, V.; Blanes Campos, C.; Blasco Ivars, J.; Ortiz Sánchez, MC.; Aleixos Borrás, MN.; Mellado Arteche, M.; Cubero García, S.... (2017). Integration of simultaneous tactile sensing and visible and near-infrared reflectance spectroscopy in a robot gripper for mango quality assessment. Biosystems Engineering. 162:112-123. doi:10.1016/j.biosystemseng.2017.08.005S11212316

Rmóvil - Introducción - Antecedentes

El vídeo presenta los antecedentes de la robótica móvilhttps://polimedia.upv.es/visor/?id=59930230-849c-11e6-8476-7979672e88beMellado Arteche, M. (2017). Rmóvil - Introducción - Antecedentes. http://hdl.handle.net/10251/82154DE