A layered control architecture for mobile robot navigation

A Thesis submitted to the University Research Degree Committee in fulfillment ofthe requirements for the degree of DOCTOR OF PHILOSOPHY in RoboticsThis thesis addresses the problem of how to control an autonomous mobile robot navigation in indoor environments, in the face of sensor noise, imprecise information, uncertainty and limited response time. The thesis argues that the effective control of autonomous mobile robots can be achieved by organising low level and higher level control activities into a layered architecture. The low level reactive control allows the robot to respond to contingencies quickly. The higher level control allows the robot to make longer term decisions and arranges appropriate sequences for a task execution. The thesis describes the design and implementation of a two layer control architecture, a task template based sequencing layer and a fuzzy behaviour based low level control layer. The sequencing layer works at the pace of the higher level of abstraction, interprets a task plan, mediates and monitors the controlling activities. While the low level performs fast computation in response to dynamic changes in the real world and carries out robust control under uncertainty. The organisation and fusion of fuzzy behaviours are described extensively for the construction of a low level control system. A learning methodology is also developed to systematically learn fuzzy behaviours and the behaviour selection network and therefore solve the difficulties in configuring the low level control layer. A two layer control system has been implemented and used to control a simulated mobile robot performing two tasks in simulated indoor environments. The effectiveness of the layered control and learning methodology is demonstrated through the traces of controlling activities at the two different levels. The results also show a general design methodology that the high level should be used to guide the robot's actions while the low level takes care of detailed control in the face of sensor noise and environment uncertainty in real time

Conceptual spatial representations for indoor mobile robots

We present an approach for creating conceptual representations of human-made indoor environments using mobile robots. The concepts refer to spatial and functional properties of typical indoor environments. Following findings in cognitive psychology, our model is composed of layers representing maps at different levels of abstraction. The complete system is integrated in a mobile robot endowed with laser and vision sensors for place and object recognition. The system also incorporates a linguistic framework that actively supports the map acquisition process, and which is used for situated dialogue. Finally, we discuss the capabilities of the integrated system

Q Learning Behavior on Autonomous Navigation of Physical Robot

Behavior based architecture gives robot fast and reliable action. If there are many behaviors in robot, behavior coordination is needed. Subsumption architecture is behavior coordination method that give quick and robust response. Learning mechanism improve robot’s performance in handling uncertainty. Q learning is popular reinforcement learning method that has been used in robot learning because it is simple, convergent and off policy. In this paper, Q learning will be used as learning mechanism for obstacle avoidance behavior in autonomous robot navigation. Learning rate of Q learning affect robot’s performance in learning phase. As the result, Q learning algorithm is successfully implemented in a physical robot with its imperfect environment

A layered fuzzy logic controller for nonholonomic car-like robot

A system for real time navigation of a nonholonomic car-like robot in a dynamic environment consists of two layers is described: a Sugeno-type fuzzy motion planner; and a modified proportional navigation based fuzzy controller. The system philosophy is inspired by human routing when moving between obstacles based on visual information including right and left views to identify the next step to the goal. A Sugeno-type fuzzy motion planner of four inputs one output is introduced to give a clear direction to the robot controller. The second stage is a modified proportional navigation based fuzzy controller based on the proportional navigation guidance law and able to optimize the robot's behavior in real time, i.e. to avoid stationary and moving obstacles in its local environment obeying kinematics constraints. The system has an intelligent combination of two behaviors to cope with obstacle avoidance as well as approaching a target using a proportional navigation path. The system was simulated and tested on different environments with various obstacle distributions. The simulation reveals that the system gives good results for various simple environments

Realization of reactive control for multi purpose mobile agents

Mobile robots are built for different purposes, have different physical size, shape, mechanics and electronics. They are required to work in real-time, realize more than one goal simultaneously, hence to communicate and cooperate with other agents. The approach proposed in this paper for mobile robot control is reactive and has layered structure that supports multi sensor perception. Potential field method is implemented for both obstacle avoidance and goal tracking. However imaginary forces of the obstacles and of the goal point are separately treated, and then resulting behaviors are fused with the help of the geometry. Proposed control is tested on simulations where different scenarios are studied. Results have confirmed the high performance of the method

Robotic Wireless Sensor Networks

In this chapter, we present a literature survey of an emerging, cutting-edge, and multi-disciplinary field of research at the intersection of Robotics and Wireless Sensor Networks (WSN) which we refer to as Robotic Wireless Sensor Networks (RWSN). We define a RWSN as an autonomous networked multi-robot system that aims to achieve certain sensing goals while meeting and maintaining certain communication performance requirements, through cooperative control, learning and adaptation. While both of the component areas, i.e., Robotics and WSN, are very well-known and well-explored, there exist a whole set of new opportunities and research directions at the intersection of these two fields which are relatively or even completely unexplored. One such example would be the use of a set of robotic routers to set up a temporary communication path between a sender and a receiver that uses the controlled mobility to the advantage of packet routing. We find that there exist only a limited number of articles to be directly categorized as RWSN related works whereas there exist a range of articles in the robotics and the WSN literature that are also relevant to this new field of research. To connect the dots, we first identify the core problems and research trends related to RWSN such as connectivity, localization, routing, and robust flow of information. Next, we classify the existing research on RWSN as well as the relevant state-of-the-arts from robotics and WSN community according to the problems and trends identified in the first step. Lastly, we analyze what is missing in the existing literature, and identify topics that require more research attention in the future

CORBYS cognitive control architecture for robotic follower

In this paper the novel generic cognitive robot control architecture CORBYS is presented. The objective of the CORBYS architecture is the integration of high-level cognitive modules to support robot functioning in dynamic environments including interacting with humans. This paper presents the preliminary integration of the CORBYS architecture to support a robotic follower. Experimental results on high-level empowerment-based trajectory planning have demonstrated the effectiveness of ROS-based communication between distributed modules developed in a multi-site research environment as typical for distributed collaborative projects such as CORBYS

A Hierarchical Hybrid Architecture for Mission-Oriented Robot Control

The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-319-03413-3_26In this work is presented a general architecture for a multi physical agent network system based on the coordination and the behaviour management. The system is organised in a hierarchical structure where are distinguished the individual agent actions and the collective ones linked to the whole agent network. Individual actions are also organised in a hybrid layered system that take advantages from reactive and deliberative control. Sensing system is involved as well in the behaviour architecture improving the information acquisition performance.This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the CICYT project Mission Based Control (COBAMI): DPI2011-28507-C02-02, under coordinated project High Integrity Partitioned Embedded Systems (Hi-PartES): TIN2011-28567-C03-03, and under the collaborative research project supported by the European Union MultiPARTES Project: FP7-ICT 287702. 2011-14.Muñoz Alcobendas, M.; Munera Sánchez, E.; Blanes Noguera, F.; Simó Ten, JE. (2013). A Hierarchical Hybrid Architecture for Mission-Oriented Robot Control. En ROBOT2013: First Iberian Robotics Conference: Advances in Robotics, Vol. 1. Springer. 363-380. https://doi.org/10.1007/978-3-319-03413-3_26S363380Aragues, R.: Consistent data association in multi-robot systems with limited communications. Robotics: Science and Systems, 97–104 (2010)Aragues, R., Cortes, J., Sagues, C.: Distributed consensus on robot networks for dynamically merging feature-based maps. IEEE Transactions on Robotics (2012)Arkin, R.C.: Motor schema based mobile robot navigation. The International Journal of Robotics Research 8(4), 92–112 (1989)Asama, H., Habib, M.K., Endo, I., Ozaki, K., Matsumoto, A., Ishida, Y.: Functional distribution among multiple mobile robots in an autonomous and decentralized robot system. In: Proceedings of the 1991 IEEE International Conference on Robotics and Automation. IEEE (1991)Benet, G., Blanes, F., Martínez, M., Simó, J.: A multisensor robot distributed architecture. In: IFAC Conference INCOM 1998 (1998)Brooks, R.: A robust layered control system for a mobile robot. IEEE Journal of Robotics and Automation 2(1), 14–23 (1986)Canas, J.M., Matellán, V.: Dynamic schema hierarchies for an autonomous robot. In: Garijo, F.J., Riquelme, J.-C., Toro, M. (eds.) IBERAMIA 2002. LNCS (LNAI), vol. 2527, pp. 903–912. Springer, Heidelberg (2002)Choset, H., Nagatani, K.: Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localization. IEEE Transactions on Robotics and Automation 17(2), 125–137 (2001)Fox, D., Burgard, W., Dellaert, F., Thrun, S.: Monte carlo localization: Efficient position estimation for mobile robots. American Association for Artificial Intelligence, 343–349 (1999)Hu, J., Xie, L., Xu, J.: Vision-based multi-agent cooperative target search. In: Control Automation Robotics & Vision (ICARCV), pp. 895–900 (2012)Huq, R., Mann, G.K.I., Gosine, R.G.: Behavior-modulation technique in mobile robotics using fuzzy discrete event system. IEEE Transactions on Robotics 22(5), 903–916 (2006)Jayasiri, A., Mann, G., Gosine, R.G.: Mobile robot behavior coordination using supervisory control of fuzzy discrete event systems. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009, pp. 690–695 (2009)Jayasiri, A., Mann, G.K.I., Gosine, R.G.: Behavior coordination of mobile robotics using supervisory control of fuzzy discrete event systems. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 41(5), 1224–1238 (2011)Koenig, N., Howard, A.: Gazebo-3d multiple robot simulator with dynamics. Technical report (2006)Lin, F., Ying, H.: Modeling and control of fuzzy discrete event systems. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 32(4), 408–415 (2002)Madden, J.D.: Multi-robot system based on model of wolf hunting behavior to emulate wolf and elk interactions. In: 2010 IEEE International Conference on Robotics and Biomimetics, ROBIO, pp. 1043–1050 (2010)Mataric, M.J.: Interaction and intelligent behavior. Technical report, DTIC Document (1994)Olivera, V.M., Molina, J.M., Sommaruga, L., et al.: Fuzzy cooperation of autonomous robots. In: Fourth International System on Intelligent Robotics Systems, Lisboa, Portugal (1996)McGann, C., Py, F., Rajan, K., Thomas, H., Henthorn, R., McEwen, R.: A deliberative architecture for auv control. In: IEEE International Conference on Robotics and Automation, ICRA 2008, pp. 1049–1054. IEEE (2008)Munera, E., Muñoz, M., Simó, J., Blanes, F.: Humanoid Robot Self-Location In SPL League. In: Comité Español de Automática (CEA), XXXIII Jornadas de Automatica, 797–804 (2012)Proetzsch, M., Luksch, T., Berns, K.: Development of complex robotic systems using the behavior-based control architecture iB2C. Robotics and Autonomous Systems 58(1), 46–67 (2010)Qiu, D.: Supervisory control of fuzzy discrete event systems: a formal approach. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 35(1), 72–88 (2005)Aladebaran Robotics. NAO Software Documentation 1.12. Technical report (2012)St-Pierre, M., Gingras, D.: Comparison between the unscented Kalman filter and the extended Kalman filter for the position estimation module of an integrated navigation information system. In: 2004 IEEE Intelligent Vehicles Symposium, pp. 831–835 (2004)Stoytchev, A., Arkin, R.C.: Combining deliberation, reactivity, and motivation in the context of a behavior-based robot architecture. In: Proceedings of the 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp. 290–295 (2001)Nicolau, V., Muñoz, M., Simó, J.: KertrolBot Platform. SiDiReLi: Distributed System with Limited Resources. Technical report, Institute of Control Systems and Industrial Computing - Polytechnic University of Valencia, Valencia, Spain (2011