Human-robot teamwork: a knowledge-based solution

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Engenharia Electrotécnica e de ComputadoresTeams of humans and robots pose new challenges to the teamwork field. This stems from the fact that robots and humans have significantly different perceptual, reasoning, communication and actuation capabilities. This dissertation contributes to solving this problem by proposing a knowledge-based multi-agent system to support design and execution of stereotyped (i.e. recurring) human-robot teamwork. The cooperative workflow formalism has been selected to specify team plans, and adapted to allow activities to share structured data, even during their execution. This novel functionality enables tightly coupled interactions among team members. Rather than focusing on automatic teamwork planning, this dissertation proposes a complementary and intuitive knowledge-based solution for fast deployment and adaptation of small scale human-robot teams. In addition, the system has been designed in order to improve task awareness of each mission participant, and of the human overall mission awareness. A set of empirical results obtained from simulated and real missions proved the concept and the reusability of such a system. Practical results showed that this approach used is an effective solution for small scale teams in stereotyped human-robot teamwork

DSAAR: distributed software architecture for autonomous robots

Dissertação apresentada na Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa para obtenção do grau de Mestre em Engenharia ElectrotécnicaThis dissertation presents a software architecture called the Distributed Software Architecture for Autonomous Robots (DSAAR), which is designed to provide the fast development and prototyping of multi-robot systems. The DSAAR building blocks allow engineers to focus on the behavioural model of robots and collectives. This architecture is of special interest in domains where several human, robot, and software agents have to interact continuously. Thus, fast prototyping and reusability is a must. DSAAR tries to cope with these requirements towards an advanced solution to the n-humans and m-robots problem with a set of design good practices and development tools. This dissertation will also focus on Human-Robot Interaction, mainly on the subject of teleoperation. In teleoperation human judgement is an integral part of the process, heavily influenced by the telemetry data received from the remote environment. So the speed in which commands are given and the telemetry data is received, is of crucial importance. Using the DSAAR architecture a teleoperation approach is proposed. This approach was designed to provide all entities present in the network a shared reality, where every entity is an information source in an approach similar to the distributed blackboard. This solution was designed to accomplish a real time response, as well as, the completest perception of the robots’ surroundings. Experimental results obtained with the physical robot suggest that the system is able to guarantee a close interaction between users and robot

Aisimam - An Artificial immune system based intelligent multiangent model

The goal of this thesis is to develop a biological model for multiagent systems. This thesis explores artificial immune systems, a novel evolutionary paradigm based on the immunological principles. Artificial Immune systems (AIS) are found to be powerful to solve complex computational tasks. The main focus of the thesis is to develop a generic mathematical model that uses the principles of the human immune system in multiagent systems (MAS). The components and properties of the human immune system are studied. On understanding the concepts of A/5, a literature survey of multiagent systems is performed to understand and compare the multiagent concepts and AIS concepts. An analogy between the immune system parameters and the agent theory was derived. Then, an intelligent multiagent model named AISIMAM is derived. It exploits several properties and features of the immune system in multiagent systems. In other words, the intelligence of the immune systems to kill the antigen and the characteristics of the agents are combined in the model. The model is expressed in terms of mathematical expressions. The model is applied to a specific application namely the mine detection and defusion. The simulations are done in MATLAB that runs on a PC. The experimental results of AISIMAM applied to the mine detection problem are discussed. The results are successful and shows that AISIMAM could be an alternative solution to agent based problems. Artificial Immune System is also applied to a pattern recognition problem. The problem experimented is a color image classification problem useful in a real time industrial application. The images are those of wooden components that need to be classified according to the color and type of wood. To solve the classification task, a simple negative selection and genetic algorithm based A/5 algorithm was developed and simulated. The results are compared with the radial basis function approach applied to the same set of input images

Robust Continuous System Integration for Critical Deep-Sea Robot Operations Using Knowledge-Enabled Simulation in the Loop

Deep-sea robot operations demand a high level of safety, efficiency and reliability. As a consequence, measures within the development stage have to be implemented to extensively evaluate and benchmark system components ranging from data acquisition, perception and localization to control. We present an approach based on high-fidelity simulation that embeds spatial and environmental conditions from recorded real-world data. This simulation in the loop (SIL) methodology allows for mitigating the discrepancy between simulation and real-world conditions, e.g. regarding sensor noise. As a result, this work provides a platform to thoroughly investigate and benchmark behaviors of system components concurrently under real and simulated conditions. The conducted evaluation shows the benefit of the proposed work in tasks related to perception and self-localization under changing spatial and environmental conditions.Comment: published on IROS 201

THE DETECTION OF MINEFIELD IN SPECTRAL MAPPING WITH USING OF UAV

Negligence in the use of human labor in demining dangerous areas can result in great human casualties. If we consider that we live in a modern information society, we can say that before the reconstruction and rehabilitation work in these areas, there is a need to apply information and communication technologies in the field of mine clearance to minimize human labor, hazards and losses. The scientific work presents the development of UAVs used for geo-detection of explosive surface mines by computer vision. The proposed integrated unmanned aerial vehicles will enable the acquisition of danger zones by spectral mapping and aim to clear explosives 100% and as soon as possible. In order to save time, it is important to identify the areas beyond the mine operations as well as detecting the mined areas. The proposed equipment will allow obtaining a map of the boundaries of dangerous areas. This will allow mines to be detected in larger areas and with minimal risks in the shortest possible time.Negligence in the use of human labor in demining dangerous areas can result in great human casualties. If we consider that we live in a modern information society, we can say that before the reconstruction and rehabilitation work in these areas, there is a need to apply information and communication technologies in the field of mine clearance to minimize human labor, hazards and losses. The scientific work presents the development of UAVs used for geo-detection of explosive surface mines by computer vision. The proposed integrated unmanned aerial vehicles will enable the acquisition of danger zones by spectral mapping and aim to clear explosives 100% and as soon as possible. In order to save time, it is important to identify the areas beyond the mine operations as well as detecting the mined areas. The proposed equipment will allow obtaining a map of the boundaries of dangerous areas. This will allow mines to be detected in larger areas and with minimal risks in the shortest possible time

Trends in the control of hexapod robots: a survey

The static stability of hexapods motivates their design for tasks in which stable locomotion is required, such as navigation across complex environments. This task is of high interest due to the possibility of replacing human beings in exploration, surveillance and rescue missions. For this application, the control system must adapt the actuation of the limbs according to their surroundings to ensure that the hexapod does not tumble during locomotion. The most traditional approach considers their limbs as robotic manipulators and relies on mechanical models to actuate them. However, the increasing interest in model-free models for the control of these systems has led to the design of novel solutions. Through a systematic literature review, this paper intends to overview the trends in this field of research and determine in which stage the design of autonomous and adaptable controllers for hexapods is.The first author received funding through a doctoral scholarship from the Portuguese Foundation for Science and Technology (FCT) (Grant No. SFRH/BD/145818/2019), with funds from the Portuguese Ministry of Science, Technology and Higher Education and the European Social Fund through the Programa Operacional Regional Norte. This work has been supported by the FCT national funds, under the national support to R&D units grant, through the reference project UIDB/04436/2020 and UIDP/04436/2020

Autonomous Landmine Detection Rover

Major engagements throughout modern history have left unexploded and unmarked anti-personnel landmines, which result in thousands of casualties each year. Current demi- ning detection methods use sensors such as metal detectors or trained animals such as rats. This project mitigates the threat to human life by replacing human operators with an au- tonomous robotic system. Building upon prior work, a rover was developed which locates and marks anti-personnel landmines in a user-de ned location which a separate octocopter drone will later eliminate

Autonomous Landmine Detection Rover

Major engagements throughout modern history have left unexploded and unmarked anti-personnel landmines, which result in thousands of casualties each year. Current demining detection methods use sensors such as metal detectors or trained animals such as rats. This project mitigates the threat to human life by replacing human operators with an autonomous robotic system. Building upon prior work, a rover was developed which locates and marks anti-personnel landmines in a user- defined location which a separate octocopter drone will later eliminate