Model-Based Environmental Visual Perception for Humanoid Robots

The visual perception of a robot should answer two fundamental questions: What? and Where? In order to properly and efficiently reply to these questions, it is essential to establish a bidirectional coupling between the external stimuli and the internal representations. This coupling links the physical world with the inner abstraction models by sensor transformation, recognition, matching and optimization algorithms. The objective of this PhD is to establish this sensor-model coupling

Post-Turing Methodology: Breaking the Wall on the Way to Artificial General Intelligence

This article offers comprehensive criticism of the Turing test and develops quality criteria for new artificial general intelligence (AGI) assessment tests. It is shown that the prerequisites A. Turing drew upon when reducing personality and human consciousness to “suitable branches of thought” re-flected the engineering level of his time. In fact, the Turing “imitation game” employed only symbolic communication and ignored the physical world. This paper suggests that by restricting thinking ability to symbolic systems alone Turing unknowingly constructed “the wall” that excludes any possi-bility of transition from a complex observable phenomenon to an abstract image or concept. It is, therefore, sensible to factor in new requirements for AI (artificial intelligence) maturity assessment when approaching the Tu-ring test. Such AI must support all forms of communication with a human being, and it should be able to comprehend abstract images and specify con-cepts as well as participate in social practices

Towards adaptive and autonomous humanoid robots: from vision to actions

Although robotics research has seen advances over the last decades robots are still not in widespread use outside industrial applications. Yet a range of proposed scenarios have robots working together, helping and coexisting with humans in daily life. In all these a clear need to deal with a more unstructured, changing environment arises. I herein present a system that aims to overcome the limitations of highly complex robotic systems, in terms of autonomy and adaptation. The main focus of research is to investigate the use of visual feedback for improving reaching and grasping capabilities of complex robots. To facilitate this a combined integration of computer vision and machine learning techniques is employed. From a robot vision point of view the combination of domain knowledge from both imaging processing and machine learning techniques, can expand the capabilities of robots. I present a novel framework called Cartesian Genetic Programming for Image Processing (CGP-IP). CGP-IP can be trained to detect objects in the incoming camera streams and successfully demonstrated on many different problem domains. The approach requires only a few training images (it was tested with 5 to 10 images per experiment) is fast, scalable and robust yet requires very small training sets. Additionally, it can generate human readable programs that can be further customized and tuned. While CGP-IP is a supervised-learning technique, I show an integration on the iCub, that allows for the autonomous learning of object detection and identification. Finally this dissertation includes two proof-of-concepts that integrate the motion and action sides. First, reactive reaching and grasping is shown. It allows the robot to avoid obstacles detected in the visual stream, while reaching for the intended target object. Furthermore the integration enables us to use the robot in non-static environments, i.e. the reaching is adapted on-the- fly from the visual feedback received, e.g. when an obstacle is moved into the trajectory. The second integration highlights the capabilities of these frameworks, by improving the visual detection by performing object manipulation actions

Design and Implementation of a Computer Vision System for an Autonomous Chess-Playing Robot

This work describes a mechatronic system composed by a robot arm that can play chess autonomously. The system is based on an industrial-grade robot manipulator, a computer vision system, and an open source chess engine. Classification algorithms were implemented in order to detect whether a given chessboard square is occupied, and in that case, if the piece is black or white. Such algorithms were compared in terms of their complexity of implementation, execution time and accuracy of predictions. To achieve an uniform illumination of the chessboard, a theoretical model of an LED illuminance curve was used to find the best orientation for each diode using a genetic algorithm. Both the support base for the LEDs and the chess pieces were made using a 3D printer. This implementation demonstrates the capabilities of the proposed vision-based system, whose complexity can be increased in the future for a number of applications.Facultad de Informátic

Design and Implementation of a Computer Vision System for an Autonomous Chess-Playing Robot

This work describes a mechatronic system composed by a robot arm that can play chess autonomously. The system is based on an industrial-grade robot manipulator, a computer vision system, and an open source chess engine. Classification algorithms were implemented in order to detect whether a given chessboard square is occupied, and in that case, if the piece is black or white. Such algorithms were compared in terms of their complexity of implementation, execution time and accuracy of predictions. To achieve an uniform illumination of the chessboard, a theoretical model of an LED illuminance curve was used to find the best orientation for each diode using a genetic algorithm. Both the support base for the LEDs and the chess pieces were made using a 3D printer. This implementation demonstrates the capabilities of the proposed vision-based system, whose complexity can be increased in the future for a number of applications.Facultad de Informátic