Evaluating the use of robots to enlarge AAL services

We introduce robots as a tools to enhance Ambient Assisted Living (AAL) services. Robots are a unique opportunity to create new systems to cooperate in reaching better living conditions. Robots offer the possibility of richer interaction with humans, and can perform actions to actively change the environment. The current state-of-art includes skills in various areas, including advanced interaction (natural language, visual attention, object recognition, intention learning), navigation (map learning, obstacle avoidance), manipulation (grasping, use of tools), and cognitive architectures to handle highly unpredictable environments. From our experience in several robotics projects and principally in the RoboCup@Home competition, a new set of evaluation methods is proposed to assess the maturity of the required skills. Such comparison should ideally enable the abstraction from the particular robotic platform and concentrate on the easy comparison of skills. The validity of that low-level skills can be then scaled to more complex tasks, that are composed by several skills. Our conclusion is that effective evaluation methods can be designed with the objective of enabling robots to enlarge AAL services.This research was partly supported by the PATRICIA project (TIN2012-38416-C03-01), MANIPlus project (201350E102), Spanish Ministry of Economy and Competitiveness, and European Found for Regional Development (FEDER).Peer Reviewe

Fostering Progress in Performance Evaluation and Benchmarking of Robotic and Automation Systems

We have shared benchmarks for many engineering systems and products in the market that can be used to compare solutions and systems. We can compare cars in terms of maximum speed, acceleration, and maximum torque; computers in terms of flops, random access memory, and hard disk capacity; and smartphones in terms of battery life and screen dimensions. We also have shared usability metrics based on human factors, which are used to compare the ease of use of different software interfaces. When we come to the evaluation and the comparison of how intelligent, robust, adaptive, and antifragile the behaviors of robots are in performing a given set of tasks, such as daily life activities with daily life objects such as in a kitchen or a hospital room, we are in trouble