Interactive Robot Learning of Gestures, Language and Affordances

A growing field in robotics and Artificial Intelligence (AI) research is human-robot collaboration, whose target is to enable effective teamwork between humans and robots. However, in many situations human teams are still superior to human-robot teams, primarily because human teams can easily agree on a common goal with language, and the individual members observe each other effectively, leveraging their shared motor repertoire and sensorimotor resources. This paper shows that for cognitive robots it is possible, and indeed fruitful, to combine knowledge acquired from interacting with elements of the environment (affordance exploration) with the probabilistic observation of another agent's actions. We propose a model that unites (i) learning robot affordances and word descriptions with (ii) statistical recognition of human gestures with vision sensors. We discuss theoretical motivations, possible implementations, and we show initial results which highlight that, after having acquired knowledge of its surrounding environment, a humanoid robot can generalize this knowledge to the case when it observes another agent (human partner) performing the same motor actions previously executed during training.Comment: code available at https://github.com/gsaponaro/glu-gesture

Lower body design of the ‘iCub’ a human-baby like crawling robot

The development of robotic cognition and a greater understanding of human cognition form two of the current greatest challenges of science. Within the RobotCub project the goal is the development of an embodied robotic child (iCub) with the physical and ultimately cognitive abilities of a 2frac12 year old human baby. The ultimate goal of this project is to provide the cognition research community with an open human like platform for understanding of cognitive systems through the study of cognitive development. In this paper the design of the mechanisms adopted for lower body and particularly for the leg and the waist are outlined. This is accompanied by discussion on the actuator group realisation in order to meet the torque requirements while achieving the dimensional and weight specifications. Estimated performance measures of the iCub are presented

Human-friendly robotic manipulators: safety and performance issues in controller design

Recent advances in robotics have spurred its adoption into new application areas such as medical, rescue, transportation, logistics, personal care and entertainment. In the personal care domain, robots are expected to operate in human-present environments and provide non-critical assistance. Successful and flourishing deployment of such robots present different opportunities as well as challenges. Under a national research project, Bobbie, this dissertation analyzes challenges associated with these robots and proposes solutions for identified problems. The thesis begins by highlighting the important safety concern and presenting a comprehensive overview of safety issues in a typical domestic robot system. By using functional safety concept, the overall safety of the complex robotic system was analyzed through subsystem level safety issues. Safety regions in the world model of the perception subsystem, dependable understanding of the unstructured environment via fusion of sensory subsystems, lightweight and compliant design of mechanical components, passivity based control system and quantitative metrics used to assert safety are some important points discussed in the safety review. The main research focus of this work is on controller design of robotic manipulators against two conflicting requirements: motion performance and safety. Human-friendly manipulators used on domestic robots exhibit a lightweight design and demand a stable operation with a compliant behavior injected via a passivity based impedance controller. Effective motion based manipulation using such a controller requires a highly stiff behavior while important safety requirements are achieved with compliant behaviors. On the basis of this intuitive observation, this research identifies suitable metrics to identify the appropriate impedance for a given performance and safety requirement. This thesis also introduces a domestic robot design that adopts a modular design approach to minimize complexity, cost and development time. On the basis of functional modularity concept where each module has a unique functional contribution in the system, the robot “Bobbie-UT‿ is built as an interconnection of interchangeable mobile platform, torso, robotic arm and humanoid head components. Implementation of necessary functional and safety requirements, design of interfaces and development of suitable software architecture are also discussed with the design

Clustering for Different Scales of Measurement - the Gap-Ratio Weighted K-means Algorithm

This paper describes a method for clustering data that are spread out over large regions and which dimensions are on different scales of measurement. Such an algorithm was developed to implement a robotics application consisting in sorting and storing objects in an unsupervised way. The toy dataset used to validate such application consists of Lego bricks of different shapes and colors. The uncontrolled lighting conditions together with the use of RGB color features, respectively involve data with a large spread and different levels of measurement between data dimensions. To overcome the combination of these two characteristics in the data, we have developed a new weighted K-means algorithm, called gap-ratio K-means, which consists in weighting each dimension of the feature space before running the K-means algorithm. The weight associated with a feature is proportional to the ratio of the biggest gap between two consecutive data points, and the average of all the other gaps. This method is compared with two other variants of K-means on the Lego bricks clustering problem as well as two other common classification datasets.Comment: 13 pages, 6 figures, 2 tables. This paper is under the review process for AIAP 201

Combining energy and power based safety metrics in controller design for domestic robots

This paper presents a general passivity based interaction controller design approach that utilizes a combined energy and power based safety norms to assert safety of domestic robots. Since these robots are expected to co-habit the same environment with a human user, analysing and ensuring their safety is an important requirement. Safety analysis of domestic robots determine whether a robot achieves a desired safety level according to some quantitative safety metrics. When it comes to controller design for human friendly robots, it often involves introducing compliance and ensuring asymptotic stability using impedance control technique and passivity theories. The controller proposed in this work uses a passive design that extends the standard impedance control scheme with energy and power based safety metrics to ensure that safety requirements defined in these norms are achieved by domestic robots. The effectiveness of the proposed guideline is illustrated with simulation and experimental results

Visions, Values, and Videos: Revisiting Envisionings in Service of UbiComp Design for the Home

UbiComp has been envisioned to bring about a future dominated by calm computing technologies making our everyday lives ever more convenient. Yet the same vision has also attracted criticism for encouraging a solitary and passive lifestyle. The aim of this paper is to explore and elaborate these tensions further by examining the human values surrounding future domestic UbiComp solutions. Drawing on envisioning and contravisioning, we probe members of the public (N=28) through the presentation and focus group discussion of two contrasting animated video scenarios, where one is inspired by "calm" and the other by "engaging" visions of future UbiComp technology. By analysing the reasoning of our participants, we identify and elaborate a number of relevant values involved in balancing the two perspectives. In conclusion, we articulate practically applicable takeaways in the form of a set of key design questions and challenges.Comment: DIS'20, July 6-10, 2020, Eindhoven, Netherland

Responsible domestic robotics:Exploring ethical implications of robots in the home

Purpose: The vision of robotics in the home promises increased convenience, comfort, companionship, and greater security for users. The robot industry risks causing harm to users, being rejected by society at large, or being regulated in overly prescriptive ways if robots are not developed in a socially responsible manner. The purpose of this paper is to explore some of the challenges and requirements for designing responsible domestic robots.Design/methodology/approach: The paper examines definitions of robotics and the current commercial state of the art. In particular it considers the emerging technological trends, such as smart homes, that are already embedding computational agents in the fabric of everyday life. The paper then explores the role of values in design, aligning with human computer interaction and considers the importance of the home as a deployment setting for robots. The paper examines what responsibility in robotics means and draws lessons from past home information technologies. An exploratory pilot survey was conducted to understand user concerns about different aspects of domestic robots such as form, privacy and trust. The paper provides these findings, married with literature analysis from across technology law, computer ethics and computer science.Findings: By drawing together both empirical observations and conceptual analysis, this paper concludes that user centric design is needed to create responsible domestic robotics in the future.Originality/value: This multidisciplinary paper provides conceptual and empirical research from different domains to unpack the challenges of designing responsible domestic robotics

An Integrated Testbed for Cooperative Perception with Heterogeneous Mobile and Static Sensors

Cooperation among devices with different sensing, computing and communication capabilities provides interesting possibilities in a growing number of problems and applications including domotics (domestic robotics), environmental monitoring or intelligent cities, among others. Despite the increasing interest in academic and industrial communities, experimental tools for evaluation and comparison of cooperative algorithms for such heterogeneous technologies are still very scarce. This paper presents a remote testbed with mobile robots and Wireless Sensor Networks (WSN) equipped with a set of low-cost off-the-shelf sensors, commonly used in cooperative perception research and applications, that present high degree of heterogeneity in their technology, sensed magnitudes, features, output bandwidth, interfaces and power consumption, among others. Its open and modular architecture allows tight integration and interoperability between mobile robots and WSN through a bidirectional protocol that enables full interaction. Moreover, the integration of standard tools and interfaces increases usability, allowing an easy extension to new hardware and software components and the reuse of code. Different levels of decentralization are considered, supporting from totally distributed to centralized approaches. Developed for the EU-funded Cooperating Objects Network of Excellence (CONET) and currently available at the School of Engineering of Seville (Spain), the testbed provides full remote control through the Internet. Numerous experiments have been performed, some of which are described in the paper