Lifelong Augmentation of Multi-Modal Streaming Autobiographical Memories

Robot systems that interact with humans over extended periods of time will benefit from storing and recalling large amounts of accumulated sensorimotor and interaction data. We provide a principled framework for the cumulative organisation of streaming autobiographical data so that data can be continuously processed and augmented as the processing and reasoning abilities of the agent develop and further interactions with humans take place. As an example, we show how a kinematic structure learning algorithm reasons a-posteriori about the skeleton of a human hand. A partner can be asked to provide feedback about the augmented memories, which can in turn be supplied to the reasoning processes in order to adapt their parameters. We employ active, multi-modal remembering, so the robot as well as humans can gain insights of both the original and augmented memories. Our framework is capable of storing discrete and continuous data in real-time. The data can cover multiple modalities and several layers of abstraction (e.g. from raw sound signals over sentences to extracted meanings). We show a typical interaction with a human partner using an iCub humanoid robot. The framework is implemented in a platform-independent manner. In particular, we validate its multi platform capabilities using the iCub, Baxter and NAO robots. We also provide an interface to cloud based services, which allow automatic annotation of episodes. Our framework is geared towards the developmental robotics community, as it 1) provides a variety of interfaces for other modules, 2) unifies previous works on autobiographical memory, and 3) is licensed as open source software

Mutual Alignment Transfer Learning

Training robots for operation in the real world is a complex, time consuming and potentially expensive task. Despite significant success of reinforcement learning in games and simulations, research in real robot applications has not been able to match similar progress. While sample complexity can be reduced by training policies in simulation, such policies can perform sub-optimally on the real platform given imperfect calibration of model dynamics. We present an approach -- supplemental to fine tuning on the real robot -- to further benefit from parallel access to a simulator during training and reduce sample requirements on the real robot. The developed approach harnesses auxiliary rewards to guide the exploration for the real world agent based on the proficiency of the agent in simulation and vice versa. In this context, we demonstrate empirically that the reciprocal alignment for both agents provides further benefit as the agent in simulation can adjust to optimize its behaviour for states commonly visited by the real-world agent

An ontology framework for developing platform-independent knowledge-based engineering systems in the aerospace industry

This paper presents the development of a novel knowledge-based engineering (KBE) framework for implementing platform-independent knowledge-enabled product design systems within the aerospace industry. The aim of the KBE framework is to strengthen the structure, reuse and portability of knowledge consumed within KBE systems in view of supporting the cost-effective and long-term preservation of knowledge within such systems. The proposed KBE framework uses an ontology-based approach for semantic knowledge management and adopts a model-driven architecture style from the software engineering discipline. Its phases are mainly (1) Capture knowledge required for KBE system; (2) Ontology model construct of KBE system; (3) Platform-independent model (PIM) technology selection and implementation and (4) Integration of PIM KBE knowledge with computer-aided design system. A rigorous methodology is employed which is comprised of five qualitative phases namely, requirement analysis for the KBE framework, identifying software and ontological engineering elements, integration of both elements, proof of concept prototype demonstrator and finally experts validation. A case study investigating four primitive three-dimensional geometry shapes is used to quantify the applicability of the KBE framework in the aerospace industry. Additionally, experts within the aerospace and software engineering sector validated the strengths/benefits and limitations of the KBE framework. The major benefits of the developed approach are in the reduction of man-hours required for developing KBE systems within the aerospace industry and the maintainability and abstraction of the knowledge required for developing KBE systems. This approach strengthens knowledge reuse and eliminates platform-specific approaches to developing KBE systems ensuring the preservation of KBE knowledge for the long term

Portability, compatibility and reuse of MAC protocols across different IoT radio platforms

To cope with the diversity of Internet of Things (loT) requirements, a large number of Medium Access Control (MAC) protocols have been proposed in scientific literature, many of which are designed for specific application domains. However, for most of these MAC protocols, no multi-platform software implementation is available. In fact, the path from conceptual MAC protocol proposed in theoretical papers, towards an actual working implementation is rife with pitfalls. (i) A first problem is the timing bugs, frequently encountered in MAC implementations. (ii) Furthermore, once implemented, many MAC protocols are strongly optimized for specific hardware, thereby limiting the potential of software reuse or modifications. (iii) Finally, in real-life conditions, the performance of the MAC protocol varies strongly depending on the actual underlying radio chip. As a result, the same MAC protocol implementation acts differently per platform, resulting in unpredictable/asymmetrical behavior when multiple platforms are combined in the same network. This paper describes in detail the challenges related to multi-platform MAC development, and experimentally quantifies how the above issues impact the MAC protocol performance when running MAC protocols on multiple radio chips. Finally, an overall methodology is proposed to avoid the previously mentioned cross-platform compatibility issues. (C) 2018 Elsevier B.V. All rights reserved

Human-computer cooperation platform for developing real-time robotic applications

[EN] This paper presents a human-computer cooperation platform, which permits the coordination between the user and the tool to improve the development of real-time control applications (e.g., mobile robots). These applications have functional (robot objectives) and temporal requirements to accomplish (deadlines guarantee of tasks). The simulation tool has been designed in order to permit the testing and validation of these two requirements. To this end, the tool is composed of two independent simulators interconnected through a shared memory: the robot simulator (functional level) and the real-time task scheduler simulator (task execution level). Robotic applications can be defined with the robot simulator while the real-time scheduler simulator permits to analyze the schedulability of the robotic tasks. The real-time task simulator incorporates a flexible task model where the task temporal parameters (e.g., computation time) adapt to the requirements of the application (e.g., number of objects in scenes); thus, the use of the CPU is not overestimated. A key issue of the framework is the human-computer interface, which allows the monitoring of different parameters of the application: robot objectives, task schedule, robot speed, computation time, CPU utilization, deadline misses. The usefulness of the simulation tool is shown through different robotic navigation experiments. Finally, the simulation tool has been used to evaluate the proposed flexible model of tasks compared to a traditional fixed temporal parameters task model. Results show that the robot fulfills the objectives earlier, about 32% on average, and consumes on average about 15% less CPU to accomplish the objectives.Domínguez Montagud, CP.; Martínez-Rubio, J.; Busquets Mataix, JV.; Hassan Mohamed, H. (2019). Human-computer cooperation platform for developing real-time robotic applications. The Journal of Supercomputing. 75(4):1849-1868. https://doi.org/10.1007/s11227-018-2343-4S18491868754Dominguez C, Hassan H, Crespo A (2007) Real-time embedded architecture for pervasive robots. In: The 2007 International Conference on Intelligent Pervasive Computing (IPC 2007), pp 531–536Audsley NC, Burns A, Davis RI, Tindell KW, Wellings AJ (1995) Fixed priority pre-emptive scheduling: an historical perspective. Real Time Syst 8(2–3):173–198Stankovic JA, Lee I, Mok A, Rajkumar R (2005) Opportunities and obligations for physical computing systems. Computer 38(11):23–31Zhen Z, Qixin C, Lo C, Lei Z (2009) A CORBA-based simulation and control framework for mobile robots. Robotica 27(3):459Ferretti G, Magnani G, Porrati P, Rizzi G, Rocco P, Rusconi A (2008) Real-time simulation of a space robotic arm. In: IROSQadi A, Goddard S, Huang J, Farritor S (2005) A performance and schedulability analysis of an autonomous mobile robot. In: 17th Euromicro Conference on Real-Time Systems (ECRTS’05), pp 239–248Goud GR, Sharma N, Ramamritham K, Malewar S (2006) Efficient real-time support for automotive applications: a case study. In: 12th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA’06), pp 335–341Pedreiras P, Luis A (2003) The flexible time-triggered (FTT) paradigm: an approach to QoS management in distributed real-time systems. In: Proceedings International Parallel and Distributed Processing Symposium, p 9Li H, Sweeney J, Ramamritham K, Grupen R, Shenoy P (2003) Real-time support for mobile robotics. In: The 9th IEEE Real-Time and Embedded Technology and Applications Symposium. Proceedings, pp 10–18Chetto H, Chetto M (1989) Some results of the earliest deadline scheduling algorithm. IEEE Trans Softw Eng 15(10):1261–1269Liu R, Zhang X (2017) Systems of natural-language-facilitated human-robot cooperation: a review. arXiv:1701.08269v2Tsarouchi P, Makris S, Chryssolouris G (2016) Human–robot interaction review and challenges on task planning and programming. Int J Comput Integr Manuf 29(8):916–931Moniz A (2013) Organizational concepts and interaction between humans and robots in industrial environments. In: IEEE-RAS-IARP Joint Workshop on Technical Challenges for Dependable Robots in Human Environment, TokyoMayer MP, Odenthal B, Faber M, Winkelholz C, Schlick CM (2014) Cognitive engineering of automated assembly processes. Hum Factors Ergon Manuf Serv Ind 24(3):348–368Agostini A, Torras C, Wörgötter F (2011) Integrating task planning and interactive learning for robots to work in human environments. In: IJCAIKwon W, Suh I (2014) Planning of proactive behaviors for human–robot cooperative tasks under uncertainty. Knowl Based Syst 72:81–95Chen F, Sekiyama K, Sasaki H, Huang J, Sun B, Fukuda T (2011) Assembly strategy modeling and selection for human and robot coordinated cell assembly. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 4670–4675Gombolay M, Wilcox R, Diaz A, Yu F (2013) Towards successful coordination of human and robotic work using automated scheduling tools: an initial pilot study. In: Proceedings of Robotics: Science and Systems, Human–Robot Collaboration WorkshopGombolay MC, Gutierrez RA, Clarke SG, Sturla GF, Shah JA (2015) Decision-making authority, team efficiency and human worker satisfaction in mixed human–robot teams. Auton Robots 39(3):293–312Frontoni E, Mancini A, Caponetti F, Zingaretti P (2006) A framework for simulations and tests of mobile robotics tasks. In: 2006 14th Mediterranean Conference on Control and Automation, pp 1–6I. Embarcadero Technologies, C++ Builder 10.2. https://www.embarcadero.com

An IoT-based solution for monitoring a fleet of educational buildings focusing on energy efficiency

Raising awareness among young people and changing their behaviour and habits concerning energy usage iskey to achieving sustained energy saving. Additionally, young people are very sensitive to environmental protection so raising awareness among children is much easier than with any other group of citizens. This work examinesways to create an innovative Information & Communication Technologies (ICT) ecosystem (including web-based, mobile, social and sensing elements) tailored specifically for school environments, taking into account both theusers (faculty, staff, students, parents) and school buildings, thus motivating and supporting young citizenś behavioural change to achieve greater energy efficiency. A mixture of open-source IoT hardware and proprietary platforms on the infrastructure level, are currently being utilized for monitoring a fleet of 18 educational buildings across 3 countries, comprising over 700 IoT monitoring points. Hereon presented is the system's high-level architecture, as well as several aspects of its implementation, related to the application domain of educational building monitoring and energy efficiency. The system is developed based on open-source technologies andservices in order to make it capable of providing open IT-infrastructure and support from different commercial hardware/sensor vendors as well as open-source solutions. The system presented can be used to develop and offer newapp-based solutions that can be used either for educational purposes or for managing the energy efficiency ofthebuilding. The system is replicable and adaptable to settings that may be different than the scenarios envisionedhere (e.g., targeting different climate zones), different IT infrastructures and can be easily extended to accommodate integration with other systems. The overall performance of the system is evaluated in real-world environment in terms of scalability, responsiveness and simplicity

A Framework for Evaluating Model-Driven Self-adaptive Software Systems

In the last few years, Model Driven Development (MDD), Component-based Software Development (CBSD), and context-oriented software have become interesting alternatives for the design and construction of self-adaptive software systems. In general, the ultimate goal of these technologies is to be able to reduce development costs and effort, while improving the modularity, flexibility, adaptability, and reliability of software systems. An analysis of these technologies shows them all to include the principle of the separation of concerns, and their further integration is a key factor to obtaining high-quality and self-adaptable software systems. Each technology identifies different concerns and deals with them separately in order to specify the design of the self-adaptive applications, and, at the same time, support software with adaptability and context-awareness. This research studies the development methodologies that employ the principles of model-driven development in building self-adaptive software systems. To this aim, this article proposes an evaluation framework for analysing and evaluating the features of model-driven approaches and their ability to support software with self-adaptability and dependability in highly dynamic contextual environment. Such evaluation framework can facilitate the software developers on selecting a development methodology that suits their software requirements and reduces the development effort of building self-adaptive software systems. This study highlights the major drawbacks of the propped model-driven approaches in the related works, and emphasise on considering the volatile aspects of self-adaptive software in the analysis, design and implementation phases of the development methodologies. In addition, we argue that the development methodologies should leave the selection of modelling languages and modelling tools to the software developers.Comment: model-driven architecture, COP, AOP, component composition, self-adaptive application, context oriented software developmen