Human-computer cooperation platform for developing real-time robotic applications

[EN] This paper presents a human-computer cooperation platform, which permits the coordination between the user and the tool to improve the development of real-time control applications (e.g., mobile robots). These applications have functional (robot objectives) and temporal requirements to accomplish (deadlines guarantee of tasks). The simulation tool has been designed in order to permit the testing and validation of these two requirements. To this end, the tool is composed of two independent simulators interconnected through a shared memory: the robot simulator (functional level) and the real-time task scheduler simulator (task execution level). Robotic applications can be defined with the robot simulator while the real-time scheduler simulator permits to analyze the schedulability of the robotic tasks. The real-time task simulator incorporates a flexible task model where the task temporal parameters (e.g., computation time) adapt to the requirements of the application (e.g., number of objects in scenes); thus, the use of the CPU is not overestimated. A key issue of the framework is the human-computer interface, which allows the monitoring of different parameters of the application: robot objectives, task schedule, robot speed, computation time, CPU utilization, deadline misses. The usefulness of the simulation tool is shown through different robotic navigation experiments. Finally, the simulation tool has been used to evaluate the proposed flexible model of tasks compared to a traditional fixed temporal parameters task model. Results show that the robot fulfills the objectives earlier, about 32% on average, and consumes on average about 15% less CPU to accomplish the objectives.Domínguez Montagud, CP.; Martínez-Rubio, J.; Busquets Mataix, JV.; Hassan Mohamed, H. (2019). Human-computer cooperation platform for developing real-time robotic applications. The Journal of Supercomputing. 75(4):1849-1868. https://doi.org/10.1007/s11227-018-2343-4S18491868754Dominguez C, Hassan H, Crespo A (2007) Real-time embedded architecture for pervasive robots. In: The 2007 International Conference on Intelligent Pervasive Computing (IPC 2007), pp 531–536Audsley NC, Burns A, Davis RI, Tindell KW, Wellings AJ (1995) Fixed priority pre-emptive scheduling: an historical perspective. Real Time Syst 8(2–3):173–198Stankovic JA, Lee I, Mok A, Rajkumar R (2005) Opportunities and obligations for physical computing systems. Computer 38(11):23–31Zhen Z, Qixin C, Lo C, Lei Z (2009) A CORBA-based simulation and control framework for mobile robots. Robotica 27(3):459Ferretti G, Magnani G, Porrati P, Rizzi G, Rocco P, Rusconi A (2008) Real-time simulation of a space robotic arm. In: IROSQadi A, Goddard S, Huang J, Farritor S (2005) A performance and schedulability analysis of an autonomous mobile robot. In: 17th Euromicro Conference on Real-Time Systems (ECRTS’05), pp 239–248Goud GR, Sharma N, Ramamritham K, Malewar S (2006) Efficient real-time support for automotive applications: a case study. In: 12th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA’06), pp 335–341Pedreiras P, Luis A (2003) The flexible time-triggered (FTT) paradigm: an approach to QoS management in distributed real-time systems. In: Proceedings International Parallel and Distributed Processing Symposium, p 9Li H, Sweeney J, Ramamritham K, Grupen R, Shenoy P (2003) Real-time support for mobile robotics. In: The 9th IEEE Real-Time and Embedded Technology and Applications Symposium. Proceedings, pp 10–18Chetto H, Chetto M (1989) Some results of the earliest deadline scheduling algorithm. IEEE Trans Softw Eng 15(10):1261–1269Liu R, Zhang X (2017) Systems of natural-language-facilitated human-robot cooperation: a review. arXiv:1701.08269v2Tsarouchi P, Makris S, Chryssolouris G (2016) Human–robot interaction review and challenges on task planning and programming. Int J Comput Integr Manuf 29(8):916–931Moniz A (2013) Organizational concepts and interaction between humans and robots in industrial environments. In: IEEE-RAS-IARP Joint Workshop on Technical Challenges for Dependable Robots in Human Environment, TokyoMayer MP, Odenthal B, Faber M, Winkelholz C, Schlick CM (2014) Cognitive engineering of automated assembly processes. Hum Factors Ergon Manuf Serv Ind 24(3):348–368Agostini A, Torras C, Wörgötter F (2011) Integrating task planning and interactive learning for robots to work in human environments. In: IJCAIKwon W, Suh I (2014) Planning of proactive behaviors for human–robot cooperative tasks under uncertainty. Knowl Based Syst 72:81–95Chen F, Sekiyama K, Sasaki H, Huang J, Sun B, Fukuda T (2011) Assembly strategy modeling and selection for human and robot coordinated cell assembly. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp 4670–4675Gombolay M, Wilcox R, Diaz A, Yu F (2013) Towards successful coordination of human and robotic work using automated scheduling tools: an initial pilot study. In: Proceedings of Robotics: Science and Systems, Human–Robot Collaboration WorkshopGombolay MC, Gutierrez RA, Clarke SG, Sturla GF, Shah JA (2015) Decision-making authority, team efficiency and human worker satisfaction in mixed human–robot teams. Auton Robots 39(3):293–312Frontoni E, Mancini A, Caponetti F, Zingaretti P (2006) A framework for simulations and tests of mobile robotics tasks. In: 2006 14th Mediterranean Conference on Control and Automation, pp 1–6I. Embarcadero Technologies, C++ Builder 10.2. https://www.embarcadero.com

A Role-Based Approach for Orchestrating Emergent Configurations in the Internet of Things

The Internet of Things (IoT) is envisioned as a global network of connected things enabling ubiquitous machine-to-machine (M2M) communication. With estimations of billions of sensors and devices to be connected in the coming years, the IoT has been advocated as having a great potential to impact the way we live, but also how we work. However, the connectivity aspect in itself only accounts for the underlying M2M infrastructure. In order to properly support engineering IoT systems and applications, it is key to orchestrate heterogeneous 'things' in a seamless, adaptive and dynamic manner, such that the system can exhibit a goal-directed behaviour and take appropriate actions. Yet, this form of interaction between things needs to take a user-centric approach and by no means elude the users' requirements. To this end, contextualisation is an important feature of the system, allowing it to infer user activities and prompt the user with relevant information and interactions even in the absence of intentional commands. In this work we propose a role-based model for emergent configurations of connected systems as a means to model, manage, and reason about IoT systems including the user's interaction with them. We put a special focus on integrating the user perspective in order to guide the emergent configurations such that systems goals are aligned with the users' intentions. We discuss related scientific and technical challenges and provide several uses cases outlining the concept of emergent configurations.Comment: In Proceedings of the Second International Workshop on the Internet of Agents @AAMAS201

Rewiring strategies for changing environments

A typical pervasive application executes in a changing environment: people, computing resources, software services and network connections come and go continuously. A robust pervasive application needs adapt to this changing context as long as there is an appropriate rewiring strategy that guarantees correct behavior. We combine the MERODE modeling methodology with the ReWiRe framework for creating interactive pervasive applications that can cope with changing environments. The core of our approach is a consistent environment model, which is essential to create (re)configurable context-aware pervasive applications. We aggregate different ontologies that provide the required semantics to describe almost any target environment. We present a case study that shows a interactive pervasive application for media access that incorporates parental control on media content and can migrate between devices. The application builds upon models of the run-time environment represented as system states for dedicated rewiring strategies

Addressing the Challenges in Federating Edge Resources

This book chapter considers how Edge deployments can be brought to bear in a global context by federating them across multiple geographic regions to create a global Edge-based fabric that decentralizes data center computation. This is currently impractical, not only because of technical challenges, but is also shrouded by social, legal and geopolitical issues. In this chapter, we discuss two key challenges - networking and management in federating Edge deployments. Additionally, we consider resource and modeling challenges that will need to be addressed for a federated Edge.Comment: Book Chapter accepted to the Fog and Edge Computing: Principles and Paradigms; Editors Buyya, Sriram