Internet of robotic things : converging sensing/actuating, hypoconnectivity, artificial intelligence and IoT Platforms

The Internet of Things (IoT) concept is evolving rapidly and influencing newdevelopments in various application domains, such as the Internet of MobileThings (IoMT), Autonomous Internet of Things (A-IoT), Autonomous Systemof Things (ASoT), Internet of Autonomous Things (IoAT), Internetof Things Clouds (IoT-C) and the Internet of Robotic Things (IoRT) etc.that are progressing/advancing by using IoT technology. The IoT influencerepresents new development and deployment challenges in different areassuch as seamless platform integration, context based cognitive network integration,new mobile sensor/actuator network paradigms, things identification(addressing, naming in IoT) and dynamic things discoverability and manyothers. The IoRT represents new convergence challenges and their need to be addressed, in one side the programmability and the communication ofmultiple heterogeneous mobile/autonomous/robotic things for cooperating,their coordination, configuration, exchange of information, security, safetyand protection. Developments in IoT heterogeneous parallel processing/communication and dynamic systems based on parallelism and concurrencyrequire new ideas for integrating the intelligent “devices”, collaborativerobots (COBOTS), into IoT applications. Dynamic maintainability, selfhealing,self-repair of resources, changing resource state, (re-) configurationand context based IoT systems for service implementation and integrationwith IoT network service composition are of paramount importance whennew “cognitive devices” are becoming active participants in IoT applications.This chapter aims to be an overview of the IoRT concept, technologies,architectures and applications and to provide a comprehensive coverage offuture challenges, developments and applications

Continuous maintenance and the future – Foundations and technological challenges

High value and long life products require continuous maintenance throughout their life cycle to achieve required performance with optimum through-life cost. This paper presents foundations and technologies required to offer the maintenance service. Component and system level degradation science, assessment and modelling along with life cycle ‘big data’ analytics are the two most important knowledge and skill base required for the continuous maintenance. Advanced computing and visualisation technologies will improve efficiency of the maintenance and reduce through-life cost of the product. Future of continuous maintenance within the Industry 4.0 context also identifies the role of IoT, standards and cyber security

Achieving Adaptive Augmented Reality through Ontological Context-Awareness applied to AAL Scenarios

This paper presents a proposal for supporting daily user needs by simple interactions with the environment through an augmented-reality perspective that applies proactive adaptation through knowledge representation using ontologies. The proposed architecture (i-ARA) uses principles of the Semantic Web that endow context-awareness and user personalization. In addition, these types of services allow the supervision and management of what is happening in the environment and, consequently, improve the information offered to users. The architecture has been used to implement applications using iPhone technology and has been applied to illustrative scenarios, including Ambient Assisted Living.This paper presents a proposal for supporting daily user needs by simple interactions with the environment through an augmented-reality perspective that applies proactive adaptation through knowledge representation using ontologies. The proposed architecture (i-ARA) uses principles of the Semantic Web that endow context-awareness and user personalization. In addition, these types of services allow the supervision and management of what is happening in the environment and, consequently, improve the information offered to users. The architecture has been used to implement applications using iPhone technology and has been applied to illustrative scenarios, including Ambient Assisted Living

Study of Augmented Reality based manufacturing for further integration of quality control 4.0: a systematic literature review

Augmented Reality (AR) has gradually become a mainstream technology enabling Industry 4.0 and its maturity has also grown over time. AR has been applied to support different processes on the shop-floor level, such as assembly, maintenance, etc. As various processes in manufacturing require high quality and near-zero error rates to ensure the demands and safety of end-users, AR can also equip operators with immersive interfaces to enhance productivity, accuracy and autonomy in the quality sector. However, there is currently no systematic review paper about AR technology enhancing the quality sector. The purpose of this paper is to conduct a systematic literature review (SLR) to conclude about the emerging interest in using AR as an assisting technology for the quality sector in an industry 4.0 context. Five research questions (RQs), with a set of selection criteria, are predefined to support the objectives of this SLR. In addition, different research databases are used for the paper identification phase following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) methodology to find the answers for the predefined RQs. It is found that, in spite of staying behind the assembly and maintenance sector in terms of AR-based solutions, there is a tendency towards interest in developing and implementing AR-assisted quality applications. There are three main categories of current AR-based solutions for quality sector, which are AR-based apps as a virtual Lean tool, AR-assisted metrology and AR-based solutions for in-line quality control. In this SLR, an AR architecture layer framework has been improved to classify articles into different layers which are finally integrated into a systematic design and development methodology for the development of long-term AR-based solutions for the quality sector in the future

Recent Advancements in Augmented Reality for Robotic Applications: A Survey

Robots are expanding from industrial applications to daily life, in areas such as medical robotics, rehabilitative robotics, social robotics, and mobile/aerial robotics systems. In recent years, augmented reality (AR) has been integrated into many robotic applications, including medical, industrial, human–robot interactions, and collaboration scenarios. In this work, AR for both medical and industrial robot applications is reviewed and summarized. For medical robot applications, we investigated the integration of AR in (1) preoperative and surgical task planning; (2) image-guided robotic surgery; (3) surgical training and simulation; and (4) telesurgery. AR for industrial scenarios is reviewed in (1) human–robot interactions and collaborations; (2) path planning and task allocation; (3) training and simulation; and (4) teleoperation control/assistance. In addition, the limitations and challenges are discussed. Overall, this article serves as a valuable resource for working in the field of AR and robotic research, offering insights into the recent state of the art and prospects for improvement

Interaction Design of Augmented Education Environments - Augmented and Mixed Reality for performance and training support of Aviation / Automotive Technicians.

"Augmented reality (AR),Mixed Reality (MR) and their mix and combination with other disruptive technologies offer an enormous potential for supporting instructors and trainees in modern education and working environments such as of aircraft maintenance technicians or automotive service technicians. In this paper we investigate and show some examples on how the performance and training of such instructors and trainees can be actively supported. Furthermore we will discuss the new challenges for training designers. The augmentation of the physical world with interactive, context-aware information (e.g. 2D and 3D content) provides multifaceted possibilities, on various ubiquitous and pervasive computing environments. While there is still the broad opinion that these concepts are just situated in the world of science fiction (SciFi) and SciFi movies, we will relate these techniques to existing technologies and prototypes in research. Terms like outernet, print + or 2.0, augmented goggles, wearable technology are not just remaining pure buzzwords anymore. We will demonstrate how different prototypes applying low cost rapid prototyping methods can be applied as powerful performance assistance and training support instruments, whereby discussing the requirements and user-needs analysis phases as well as human–computer interaction and interaction design issues, user modelling, usability engineering, prototyping and evaluation issues. Different scenarios are possible and provide the basis to generate storyboards. One of the key factors is hereby to analyse typical tasks and activities of users and utilize familiar user interaction paradigms for accessing information, such as using a book or assisting the work with task sheets. For example by augmenting the material that is printed in the book with additional graphical 3D interactive information which can be viewed and manipulated by the instructor and/or trainee, one can provide a link between traditional learning and technology-enhanced learning. Basing on theoretical and empirical research it is possible then to design via first moodboards and scribbles relevant prototypes. A qualitative and quantitative analysis can be used to define a basic design process for such new environments and settings. Moreover, MR and AR along with Mobile Tagging (MT) combined with Pervasive Computing provide the possibility to realize a Physical World Connection (PWC) between Reality and Virtuality. In the field of aviation and automotive industry, this offers manifold possibilities for maintenance and service personnel to get access to assistive technologies in a very intuitive way to enhance their operation, work, training, and knowledge. Assistance for the large variety of job tasks can be provided to a certain extent by offering augmentation of the different senses like vision and audition, providing a media-rich interface. Although the roots of Mixed Reality and Augmented Reality are based on prototype applications in the aircraft industry in the early 1990s, the impact of these emerging technologies on special target groups has not yet been investigated and validated by many research groups. With a specific focus on these user communities, applications are considerably more influenced by both usefulness and usability of technology. Consequently, it is argued that key issues in developing such applications are the tracking methodology, the display technology, interaction (devices and framework) and most of all ensuring good usability. In this paper, a concrete example in a aviation and automotive environment will be presented as a case study for investigating and validating these key issues. Preliminary results of semi-structured interviews and observations in real training and work settings indicate a lack of information concerning existence of such technologies and environments, but show big interest and potential for such educational and workplace innovations, while concrete visions or user requirements for future augmented education environments remain open and are subject of our further research steps

From Sensor to Observation Web with Environmental Enablers in the Future Internet

This paper outlines the grand challenges in global sustainability research and the objectives of the FP7 Future Internet PPP program within the Digital Agenda for Europe. Large user communities are generating significant amounts of valuable environmental observations at local and regional scales using the devices and services of the Future Internet. These communities’ environmental observations represent a wealth of information which is currently hardly used or used only in isolation and therefore in need of integration with other information sources. Indeed, this very integration will lead to a paradigm shift from a mere Sensor Web to an Observation Web with semantically enriched content emanating from sensors, environmental simulations and citizens. The paper also describes the research challenges to realize the Observation Web and the associated environmental enablers for the Future Internet. Such an environmental enabler could for instance be an electronic sensing device, a web-service application, or even a social networking group affording or facilitating the capability of the Future Internet applications to consume, produce, and use environmental observations in cross-domain applications. The term ?envirofied? Future Internet is coined to describe this overall target that forms a cornerstone of work in the Environmental Usage Area within the Future Internet PPP program. Relevant trends described in the paper are the usage of ubiquitous sensors (anywhere), the provision and generation of information by citizens, and the convergence of real and virtual realities to convey understanding of environmental observations. The paper addresses the technical challenges in the Environmental Usage Area and the need for designing multi-style service oriented architecture. Key topics are the mapping of requirements to capabilities, providing scalability and robustness with implementing context aware information retrieval. Another essential research topic is handling data fusion and model based computation, and the related propagation of information uncertainty. Approaches to security, standardization and harmonization, all essential for sustainable solutions, are summarized from the perspective of the Environmental Usage Area. The paper concludes with an overview of emerging, high impact applications in the environmental areas concerning land ecosystems (biodiversity), air quality (atmospheric conditions) and water ecosystems (marine asset management)