Internet of robotic things : converging sensing/actuating, hypoconnectivity, artificial intelligence and IoT Platforms

The Internet of Things (IoT) concept is evolving rapidly and influencing newdevelopments in various application domains, such as the Internet of MobileThings (IoMT), Autonomous Internet of Things (A-IoT), Autonomous Systemof Things (ASoT), Internet of Autonomous Things (IoAT), Internetof Things Clouds (IoT-C) and the Internet of Robotic Things (IoRT) etc.that are progressing/advancing by using IoT technology. The IoT influencerepresents new development and deployment challenges in different areassuch as seamless platform integration, context based cognitive network integration,new mobile sensor/actuator network paradigms, things identification(addressing, naming in IoT) and dynamic things discoverability and manyothers. The IoRT represents new convergence challenges and their need to be addressed, in one side the programmability and the communication ofmultiple heterogeneous mobile/autonomous/robotic things for cooperating,their coordination, configuration, exchange of information, security, safetyand protection. Developments in IoT heterogeneous parallel processing/communication and dynamic systems based on parallelism and concurrencyrequire new ideas for integrating the intelligent “devices”, collaborativerobots (COBOTS), into IoT applications. Dynamic maintainability, selfhealing,self-repair of resources, changing resource state, (re-) configurationand context based IoT systems for service implementation and integrationwith IoT network service composition are of paramount importance whennew “cognitive devices” are becoming active participants in IoT applications.This chapter aims to be an overview of the IoRT concept, technologies,architectures and applications and to provide a comprehensive coverage offuture challenges, developments and applications

An Overview of Self-Adaptive Technologies Within Virtual Reality Training

This overview presents the current state-of-the-art of self-adaptive technologies within virtual reality (VR) training. Virtual reality training and assessment is increasingly used for five key areas: medical, industrial & commercial training, serious games, rehabilitation and remote training such as Massive Open Online Courses (MOOCs). Adaptation can be applied to five core technologies of VR including haptic devices, stereo graphics, adaptive content, assessment and autonomous agents. Automation of VR training can contribute to automation of actual procedures including remote and robotic assisted surgery which reduces injury and improves accuracy of the procedure. Automated haptic interaction can enable tele-presence and virtual artefact tactile interaction from either remote or simulated environments. Automation, machine learning and data driven features play an important role in providing trainee-specific individual adaptive training content. Data from trainee assessment can form an input to autonomous systems for customised training and automated difficulty levels to match individual requirements. Self-adaptive technology has been developed previously within individual technologies of VR training. One of the conclusions of this research is that while it does not exist, an enhanced portable framework is needed and it would be beneficial to combine automation of core technologies, producing a reusable automation framework for VR training

real time assistance to manual assembly through depth camera and visual feedback

Abstract The current fourth industrial revolution significantly impacts on production processes. The personalized production paradigm enables customers to order unique products. The operators assemble an enormous component variety adapting their process from product to product with limited learning opportunities. Digital technologies are increasingly adopted in production processes to improve performance and quality. Considering this framework, this research proposes a hardware/software architecture to assist in real-time operators involved in manual assembly processes. A depth camera captures human motions in relation with the workstation environment whereas a visual feedback guides the operator through consecutive assembly tasks. An industrial case study validates the architecture

Adopting augmented reality in the age of industrial digitalisation

Industrial augmented reality (IAR) is one of the key pillars of the industrial digitalisation concepts, which connects workers with the physical world through overlaying digital information. Augmented reality (AR) market is increasing but still its adoption levels are low in industry. While companies strive to learn and adopt AR, there are chances that they fail in such endeavours due to lack of understanding key challenges and success factors in this space. This study identifies critical success factors and challenges for IAR implementation projects based on field experiments. The broadly used technology, organisation, environment (TOE) framework was used as a theoretical basis for the study, while 22 experiments were conducted for validation. It is found that, while technological aspects are of importance, organisational issues are more relevant for industry, which has not been reflected to the same extent in the literature.No funding source. 22 experiments were conducted with in-kind support (employee time and company access) from Beckhoff Automation, Herman Miller and fluiconnecto as well as University of Cambridge students (see Table 1)

Immersive Technologies in Virtual Companions: A Systematic Literature Review

The emergence of virtual companions is transforming the evolution of intelligent systems that effortlessly cater to the unique requirements of users. These advanced systems not only take into account the user present capabilities, preferences, and needs but also possess the capability to adapt dynamically to changes in the environment, as well as fluctuations in the users emotional state or behavior. A virtual companion is an intelligent software or application that offers support, assistance, and companionship across various aspects of users lives. Various enabling technologies are involved in building virtual companion, among these, Augmented Reality (AR), and Virtual Reality (VR) are emerging as transformative tools. While their potential for use in virtual companions or digital assistants is promising, their applications in these domains remain relatively unexplored. To address this gap, a systematic review was conducted to investigate the applications of VR, AR, and MR immersive technologies in the development of virtual companions. A comprehensive search across PubMed, Scopus, and Google Scholar yielded 28 relevant articles out of a pool of 644. The review revealed that immersive technologies, particularly VR and AR, play a significant role in creating digital assistants, offering a wide range of applications that brings various facilities in the individuals life in areas such as addressing social isolation, enhancing cognitive abilities and dementia care, facilitating education, and more. Additionally, AR and MR hold potential for enhancing Quality of life (QoL) within the context of virtual companion technology. The findings of this review provide a valuable foundation for further research in this evolving field

Augmented reality in support of intelligent manufacturing – A systematic literature review

Industry increasingly moves towards digitally enabled ‘smart factories’ that utilise the internet of things (IoT) to realise intelligent manufacturing concepts like predictive maintenance or extensive machine to machine communication. A core technology to facilitate human integration in such a system is augmented reality (AR), which provides people with an interface to interact with the digital world of a smart factory. While AR is not ready yet for industrial deployment in some areas, it is already used in others. To provide an overview of research activities concerning AR in certain shop floor operations, a total of 96 relevant papers from 2011 to 2018 are reviewed. This paper presents the state of the art, the current challenges, and future directions of manufacturing related AR research through a systematic literature review and a citation network analysis. The results of this review indicate that the context of research concerning AR gets increasingly broader, especially by addressing challenges when implementing AR solutions.No funding was received