Workshop on disruptive information and communication technologies for innovation and digital transformation

The workshop on Disruptive Information and Communication Technologies for Innovation and Digital transformation, organized under the scope of the DISRUPTIVE project (disruptive.usal.es) and held on December 20, 2019 in Bragança, aims to discuss problems, challenges and benefits of using disruptive digital technologies, namely Internet of Things, Big data, cloud computing, multi-agent systems, machine learning, virtual and augmented reality, and collaborative robotics, to support the on-going digital transformation in society. The main topics included: • Intelligent Manufacturing Systems • Industry 4.0 and digital transformation • Internet of Things • Cyber-security • Collaborative and intelligent robotics • Multi-Agent Systems • Industrial Cyber-Physical Systems • Virtualization and digital twins • Predictive maintenance • Virtual and augmented reality • Big Data and advanced data analytics • Edge and cloud computing • Digital Transformation The workshop program included 16 accepted technical papers, 2 invited talks and 1 technical demonstration of use cases. This volume contains six of the papers presented at the Workshop on Disruptive Information and Communication Technologies for Innovation and Digital Transformation.info:eu-repo/semantics/publishedVersio

WORKSHOP OF MOBILE APPLICATION USE EQUIPPED WITH AUGMENTED REALITY TECHNOLOGY IN THE SCIENCE FORMATIVE ASSESSMENT

Abstrak: Revolusi industri 4.0 menyasar pada teknologi terapan dan berdampak langsung kepada masyarakat termasuk golongan yang bergerak pada bidang pendidikan yakni guru dan dosen. Para pendidik dituntut untuk selalu berinovasi dengan metode belajar, model pembelajaran, penilaian serta umpan baliknya terutama di masa pandemi COVID-19. Untuk itu, dilaksanakanlah kegiatan workshop dengan tema pelatihan penggunaan aplikasi mobile (bergerak) dilengkapi teknologi augmented reality dalam pelaksanaan asesmen formatif IPA. Tujuan workshop ini adalah membantu para guru dalam pelaksanaan penilaian (asesmen) berbantuan teknologi yang sedang berkembang saat ini yaitu Augmented Reality terintegrasi dengan teknologi internet dan perangkat bergerak lainnya di masa pandemik. Kegiatan pengabdian kepada masyarakat ini terdiri dari tiga tahapan utama yakni tahap persiapan, pelaksanaan, dan penyusunan laporan. Pelaksanaan kegiatan workshop ini dilaksanakan secara daring melalui platform Zoom pada tanggal 16-18 Juni 2020 yang terdiri dari penyampaian materi 1 dan materi 2, diskusi, serta tugas mandiri. Kegiatan pengabdian berjalan baik dan lancar dengan 97,1% peserta menyatakan materi yang dibawakan jelas dan bobot tugas yang proporsional, Selain itu, sebanyak empat orang peserta workshop berhasil mendiseminasikan karyanya melalui sebuah seminar berskala nasional.Abstract: Industrial revolution 4.0 targets applied technology and directly impacts people including the educational community such as teachers and lecturers. The educators are required to keep innovating the learning method, model, and assessment along with its feedback, especially in the COVID-19 pandemic era. Thus, a workshop with the theme of the use of mobile applications equipped with augmented reality in Science formative assessment was conducted. The purpose of this workshop is to assist the teachers in conducting assessments equipped with currently developing technology which is the Augmented Reality integrated with the internet and other mobile applications in the pandemic era. The activity of this community service consists of three main stages including planning, execution, and reporting. The workshop execution was conducted virtually through the Zoom platform on June 16th-18th, 2020 including the presentation of 1st and 2nd material, discussion, and independent structured assignment. The community service went well and smoothly with the material clarity responses reached 97.1% and proportional workload. Besides, four participants have submitted and disseminated their papers through a national-scaled conference

Using Augmented Reality to Assess and Modify Mobile Manipulator Surface Repair Plans

Industrial robotics are redefining inspection and maintenance routines across multiple sectors, enhancing safety, efficiency, and environmental sustainability. In outdoor industrial facilities, it is crucial to inspect and repair complex surfaces affected by corrosion. To address this challenge, mobile manipulators have been developed to navigate these facilities, identify corroded areas, and apply protective coatings. However, given that this technology is still in its infancy and the consequences of improperly coating essential equipment can be significant, human oversight is necessary to review the robot's corrosion identification and repair plan. We present a practical and scalable Augmented Reality (AR)-based system designed to empower non-experts to visualize, modify, and approve robot-generated surface corrosion repair plans in real-time. Built upon an AR-based human-robot interaction framework, Augmented Robot Environment (AugRE), we developed a comprehensive AR application module called Situational Task Accept and Repair (STAR). STAR allows users to examine identified corrosion images, point cloud data, and robot navigation objectives overlaid on the physical environment within these industrial environments. Users are able to additionally make adjustments to the robot repair plan in real-time using interactive holographic volumes, excluding critical nearby equipment that might be at risk of coating overspray. We demonstrate the entire system using a Microsoft HoloLens 2 and a dual-arm mobile manipulator. Our future research will focus on evaluating user experience, system robustness, and real-world validation.Comment: Winning Paper (2nd Prize) at The Second International Horizons of an Extended Robotics Reality (XR-ROB) Workshop - IEEE IROS 2023 | Workshop Website: https://sites.google.com/view/xr-robotics-iros2023/home?authuser=

Collaborative Augmented Digital Twin: A Novel Open-Source Augmented Reality Solution for Training and Maintenance Processes in the Shipyard of the Future

Presented at the 4th XoveTIC Conference, A Coruña, Spain, 7–8 October 2021.[Abstract] Large companies use a lot of resources on workshop operator training and industrial machinery maintenance since the lack of this practice or its poor implementation increases the cost and risks of operating and handling sensitive and/or hazardous machinery. Industrial Augmented Reality (IAR), a major technology in the Industry 4.0 paradigm that may enhance worker performance, minimize hazards and improve manufacturing processes, could be beneficial in this situation. This paper presents an IAR solution that allows for visualizing and interacting with the digital twin of a critical system. Specifically, the augmented digital twin of an industrial cooler was developed. The proposed IAR system provides a dynamic way to perform operator training with a full-size model of the actual equipment and to provide step-by-step guidance so that maintenance processes can be performed more safely and efficiently. The proposed system also allows several users to use devices at the same time, creating a new type of collaborative interaction by viewing the model in the same place and state. Performance tests with many simultaneous users have been conducted, with response latency being measured as the number of connected users grows. Furthermore, the suggested IAR system has been thoroughly tested in a real-world industrial environment.This work was supported by the Plant Information and Augmented Reality research line of the Navantia-UDC Joint Research Unit (IN853B-2018/02). The authors would like to thank CITIC for its support. CITIC, a research center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidades from Xunta de Galicia”, with 80% of funds coming from ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% from “Secretaría Xeral de Universidades” (Grant ED431G 2019/01).Xunta de Galicia; IN853B-2018/02Xunta de Galicia; ED431G 2019/0

Using the Proteus virtual environment to train future IT professionals

Abstract. Based on literature review it was established that the use of augmented reality as an innovative technology of student training occurs in following directions: 3D image rendering; recognition and marking of real objects; interaction of a virtual object with a person in real time. The main advantages of using AR and VR in the educational process are highlighted: clarity, ability to simulate processes and phenomena, integration of educational disciplines, building an open education system, increasing motivation for learning, etc. It has been found that in the field of physical process modelling the Proteus Physics Laboratory is a popular example of augmented reality. Using the Proteus environment allows to visualize the functioning of the functional nodes of the computing system at the micro level. This is especially important for programming systems with limited resources, such as microcontrollers in the process of training future IT professionals. Experiment took place at Borys Grinchenko Kyiv University and Sumy State Pedagogical University named after A. S. Makarenko with students majoring in Computer Science (field of knowledge is Secondary Education (Informatics)). It was found that computer modelling has a positive effect on mastering the basics of microelectronics. The ways of further scientific researches for grounding, development and experimental verification of forms, methods and augmented reality, and can be used in the professional training of future IT specialists are outlined in the article

Inside-out Infrared Marker Tracking via Head Mounted Displays for Smart Robot Programming

Intuitive robot programming through use of tracked smart input devices relies on fixed, external tracking systems, most often employing infra-red markers. Such an approach is frequently combined with projector-based augmented reality for better visualisation and interface. The combined system, although providing an intuitive programming platform with short cycle times even for inexperienced users, is immobile, expensive and requires extensive calibration. When faced with a changing environment and large number of robots it becomes sorely impractical. Here we present our work on infra-red marker tracking using the Microsoft HoloLens head-mounted display. The HoloLens can map the environment, register the robot on-line, and track smart devices equipped with infra-red markers in the robot coordinate system. We envision our work to provide the basis to transfer many of the paradigms developed over the years for systems requiring a projector and a tracked input device into a highly-portable system that does not require any calibration or special set-up. We test the quality of the marker-tracking in an industrial robot cell and compare our tracking with a ground truth obtained via an ART-3 tracking system.Comment: As accepted to the 5th International Workshop on Virtual, Augmented, and Mixed Reality for HR