Conceitos e métodos para apoio ao desenvolvimento e avaliação de colaboração remota utilizando realidade aumentada

Remote Collaboration using Augmented Reality (AR) shows great potential to establish a common ground in physically distributed scenarios where team-members need to achieve a shared goal. However, most research efforts in this field have been devoted to experiment with the enabling technology and propose methods to support its development. As the field evolves, evaluation and characterization of the collaborative process become an essential, but difficult endeavor, to better understand the contributions of AR. In this thesis, we conducted a critical analysis to identify the main limitations and opportunities of the field, while situating its maturity and proposing a roadmap of important research actions. Next, a human-centered design methodology was adopted, involving industrial partners to probe how AR could support their needs during remote maintenance. These outcomes were combined with literature methods into an AR-prototype and its evaluation was performed through a user study. From this, it became clear the necessity to perform a deep reflection in order to better understand the dimensions that influence and must/should be considered in Collaborative AR. Hence, a conceptual model and a humancentered taxonomy were proposed to foster systematization of perspectives. Based on the model proposed, an evaluation framework for contextualized data gathering and analysis was developed, allowing support the design and performance of distributed evaluations in a more informed and complete manner. To instantiate this vision, the CAPTURE toolkit was created, providing an additional perspective based on selected dimensions of collaboration and pre-defined measurements to obtain “in situ” data about them, which can be analyzed using an integrated visualization dashboard. The toolkit successfully supported evaluations of several team-members during tasks of remote maintenance mediated by AR. Thus, showing its versatility and potential in eliciting a comprehensive characterization of the added value of AR in real-life situations, establishing itself as a generalpurpose solution, potentially applicable to a wider range of collaborative scenarios.Colaboração Remota utilizando Realidade Aumentada (RA) apresenta um enorme potencial para estabelecer um entendimento comum em cenários onde membros de uma equipa fisicamente distribuídos precisam de atingir um objetivo comum. No entanto, a maioria dos esforços de investigação tem-se focado nos aspetos tecnológicos, em fazer experiências e propor métodos para apoiar seu desenvolvimento. À medida que a área evolui, a avaliação e caracterização do processo colaborativo tornam-se um esforço essencial, mas difícil, para compreender as contribuições da RA. Nesta dissertação, realizámos uma análise crítica para identificar as principais limitações e oportunidades da área, ao mesmo tempo em que situámos a sua maturidade e propomos um mapa com direções de investigação importantes. De seguida, foi adotada uma metodologia de Design Centrado no Humano, envolvendo parceiros industriais de forma a compreender como a RA poderia responder às suas necessidades em manutenção remota. Estes resultados foram combinados com métodos da literatura num protótipo de RA e a sua avaliação foi realizada com um caso de estudo. Ficou então clara a necessidade de realizar uma reflexão profunda para melhor compreender as dimensões que influenciam e devem ser consideradas na RA Colaborativa. Foram então propostos um modelo conceptual e uma taxonomia centrada no ser humano para promover a sistematização de perspetivas. Com base no modelo proposto, foi desenvolvido um framework de avaliação para recolha e análise de dados contextualizados, permitindo apoiar o desenho e a realização de avaliações distribuídas de forma mais informada e completa. Para instanciar esta visão, o CAPTURE toolkit foi criado, fornecendo uma perspetiva adicional com base em dimensões de colaboração e medidas predefinidas para obter dados in situ, que podem ser analisados utilizando o painel de visualização integrado. O toolkit permitiu avaliar com sucesso vários colaboradores durante a realização de tarefas de manutenção remota apoiada por RA, permitindo mostrar a sua versatilidade e potencial em obter uma caracterização abrangente do valor acrescentado da RA em situações da vida real. Sendo assim, estabelece-se como uma solução genérica, potencialmente aplicável a uma gama diversificada de cenários colaborativos.Programa Doutoral em Engenharia Informátic

Instructors’ Perceptions of the Opportunities and Challenges of Integrating Technology in Crisis- Prompted Online Language Instruction in the Times of COVID-19

ABSTRACT This mixed-method study investigated higher education language instructors’ experiences during the pivot from face-to-face teaching to online teaching during the stay-at-home order in the Spring of 2020. Eleven participants discussed their approach to teaching online for the first time. The present study provided a comprehensive view of language instructors\u27 use of technology, their experiences, challenges, and lessons learned during this time of online teaching. The findings from this study revealed several themes. In regard to challenges, faculty were concerned about ways to adapt technology, enhance student-instructor interaction, allocate time, and enhance student participation. For the opportunities, participants discussed ways to create a sense of community in the synchronous online classroom and effective ways to communicate with their students despite the lack of physical proximity. Participants’ final recommendations included evaluating their current instructional strategies and taking advantage of learning opportunities in their workplace. An analysis conducted using the Community of Inquiry (CoI) and Substitution Augmentation Modification Redefinition (SAMR) frameworks provided insight on how language instructors pivoted to teaching online amid a global pandemic. Each of the CoI presences offered an overview of how language instructors used different approaches to teach online. Similarly, the present study revealed that most class activities used during this time remained at the substitution level in the SAMR framework. This study concluded with recommendations for future research and specific recommendations for online language instructors. Keywords: COVID-19, higher education, online language instruction, Community of Inquiry, SAMR, social presence, cognitive presence, teaching presence, language instructors, language teaching, Zoom, challenges, opportunities, recommendations, student-instructor interaction, time, student participation, community, communication, instructional strategies, learning opportunities, effective online instruction, online language learning communities

Democratised Making: Skills Enhancing Through Extended Realities

Throughout history, technology has had a crucial influence on the development of our society. Different eras have been defined by sets of technological advancements, which at the same time had a profound impact on the built environment and construction. It has been proposed that, after the internet age, we are entering a new era - the ‘Augmented Age’ (King, 2016), while physicist Michio Kaku argues for the future in which architects rely heavily on Augmented Reality technologies (Kaku, 2015). Machines have become an inseparable part of our daily life. We are immersing ourselves into rapidly developing mixed realities, with portable devices (smartphones, tablets etc.) augmenting our perception of the environment. Barriers between humans and machines are increasingly blurred, and the modes of interaction between them becoming progressively sophisticated at a rapid pace. The future of manufacturing jobs will be embedded with technological add-ons that will augment the capabilities of the workers. This augmentation will come from the XR devices, including (Augmented and Mixed reality) and human-machine collaboration and automation. This relation between technology and human labour will have a high impact on architecture. It will change the traditional roles in the production chain, affecting everything from the way we design to the ways we manufacture. Concepts like designer and artisan are again brought together through Immersive technology. In the same way, the barriers between user and designer are continuously diluted through these technological advances

THE PROCESS AUGMENTABILITY CANVAS - HOW TO FIND THE SWEET SPOT FOR AUGMENTED REALITY

The adoption of augmented reality (AR) has been one of the defining technological trends of the past decade. While AR has experienced significant growth in consumer electronics, its potential for professional use still needs to be explored. Despite the growing interest in AR, determining its feasibility and potential to satisfy business needs remains challenging. To address this gap, we used a mixedmethod research approach to create a guiding framework called the process augmentability canvas. Drawing on a comprehensive case study of a major European maintenance, repair, and overhaul service provider, as well as state-of-the literature, we present a canvas that allows scholars and practitioners to evaluate AR’s applicability for a given process thoroughly. By providing a structured approach to analyzing AR solutions, the process augmentability canvas contributes to a better understanding of how AR can be used efficiently in organizational settings

Study of Augmented Reality based manufacturing for further integration of quality control 4.0: a systematic literature review

Augmented Reality (AR) has gradually become a mainstream technology enabling Industry 4.0 and its maturity has also grown over time. AR has been applied to support different processes on the shop-floor level, such as assembly, maintenance, etc. As various processes in manufacturing require high quality and near-zero error rates to ensure the demands and safety of end-users, AR can also equip operators with immersive interfaces to enhance productivity, accuracy and autonomy in the quality sector. However, there is currently no systematic review paper about AR technology enhancing the quality sector. The purpose of this paper is to conduct a systematic literature review (SLR) to conclude about the emerging interest in using AR as an assisting technology for the quality sector in an industry 4.0 context. Five research questions (RQs), with a set of selection criteria, are predefined to support the objectives of this SLR. In addition, different research databases are used for the paper identification phase following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) methodology to find the answers for the predefined RQs. It is found that, in spite of staying behind the assembly and maintenance sector in terms of AR-based solutions, there is a tendency towards interest in developing and implementing AR-assisted quality applications. There are three main categories of current AR-based solutions for quality sector, which are AR-based apps as a virtual Lean tool, AR-assisted metrology and AR-based solutions for in-line quality control. In this SLR, an AR architecture layer framework has been improved to classify articles into different layers which are finally integrated into a systematic design and development methodology for the development of long-term AR-based solutions for the quality sector in the future

Enhanced Concrete Bridge Assessment Using Artificial Intelligence and Mixed Reality

Conventional methods for visual assessment of civil infrastructures have certain limitations, such as subjectivity of the collected data, long inspection time, and high cost of labor. Although some new technologies (i.e. robotic techniques) that are currently in practice can collect objective, quantified data, the inspector\u27s own expertise is still critical in many instances since these technologies are not designed to work interactively with human inspector. This study aims to create a smart, human-centered method that offers significant contributions to infrastructure inspection, maintenance, management practice, and safety for the bridge owners. By developing a smart Mixed Reality (MR) framework, which can be integrated into a wearable holographic headset device, a bridge inspector, for example, can automatically analyze a certain defect such as a crack that he or she sees on an element, display its dimension information in real-time along with the condition state. Such systems can potentially decrease the time and cost of infrastructure inspections by accelerating essential tasks of the inspector such as defect measurement, condition assessment and data processing to management systems. The human centered artificial intelligence (AI) will help the inspector collect more quantified and objective data while incorporating inspector\u27s professional judgment. This study explains in detail the described system and related methodologies of implementing attention guided semi-supervised deep learning into mixed reality technology, which interacts with the human inspector during assessment. Thereby, the inspector and the AI will collaborate/communicate for improved visual inspection

Augmented Manufacturing

The evolution of digital technologies and their rapid adoption by our society is shifting traditional paradigms. The normally conservative industry of architecture is now leading the integration of new techniques in multiple ways. Technologies like 3D printing, robotic automation, platform-based apps and Mixed Realities are changing architecture workflows. Using these interfaces, designers and builders are leaving the Post-Industrial Age to enter the Augmented Age. Looking towards the near future, the use of Mixed Reality technology will change the traditional role of the workforce, enhancing and extending their skills. Future workers will have access to real-time skills and guidance through augmentation, facilitating and preserving traditional craftsmanship and integrating them simultaneously with computational architecture. This research explores how the application of augmented reality can challenge the concept of the traditional artisan and propose a new approach to the access of skills and labour in manufacturing methodologies for the architectural environment. The analysis will review the impact of mixed realities by studying three study cases themed into two different topics, craftsmanship and digital platforms

Augmented Reality

Augmented Reality (AR) is a natural development from virtual reality (VR), which was developed several decades earlier. AR complements VR in many ways. Due to the advantages of the user being able to see both the real and virtual objects simultaneously, AR is far more intuitive, but it's not completely detached from human factors and other restrictions. AR doesn't consume as much time and effort in the applications because it's not required to construct the entire virtual scene and the environment. In this book, several new and emerging application areas of AR are presented and divided into three sections. The first section contains applications in outdoor and mobile AR, such as construction, restoration, security and surveillance. The second section deals with AR in medical, biological, and human bodies. The third and final section contains a number of new and useful applications in daily living and learning