Mediating between AI and highly specialized users

We report part of the design experience gained in X-Media, a system for knowledge management and sharing. Consolidated techniques of interaction design (scenario-based design) had to be revisited to capture the richness and complexity of intelligent interactive systems. We show that the design of intelligent systems requires methodologies (faceted scenarios) that support the investigation of intelligent features and usability factors simultaneously. Interaction designers become mediators between intelligent technology and users, and have to facilitate reciprocal understanding

Towards e-Cities: an Atlas to enhance the public realm through interactive urban cyber-physical devices

Cyber-physical devices are the backbone of a postdigital society in which the virtual and real spaces are seamlessly integrated by ubiquitous computing and networking. The incorporation of such devices in public space is a central subject of a strategic Research Project that gathers a multidisciplinary team from architecture, product design, polymer science and ICT R&D units. This paper frames the key roles of public space and ICTs for UN Sustainable Development Goals and sustainable smart cities. It also reports the architecture R&D unit review on the relations between public space, community, environment and digital interfaces. This review was materialized in an Atlas that collects, classifies and relates a corpus of heterogeneous urban cyber-physical projects case studies. We expand on three main framing concepts (Digital Twin, Interface, Awareness) and identify trends on the devices’ design and deployment strategies to counteract digitally hostile environments and early obsolescence. We also suggest the rising of new types of urban devices aiming at expanding the liveliness of urban places, the knowledge of urban life and the users’ environmental consciousness. The lessons learned from the Atlas fed the design guidelines for a developing demonstrator of a new breed of environmentally sensible interactive urban devices.Work co-funded by European Regional Development Fund (ERDF) thru Norte 2020: Project “Lab4U&Spaces - Living Lab of Interactive Urban Space Solution” (NORTE-01-0145-FEDER-000072); and Project Lab2PT - Landscapes, Heritage and Territory laboratory - UIDB/04509/2020 thru FCT - Fundação para a Ciência e a Tecnologia

Graph-based reasoning in collaborative knowledge management for industrial maintenance

Capitalization and sharing of lessons learned play an essential role in managing the activities of industrial systems. This is particularly the case for the maintenance management, especially for distributed systems often associated with collaborative decision-making systems. Our contribution focuses on the formalization of the expert knowledge required for maintenance actors that will easily engage support tools to accomplish their missions in collaborative frameworks. To do this, we use the conceptual graphs formalism with their reasoning operations for the comparison and integration of several conceptual graph rules corresponding to different viewpoint of experts. The proposed approach is applied to a case study focusing on the maintenance management of a rotary machinery system

How can Data Analytics Results be Exploited in the Early Phase of Product Development? 13 Design Principles for Data-Driven Product Planning

The megatrend digitalization turns mechatronic products into continuous collectors and generators of use phase data. By analyzing this data, manufacturers can uncover valuable insights about the products and the users. Especially in product planning, these insights could be used to plan promising future product generations. The systematic exploitation of data analytics results, however, represents a serious challenge, as research on the topic is still scarce. In this paper, we present 13 design principles for exploiting data analytics results in product planning. The results are based on a systematic literature review and a workshop with a research consortium. The evaluation of the design principles is demonstrated with a real case of a manufacturing company. The identified design principles represent a first contribution to a still scarcely explored research field

Towards Improved Visualization and Optimization of Aquaculture Production Process

Aquaculture is one of the largest, and fastest growing industries in Norway. Recently, the industry has experienced significant development in the daily operations acquiring new technologies and systems that capture data and automate the different processes. These emerging technologies enable the generation of enormous amounts of data from sensors in the fish cages, cameras, boats, and feeding control rooms. Additional information relevant to the aquaculture industry is based on e-mails, manual notes, or intrinsic experiences and knowledge exchanges. One of the critical aspects of successful fish farming operation management, which is yet not achieved, is to allow domain experts to gain insight into the interconnection between the broad spectrum of heterogeneous data currently realized. This paper describes a graph-based database approach to storing and retrieving critical information connected to fish farming operations. The overall architecture is presented with detailed illustrations of how data is visualized and interpreted through a user-friendly interface. Accordingly, this work demonstrates how aquaculture users can benefit from the system to identify possible connections in the data and reveal previously undiscovered causalities and correlations that suggest optimal actions. Further, studies and evaluations of the querying system are conducted, evaluating the capability of the proposed design to process complex relationships. This work showcases that the system helps fish farmers and aquaculture users gain knowledge, reveal hidden links in the data, and improve aquaculture operations.publishedVersio

Advancing Smart Manufacturing in Europe: Experiences from Two Decades of Research and Innovation Projects

In the past two decades, a large amount of attention has been devoted to the introduction of smart manufacturing concepts and technologies into industrial practice. In Europe, these efforts have been supported by European research and innovation programs, bringing together research and application parties. In this paper, we provide an overview of a series of four content-wise connected projects on the European scale that are aimed at advancing smart manufacturing, with a focus on connecting processes on smart factory shop floors to manufacturing equipment on the one hand and enterprise-level business processes on the other hand. These projects cover several tens of application cases across Europe. We present our experiences in the form of a single, informal longitudinal case study, highlighting both the major advances and the current limitations of developments. To organize these experiences, we place them in the context of the well-known RAMI4.0 reference framework for Industry 4.0 (covering the ISA-95 standard). Then, we analyze the experiences, both the positive ones and those including problems, and draw our learnings from these. In doing so, we do not present novel technological developments in this paper—these are presented in the papers we refer to—but concentrate on the main issues we have observed to guide future developments in research efforts and industrial innovation in the smart industry domain

Enhanced findability and reusability of Engineering Data by Contextual Metadata

Complex research problems are increasingly addressed by interdisciplinary, collaborate research projects generating large amounts of heterogeneous amounts of data. The overarching processing, analysis and availability of data are critical success factors for these research efforts. Data repositories enable long term availability of such data for the scientific community. The findability and therefore reusability strongly builds on comprehensive annotations of datasets stored in repositories. Often generic metadata schema are used to annotate data. In this publication we describe the implementation of discipline specific metadata into a data repository to provide more contextual information about data. To avoid extra workload for researchers to provide such metadata a workflow with standardised data templates for automated metadata extraction during the ingest process has been developed. The enriched metadata are in the following used in the development of two repository plugins for data comparison and data visualisation. The added values of discipline-specific annotations and derived search features to support matching and reusable data is then demonstrated by use cases of two Collaborative Research Centres (CRC 1368 and CRC 1153)

Towards Flexible and Cognitive Production—Addressing the Production Challenges

Globalization in the field of industry is fostering the need for cognitive production systems. To implement modern concepts that enable tools and systems for such a cognitive production system, several challenges on the shop floor level must first be resolved. This paper discusses the implementation of selected cognitive technologies on a real industrial case-study of a construction machine manufacturer. The partner company works on the concept of mass customization but utilizes manual labour for the high-variety assembly stations or lines. Sensing and guidance devices are used to provide information to the worker and also retrieve and monitor the working, with respecting data privacy policies. Next, a specified process of data contextualization, visual analytics, and causal discovery is used to extract useful information from the retrieved data via sensors. Communications and safety systems are explained further to complete the loop of implementation of cognitive entities on a manual assembly line. This deepened involvement of cognitive technologies are human-centered, rather than automated systems. The explained cognitive technologies enhance human interaction with the processes and ease the production methods. These concepts form a quintessential vision for an effective assembly line. This paper revolutionizes the existing industry 4.0 with an even-intensified human–machine interaction and moving towards cognitivity

Conceitos e métodos para apoio ao desenvolvimento e avaliação de colaboração remota utilizando realidade aumentada

Remote Collaboration using Augmented Reality (AR) shows great potential to establish a common ground in physically distributed scenarios where team-members need to achieve a shared goal. However, most research efforts in this field have been devoted to experiment with the enabling technology and propose methods to support its development. As the field evolves, evaluation and characterization of the collaborative process become an essential, but difficult endeavor, to better understand the contributions of AR. In this thesis, we conducted a critical analysis to identify the main limitations and opportunities of the field, while situating its maturity and proposing a roadmap of important research actions. Next, a human-centered design methodology was adopted, involving industrial partners to probe how AR could support their needs during remote maintenance. These outcomes were combined with literature methods into an AR-prototype and its evaluation was performed through a user study. From this, it became clear the necessity to perform a deep reflection in order to better understand the dimensions that influence and must/should be considered in Collaborative AR. Hence, a conceptual model and a humancentered taxonomy were proposed to foster systematization of perspectives. Based on the model proposed, an evaluation framework for contextualized data gathering and analysis was developed, allowing support the design and performance of distributed evaluations in a more informed and complete manner. To instantiate this vision, the CAPTURE toolkit was created, providing an additional perspective based on selected dimensions of collaboration and pre-defined measurements to obtain “in situ” data about them, which can be analyzed using an integrated visualization dashboard. The toolkit successfully supported evaluations of several team-members during tasks of remote maintenance mediated by AR. Thus, showing its versatility and potential in eliciting a comprehensive characterization of the added value of AR in real-life situations, establishing itself as a generalpurpose solution, potentially applicable to a wider range of collaborative scenarios.Colaboração Remota utilizando Realidade Aumentada (RA) apresenta um enorme potencial para estabelecer um entendimento comum em cenários onde membros de uma equipa fisicamente distribuídos precisam de atingir um objetivo comum. No entanto, a maioria dos esforços de investigação tem-se focado nos aspetos tecnológicos, em fazer experiências e propor métodos para apoiar seu desenvolvimento. À medida que a área evolui, a avaliação e caracterização do processo colaborativo tornam-se um esforço essencial, mas difícil, para compreender as contribuições da RA. Nesta dissertação, realizámos uma análise crítica para identificar as principais limitações e oportunidades da área, ao mesmo tempo em que situámos a sua maturidade e propomos um mapa com direções de investigação importantes. De seguida, foi adotada uma metodologia de Design Centrado no Humano, envolvendo parceiros industriais de forma a compreender como a RA poderia responder às suas necessidades em manutenção remota. Estes resultados foram combinados com métodos da literatura num protótipo de RA e a sua avaliação foi realizada com um caso de estudo. Ficou então clara a necessidade de realizar uma reflexão profunda para melhor compreender as dimensões que influenciam e devem ser consideradas na RA Colaborativa. Foram então propostos um modelo conceptual e uma taxonomia centrada no ser humano para promover a sistematização de perspetivas. Com base no modelo proposto, foi desenvolvido um framework de avaliação para recolha e análise de dados contextualizados, permitindo apoiar o desenho e a realização de avaliações distribuídas de forma mais informada e completa. Para instanciar esta visão, o CAPTURE toolkit foi criado, fornecendo uma perspetiva adicional com base em dimensões de colaboração e medidas predefinidas para obter dados in situ, que podem ser analisados utilizando o painel de visualização integrado. O toolkit permitiu avaliar com sucesso vários colaboradores durante a realização de tarefas de manutenção remota apoiada por RA, permitindo mostrar a sua versatilidade e potencial em obter uma caracterização abrangente do valor acrescentado da RA em situações da vida real. Sendo assim, estabelece-se como uma solução genérica, potencialmente aplicável a uma gama diversificada de cenários colaborativos.Programa Doutoral em Engenharia Informátic

SENSEMAKING IN AI-BASED DIGITAL INNOVATIONS: INSIGHTS FROM A MANUFACTURING CASE STUDY

Organizations strive to innovate with Artificial Intelligence (AI) to tap new value potentials and outperform their competition. However, despite the enormous expectations associated with AI, incorporating the latter induces novel uncertainties and can even result in business value destruction. Therefore, organizations innovating with AI must manage these AI-induced uncertainties in their sensemaking process. Drawing on an exploratory case study, we investigate organizational sensemaking in two AI-based digital innovation projects at a globally leading automotive manufacturer. We account for the properties by which AI differs from traditional information systems and carve out how distinct AI properties unfold in AI-based digital innovations. We deduce four AI sensemaking mechanisms (i.e., cognition, interaction, regulation, and concretization) to understand better how AI challenges digital innovation endeavors in organizations