Benchmarking of Tools for User Experience Analysis in Industry 4.0

Abstract Industry 4.0 paradigm is based on systems communication and cooperation with each other and with humans in real time to improve process performances in terms of productivity, security, energy efficiency, and cost. Although industrial processes are more and more automated, human performance is still the main responsible for product quality and factory productivity. In this context, understanding how workers interact with production systems and how they experience the factory environment is fundamental to properly model the human interaction and optimize the processes. This research investigates the available technologies to monitor the user experience (UX) and defines a set of tools to be applied in the Industry 4.0 scenario to assure the workers' wellbeing, safety and satisfaction and improve the overall factory performance

Exploring how to use virtual tours to create an interactive customer remote experience

This paper investigates the use of Virtual Reality (VR) to develop virtual tour applications for marketing purposes. The aim is to explore how virtual technologies can support the creation of knowledge about a specific food product and the achievement of user engagement by a multi-sensory virtual tour of the real production site. The study provides design guidelines to create a valuable, multisensory experience by VR tours and demonstrate how the adoption of a user-driven approach, instead of a technology-driven approach, allows to achieve a positive intention to buy. The case study was represented by one of the excellences among Italian food products, the Parmigiano Reggiano (PR) cheese. The PR virtual tour was validated by a user testing campaign, involving more than 70 users: users' reactions and feedback were collected by human physiological data monitoring and questionnaires' administration. The research results demonstrated how virtual technologies could effectively help people to create a solid knowledge about a food product to support the marketing process and to form an intention to buy thanks to a better understanding of the quality of the local and traditional productions

Towards Agility and Speed in Enriched UX Evaluation Projects

Recent research has called for the use of enriched measures, that is, psychophysiological measures of emotional and cognitive states, in user experience (UX) testing. This chapter investigates how these enriched measures can inform user experience evaluation while maintaining agility and speed in managing UX projects. Using a multiple case approach, this chapter presents the analysis of 12 recent user experience projects in which enriched measures were used. Lessons learned with regard to challenges encountered are outlined. They emphasize on: (1) the nature of the research question impacts the completion time and the complexity of the project; (2) the need to communicate and coordinate between all parties; (3) the need to anticipate the collected measurements and enhanced results using a mosaic of hybrid collection methods; (4) the nature of the results adapted to underline the operational side without reducing the quality of the work performed; and (5) the time constrains influenced and influencing the pre-tests and project’s granularity. This chapter concludes with lessons learned from an agile/UX development approach in the realization of Sprint projects

A multidimensional evaluation framework for personal learning environments

Evaluating highly dynamic and heterogeneous Personal Learning Environments (PLEs) is extremely challenging. Components of PLEs are selected and configured by individual users based on their personal preferences, needs, and goals. Moreover, the systems usually evolve over time based on contextual opportunities and constraints. As such dynamic systems have no predefined configurations and user interfaces, traditional evaluation methods often fall short or are even inappropriate. Obviously, a host of factors influence the extent to which a PLE successfully supports a learner to achieve specific learning outcomes. We categorize such factors along four major dimensions: technological, organizational, psycho-pedagogical, and social. Each dimension is informed by relevant theoretical models (e.g., Information System Success Model, Community of Practice, self-regulated learning) and subsumes a set of metrics that can be assessed with a range of approaches. Among others, usability and user experience play an indispensable role in acceptance and diffusion of the innovative technologies exemplified by PLEs. Traditional quantitative and qualitative methods such as questionnaire and interview should be deployed alongside emergent ones such as learning analytics (e.g., context-aware metadata) and narrative-based methods. Crucial for maximal validity of the evaluation is the triangulation of empirical findings with multi-perspective (end-users, developers, and researchers), mixed-method (qualitative, quantitative) data sources. The framework utilizes a cyclic process to integrate findings across cases with a cross-case analysis in order to gain deeper insights into the intriguing questions of how and why PLEs work

Building trust in autonomous vehicles: Role of virtual reality driving simulators in HMI design

The investigation of factors contributing at making humans trust Autonomous Vehicles (AVs) will play a fundamental role in the adoption of such technology. The user's ability to form a mental model of the AV, which is crucial to establish trust, depends on effective user-vehicle communication; thus, the importance of Human-Machine Interaction (HMI) is poised to increase. In this work, we propose a methodology to validate the user experience in AVs based on continuous, objective information gathered from physiological signals, while the user is immersed in a Virtual Reality-based driving simulation. We applied this methodology to the design of a head-up display interface delivering visual cues about the vehicle' sensory and planning systems. Through this approach, we obtained qualitative and quantitative evidence that a complete picture of the vehicle's surrounding, despite the higher cognitive load, is conducive to a less stressful experience. Moreover, after having been exposed to a more informative interface, users involved in the study were also more willing to test a real AV. The proposed methodology could be extended by adjusting the simulation environment, the HMI and/or the vehicle's Artificial Intelligence modules to dig into other aspects of the user experience

Measuring Trust in Technology: A Survey Tool to Assess Users’ Trust Experiences

This work reports a survey mechanism to empower non-experts to measure technology trustworthiness. It uses a validated Human-Computer Trust Scale (HCTS) with nine items and aims to answer if (RQ1) Can this survey system build from the HCTS be a valuable tool for mapping user’s Trust in a system? (RQ2) Can the HCTS be used to support trustworthy design practices? Overall results indicate that the system can be a helpful tool and can be an effective tool to map trust behaviours towards technology. The majority of the inquired (designers) considered simple, valuable and easy to use the tool. However, it was challenging to understand and interpret the results. Highlighted points are the fact of being not technical, practical, and simple to apply. Results also indicate that it can be an effective tool to map trust behaviours across cultures when analyzed with complementary indicators, like differences, privacy perception