Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S)

The user experience questionnaire (UEQ) is a widely used questionnaire to measure the subjective impression of users towards the user experience of products. The UEQ is a semantic differential with 26 items. Filling out the UEQ takes approximately 3-5 minutes, i.e. the UEQ is already reasonably efficient concerning the time required to answer all items. However, there exist several valid application scenarios, where filling out the entire UEQ appears impractical. This paper deals with the creation of an 8 item short version of the UEQ, which is optimized for these specific application scenarios. First validations of this short version are also described

User-centred design of a clinical decision support system for palliative care: Insights from healthcare professionals

[EN] Objective:Although clinical decision support systems (CDSS) have many benefits for clinical practice, they also have several barriers to their acceptance by professionals. Our objective in this study was to design and validate The Aleph palliative care (PC) CDSS through a user-centred method, considering the predictions of the artificial intelligence (AI) core, usability and user experience (UX). Methods:We performed two rounds of individual evaluation sessions with potential users. Each session included a model evaluation, a task test and a usability and UX assessment. Results:The machine learning (ML) predictive models outperformed the participants in the three predictive tasks. System Usability Scale (SUS) reported 62.7 +/- 14.1 and 65 +/- 26.2 on a 100-point rating scale for both rounds, respectively, while User Experience Questionnaire - Short Version (UEQ-S) scores were 1.42 and 1.5 on the -3 to 3 scale. Conclusions:The think-aloud method and including the UX dimension helped us to identify most of the workflow implementation issues. The system has good UX hedonic qualities; participants were interested in the tool and responded positively to it. Performance regarding usability was modest but acceptable.The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the InAdvance project (H2020-SC1-BHC-2018¿2020 grant number 825750) and the CANCERLESS project (H2020-SC1-2020-Single-Stage-RTD grant number 965351), both funded by the European Union¿s Horizon 2020 research and innovation programme. Also, it was partially supported by the ALBATROSS project (National Plan for Scientific and Technical Research and Innovation 2017¿ 2020, grant number PID2019-104978RB-I00)Blanes-Selva, V.; Asensio-Cuesta, S.; Doñate-Martínez, A.; Pereira Mesquita, F.; Garcia-Gomez, JM. (2023). User-centred design of a clinical decision support system for palliative care: Insights from healthcare professionals. Digital Health. 9:1-13. https://doi.org/10.1177/20552076221150735113

Evaluating and Redesigning the Self-Monitoring Tool

In order to facilitate self-monitoring interventions designed by the Faculty of Computer Science Universitas Indonesia a web-based self-monitoring tool was created. This paper aims to evaluate the tool regarding its usability and user-experiences prior to its wide adoption. The System Usability Scale (SUS) and the User-Experience Questionnaire (UEQ) were used to evaluate the self-monitoring tool. The tool was implemented in a Human-Computer Interaction course during odd semesters, and the evaluations were taken by the participants of the course. The evaluation results were analysed to help determine whether the tool needs to be enhanced or improved. Based on the results, a new design of self-monitoring tool was developed using the interface design principles

A Benchmark for the UEQ+ Framework: Construction of a Simple Tool to Quickly Interpret UEQ+ KPIs

Questionnaires are a highly efficient method to compare the user experience (UX) of different interactive products or versions of a single product. Concretely, they allow us to evaluate the UX easily and to compare different products with a numeric UX score. However, often only one UX score from a single evaluated product is available. Without a comparison to other measurements, it is difficult to interpret an individual score, e.g. to decide whether a product’s UX is good enough to compete in the market. Many questionnaires offer benchmarks to support researchers in these cases. A benchmark is the result of a larger set of product evaluations performed with the same questionnaire. The score obtained from a single product evaluation can be compared to the scores from this benchmark data set to quickly interpret the results. In this paper, the first benchmark for the UEQ+ (User Experience Questionnaire +) is presented, which was created using 3.290 UEQ+ responses for 26 successful software products. The UEQ+ is a modular framework that contains a high number of validated user experience scales that can be combined to form a UX questionnaire. Currently, no benchmark is available for this framework, making the benchmark constructed in this paper a valuable interpretation tool for UEQ+ questionnaires

Design and Validation of a Framework for the Creation of User Experience Questionnaires

Existing user experience questionnaires have a fixed number of scales. Each of these scales measures a distinct aspect of user experience. These questionnaires can be used with little effort and provide a number of useful support materials that make the application of such a questionnaire quite easy. However, in practical evaluation scenarios it can happen that none of the existing questionnaires contains all scales necessary to answer the research question. It is of course possible to combine several UX questionnaires in such cases, but due to the variations of item formats this is also not an optimal solution. In this paper, we describe the development and first validation studies of a modular framework that allows the creation of user experience questionnaires that fit perfectly to a given research question. The framework contains several scales that measure different UX aspects. These scales can be combined to cover the relevant research questions

Usability Evaluation of the Restaurant Finder Application Using Inspection and Inquiry Methods

Restaurant Finder application is a mobile application that helps users to find restaurants according to their requirements. One of the most well-known and widely used restaurant finder apps is Zomato. Zomato ranks first in the food and delivery category websites from around the world. But, the number of users of a product or application certainly does not guarantee the satisfaction of the user experience of apps. A system that is poorly designed will make it difficult for users, which results in the system being rarely or misused so that the costs to the organization become high and dangerous to the reputation of the company. The purpose of this study was to evaluate the usability of the restaurant finder application using inspection and inquiry methods. Inspection method using the Enhanced Cognitive Walkthrough method, and for inquiry methods using the User Experience Questionnaire method and the System Usability Scale. The inspection method results identified 7 serious problems. Recommendations for improvement based on inspection methods are focused on login tasks, reviews, and food promo information. The inquiry methods results identified 5 aspects that needed improvement. The five aspects consist of novelty, stimulation, learnability, consistency, complexity

Is Silent eHMI Enough? A Passenger-Centric Study on Effective eHMI for Autonomous Personal Mobility Vehicles in the Field

Autonomous personal mobility vehicle (APMV) is a miniaturized autonomous vehicle that is used in pedestrian-rich environments. In addition, the open bodywork design of APMVs exposes passengers to the communication between the eHMI deployed on APMVs and pedestrians. Therefore, to ensure an optimal passenger experience, eHMI designs for APMVs must consider the potential impact of APMV-pedestrian communications on passengers' psychological feelings. This study discussed three external human-machine interface (eHMI) designs, i.e., eHMI with text message (eHMI-T), eHMI with neutral voice (eHMI-NV) and eHMI with affective voice (eHMI-AV), from the perspective of APMV passengers in the communication between APMV and pedestrians. In the riding experiment, we found that eHMI-T may be less suitable for APMVs. This conclusion was drawn based on passengers' feedback, as they expressed feeling awkward during the ``silent period'' because the eHMI-T conveyed information only to pedestrians but not to passengers. Additionally, the affective voice cues on eHMI improved overall user experience of passengers, leading to higher ratings for both pragmatic and hedonic quality. The study also highlights the necessity of considering passengers' personalities when designing eHMI for APMVs to enhance their experience