Applicability of HCI Techniques to Systems Interface Design

PhDThis thesis seeks to identify reasons why HCI techniques are unsuitable for application in real world design projects. User-oriented systems design and evaluation require that many considerations such as the psychology of users, the applications and target tasks be born in mind simultaneously. A selection of influential HCI design and evaluative techniques from HCI research literature are reviewed and characterised in terms of their analytic scope. Two studies of systems designers' approaches to user-oriented design and evaluation were carried out in order to gain a clearer picture of the design process as it occurs in applied and commercial projects. It was found that designers frequently lack adequate information about users, carrying Out, at best, informal user-evaluations of prototypes. Most notably HCI design and evaluative techniques, of the type common in the literature, are not being used in applied and commercial design practice. They seem to be complex, often limited in scope, and possessed of inadequate or unrepresentative views of the design process within which they might be applied. It was noted that design practice is highly varied with only a small number of common goal directed classes of activity being identified. These together with observed user-oriented information sources and design constraints provide a useful schema for viewing applied and commercial design practice. A further study of HCI specialists' practice in commercial environments was undertaken, in order to identify particular user-oriented design approaches and HCI techniques suitable for application in practice. The specialists were able to describe desirable, and undesirable properties of the techniques they used which made it possible to identify a list of specific desirable features for HCI techniques. A framework for assessing applicability of HCI techniques was developed from the findings of the thesis. This is demonstrated using an example project from the design studies and may prove valuable in supporting design, evaluation, critiquing and selection of HCI techniques

A Load of Cobbler’s Children: Beyond the Model Designing Processor

HCI has developed rich understandings of people at work and at play with technology: most people that is, except designers, who remain locked in the information processing paradigm of first wave HCI. Design methods are validated as if they were computer programs, expected to produce the same results on a range of architectures and hardware. Unfortunately, designers are people, and thus interfere substantially (generally to good effects) with the ‘code’ of design methods. We need to rethink the evaluation and design of design and evaluation methods in HCI. A logocentric proposal based on resource function vocabularies is presented

Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

Applicability of the user engagement scale to mobile health : a survey-based quantitative study

Background: There has recently been exponential growth in the development and use of health apps on mobile phones. As with most mobile apps, however, the majority of users abandon them quickly and after minimal use. One of the most critical factors for the success of a health app is how to support users’ commitment to their health. Despite increased interest from researchers in mobile health, few studies have examined the measurement of user engagement with health apps. Objective: User engagement is a multidimensional, complex phenomenon. The aim of this study was to understand the concept of user engagement and, in particular, to demonstrate the applicability of a user engagement scale (UES) to mobile health apps. Methods: To determine the measurability of user engagement in a mobile health context, a UES was employed, which is a psychometric tool to measure user engagement with a digital system. This was adapted to Ada, developed by Ada Health, an artificial intelligence–powered personalized health guide that helps people understand their health. A principal component analysis (PCA) with varimax rotation was conducted on 30 items. In addition, sum scores as means of each subscale were calculated. Results: Survey data from 73 Ada users were analyzed. PCA was determined to be suitable, as verified by the sampling adequacy of Kaiser-Meyer-Olkin=0.858, a significant Bartlett test of sphericity (χ2300=1127.1; P<.001), and communalities mostly within the 0.7 range. Although 5 items had to be removed because of low factor loadings, the results of the remaining 25 items revealed 4 attributes: perceived usability, aesthetic appeal, reward, and focused attention. Ada users showed the highest engagement level with perceived usability, with a value of 294, followed by aesthetic appeal, reward, and focused attention. Conclusions: Although the UES was deployed in German and adapted to another digital domain, PCA yielded consistent subscales and a 4-factor structure. This indicates that user engagement with health apps can be assessed with the German version of the UES. These results can benefit related mobile health app engagement research and may be of importance to marketers and app developers

Context-driven progressive enhancement of mobile web applications: a multicriteria decision-making approach

Personal computing has become all about mobile and embedded devices. As a result, the adoption rate of smartphones is rapidly increasing and this trend has set a need for mobile applications to be available at anytime, anywhere and on any device. Despite the obvious advantages of such immersive mobile applications, software developers are increasingly facing the challenges related to device fragmentation. Current application development solutions are insufficiently prepared for handling the enormous variety of software platforms and hardware characteristics covering the mobile eco-system. As a result, maintaining a viable balance between development costs and market coverage has turned out to be a challenging issue when developing mobile applications. This article proposes a context-aware software platform for the development and delivery of self-adaptive mobile applications over the Web. An adaptive application composition approach is introduced, capable of autonomously bypassing context-related fragmentation issues. This goal is achieved by incorporating and validating the concept of fine-grained progressive application enhancements based on a multicriteria decision-making strategy

Changing the view:towards the theory of visualisation comprehension

The core problem of the evaluation of information visualisation is that the end product of visualisation - the comprehension of the information from the data - is difficult to measure objectively. This paper outlines a description of visualisation comprehension based on two existing theories of perception: principles of perceptual organisation and the reverse hierarchy theory. The resulting account of the processes involved in visualisation comprehension enables evaluation that is not only objective, but also non-comparative, providing an absolute efficiency classification. Finally, as a sample application of this approach, an experiment studying the benefits of interactivity in 3D scatterplots is presented

Assessing the Semiotic Inspection Method – The Evaluators’ Perspective

This paper presents an assessment of the Semiotic Inspection Methodaimed at understanding its costs, benefits, advantages and disadvantages from the evaluators’perspective. We applied a questionnaire to novice evaluators and interviewedthe authors of the method (representing the experts’ evaluators). An analysis of theresponses shows interesting insights and characteristics of the method

From plane crashes to algorithmic harm: applicability of safety engineering frameworks for responsible ML

Inappropriate design and deployment of machine learning (ML) systems leads to negative downstream social and ethical impact -- described here as social and ethical risks -- for users, society and the environment. Despite the growing need to regulate ML systems, current processes for assessing and mitigating risks are disjointed and inconsistent. We interviewed 30 industry practitioners on their current social and ethical risk management practices, and collected their first reactions on adapting safety engineering frameworks into their practice -- namely, System Theoretic Process Analysis (STPA) and Failure Mode and Effects Analysis (FMEA). Our findings suggest STPA/FMEA can provide appropriate structure toward social and ethical risk assessment and mitigation processes. However, we also find nontrivial challenges in integrating such frameworks in the fast-paced culture of the ML industry. We call on the ML research community to strengthen existing frameworks and assess their efficacy, ensuring that ML systems are safer for all people