Assessing the Effectiveness and Usability of Personalized Internet Search through a Longitudinal Evaluation

This paper discusses a longitudinal user evaluation of Prospector, a personalized Internet meta-search engine capable of personalized re-ranking of search results. Twenty-one participants used Prospector as their primary search engine for 12 days, agreed to have their interaction with the system logged, and completed three questionnaires. The data logs show that the personalization provided by Prospector is successful: participants preferred re-ranked results that appeared higher up. However, the questionnaire results indicated that people would prefer to use Google instead (their search engine of choice). Users would, nevertheless, consider employing a personalized search engine to perform searches with terms that require disambiguation and/or contextualization. We conclude the paper with a discussion on the merit of combining system- and user-centered evaluation for the case of personalized systems

Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

On the Integration of Adaptive and Interactive Robotic Smart Spaces

© 2015 Mauro Dragone et al.. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License. (CC BY-NC-ND 3.0)Enabling robots to seamlessly operate as part of smart spaces is an important and extended challenge for robotics R&D and a key enabler for a range of advanced robotic applications, such as AmbientAssisted Living (AAL) and home automation. The integration of these technologies is currently being pursued from two largely distinct view-points: On the one hand, people-centred initiatives focus on improving the user’s acceptance by tackling human-robot interaction (HRI) issues, often adopting a social robotic approach, and by giving to the designer and - in a limited degree – to the final user(s), control on personalization and product customisation features. On the other hand, technologically-driven initiatives are building impersonal but intelligent systems that are able to pro-actively and autonomously adapt their operations to fit changing requirements and evolving users’ needs,but which largely ignore and do not leverage human-robot interaction and may thus lead to poor user experience and user acceptance. In order to inform the development of a new generation of smart robotic spaces, this paper analyses and compares different research strands with a view to proposing possible integrated solutions with both advanced HRI and online adaptation capabilities.Peer reviewe

User-centred design of flexible hypermedia for a mobile guide: Reflections on the hyperaudio experience

A user-centred design approach involves end-users from the very beginning. Considering users at the early stages compels designers to think in terms of utility and usability and helps develop the system on what is actually needed. This paper discusses the case of HyperAudio, a context-sensitive adaptive and mobile guide to museums developed in the late 90s. User requirements were collected via a survey to understand visitors’ profiles and visit styles in Natural Science museums. The knowledge acquired supported the specification of system requirements, helping defining user model, data structure and adaptive behaviour of the system. User requirements guided the design decisions on what could be implemented by using simple adaptable triggers and what instead needed more sophisticated adaptive techniques, a fundamental choice when all the computation must be done on a PDA. Graphical and interactive environments for developing and testing complex adaptive systems are discussed as a further step towards an iterative design that considers the user interaction a central point. The paper discusses how such an environment allows designers and developers to experiment with different system’s behaviours and to widely test it under realistic conditions by simulation of the actual context evolving over time. The understanding gained in HyperAudio is then considered in the perspective of the developments that followed that first experience: our findings seem still valid despite the passed time

The impact of user- and system-initiated personalization on the user experience at large sports events

This article describes an experimental study investigating the impact on user experience of two approaches of personalization of content provided on a mobile device, for spectators at large sports events. A lab-based experiment showed that a system-driven approach to personalization was generally preferable, but that there were advantages to retaining some user control over the process. Usability implications for a hybrid approach, and design implications are discussed, with general support for countermeasures designed to overcome recognised limitations of adaptive systems

A Model for patient engagement integration in perinatal eHealth development and quality assurance

The aim of this study was to construct a model for patient engagement integration in perinatal eHealth development and quality assurance. The model was developed in four phases. The first three phases produced evidence for the development of a model. In the final phase, a qualitative interpretive synthesis was conducted using grounded theory to articulate a patient engagement model composed of three steps. The first phase was a scoping review aimed at describing the nature and range of patient engagement from the perspective of access, personalization, commitment, and therapeutic alliance within perinatal eHealth. A narrative synthesis was used to describe findings. Phase two consisted of two studies exploring engagement practices of pregnant users during their use of a self-monitoring health promotion eHealth system. A descriptive comparative analysis was completed to understand user engagement patterns based on physical use of the wearable device. A mixed-methods convergence evaluation was conducted to understand the process of accessing the health promotion eHealth system. In phase three a process evaluation tool for parent participation and collaboration (in the neonatal intensive care unit) was developed and psychometrically tested. For the interpretive synthesis, articles from the first three phases of this study were purposively sampled. A deductive codebook was developed using Donabedian’s model, and an adapted version of Lewin’s Action Research Cycle. Donabedian’s model consists of quality assurance through the examination of structure, process, and outcomes. Lewin’s Action Research Cycle informs iterative steps in development and implementation of health systems. Phase four resulted in a model for patient engagement integration in perinatal eHealth development and quality assurance. Three steps of the model were identified as being: Person-centered Perinatal eHealth program mapping; Process evaluation through monitoring of patient engagement processes; and Co-creation of perinatal eHealth programs through real-life testing of perinatal eHealth systems.Malli potilaan osallistumisesta perinataaliajan sähköisen terveydenhuollon kehittämiseen ja laadunvarmistukseen Tutkimuksen tavoitteena oli kehittää malli ohjaamaan potilaan osallistumista perinataaliajan sähköisen terveydenhuollon kehittämiseen ja laadunvarmistukseen. Malli kehitettiin neljässä vaiheessa. Kolmessa ensimmäisessä vaiheessa tuotettiin tutkimusnäyttöä kehittämisen tueksi. Viimeisessä vaiheessa laadullisen tulkitsevan synteesin avulla muodostettiin potilaan sitoutumisen malli. Ensimmäisessä vaiheessa tehtiin kartoittava kirjallisuuskatsaus, joka kuvasi potilaiden sähköiseen terveydenhuoltoon osallistumisen tavat ja laajuuden saatavuuden, yksilöllisyyden, sitoutumisen ja terapeuttisen hoitosuhteen näkökulmasta. Aineisto analysoitiin teorialähtöisellä sisällönanalyysillä ja tulokset kuvattiin narratiivisen synteesin avulla. Toinen vaihe muodostui kahdesta tutkimuksesta, jotka tarkastelivat itsemonitorointisysteemin avulla raskaana olevien henkilöiden osallistumistapoja terveydenedistämiseen. Tutkimuksissa odottajat käyttivät itsemonitorointisysteemiä. Osallistumistapoja analysoitiin puettavan laitteen käyttöajan pohjalta tehtyjen vertailevien analyysien avulla. Monimenetelmällisessä tutkimuksessa muodostettiin analyysin pohjalta ymmärrys itsemonitorointisysteemin saatavuuteen liittyvästä prosessista. Kolmannessa vaiheessa kehitettiin ja psykometrisesti testattiin prosessievaluaatiomittari arvioimaan vanhempien osallistumista ja yhteistyötä henkilökunnan kanssa vastasyntyneiden teho-osastolla. Viimeisen vaiheen tulkitsevaa synteesiä varten valittiin tarkoituksenmukaisia artikkeleita. Donabedianin terveydenhuollon laadunvarmistuksen malli ja Lewinin muokatun toimintatutkimuksen syklin pohjalta muodostettiin teorialähtöinen analyysirunko. Neljännen vaiheen tuloksena muodostettiin malli potilaan osallistumisesta perinataaliajan sähköisen terveydenhuollon kehittämiseen ja laadunvarmistukseen. Malli kostuu kolmesta askeleesta: Yksilökeskeisen sähköisen terveydenhuollon kartoitus, potilaan osallistumisprosessin monitorointiin perustuva prosessievaluaatio ja perinataaliajan sähköisen terveydenhuollon yhteiskehittäminen kliinisessä todellisuudessa

Design of the user experience for personalized mobile services

This article describes how user centered, and particularly co-design methods can help maximize user experience for personalized services delivered over a mobile device. The specific focus was designing for Chinese spectators at large sports events (such as football matches, swimming galas or athletics meetings). User experience was assumed to comprise user, product, social, cultural and usage context components. Co-design methods were incorporated into a semi- structured HCI design process that comprised content, conceptual, interaction and presentation design, followed by field and lab-based user evaluation. There were two co-design methods in particular which were found to be key to working effectively with Chinese users. Emotion Cards were used to help overcome some of the inhibitions of participants and to encourage them to provide more open and unequivocal design input. The User Advisory Board was a group of participants who mediated the relationship between the designer and other participants at various design stages. They helped to ensure genuine collaboration because the wider participants felt (1) less like the object of study and (2) more able to communicate their needs during the design process

A user-centred collective system design approach for Smart Product-Service Systems:A case study on fitness product design

Emerging technologies have significantly contributed to the evolution of traditional product-service systems (PSS) into smart PSS. This transformation demands a fresh perspective and a more inventive design approach. In response, this study proposes a new User-Centred Collective System Design (CSD) framework and process for Smart PSS design, aiming to enhance stakeholder engagement during the entire design process, thus promoting highly effective and creative design solutions. A case study, titled ‘Next-G Smart Fitness PSS Design’, was carried out to test and implement this approach, contrasting the results of the CSD method with a designer-centred method. The outcomes showed a marked improvement in product novelty and user desirability of the design outcomes when using the proposed design framework. The proposed CSD framework could offer beneficial insights and user-centric viewpoints for practitioners dealing with complex challenges linked to smart PSS design

Shortcomings of learning design approaches and a possible way out

Shifting away from traditional instructional design to younger research streams like personalized, workflow-based or collaborative e-learning, learning design (LD) has become an important issue in the field of technology-enhanced learning. Nevertheless, current LD approaches turn out to be rather unhandy or costly in teaching and research practice. In this paper, we discuss these shortcomings and propose an alternative solution approach which is based on a web application mashup, learner interactions, and a semantic layer for tool recommendations. As the evaluation of our first prototype is in progress, we can not highlight first experiences, but outline benefits and possible application scenarios in this position paper

Politician's Strategic Impression Management on Instagram

With the growing trend of Instagram usage among politicians, this study investigates the effects of two self-presentation styles of personalization (i.e. presenting the private over the public life of a politician) and interactivity (i.e. presenting the active versus passive voice of a politician) on voters’ perception of politicians and their voting intention in the context of Instagram. The results of an experiment (n = 120) showed that presenting the public life of a politician had a more positive effect on perception of character, compared to the private life. Using a highly interactive style on Instagram had a more positive effect on perception of character, compared to a lack of interactivity. Finally, character perception was found to be a mediator for the effects of personalization and interactivity on voting intention. Theoretical implications with respect to impression management on social media, as well as practical implications for political engagement, are discussed