Making intelligent systems team players: Case studies and design issues. Volume 1: Human-computer interaction design

Initial results are reported from a multi-year, interdisciplinary effort to provide guidance and assistance for designers of intelligent systems and their user interfaces. The objective is to achieve more effective human-computer interaction (HCI) for systems with real time fault management capabilities. Intelligent fault management systems within the NASA were evaluated for insight into the design of systems with complex HCI. Preliminary results include: (1) a description of real time fault management in aerospace domains; (2) recommendations and examples for improving intelligent systems design and user interface design; (3) identification of issues requiring further research; and (4) recommendations for a development methodology integrating HCI design into intelligent system design

Information for the user in design of intelligent systems

Recommendations are made for improving intelligent system reliability and usability based on the use of information requirements in system development. Information requirements define the task-relevant messages exchanged between the intelligent system and the user by means of the user interface medium. Thus, these requirements affect the design of both the intelligent system and its user interface. Many difficulties that users have in interacting with intelligent systems are caused by information problems. These information problems result from the following: (1) not providing the right information to support domain tasks; and (2) not recognizing that using an intelligent system introduces new user supervisory tasks that require new types of information. These problems are especially prevalent in intelligent systems used for real-time space operations, where data problems and unexpected situations are common. Information problems can be solved by deriving information requirements from a description of user tasks. Using information requirements embeds human-computer interaction design into intelligent system prototyping, resulting in intelligent systems that are more robust and easier to use

Supporting User Understanding and Engagement in Designing Intelligent Systems for the Home.

With advances in computing, networking and sensing technology, our everyday objects have become more automated, connected, and intelligent. This dissertation aims to inform the design and implementation of future intelligent systems and devices. To do so, this dissertation presents three studies that investigated user interaction with and experience of intelligent systems. In particular, we look at intelligent technologies that employ sensing technology and machine learning algorithm to perceive and respond to user behavior, and that support energy savings in the home. We first investigated how people understand and use an intelligent thermostat in their everyday homes to identify problems and challenges that users encounter. Subsequently, we examined the opportunities and challenges for intelligent systems that aimed to save energy, by comparing how people’s interaction changed between conventional and smart thermostats as well as how interaction with smart thermostats changed over time. These two qualitative studies led us to the third study. In the final study, we evaluated a smart thermostat that offered a new approach to the management of thermostat schedule in a field deployment, exploring effective ways to define roles for intelligent systems and their users in achieving their mutual goals of energy savings. Based on findings from these studies, this dissertation argues that supporting user understanding and user control of intelligent systems for the home is critical allowing users to intervene effectively when the system does not work as desired. In addition, sustaining user engagement with the system over time is essential for the system to obtain necessary user input and feedback that help improve the system performance and achieve user goals. Informed by findings and insights from the studies, we identify design challenges and strategies in designing end-user interaction with intelligent technologies for the home: making system behaviors intuitive and intelligible; maintaining long-term, easy user engagement over time; and balancing interplay between user control and system autonomy to better achieve their mutual goals.PhDInformationUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/133318/1/rayang_1.pd

Interactive Machine Learning for End-User

User interaction with intelligent systems need not be limited to interaction where pre-trained software has intelligence “baked in.” End-user training, including interactive machine learning (IML) approaches, can enable users to create and customise systems themselves. We propose that the user experience of these users is worth considering. Furthermore, the user experience of system developers—people who may train and configure both learning algorithms and their user interfaces—also deserves attention. We additionally propose that IML can improve user experiences by supporting usercentred design processes, and that there is a further role for user-centred design in improving interactive and classical machine learning systems. We are developing this approach and embodying it through the design of a new User Innovation Toolkit, in the context of the European Commission-funded project RAPID-MIX

User-Centered Intelligent Interface of Vending Machines Modeling

Convenience and speed of service makes vending machines popular world-wide.However, the development and use of vending machines in China have not kept pace with global markets. In this paper, in order to determine the key design factors, interface elements and parameters which affect the convenience of user-machine interaction, the author analyzes the interaction problems in current vending machine design and finds out that unreasonable design results from machine-centered logic design. Then, with user-centered design principles, a new user-centered intelligent interaction model of vending machines is developed.The result of the test shows that the user-centered interface system can effectively reduce the operational time and decrease the mistake type and mistake rate. The process followed in the present study can also serve as a general framework for the analysis and development of UCD interfaces for other self-service systems

Quality of experience in affective pervasive environments

The confluence of miniaturised powerful devices, widespread communication networks and mass remote storage has caused a fundamental shift in the user interaction design paradigm. The distinction between system and user in pervasive environments is evolving into an increasingly integrated loop of interaction, raising a number of opportunities to provide enhanced and personalised experiences. We propose a platform, based on a smart architecture, to address the identified opportunities in pervasive computing. Smart systems aim at acting upon an environment for improving quality of experience: a subjective measure that has been defined as an emotional reaction to products or services. The inclusion of an emotional dimension allows us to measure individual user responses and deliver personalised services with the potential to influence experiences positively. The platform, Cloud2Bubble, leverages pervasive systems to aggregate user and environment data with the goal of addressing personal preferences and supra-functional requirements. This, combined with its societal implications, results in a set of design principles as a concrete fruition of design contractualism. In particular, this thesis describes: - a review of intelligent ubiquitous environments and relevant technologies, including a definition of user experience as a dynamic affective construct; - a specification of main components for personal data aggregation and service personalisation, without compromising privacy, security or usability; - the implementation of a software platform and a methodological procedure for its instantiation; - an evaluation of the developed platform and its benefits for urban mobility and public transport information systems; - a set of design principles for the design of ubiquitous systems, with an impact on individual experience and collective awareness. Cloud2Bubble contributes towards the development of affective intelligent ubiquitous systems with the potential to enhance user experience in pervasive environments. In addition, the platform aims at minimising the risk of user digital exposure while supporting collective action.Open Acces

SPAM – A Process Model for Developing Smart Personal Assistants

Information technology capabilities are growing at an impressive pace and increasingly overstrain the cognitive abilities of users. User assistance systems such as online manuals try to help the user in handling these systems. However, there is strong evidence that traditional user assistance systems are not as effective as intended. With the rise of smart personal assistants, such as Amazon’s Alexa, user assistance systems are becoming more sophisticated by offering a higher degree of interaction and intelligence. This study proposes a process model to develop Smart Personal Assistants. Using a design science research approach, we first gather requirements from Smart Personal Assistant designers and theory, and later evaluate the process model with developing an Amazon Alexa Skill for a Smart Home system. This paper contributes to the existing user assistance literature by offering a new process model on how to design Smart Personal Assistants for intelligent systems

Space Communication Artificial Intelligence for Link Evaluation Terminal (SCAILET)

A software application to assist end-users of the high burst rate (HBR) link evaluation terminal (LET) for satellite communications is being developed. The HBR LET system developed at NASA Lewis Research Center is an element of the Advanced Communications Technology Satellite (ACTS) Project. The HBR LET is divided into seven major subsystems, each with its own expert. Programming scripts, test procedures defined by design engineers, set up the HBR LET system. These programming scripts are cryptic, hard to maintain and require a steep learning curve. These scripts were developed by the system engineers who will not be available for the end-users of the system. To increase end-user productivity a friendly interface needs to be added to the system. One possible solution is to provide the user with adequate documentation to perform the needed tasks. With the complexity of this system the vast amount of documentation needed would be overwhelming and the information would be hard to retrieve. With limited resources, maintenance is another reason for not using this form of documentation. An advanced form of interaction is being explored using current computer techniques. This application, which incorporates a combination of multimedia and artificial intelligence (AI) techniques to provided end-users with an intelligent interface to the HBR LET system, is comprised of an intelligent assistant, intelligent tutoring, and hypermedia documentation. The intelligent assistant and tutoring systems address the critical programming needs of the end-user