Finding the future:evolving interaction design

The main aim of this project is to design and prototype a simplified example of a mobile operating system that makes use of both edge swipe control and 'smart' graphical instructions. The research will consider how these methods can be used to design a truly inclusive and accessible interface. The effectiveness of these features will be validated through user experiments and focus groups over the course of the project, with the findings of user testing used to inform design practice

ISML: an interface specification meta-language

In this paper we present an abstract metaphor model situated within a model-based user interface framework. The inclusion of metaphors in graphical user interfaces is a well established, but mostly craft-based strategy to design. A substantial body of notations and tools can be found within the model-based user interface design literature, however an explicit treatment of metaphor and its mappings to other design views has yet to be addressed. We introduce the Interface Specification Meta-Language (ISML) framework and demonstrate its use in comparing the semantic and syntactic features of an interactive system. Challenges facing this research are outlined and further work proposed

Taking a New-Generation Manager Perspective to Develop Interface Designs

Digital natives are increasingly populating organizations’ management. As they have higher expectations with respect to IS accommodating their (non-functional) user preferences, interfaces of management support systems (MSS) are becoming more important. We develop design guidelines for new MSS interfaces from a new-generation manager perspective. We compile a set of requirements from a literature review and based on a multiple-case study we synthesize five guidelines: (1) use sparklines to present information at a glance and complement them with tooltips to access details, (2) support economic value-added concepts as a “must-have” and be aware that self-service predictive analyses make them more valuable, (3) draw managers’ attention to critical events in real-time by sending notifications to their smart devices, (4) to harvest the knowledge of different users, integrate collaboration capabilities into MSS interface designs, (5) align different information media with managers’ device selection and do not forget their mobile offline use situations

Investigation of methods for user adapted visualisation of information in a hypermedia generation system

A literature review of user interaction to support creative processes is given. A design for an authoring system for semi-automatically generated hypermedia presentations is developed. The system designed is called SampLe (a Semi-Automatic Multimedia Presentation generation Environment

Specification and implementation of mapping rule visualization and editing : MapVOWL and the RMLEditor

Visual tools are implemented to help users in defining how to generate Linked Data from raw data. This is possible thanks to mapping languages which enable detaching mapping rules from the implementation that executes them. However, no thorough research has been conducted so far on how to visualize such mapping rules, especially if they become large and require considering multiple heterogeneous raw data sources and transformed data values. In the past, we proposed the RMLEditor, a visual graph-based user interface, which allows users to easily create mapping rules for generating Linked Data from raw data. In this paper, we build on top of our existing work: we (i) specify a visual notation for graph visualizations used to represent mapping rules, (ii) introduce an approach for manipulating rules when large visualizations emerge, and (iii) propose an approach to uniformly visualize data fraction of raw data sources combined with an interactive interface for uniform data fraction transformations. We perform two additional comparative user studies. The first one compares the use of the visual notation to present mapping rules to the use of a mapping language directly, which reveals that the visual notation is preferred. The second one compares the use of the graph-based RMLEditor for creating mapping rules to the form-based RMLx Visual Editor, which reveals that graph-based visualizations are preferred to create mapping rules through the use of our proposed visual notation and uniform representation of heterogeneous data sources and data values. (C) 2018 Elsevier B.V. All rights reserved

Constraint-based graphical layout of multimodal presentations

When developing advanced multimodal interfaces, combining the characteristics of different modalities such as natural language, graphics, animation, virtual realities, etc., the question of automatically designing the graphical layout of such presentations in an appropriate format becomes increasingly important. So, to communicate information to the user in an expressive and effective way, a knowledge-based layout component has to be integrated into the architecture of an intelligent presentation system. In order to achieve a coherent output, it must be able to reflect certain semantic and pragmatic relations specified by a presentation planner to arrange the visual appearance of a mixture of textual and graphic fragments delivered by mode-specific generators. In this paper we will illustrate by the example of LayLab, the layout manager of the multimodal presentation system WIP, how the complex positioning problem for multimodal information can be treated as a constraint satisfaction problem. The design of an aesthetically pleasing layout is characterized as a combination of a general search problem in a finite discrete search space and an optimization problem. Therefore, we have integrated two dedicated constraint solvers, an incremental hierarchy solver and a finite domain solver, in a layered constraint solver model CLAY, which is triggered from a common metalevel by rules and defaults. The underlying constraint language is able to encode graphical design knowledge expressed by semantic/pragmatic, geometrical/topological, and temporal relations. Furthermore, this mechanism allows one to prioritize the constraints as well as to handle constraint solving over finite domains. As graphical constraints frequently have only local effects, they are incrementally generated by the system on the fly. Ultimately, we will illustrate the functionality of LayLab by some snapshots of an example run