Intelligent assistance in authoring dynamically generated Web interfaces

The final publication is available at Springer via http://dx.doi.org/10.1007/s11280-008-0043-3Since its emergence in the early 1990s, the WWW has become not only an information system of unprecedented size, but a universal platform for the development of services and applications. However, most of the advances in web technologies are intended for professional developers, paying poor attention to end-users with no programming abilities but with explicit needs of creating and customizing web-based presentations. This provides a strong motivation for end-users to act as designers at some point, leading to an emerging role of new computing-related professionals to be considered. This paper is an effort to leverage such difficulties by providing intelligent mechanism to assist end-users in web-based authoring tasks. To carry out such a challenge, intelligent user-monitoring techniques are exploited to obtain high-level information that will be used to infer the user’s preferences and assist him throughout the interaction. Furthermore, we report on how iteration patterns can be applied to avoid repetitive tasks that are automatically carried out on behalf of the user. In order to bring off a feasible trade-off between expressivity and ease of use, a user experiment to obtain the user’s perception and evaluate the hit-rate of our system is also presented.The work reported in this paper is being partially supported by the Spanish Ministry of Science and Technology (MCyT), project number TSI2005-08225-C07-0

Providing end-user facilities to simplify ontology-driven web application authoring

This is the author’s version of a work that was accepted for publication in Interacting with Computers. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Interacting with Computers, Interacting with Computers 17, 4 (2007) DOI: 10.1016/j.intcom.2007.01.006Generally speaking, emerging web-based technologies are mostly intended for professional developers. They pay poor attention to users who have no programming abilities but need to customize software applications. At some point, such needs force end-users to act as designers in various aspects of software authoring and development. Every day, more new computing-related professionals attempt to create and modify existing applications in order to customize web-based artifacts that will help them carry out their daily tasks. In general they are domain experts rather than skilled software designers, and new authoring mechanisms are needed in order that they can accomplish their tasks properly. The work we present is an effort to supply end-users with easy mechanisms for authoring web-based applications. To complement this effort, we present a user study showing that it is possible to carry out a trade-off between expressiveness and ease of use in order to provide end-users with authoring facilities.The work reported in this paper is being partially supported by the Spanish Ministry of Science and Technology (MCyT), projects TIN2005-06885 and TSI2005-08225-C07-06

Feedback authoring for exploratory learning objects: AuthELO

This paper presents a tool for the configuration of logging and authoring of automated feedback for exploratory learning objects (ELOs). This tool has been developed in the context of a larger project that is developing a platform for authoring interactive educational e-books. This platform comprises an extendable set of diverse widgets that can be used to generate instances of exploratory activities that can be employed in various learning scenarios. AuthELO was designed and developed to provide a simple, common and efficient authoring interface that can normalise the heterogeneity of these widgets and give the ability to non-experts to easily modify — if not program themselves — the feedback that is provided to students based on their interaction. We describe the architecture and design characteristics of AuthELO and present a small-scale evaluation of the prototype that shows promising results

Semantic monitoring techniques for EUD

This is an electronic version of the paper presented at the Workshop on End User Modeling at the ACM International Conference on Human Factors in Computing Systems (CHI 2003), held in Florida on 2003In this work, we present how domain modeling and Programming by Example techniques can be combined to carry through a EUD approach. Our techniques are based on detecting iteration patterns from user monitoring as well as extracting knowledge about the user interface itself. Combining those, dynamic behavior can be characterized, getting maximum amount of semantic at each user step. This approach can be used in order to make PBE inference process more effective as well as to result in enhancing PBE global efficiency.The work reported in this paper is being supported by the Spanish Ministry of Science and Technology (MCyT), project number TIC2002-1948

Finding iteration patterns in dynamic Web page authoring

The final publication is available at Springer via http://dx.doi.org/10.1007/11431879_10Revised Selected Papers of the Joint Working Conferences EHCI-DSVIS 2004, Hamburg, Germany, July 11-13, 2004Most of the current WWW is made up of dynamic pages. The development of dynamic pages is a difficult and costly endeavour, out-of-reach for most users, experts, and content producers. We have developed a set of techniques to support the edition of dynamic web pages in a WYSIWYG environment. In this paper we focus on specific techniques for inferring changes to page generation procedures from users actions on examples of the pages generated by these procedures. More specifically, we propose techniques for detecting iteration patterns in users’ behavior in web page editing tasks involving page structures like lists, tables and other iterative HTML constructs. Such patterns are used in our authoring tool, DESK, where a specialized assistant, DESK-A, detects iteration patterns and generates, using Programming by Example, a programmatic representation of the user’s actions. Iteration patterns help obtain a more detailed characterization of users’ intent, based on user monitoring techniques, that is put in relation to application knowledge automatically extracted by our system from HTML pages. DESK-A relieves end-users from having to learn programming and specification languages for editing dynamic-generated web pages.The work reported in this paper is being supported by the Spanish Ministry of Science and Technology (MCyT), project number TIC2002-194

User-centred design of flexible hypermedia for a mobile guide: Reflections on the hyperaudio experience

A user-centred design approach involves end-users from the very beginning. Considering users at the early stages compels designers to think in terms of utility and usability and helps develop the system on what is actually needed. This paper discusses the case of HyperAudio, a context-sensitive adaptive and mobile guide to museums developed in the late 90s. User requirements were collected via a survey to understand visitors’ profiles and visit styles in Natural Science museums. The knowledge acquired supported the specification of system requirements, helping defining user model, data structure and adaptive behaviour of the system. User requirements guided the design decisions on what could be implemented by using simple adaptable triggers and what instead needed more sophisticated adaptive techniques, a fundamental choice when all the computation must be done on a PDA. Graphical and interactive environments for developing and testing complex adaptive systems are discussed as a further step towards an iterative design that considers the user interaction a central point. The paper discusses how such an environment allows designers and developers to experiment with different system’s behaviours and to widely test it under realistic conditions by simulation of the actual context evolving over time. The understanding gained in HyperAudio is then considered in the perspective of the developments that followed that first experience: our findings seem still valid despite the passed time

Accessible user interface support for multi-device ubiquitous applications: architectural modifiability considerations

The market for personal computing devices is rapidly expanding from PC, to mobile, home entertainment systems, and even the automotive industry. When developing software targeting such ubiquitous devices, the balance between development costs and market coverage has turned out to be a challenging issue. With the rise of Web technology and the Internet of things, ubiquitous applications have become a reality. Nonetheless, the diversity of presentation and interaction modalities still drastically limit the number of targetable devices and the accessibility toward end users. This paper presents webinos, a multi-device application middleware platform founded on the Future Internet infrastructure. Hereto, the platform's architectural modifiability considerations are described and evaluated as a generic enabler for supporting applications, which are executed in ubiquitous computing environments

Multimodal Content Delivery for Geo-services

This thesis describes a body of work carried out over several research projects in the area of multimodal interaction for location-based services. Research in this area has progressed from using simulated mobile environments to demonstrate the visual modality, to the ubiquitous delivery of rich media using multimodal interfaces (geo- services). To effectively deliver these services, research focused on innovative solutions to real-world problems in a number of disciplines including geo-location, mobile spatial interaction, location-based services, rich media interfaces and auditory user interfaces. My original contributions to knowledge are made in the areas of multimodal interaction underpinned by advances in geo-location technology and supported by the proliferation of mobile device technology into modern life. Accurate positioning is a known problem for location-based services, contributions in the area of mobile positioning demonstrate a hybrid positioning technology for mobile devices that uses terrestrial beacons to trilaterate position. Information overload is an active concern for location-based applications that struggle to manage large amounts of data, contributions in the area of egocentric visibility that filter data based on field-of-view demonstrate novel forms of multimodal input. One of the more pertinent characteristics of these applications is the delivery or output modality employed (auditory, visual or tactile). Further contributions in the area of multimodal content delivery are made, where multiple modalities are used to deliver information using graphical user interfaces, tactile interfaces and more notably auditory user interfaces. It is demonstrated how a combination of these interfaces can be used to synergistically deliver context sensitive rich media to users - in a responsive way - based on usage scenarios that consider the affordance of the device, the geographical position and bearing of the device and also the location of the device