SMIL State: an architecture and implementation for adaptive time-based web applications

In this paper we examine adaptive time-based web applications (or presentations). These are interactive presentations where time dictates which parts of the application are presented (providing the major structuring paradigm), and that require interactivity and other dynamic adaptation. We investigate the current technologies available to create such presentations and their shortcomings, and suggest a mechanism for addressing these shortcomings. This mechanism, SMIL State, can be used to add user-defined state to declarative time-based languages such as SMIL or SVG animation, thereby enabling the author to create control flows that are difficult to realize within the temporal containment model of the host languages. In addition, SMIL State can be used as a bridging mechanism between languages, enabling easy integration of external components into the web application. Finally, SMIL State enables richer expressions for content control. This paper defines SMIL State in terms of an introductory example, followed by a detailed specification of the State model. Next, the implementation of this model is discussed. We conclude with a set of potential use cases, including dynamic content adaptation and delayed insertion of custom content such as advertisements. © 2009 Springer Science+Business Media, LLC

Toward 2^W beyond Web 2.0

From its inception as a global hypertext system, the Web has evolved into a universal platform for deploying loosely coupled distributed applications. 2^W is a result of the exponentially growing Web building on itself to move from a Web of content to a Web of applications

Web application user interface technologies

The World Wide Web has expanded from a huge information storage repository into a worldwide application platform. Web applications have several benefits compared to desktop applications. An application can be used anywhere from any system and device, which means that only one version is needed, they do not need to be installed and developers can modify running applications. Despite all the benefits of the Web, web applications are suffering because they are developed using the same technologies as the static documents on the Web. Some of these web technologies are outdated and were not originally designed for the complex use cases of the modern applications to which they are now applied. For instance, HTML forms comprise the main interaction of an application, despite not having been designed to describe complex and interactive UIs. Another example is HTTP communication on the Web, which always requires client initiative and is too restrictive for dynamic web applications. Additionally, new usage contexts have brought with them new requirements for web applications, which are no longer used only via Graphical User Interfaces. Recently, several parties have developed specialized technologies for web application development. These solutions are not only minor additions to the existing technologies, but also new technologies. The goal of this thesis is to analyze the advanced web technologies and propose improvements to the technologies and architecture where applicable. The technologies are evaluated against a large set of requirements. The aim of the evaluation is two-fold. The first part is to select a technology on which to base the further improvements, and the second is to identify the deficiencies of the current solutions. The improvements focus on the developers' point-of-view. Based on the evaluation, this thesis proposes certain improvements related to multimodal interaction, server push, and remote UI updates. It also discusses software that supports the improvements and XML-based web technologies. Finally, the improvements are evaluated against the requirements and compared to other solutions

User Interface Abstraction for enabling TV set based Inclusive Access to the Information Society

199 p.The television (TV) set is present in most homes worldwide, and is the most used Information and Communication Technology (ICT). Despite its large implantation in the market, the interactive services consumption on TV set is limited. This thesis focuses on overcoming the following limiting factors: (i) limited Human Computer Interaction and (ii) lack of considering user’s real life context in the digital television (dTV) service integration strategy. Making interactive services accessible to TV set’s large user base, and especially to the most vulnerable ones, is understood as the path to integrate the mankind with the information society. This thesis explores the use of user interface abstraction technologies to reach the introduced goals. The main contributions of this thesis are: (i) an approach to enable the universally accessible remote control of the TV set, (ii) an approach for the provision of universally accessible interactive services through TV sets, and (iii) an approach for the provision of universally accessible services in the TV user’s real life context. We have implemented the contributing approaches for different use cases, and we have evaluated them with real users, achieving good results

GAIML: A New Language for Verbal and Graphical Interaction in Chatbots

Natural and intuitive interaction between users and complex systems is a crucial research topic in human-computer interaction. A major direction is the definition and implementation of systems with natural language understanding capabilities. The interaction in natural language is often performed by means of systems called chatbots. A chatbot is a conversational agent with a proper knowledge base able to interact with users. Chatbots appearance can be very sophisticated with 3D avatars and speech processing modules. However the interaction between the system and the user is only performed through textual areas for inputs and replies. An interaction able to add to natural language also graphical widgets could be more effective. On the other side, a graphical interaction involving also the natural language can increase the comfort of the user instead of using only graphical widgets. In many applications multi-modal communication must be preferred when the user and the system have a tight and complex interaction. Typical examples are cultural heritages applications (intelligent museum guides, picture browsing) or systems providing the user with integrated information taken from different and heterogenous sources as in the case of the iGoogle™ interface. We propose to mix the two modalities (verbal and graphical) to build systems with a reconfigurable interface, which is able to change with respect to the particular application context. The result of this proposal is the Graphical Artificial Intelligence Markup Language (GAIML) an extension of AIML allowing merging both interaction modalities. In this context a suitable chatbot system called Graphbot is presented to support this language. With this language is possible to define personalized interface patterns that are the most suitable ones in relation to the data types exchanged between the user and the system according to the context of the dialogue

Контекстно-зависимые методы автоматической генерации многомодальных пользовательских веб-интерфейсов

In the course of the development of interactive dynamic web-applications it is necessary to take into account used data types, their input/output means, as well as provide application capability to analyze current conditions, in which interaction with a user will be conducted, and correspondingly adapt multimedia content in order to improve the usability and naturalness of man-machine dialogue. Survey of modern papers concerned with automatic generation of web-interfaces, development of multimodal user web-applications is presented in the paper. Approaches to description, extraction and processing of context information required for fitting web-interface to the current conditions of usage during interaction with a user are considered.При разработке интерактивных динамических веб-приложений необходимо учитывать не только используемые типы данных и способы их ввода/вывода, но и обеспечить способность приложения анализировать текущие условия, в которых будет проходить взаимодействие с пользователем, и соответствующим образом адаптировать мультимедийный контент с целью повышения удобства и естественности человеко-машинного диалога. В статье проведен анализ современных работ, связанных с автоматической генераций веб-интерфейсов, проектированием многомодальных пользовательских веб-приложений, а также рассмотрены подходы к описанию, извлечению и обработке контекстной информации, необходимой для настройки веб-интерфейса к текущим условиям эксплуатации в процессе взаимодействия с пользователем

Adding state to declarative languages to enable web applications

On the web, media tend to be encoded in declarative formats, which facilitate accessibility, reuse, and transformation. Web applications, on the other hand, are created with more procedural technology and do not enjoy these benefits. In this thesis we examine how this can be fixed. We examine a small part of the problem space, adaptive time based applications, and investigate how we can extend existing declarative languages to fa