Designing Universally Accessible Networking Services for a Mobile Personal Assistant

At present, a tendency towards smaller computer sizes and at the same time increasingly inaccessible web content can be noted. Despite the worldwide recognized importance of Web accessibility, the lack of accessibility of web services has an increasingly negative impact on all users. In order to address this issue, W3C has released a recommendation on Mobile Web Best Practices, supplementary to the Web Content Accessibility Guidelines. This paper presents the design and prototype development of universally accessible networking services that fully comply with those standards. Validation and expert accessibility evaluation on the XHTML Basic prototypes present 100% compliance. The followed design process is presented in details, outlining general as well as specific issues and related solutions that may be of interest to other designers. The results will be further verified through user tests on implemented services

An empirical study of web interface design on small display devices

This paper reports an empirical study that explores the problem of finding a highly-efficient, user-friendly interface design method on small display devices. We compared three models using our PDA interface simulator: presentation optimization method, semantic conversion method, and zooming method. A controlled experiment has been carried out to identify the pros and cons of each method. The results show that of the three interface methods, the zooming method is slightly better than the semantic conversion method, while they both outperform the optimizing presentation method. © 2004 IEEE

The Continuum Architecture: Towards Enabling Chaotic Ubiquitous Computing

Interactions in the style of the ubiquitous computing paradigm are possible today, but only in handcrafted environments within one administrative and technological realm. This thesis describes an architecture (called Continuum), a design that realises the architecture, and a proof-of-concept implementation that brings ubiquitous computing to chaotic environments. Essentially, Continuum enables an ecology at the edge of the network, between users, competing service providers from overlapping administrative domains, competing internet service providers, content providers, and software developers that want to add value to the user experience. Continuum makes the ubiquitous computing functionality orthogonal to other application logic. Existing web applications are augmented for ubiquitous computing with functionality that is dynamically compiled and injected by a middleware proxy into the web pages requested by a web browser at the user?s mobile device. This enables adaptability to environment variability, manageability without user involvement, and expansibility without changes to the mobile. The middleware manipulates self-contained software units with precise functionality (called frames), which help the user interact with contextual services in conjunction with the data to which they are attached. The middleware and frame design explicitly incorporates the possibility of discrepancies between the assumptions of ubiquitous-computing software developers and field realities: multiple administrative domains, unavailable service, unavailable software, and missing contextual information. A framework for discovery and authorisation addresses the chaos inherent to the paradigm through the notion of role assertions acquired dynamically by the user. Each assertion represents service access credentials and contains bootstrapping points for service discovery on behalf of the holding user. A proof-of-concept prototype validates the design, and implements several frames that demonstrate general functionality, including driving discovery queries over multiple service discovery protocols and making equivalences between service types, across discovery protocols

The Semantic Shadow : Combining User Interaction with Context Information for Semantic Web-Site Annotation

This thesis develops the concept of the Semantic Shadow (SemS), a model for managing contentual and structural annotations on web page elements and their values. The model supports a contextual weighting of the annotated information, allowing to specify the annotation values in relation to the evaluation context. A procedure is presented, which allows to manage and process this context-dependent meta information on web page elements using a dedicated programming interface. Two distinct implementations for the model have been developed: One based on Java objects, the other using the Resource Description Framework (RDF) as modeling backend. This RDF-based storage allows to integrate the annotations of the Semantic Shadow with other information of the Semantic Web. To demonstrate the application of the Semantic Shadow concept, a procedure to optimize web based user interfaces based on the structural semantics has been developed: Assuming a mobile client, a requested web page is dynamically adapted by a proxy prototype, where the context-awareness of the adaptation can be directly modeled alongside with the structural annotations. To overcome the drawback of missing annotations for existing web pages, this thesis introduces a concept to derive context-dependent meta-information on the web pages from their usage: From the observation of the users' interaction with a web page, certain context-dependent structural information about the concerned web page elements can be derived and stored in the annotation model of the Semantic Shadow concept.In dieser Arbeit wird das Konzept des Semantic Shadow (dt. Semantischer Schatten) entwickelt, ein Programmier-Modell um Webseiten-Elemente mit inhaltsbezogenen und strukturellen Anmerkungen zu versehen. Das Modell unterstützt dabei eine kontextabhängige Gewichtung der Anmerkungen, so dass eine Anmerkung in Bezug zum Auswertungs-Kontext gesetzt werden kann. Zur Verwaltung und Verarbeitung dieser kontextbezogenen Meta-Informationen für Webseiten-Elemente wurde im Rahmen der Arbeit eine Programmierschnittstelle definiert. Dazu wurden zwei Implementierungen der Schnittstelle entwickelt: Eine basiert ausschließlich auf Java-Objekten, die andere baut auf einem RDF-Modell auf. Die RDF-basierte Persistierung erlaubt eine Integration der Semantic-Shadow-Anmerkungen mit anderen Anwendungen des Semantic Webs. Um die Anwendungsmöglichkeiten des Semantic-Shadow-Konzepts darzustellen, wurde eine Vorgehensweise zur Optimierung von webbasierten Benutzerschnittstellen auf Grundlage von semantischen Strukturinformationen entwickelt: Wenn ein mobiler Benutzer eine Webseite anfordert, wird diese dynamisch durch einen Proxy angepasst. Die Kontextabhängigkeit dieser Anpassung wird dabei bereits direkt mit den Struktur-Anmerkungen modelliert. Für bestehende Webseiten liegen zumeist keine Annotationen vor. Daher wird in dieser Arbeit ein Konzept vorgestellt, kontextabhängige Meta-Informationen aus der Benutzung der Webseiten zu bestimmen: Durch Beobachtung der Benutzer-Interaktionen mit den Webseiten-Elementen ist es möglich bestimmte kontextabhängige Strukturinformationen abzuleiten und als Anmerkungen im Modell des Semantic-Shadow-Konzepts zu persistieren

Customisation of web content for desktop and mobile devices

Accessing websites from mobile devices has been gaining popularity but may not give the same results and experiences as accessing them from a personal computer. Growth in the use of mobile devices is accelerating and therefore issues with accessing the web from them are becoming increasingly important. To investigate problems users encountered while accessing websites from mobile devices we conducted a series of surveys and conducted a user trial. Results showed that on mobile devices, users get pages with different structure, terminology, content, and location of content than those on the desktops. Each of these differences negatively impact on the user experience for the site. To address these issues, we present a server-side adaptation approach to prioritising adaptive pages to different devices through a prioritisation system. The prioritisation approach allows users to prioritise page items for different devices. The prioritisation engine reorders, shows, and removes items based on its priority set by users or developers. With this approach, the overall web page’s structure (the parent-child relationships) is preserved and the same terminology, content, and similar location of content are delivered to all devices. To evaluate the prioritisation system, we conducted user trials in a controlled lab-experiment evaluating the usability and user experience of adaptive pages developed for desktops and prioritised for mobile devices. We compared adaptive pages of a mock Facebook to the actual Facebook version. We also conducted a performance test analysing the performance of the prioritisation engine. Results demonstrate the usefulness of the Prioritisation engine and the adaptive pages. Participants preferred the Prioritised version and their performance and browsing experience on the Prioritised version is better than that on the Facebook mobile version. Results show that adaptive pages and prioritisation provides a consistent web experience across different devices

Evolutionary dynamics of new media forms: the case of the open mobile web

This thesis is designed to improve our understanding of the evolutionary dynamics of media forms, with a special historical focus on the recent processes of Web and mobile convergence and the early development of the cross-platform Web. It aims to investigate the dynamics that have underpinned the creation, evolution and conventionalisation of new media forms in the open mobile Web following the launch of 3G mobile networks. In theoretical terms the thesis explores the possibilities for the analytical integration of evolutionary approaches that traditionally have shed light on the discrete components of the evolutionary ‘ensemble’ that comprises media’s textual forms, their technologies and organisational systems. Among the theoretical pillars the study builds on is, first, the cultural semiotic approach (Lotman) that is utilised for interpreting the textual dynamics constituting the form evolution. Second, evolutionary economics (Schumpeter, Freeman and others) is included for interpreting the market dynamics that condition the formation of the media industries. Third, systems theoretical sociology (Luhmann) is deployed in order to understand the broader dynamics of social organisation in late modernism. The integration of these approaches provides the conceptual framework that focuses on the following phenomena: dialogic interchange among industry sub-systems as enabling innovations and the emergence of new sub-systems; the self-organisation of the sub-systems in the contingent environment; the role of memory and systemic ‘path-dependencies’ in guiding the processes of self-organisation; and the nature of the power relations that shape the dialogic processes. The empirical study focuses on textual as well as organisational developments. The semiotic analysis of mobile websites reveals the intertextual relations of the new forms with other media domains, especially the desktop Web. The interviews with representatives of industry stakeholders provide insights into the dialogic practices between the parties engaged in designing the mobile Web, and how, via these practices, the new platform, its media forms and institutional structures were shaped. The findings point to the historical formation of two main industry sub-systems – ‘infrastructure enablers’ and content providers – with different preferred alternatives for the design of the cross-platform Web. The thesis demonstrates how the formation of these groups was conditioned by their systemic path-dependencies, but also by the mesh of dialogic relationships among them and by the resulting changes in the discursive constellations framing the organisation of the industry and the norms for its media forms. The study points to the first signs of the historically momentous emancipation of the mobile Webmedia forms, their shaking free of path-dependency on the desktop Web

Extensions to the SMIL multimedia language

The goal of this work has been to extend the Synchronized Multimedia Integration Language (SMIL) to study the capabilities and possibilities of declarative multimedia languages for the World Wide Web (Web). The work has involved design and implementation of several extensions to SMIL. A novel approach to include 3D audio in SMIL was designed and implemented. This involved extending the SMIL 2D spatial model with an extra dimension to support a 3D space. New audio elements and a listening point were positioned in the 3D space. The extension was designed to be modular so that it was possible to use it in conjunction with other XML languages, such as XHTML and Scalable Vector Graphics (SVG) language. Web forms are one of the key features in the Web, as they offer a way to send user data to a server. A similar feature is therefore desirable in SMIL, which currently lacks forms. The XForms language, due to its modular approach, was used to add this feature to SMIL. An evaluation of this integration was carried out as part of this work. Furthermore, the SMIL player was designed to play out dynamic SMIL documents, which can be modified at run-time and the result is immediately reflected in the presentation. Dynamic SMIL enables execution of scripts to modify the presentation. XML Events and ECMAScript were chosen to provide the scripting functionality. In addition, generic methods to extend SMIL were studied based on the previous extensions. These methods include ways to attach new input and output capabilities to SMIL. To experiment with the extensions, a Synchronized Multimedia Integration Language (SMIL) player was developed. The current final version can play out SMIL 2.0 Basic profile documents with a few additional SMIL modules, such as event timing, basic animations, and brush media modules. The player includes all above-mentioned extensions. The SMIL player has been designed to work within an XML browser called X-Smiles. X-Smiles is intended for various embedded devices, such as mobile phones, Personal Digital Assistants (PDA), and digital television set-top boxes. Currently, the browser supports XHTML, SMIL, and XForms, which are developed by the current research group. The browser also supports other XML languages developed by 3rd party open-source projects. The SMIL player can also be run as a standalone player without the browser. The standalone player is portable and has been run on a desktop PC, PDA, and digital television set-top box. The core of the SMIL player is platform-independent, only media renderers require platform-dependent implementation.reviewe

Framework for ubiquitous and voice enabled web applicattions development.

RESUMEN La cantidad de dispositivos con capacidad de conexión a Internet crece rápidamente. En la actualidad se dispone de teléfonos móviles basados en tecnología WAP (Wireless Application Protocol) o I-Mode, Agendas Digitales Personales, Kioskos Internet, teléfonos convencionales basados en acceso a la Web por medio de la voz, dispositivos basados en televisión interactiva, electrodomésticos, entre otros. Desarrollar una versión de una aplicación web para cada uno de los dispositivos con conectividad a la Web resulta inviable. Por otra parte, desarrollar aplicaciones web que puedan ser visualizados en forma apropiada y aprovechando al máximo las capacidades del dispositivo se constituye en una tarea compleja. En esta tesis se propone un framework, entendido como un marco de trabajo genérico, que sirva como guía para el desarrollo de portales web pervasivos que puedan ser accedidos desde múltiples dispositivos, evitando el desarrollo de un portal por cada uno y teniendo en cuenta las grandes variaciones pueden existir en sus capacidades. Adicionalmente se ha planteado un modelo de agrupamiento de dispositivos, que permita definir una serie de grupos, así como las características asociadas a los mismos, en forma tal que puedan generarse posteriormente los formatos asociados a estos grupos de dispositivos y no a elementos individuales y se ha propuesto y validado una arquitectura de referencia para el desarrollo de aplicaciones pervasivas, que no genere dependencia de tecnologías de servidor, y que permita incorporar la solución de agrupamiento planteada previamente. ____________________________________________________________________________________________________The purpose of the Ubiquitous or Pervasive Computing - an emergent paradigm of personalized computation- is to obtain device interoperability under different conditions. The devices were designed for different purposes by different companies or from different technological generations. The ever increasing market of web enabled devices has brought up diverse challenges related to the difficulty of visualizing content in a unified form to diverse clients, while at the same time taking into account the great differences in the capacities of these devices. It is not feasible to develop a separate application for each of these devices, simply because the number of different devices is too high and still growing. In the analysis of existing proposals dealing with the modelling of ubiquitous web applications, the link that exists between the logical and conceptual modelling and the physical modelling of the applications is not clear enough, and the way in which the context aspects related to web access from these devices cannot be specified. On the other hand, the available commercial products are supplier-specific. Every future platform change would a costly and painstaking process In this thesis we present a proposal of a framework for the development of web applications that can be accessed from different types of devices, such as PCs, PDAs, mobile phones based on diverse technologies (like WAP and I-Mode) and conventional telephones that access the web through voice gateways and voice portals. The proposed framework serves as a guide for the development of this type of applications and it can be deployed to different server configurations and software development technologies. In order to obtain this objective, a description of diverse theoretical elements related to dynamic generation of information that can be acceded by devices has been made, as well as a description of involved technologies whose hardware, software and connectivity characteristics vary remarkably. The theoretical study was carried out in parallel with tests based on the different technologies used. A multilingual-ubiquitous traffic information portal was used to test the theory in an operational environment

A scalable approach to video summarization and adaptation

Tesis doctoral inédita. Universidad Autónoma de Madrid, Escuela Politécnica Superior, octubre de 201