Towards Multi-Modal Interactions in Virtual Environments: A Case Study

We present research on visualization and interaction in a realistic model of an existing theatre. This existing ‘Muziek¬centrum’ offers its visitors information about performances by means of a yearly brochure. In addition, it is possible to get information at an information desk in the theatre (during office hours), to get information by phone (by talking to a human or by using IVR). The database of the theater holds the information that is available at the beginning of the ‘theatre season’. Our aim is to make this information more accessible by using multi-modal accessible multi-media web pages. A more general aim is to do research in the area of web-based services, in particu¬lar interactions in virtual environments

Beyond multimedia adaptation: Quality of experience-aware multi-sensorial media delivery

Multiple sensorial media (mulsemedia) combines multiple media elements which engage three or more of human senses, and as most other media content, requires support for delivery over the existing networks. This paper proposes an adaptive mulsemedia framework (ADAMS) for delivering scalable video and sensorial data to users. Unlike existing two-dimensional joint source-channel adaptation solutions for video streaming, the ADAMS framework includes three joint adaptation dimensions: video source, sensorial source, and network optimization. Using an MPEG-7 description scheme, ADAMS recommends the integration of multiple sensorial effects (i.e., haptic, olfaction, air motion, etc.) as metadata into multimedia streams. ADAMS design includes both coarse- and fine-grained adaptation modules on the server side: mulsemedia flow adaptation and packet priority scheduling. Feedback from subjective quality evaluation and network conditions is used to develop the two modules. Subjective evaluation investigated users' enjoyment levels when exposed to mulsemedia and multimedia sequences, respectively and to study users' preference levels of some sensorial effects in the context of mulsemedia sequences with video components at different quality levels. Results of the subjective study inform guidelines for an adaptive strategy that selects the optimal combination for video segments and sensorial data for a given bandwidth constraint and user requirement. User perceptual tests show how ADAMS outperforms existing multimedia delivery solutions in terms of both user perceived quality and user enjoyment during adaptive streaming of various mulsemedia content. In doing so, it highlights the case for tailored, adaptive mulsemedia delivery over traditional multimedia adaptive transport mechanisms

Context-aware platform for mobile data management

Interaction design is a major issue for mobile information systems in terms of not only the choice of input/output channels and presentation of information, but also the application of context-awareness. To support experimentation with these factors, we have developed platforms to support the rapid prototyping of multi-channel, multi-modal, context-aware applications. The Java-based platform presented here is based on an integration of a cross-media link server and an object-oriented framework for advanced content publishing, along with a Client Controller and Context Engine. We also describe how this platform was used to develop a mobile tourist information system for an international arts festival where interaction was based on a combination of interactive paper and speech outpu

User Interface Migration of Web Applications with Task continuity and Platform Adaptation Support

This thesis shows the work undertaken for supporting user interface migration of web applications. Interface migration occurs when a user interacting with an application switches to a different device and the application interface is transferred onto the new device. Migration must be supported by a platform aware system able to perform interface adaptation that keeps into account the different features of the devices involved, in order to keep the interface usability. Beside adaptation, continuity is the main matter. Once the interface migrates onto a new device, the interaction can be continued without having to restart the application from the beginning. Different types of migration can occur and supporting them poses different level of difficulty. This thesis analyses the various types of migration and describes the client-server architecture implemented for supporting all of them. The thesis shows how the migration service evolved starting from a first core of basic functionalities supporting the easiest situation to the most challenging one

Perceiving is Believing. Authentication with Behavioural and Cognitive Factors

Most computer users have experienced login problems such as, forgetting passwords, loosing token cards and authentication dongles, failing that complicated screen pattern once again, as well as, interaction difficulties in usability. Facing the difficulties of non-flexible strong authentication solutions, users tend to react with poor acceptance or to relax the assumed correct use of authentication procedures and devices, rendering the intended security useless. Biometrics can, sort of, solve some of those problems. However, despite the vast research, there is no perfect solution into designing a secure strong authentication procedure, falling into a trade off between intrusiveness, effectiveness, contextual adequacy and security guarantees. Taking advantage of new technology, recent research onmulti-modal, behavioural and cognitive oriented authentication proposals have sought to optimize trade off towards precision and convenience, reducing intrusiveness for the same amount of security. But these solutions also fall short with respect to different scenarios. Users perform currently multiple authentications everyday, through multiple devices, in panoply of different situations, involving different resources and diverse usage contexts, with no "better authentication solution" for all possible purposes. The proposed framework enhances the recent research in user authentication services with a broader view on the problems involving each solution, towards an usable secure authentication methodology combining and exploring the strengths of each method. It will than be used to prototype instances of new dynamic multifactor models (including novel models of behavioural and cognitive biometrics), materializing the PiB (perceiving is believing) authentication. Ultimately we show how the proposed framework can be smoothly integrated in applications and other authentication services and protocols, namely in the context of SSO Authentication Services and OAuth

Emerging technologies for learning (volume 1)

Collection of 5 articles on emerging technologies and trend

Concept Mapping and the Cognitive Orientation to Daily Occupational Performance (CO-OP) Approach As An Intervention Framework for Adolescents with Autism Spectrum Disorder (ASD)

Individuals who are diagnosed with Autism Spectrum Disorder (ASD) experience a range of difficulties that impact their daily occupational performance. The current body of research identifies the importance of occupational engagement and competence as fundamental elements in facilitating an individual’s social connections, development of personal autonomy and overall wellbeing. This dissertation explores the use of concept mapping embedded within the meta-cognitive framework of the Cognitive Orientation to Daily Occupational Performance (CO-OP) approach, to engage adolescents with ASD in meaningful occupations. This thesis contains three manuscripts, an introductory and a final reflection chapter. The first manuscript is a methodological paper that outlines a qualitative concept mapping framework that can be applied within the field of occupational science. The second manuscript explores how concept mapping can be theoretically embedded with the CO-OP approach to facilitate the engagement, occupational competence, relatedness and autonomy of adolescents with ASD. The third manuscript presents the findings of a focused sensory ethnography exploration that explores the personalized and socio-cultural perceptions of adolescents with ASD while participating in a novel intervention. The third manuscript is analyzed using an occupational science framework, and highlights the themes identified by the participants through their concept maps and personal reflections. The data were analyzed using the qualitative concept mapping framework presented in the first manuscript, and through deductive thematic analysis using a theoretical codebook derived and highlighted in the third manuscript. This thesis contributes new knowledge to shaping the development and delivery of interventions focused on enhancing the occupational performance of adolescents with ASD in meaningful goals important in the transition to adulthood. It has expanded the limited research that approaches the topic from the frameworks of qualitative research, multi-modal and multi-sensory methods. It also uniquely explores the concept of human occupation as it relates to culture of ASD, and the development of meaningful life skills within a group environment. This work has implications for the future methodologies and research questions for studies exploring the lives of adolescents with ASD, the CO-OP approach, and the use of visual methods in exploring occupational meaning