CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines

Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective. The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines. From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research

Writing for mobile media: The influences of text, digital design and psychological characteristics on the cognitive load of the mobile user

Text elements on the mobile smartphone interface make a significant contribution to the user’s interaction experience. In combination with other visual design features, these words curate the path of the mobile user on a journey through the information to satisfy a specific task. This study analyses the elements that influence the interpretation process and optimum presentation of information on mobile media. I argue that effective digital writing contributes to reducing the cognitive load experienced by the mobile user. The central discussion focuses on the writing of text for this medium, which I suggest forges an entirely unique narrative. The optimum writing approach is based on the multi-dimensional characteristics of hypertext, which allow the writer to facilitate the journey without the user losing control of the interpretation process. This study examines the relationship between the writer, the reader and the text, with a unique perspective on the mobile media writer, who is tasked with achieving balance between the functionality and humanity of digital interaction. To explore influences on the development of the relevant writing techniques, I present insights into the distinctive characteristics of the mobile smartphone device, with specific focus on the screen and keyboard. I also discuss the unique characteristics of the mobile user and show how the visual design of the interface is integral to the writing of text for this medium. Furthermore, this study explores the role, skills, and processes of the current and future digital writer, within the backdrop of incessant technological advancement and revolutionary changes in human-computer behaviour

Information and communication technologies for public use and interactive-multimedia city kiosks

Thesis (Master)--Izmir Institute of Technology, Industrial Design, Izmir, 2004Includes bibliographical references (leaves: 103)Text in English; Abstract: Turkish and Englishix, 106 leavesThis thesis provides framework for consideration of the potential of information andcommunication technologies for public events and performances for the developing usage of new products, particularly information public kiosks. In the theoretical framework, the concepts and terms of information and communication technology are generally introduced along with the identification of number of major factors such as elements, diversity, necessity and evolution. Moreover, the importance of ICT technologies in urban settings and human behavior in response to this type of technology are investigated through the history of ICT. The concept of the usage of information and communication technology by actual people is particularly emphasized. Not only the utilization of information and communication technology in public space is described but also effective usage of ICT in the public space and information access provided by public products are identified.Figures of ICT systems and related products, their roots in design differences and new tools and products that are common examples of ICT, particularly the use of the information city kiosk, are presented and discussed. Design principles of the public information kiosk, which play a prominent role in the public use of ICT, are established. The analysis of design factors and human-product relations based on user profile, material choices, form, function and location are discussed. Finally, the thesis includes a conclusion that argues that the information city kiosks and their increased public use will designate the new images of the cities

Toward New Ecologies of Cyberphysical Representational Forms, Scales, and Modalities

Research on tangible user interfaces commonly focuses on tangible interfaces acting alone or in comparison with screen-based multi-touch or graphical interfaces. In contrast, hybrid approaches can be seen as the norm for established mainstream interaction paradigms. This dissertation describes interfaces that support complementary information mediations, representational forms, and scales toward an ecology of systems embodying hybrid interaction modalities. I investigate systems combining tangible and multi-touch, as well as systems combining tangible and virtual reality interaction. For each of them, I describe work focusing on design and fabrication aspects, as well as work focusing on reproducibility, engagement, legibility, and perception aspects

The design of speech-based automated mobile phone services using interface metaphors

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Interface metaphor is a widely used design technique for interactive computer systems. The advantages of using interface metaphors derive from their ability to promote active learning, which enables a user to transfer knowledge from a familiar real world domain, to an unfamiliar computing domain. Interface metaphor is not currently used for the design of automated phone services, and it was the aim of this thesis to examine whether interface metaphor could improve the usability of speech-activated automated mobile phone services. A human-centred design methodology was followed to generate, select, and develop potential metaphors, which were used to implement metaphor-based phone services. An experimental methodology was then used to compare the usability of the metaphor-based services with the usability of currently available number-based phone services. The first experiment examined the effect of three different interface metaphors on the usability of a mobile city guide service. Usability was measured as a range of performance and attitude measures, and was supplemented by telephone interview data. After three consecutive days of usage, participants both preferred, and performed better with, the service that was based on an office filing system metaphor. Experiment two was conducted over a six week period, and investigated the effect of users' individual differences, and the context of use, on the usability of both the office filing system metaphor-based service, and a non-metaphor service. The results showed that performance with the metaphor-based service was significantly better than performance with the non-metaphor service. The usability of the metaphor-based service was not significantly affected by users' individual characteristics and aptitudes, whereas the number-based service was, suggesting that metaphor-based services may be more usable for a wider range of potential users. Usability levels for both services were found to be consistent across both private and public locations of use, suggesting that speech-activated mobile phone services provide a flexible means of information access. Experiment three investigated the strategies used by participants when interacting with mobile phone services, specifically the visualisation strategy that was used by two thirds of the metaphor-based service participants in experiment two. In addition to the attitude and performance measures used for experiments one and two, face-to face interviews were conducted with participants. The results indicated that significantly more participants visualised the metaphor-based services relative to a non-metaphor service, and that visualisation of the service structure led to significant performance improvements. This thesis has demonstrated the usability benefits of interface metaphor as a design technique for speech-based mobile phone services. These benefits of metaphor appear to derive from their ability to provide a mental model of the phone service that can be visualised, and their ability to accommodate the individual differences of users

P2P Mapper: From User Experiences to Pattern-Based Design

User experience is an umbrella term referring to a collection of information that covers the user’s behavior and interaction with a system. It is observed when the user is actively using a service or interacting with information, includes expectations and perceptions, and is influenced by user characteristics and application or service characteristics. User characteristics include knowledge, experience, personality and demographics. We propose a process and supporting software tool called Persona to Pattern (P2P) Mapper, which guides designers in modeling user experiences and identifying appropriate design patterns. The three-step process is: Persona Creation (a representative persona set is developed), Pattern Selection (behavioral patterns are identified resulting in an ordered list of design patterns for each persona), and Pattern Composition (patterns are used to create a conceptual design). The tool supports the first two steps of the process by providing various automation algorithms for user grouping and pattern selection combined with the benefit of rapid pattern and user information access. Persona and pattern formats are augmented with a set of discrete domain variables to facilitate automation and provide an alternative view on the information. Finally, the P2P Mapper is used in the redesign of two different Bioinformatics applications: a popular website and a visualization tool. The results of the studies demonstrate a significant improvement in the system usability of both applications

Wireless Location Based Services (Wi-LBS)

The needs and demands on location information have arisen rapidly. With the advancement of mobile computing technologies, many researches and studies have been conducted in providing reliable location information solution. Location based information has become an important resource for mobile users especially in giving direction or locating places. Wireless Location Based Services (Wi-LBS) highlight this scenario by explaining the application and usage of the LBS in wireless environment. Wi-LBS is introduced with respect to providing wireless method in locating places within UTP campus instead of referring to static map. The objective of this research is to integrate GIS with MMS technology as a system called Wireless Location Based Services. It is mainly focused on applying GIS elements in providing location information by utilizing the advancement of today's wireless handheld devices. Users will request for location by sending short messages using their mobile phones to the WiLBS system and the system will reply back sending the location information containing pictures and direction. Rapid Application Development (RAD) is used as the methodology in designing the system of Wi-LBS. This research also details the study on Multimedia Messaging Service (MMS) that covers the sending of picture messages from Wi-LBS to mobile phones and system's function in responding to the users' requests. Various references and studies have been done regarding the successful LBS applications implemented in foreign country that leads to the interest of doing the research on LBS implementation in this country. The result from the research will be the proposed framework for Wi-LBS, the discussion on the GIS and MMS as well as the system of Wi-LBS. This study proved that Wireless Location Based Services has great potential to be commercially implemented with the growth of wireless application nowadays as today's community is eager of getting more services from wireless system