Modelling Reactive Multimedia: Design and Authoring

Multimedia document authoring is a multifaceted activity, and authoring tools tend to concentrate on a restricted set of the activities involved in the creation of a multimedia artifact. In particular, a distinction may be drawn between the design and the implementation of a multimedia artifact. This paper presents a comparison of three different authoring paradigms, based on the common case study of a simple interactive animation. We present details of its implementation using the three different authoring tools, MCF, Fran and SMIL 2.0, and we discuss the conclusions that may be drawn from our comparison of the three approaches

Using the Internet to improve university education

Up to this point, university education has largely remained unaffected by the developments of novel approaches to web-based learning. The paper presents a principled approach to the design of problem-oriented, web-based learning at the university level. The principles include providing authentic contexts with multimedia, supporting collaborative knowledge construction, making thinking visible with dynamic visualisation, quick access to content resources via information and communication technologies, and flexible support by tele-tutoring. These principles are used in the MUNICS learning environment, which is designed to support students of computer science to apply their factual knowledge from the lectures to complex real-world problems. For example, students may model the knowledge management in an educational organisation with a graphical simulation tool. Some more general findings from a formative evaluation study with the MUNICS prototype are reported and discussed. For example, the students' ignorance of the additional content resources is discussed in the light of the well-known finding of insufficient use of help systems in software applications

Using the Internet to improve university education: Problem-oriented web-based learning and the MUNICS environment

Up to this point, university education has largely remained unaffected by the developments of novel approaches to web-based learning. The paper presents a principled approach to the design of problem-oriented, web-based learning at the university level. The principles include providing authentic contexts with multimedia, supporting collaborative knowledge construction, making thinking visible with dynamic visualisation, quick access to content resources via Information and Communication Technologies (ICT), and flexible support by tele-tutoring. These principles are used in the Munich Net-based Learning In Computer Science (MUNICS) learning environment, which is designed to support students of computer science to apply their factual knowledge from the lectures to complex real-world problems. For example, students can model the knowledge management in an educational organisation with a graphical simulation tool. Some more general findings from a formative evaluation study with the MUNICS prototype are reported and discussed. E.g., the students' ignorance of the additional content resources is discussed in the light of the well-known finding of insufficient use of help systems in software applicationsBislang wurden neuere Ansätze zum web-basierten Lernen in nur geringem Maße zur Verbesserung des Universitätsstudiums genutzt. Es werden theoretisch begründete Prinzipien für die Gestaltung problemorientierter, web-basierter Lernumgebungen an der Universität formuliert. Zu diesen Prinzipien gehören die Nutzung von Multimedia-Technologien für die Realisierung authentischer Problemkontexte, die Unterstützung der gemeinsamen Wissenskonstruktion, die dynamische Visualisierung, der schnelle Zugang zu weiterführenden Wissensressourcen mit Hilfe von Informations- und Kommunikationstechnologien sowie die flexible Unterstützung durch Teletutoring. Diese Prinzipien wurden bei der Gestaltung der MUNICS Lernumgebung umgesetzt. MUNICS soll Studierende der Informatik bei der Wissensanwendung im Kontext komplexer praktischer Problemstellungen unterstützen. So können die Studierenden u.a. das Wissensmanagement in einer Bildungsorganisation mit Hilfe eines graphischen Simulationswerkzeugs modellieren. Es werden Ergebnisse einer formativen Evaluationsstudie berichtet und diskutiert. Beispielsweise wird die in der Studie festgestellte Ignoranz der Studierenden gegenüber den weiterführenden Wissensressourcen vor dem Hintergrund des häufig berichteten Befunds der unzureichenden Nutzung von Hilfesystemen beleuchte

Design of a shared whiteboard component for multimedia conferencing

This paper reports on the development of a framework for multimedia applications in the domain of tele-education. The paper focuses on the protocol design of a specific component of the framework, namely a shared whiteboard application. The relationship of this component with other components of the framework is also discussed. A salient feature of the framework is that it uses an advanced ATM-based network service. The design of the shared whiteboard component is considered representative for the design as a whole, and is used to illustrate how a flexible protocol architecture utilizing innovative network functions and satisfying demanding user requirements can be developed

Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach

This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types

Generating collaborative systems for digital libraries: A model-driven approach

This is an open access article shared under a Creative Commons Attribution 3.0 Licence (http://creativecommons.org/licenses/by/3.0/). Copyright @ 2010 The Authors.The design and development of a digital library involves different stakeholders, such as: information architects, librarians, and domain experts, who need to agree on a common language to describe, discuss, and negotiate the services the library has to offer. To this end, high-level, language-neutral models have to be devised. Metamodeling techniques favor the definition of domainspecific visual languages through which stakeholders can share their views and directly manipulate representations of the domain entities. This paper describes CRADLE (Cooperative-Relational Approach to Digital Library Environments), a metamodel-based framework and visual language for the definition of notions and services related to the development of digital libraries. A collection of tools allows the automatic generation of several services, defined with the CRADLE visual language, and of the graphical user interfaces providing access to them for the final user. The effectiveness of the approach is illustrated by presenting digital libraries generated with CRADLE, while the CRADLE environment has been evaluated by using the cognitive dimensions framework

Navigation in hypermedia learning systems: Experts vs. novices

With the advancement of Web technology, hypermedia learning systems are becoming more widespread in educational settings. Hypermedia learning systems present course content with non-sequential formats, so students are required to develop learning paths by themselves. Yet, empirical evidence indicates that not all students can benefit from hypermedia learning. Research into individual differences suggests that prior knowledge has significant effects on student learning in hypermedia systems, with experts and novices showing different preferences to the use of hypermedia learning systems and requiring different levels of navigation support. It is therefore essential to develop a mechanism to help designers understand the needs of experts and novices. To address this issue, this paper presents a framework to illustrate the needs of students with different levels of prior knowledge by analyzing the findings of previous research. The overall aim of this framework is to integrate students’ prior knowledge into the design of hypermedia learning systems. Finally, implications for the design of hypermedia learning systems are discussed

A system design for human factors studies of speech-enabled Web browsing

This paper describes the design of a system which will subsequently be used as the basis of a range of empirical studies aimed at discovering how best to harness speech recognition capabilities in multimodal multimedia computing. Initial work focuses on speech-enabled browsing of the World Wide Web, which was never designed for such use. System design is complete, and is being evaluated via usability testing

Desiderata for an Every Citizen Interface to the National Information Infrastructure: Challenges for NLP

In this paper, I provide desiderata for an interface that would enable ordinary people to properly access the capabilities of the NII. I identify some of the technologies that will be needed to achieve these desiderata, and discuss current and future research directions that could lead to the development of such technologies. In particular, I focus on the ways in which theory and techniques from natural language processing could contribute to future interfaces to the NII. Introduction The evolving national information infrastructure (NII) has made available a vast array of on-line services and networked information resources in a variety of forms (text, speech, graphics, images, video). At the same time, advances in computing and telecommunications technology have made it possible for an increasing number of households to own (or lease or use) powerful personal computers that are connected to this resource. Accompanying this progress is the expectation that people will be able to more..

CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap

After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in multimedia search engines, we have identified and analyzed gaps within European research effort during our second year. In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio- economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal challenges