PANEL: Challenges for multimedia/multimodal research in the next decade

The multimedia and multimodal community is witnessing an explosive transformation in the recent years with major societal impact. With the unprecedented deployment of multimedia devices and systems, multimedia research is critical to our abilities and prospects in advancing state-of-theart technologies and solving real-world challenges facing the society and the nation. To respond to these challenges and further advance the frontiers of the field of multimedia, this panel will discuss the challenges and visions that may guide future research in the next ten years

Advanced content-based semantic scene analysis and information retrieval: the SCHEMA project

The aim of the SCHEMA Network of Excellence is to bring together a critical mass of universities, research centers, industrial partners and end users, in order to design a reference system for content-based semantic scene analysis, interpretation and understanding. Relevant research areas include: content-based multimedia analysis and automatic annotation of semantic multimedia content, combined textual and multimedia information retrieval, semantic -web, MPEG-7 and MPEG-21 standards, user interfaces and human factors. In this paper, recent advances in content-based analysis, indexing and retrieval of digital media within the SCHEMA Network are presented. These advances will be integrated in the SCHEMA module-based, expandable reference system

Visualization of Accessible Multimedia Content in Web Pages

Multimedia content still presented on the web sites. The visualization of multimedia content by the users with disabilities, those that usually use screen readers, is extremely difficult. With the onset of the audio sequence of multimedia presentation it is difficult for users with visual impairs to listen the audio component of presentation and the audio version of the screen readers too, because the two audio streams cannot be controlled using only one volume control. Therefore, because of the difficulties to control the available audio streams and because of the difficulties to access the control buttons by people with disabilities, the multimedia content is often inaccessible for users with visual problems. More than this, the use of dynamic users’ interfaces is a critical problem because the screen-readers cannot detect the dynamics in content changes. The current paper presents some solutions for multimedia content production and distribution in distributed multimedia web presentations.Accessible multimedia content, Synchronized Accessible Media Interchange

Developing Learning Multimedia to Improve Critical Thinking in Mathematics at Class V of Elementary School

This study aims (1) to produce a learning multimedia which is feasible to improve critical thinking in mathematics at class V of elementary school, (2) to find out the effectiveness of learning multimedia to improve critical thinking in mathematics at class V of elementary school. This study is a research and development referring to the opinion of Borg & Gall. The subject trials are the fifth-grade students of SD Muhammadiyah Special Program Boyolali. The results of this research is a software of learning multimedia. The results showed that the developed of learning multimedia is feasible and effective to improve critical thinking of students. Based on the test results show that the effectiveness of the learning multimedia is effective in increasing critical thinking of students. It is based on the results of the implementation of the test field that indicates p<0.05, which means a significant influence critical thinking on student learning using learning multimedia.     Keywords: learning multimedia, critical thinking, learning mathematic

Unsupervised Visual and Textual Information Fusion in Multimedia Retrieval - A Graph-based Point of View

Multimedia collections are more than ever growing in size and diversity. Effective multimedia retrieval systems are thus critical to access these datasets from the end-user perspective and in a scalable way. We are interested in repositories of image/text multimedia objects and we study multimodal information fusion techniques in the context of content based multimedia information retrieval. We focus on graph based methods which have proven to provide state-of-the-art performances. We particularly examine two of such methods : cross-media similarities and random walk based scores. From a theoretical viewpoint, we propose a unifying graph based framework which encompasses the two aforementioned approaches. Our proposal allows us to highlight the core features one should consider when using a graph based technique for the combination of visual and textual information. We compare cross-media and random walk based results using three different real-world datasets. From a practical standpoint, our extended empirical analysis allow us to provide insights and guidelines about the use of graph based methods for multimodal information fusion in content based multimedia information retrieval.Comment: An extended version of the paper: Visual and Textual Information Fusion in Multimedia Retrieval using Semantic Filtering and Graph based Methods, by J. Ah-Pine, G. Csurka and S. Clinchant, submitted to ACM Transactions on Information System

IMPROVING STUDENTS LISTENING SKILL THROUGH INTERACTIVE MULTIMEDIA IN INDONESIA

Leraning method inovation will influence learning media used and it is hoped to improve learning qualities. One of them is improving students’ critical listening ability. This research was done to know the students activities in learning critical listening by using interactive multimedia and to measure the effetiveness of that multimedia in improving students’ critical listening ability. The data was taken through test, observation, and interview. The result of the research were (1) the students created active, creative, and effective learning process independenly in measuring and developing each step of listening learning model. (2) Interactive multimedia was effective learning media to improve students’ critical listening skill. It could be seen from improving critical listening ability in limited test at experiment class was 42,98%, whereas at control class the rise was only 7,36%. For extensive test, the improving of critical listening ability at experiment class was 33,88%, while control class was only up at 2,62%. (3) Critical listening strategy performance in PMAI Model could improve students’ critical listening ability so that this model is better to be applied as an implimentation of reference in listening learning model. (4) Learning media with interactive multimedia can improve students’ critical listening skill than audio learning media because listening is not only aural aspet but also visual aspect integrated with multimedia

Pengembangan Multimedia Interaktif Berbasis Critical Thinking Skill Tema Panas dan Perpindahanya Kelas V SD

Pada implementasi K-13 revisi tahun 2017 terdapat empat aspek yang harus dimunculkan dalam pelaksanaan pembelajaran yakni penguatan pendidikan karakter, literasi, 4C. Critical thinking skill penting untuk diimplementasikan pada peserta didik dimulai semenjak peserta didik berada ditingkatan sekolah dasar, hal tersebut bertujuan untuk mengembangkan keterampilan berpikir peserta didik yang meliputi berpikir kritis, inovatif, solutif, serta aktif dalam proses pembelajaran. Penelitian ini bertujuan untuk 1) menghasilkan sebuah produk berupa multimedia interaktif berbasis critical thinking skill, dan 2) mengetahui tingkat kelayakan sebuah produk berupa multimedia interaktif berbasis critical thinking skill. Multimedia interaktif dikembangkan dengan menggunakan metode penelitian pengembangan ADDIE yang meliputi Analysis, Design, Development, Implemtation, dan Evaluation. Hasil Penelitian pengembangan multimedia interaktif berbasis critical thinking skill: 1) produk yang dikembangkan menghasilkan media pembelajaran berupa multimedia interaktif berbasis critical thinking skill yang dapat digunakan sebagai referensi sumber dan media untuk belajar. 2) hasil validasi yang dilakukan oleh ahli media, ahli materi, dan praktisi pendidikan terhadap multimedia interaktif yang dikembangkan diperoleh persentase 89,1% dengan kriteria sangat valid, kemudian respon peserta didik diperoleh persentase 93,6% dengan kriteria sangat positif, dan ketuntasan tes evaluasi pada peserta didik yang mencapai 90% sehingga penggunaan multimedia interaktif dinilai efektif

Smart PIN: utility-based replication and delivery of multimedia content to mobile users in wireless networks

Next generation wireless networks rely on heterogeneous connectivity technologies to support various rich media services such as personal information storage, file sharing and multimedia streaming. Due to users’ mobility and dynamic characteristics of wireless networks, data availability in collaborating devices is a critical issue. In this context Smart PIN was proposed as a personal information network which focuses on performance of delivery and cost efficiency. Smart PIN uses a novel data replication scheme based on individual and overall system utility to best balance the requirements for static data and multimedia content delivery with variable device availability due to user mobility. Simulations show improved results in comparison with other general purpose data replication schemes in terms of data availability