A Survey of Multimedia Technologies and Robust Algorithms

Multimedia technologies are now more practical and deployable in real life, and the algorithms are widely used in various researching areas such as deep learning, signal processing, haptics, computer vision, robotics, and medical multimedia processing. This survey provides an overview of multimedia technologies and robust algorithms in multimedia data processing, medical multimedia processing, human facial expression tracking and pose recognition, and multimedia in education and training. This survey will also analyze and propose a future research direction based on the overview of current robust algorithms and multimedia technologies. We want to thank the research and previous work done by the Multimedia Research Centre (MRC), the University of Alberta, which is the inspiration and starting point for future research.Comment: arXiv admin note: text overlap with arXiv:2010.1296

Flipped classroom model before and during covid-19: using technology to develop 21st century skills

Purpose – The confidence placed in the use of technology and other computing resources is an important support for the deep transformation toward processes of very high quality teaching-learning based on active learning. This paper aims to present and describe a higher education experience with Flipped Learning before and during the transformation of education due to the COVID-19 pandemic. In addition, the study analyzes the effectiveness perceived by university students of Flipped Learning for the development of competencies for the 21st century. Design/methodology/approach – For this study, a quantitative methodology is used in which 376 university students fill out a questionnaire after experiencing several sessions with an inverted classroom under both onsite and online instructions. Findings – On average, the results show a high agreement among students on the benefits or effectiveness that learning designs with Flipped Classroom have on the development of skills that will be useful for their personal and professional future. These competencies include character building, collaboration, communication, citizenship, critical thinking and creativity. At the same time, and depending on some control variables such as the modality of teaching (onsite or online), the course, the predisposition to innovate or previous experience with innovation, significant differences are also observed. Originality/value – Education and learning have the need to respond to the different educational and training needs for the future. In this sense, the Flipped Classroom methodology allows the development of skills for the 21st century. In turn, this approach also makes it possible to approach blended learning. Experiences such as the one described in this study will characterize the future of education

PENGEMBANGAN PEMBELAJARAN INKUIRI BERBANTUAN MULTIMEDIA INTERAKTIF PADA MATA PELAJARAN IPA KELAS V SD

Inquiry is learning that maximally involves all the abilities of students to find and investigate natural phenomena, living things or objects critically, analytically and logically to produce creative and innovative students in solving problems. The purpose of this study was to produce interactive multimedia assisted inquiry learning in science subjects in grade V elementary schools to improve critical thinking skills. The research method used is research and development of learning approaches by Borg and Gall and the Dick and Carey learning design model. The design used was: R&D, ADDIE, SDLC, Tesmer's formative evaluation model. The contribution of this research is to obtain a standardized interactive multimedia design based on the inquiry learning model which can help teachers implement science learning, for the formation of the students competence of Class V elementary school, implications for increasing teacher productivity and increasing competence in student learning for fifth grade elementary school. The follow-up of this interactive multimedia development research has implications for increasing teacher productivity and increasing competence in learning student for fifth grade elementary school.Inkuiri merupakan pembelajaran yang melibatkan secara maksimal seluruh kemampuan peserta didik untuk mencari dan menyelidiki fenomena alam, mahluk hidup atau benda secara kritis, analitis dan logis untuk menghasilkan siswa-siswa yang kreatif dan inovatif dalam memecahkan masalah. Tujuan penelitian ini adalah menghasilkan pembelajaran inkuiri berbantuan multimedia interaktif pada mata pelajaran IPA kelas V sekolah dasar meningkatkan kemampuan berpikir kritis. Metode penelitian yang digunakan adalah penelitian dan pengembangan dengan pendekatan pembelajaran Borg and Gall dan model desain pembelajaran Dick and Carey. Desain yang digunakan adalah: R&D, ADDIE, SDLC, model evaluasi formatif Tesmer. Kontribusi penelitian ini adalah untuk mendapatkan desain multimedia interaktif terstandar berbasis model pembelajaran inkuiri yang dapat membantu guru melaksanakan pembelajaran IPA, untuk pembentukan kompetensi siswa kelas V SD, implikasinya dalam peningkatan produktivitas guru dan peningkatan kompetensi pada siswa belajar, untuk kelas lima sekolah dasar

Information and communications technologies and multimedia content as motivational factors for new generations of students

This paper deals with the theoretical analysis of the principles of efficient use of information and communications technologies (ICT) in teaching and learning, which can contribute to the advancement of the teaching process and motivation of students/pupils in the achieving the planned activities. Apart from the theoretical analysis, the results of empirical research are also presented in the paper. They tested and practically confirmed that there is a significant influence of the application of ICT and enriching the teaching material with multimedia content and also the effects in contemporary teaching of information technology. The primary intention of this paper is to point out the importance of the introduction of ICT to the teaching process with the aim of a significant improvement of students’/pupils’ learning through the increase of their motivation and efficiency in learning, and at the same time the improvement in the performance of the educational system

An educational ontology-based M-learning system

Smart devices applications can assist young children in improving their learning capabilities and comprehension skills. However most of learning applications are built without taking into consideration the effective needs and background of Arab users. They are somehow incompatible with their local environment and culture. We propose in this paper a mobile-based educational system that displays illustrations automatically to characterize the content of children' stories on animal domain, and we use some intelligent technique to answer users' questions using an educational ontology. The generation of illustrations passes through different phases which include text processing, extraction of word-to-word relationships, building and accessing an ontology, and using Internet search engines for retrieval of complimentary information. The system can be used also by instructors to teach the children in a nonconventional manner. They can customize semantically the structure of the questions and determine how the answers will be displayed. In order to customize questions and answers, we have defined a semantic infrastructure to define the logic of terms, and the workflow of answers. The aim of our system is to improve the children educational skills to grasp vocabulary and grammar using multimedia with a portable smart device which includes observation, comprehension, realization, and deduction. Children will then be able to continue learning outside the limited time of their schools and from any location.Scopu

An Ontology based Text-to-Picture Multimedia m-Learning System

Multimedia Text-to-Picture is the process of building mental representation from words associated with images. From the research aspect, multimedia instructional message items are illustrations of material using words and pictures that are designed to promote user realization. Illustrations can be presented in a static form such as images, symbols, icons, figures, tables, charts, and maps; or in a dynamic form such as animation, or video clips. Due to the intuitiveness and vividness of visual illustration, many text to picture systems have been proposed in the literature like, Word2Image, Chat with Illustrations, and many others as discussed in the literature review chapter of this thesis. However, we found that some common limitations exist in these systems, especially for the presented images. In fact, the retrieved materials are not fully suitable for educational purposes. Many of them are not context-based and didn’t take into consideration the need of learners (i.e., general purpose images). Manually finding the required pedagogic images to illustrate educational content for learners is inefficient and requires huge efforts, which is a very challenging task. In addition, the available learning systems that mine text based on keywords or sentences selection provide incomplete pedagogic illustrations. This is because words and their semantically related terms are not considered during the process of finding illustrations. In this dissertation, we propose new approaches based on the semantic conceptual graph and semantically distributed weights to mine optimal illustrations that match Arabic text in the children’s story domain. We combine these approaches with best keywords and sentences selection algorithms, in order to improve the retrieval of images matching the Arabic text. Our findings show significant improvements in modelling Arabic vocabulary with the most meaningful images and best coverage of the domain in discourse. We also develop a mobile Text-to-Picture System that has two novel features, which are (1) a conceptual graph visualization (CGV) and (2) a visual illustrative assessment. The CGV shows the relationship between terms associated with a picture. It enables the learners to discover the semantic links between Arabic terms and improve their understanding of Arabic vocabulary. The assessment component allows the instructor to automatically follow up the performance of learners. Our experiments demonstrate the efficiency of our multimedia text-to-picture system in enhancing the learners’ knowledge and boost their comprehension of Arabic vocabulary

Supervision and control architecture proposal for automation and robotics training on platform

Orientador: João Maurício RosárioDissertação (mestrado) - Universidade Estadual de Campinas, Faculdade de Engenharia MecânicaResumo: Este trabalho propõe uma arquitetura genérica de supervisão e comando para uma plataforma automatizada de experimentação modular com capacidade de utilização remota, concebida para apoiar e complementar os processos de formação e pesquisa em Automação Industrial e Robótica, descrevendo sua concepção, modelagem dinâmica e implementação hardware - software. A integração de tecnologias e dispositivos industriais existentes no mercado (Controladores Lógicos Programáveis - CLP, diversos tipos de sensores e atuadores industriais, processamento de imagens, sistemas supervisórios e dispositivos robóticos de movimentação) em uma única plataforma implementada através de uma arquitetura modular de Sistema Automatizado de Produção Colaborativo (CSAP/ADACOR) permite que alunos e pesquisadores possam interatuar com essas tecnologias realizando atividades de modo a automatizar, supervisar e comandar um processo completo de produção. Uma plataforma desenvolvida utilizando esta arquitetura genérica permite aos estudantes e pesquisadores trabalhar dentro de um ambiente educacional, mas que retrata a maioria dos aspectos encontrados em um Sistema Automatizado de Manufatura real, tais como Integração Tecnológica, Redes de Comunicação, Controle de Processos e Gestão da Produção. Além disso, é possível realizar o controle e supervisão do processo completo que ocorre na plataforma automatizada por meio de uma conexão remota que utiliza a internet - WEBLAB (Laboratório Remoto); possibilitando que usuários e grupos em diferentes lugares possam utilizar a plataforma e compartilhar informação rapidamente. Pode-se destacar também que as características de Modularidade e Flexibilidade da plataforma permitem futuras modificações tanto do software quanto do hardware da mesmaAbstract: This work proposes a generic supervisory and command architecture for an experimentation modular automated platform equipped with remote access capacities which is conceived with the aim of improve training and research processes on Automation and Robotics, this study describes the platform's design, dynamic modeling and implementation stages. The technologic and industrial devices integration (Programmable Logic Controllers - PLC, several types of sensors and actuators, image processing, supervisory systems and robotic manipulation devices) in a single platform which is implemented following a modular Collaborative Automatic Production System (CAPS/ADACOR) architecture allows students and researchers to Interact with it by means of doing practices in order to successfully automate, supervise and manage a complete production process. Therefore, class acquired theoretical concepts are supported so improving user's professional skills. A platform developed using the here proposed generic structure allows users to work within an educational environment coping with most of the encountered aspects in a real Manufacturing Automation System, such as Technologic Integration, Communication Networks, Process Control and Production Management. Furthermore it is possible to command the entire assembly process taking place at the platform by a remote network connection using the internet - WEBLAB (Remote Laboratory), enabling individual users and groups in different places in order to use the platform and quickly interchange information. In addition it is important to outstand that both the Modularity and Flexibility of the platform can allow readily any further hardware or software enhancementMestradoMecanica dos Sólidos e Projeto MecanicoMestre em Engenharia Mecânic