Designing intelligent computer‐based simulations: A pragmatic approach

This paper examines the design of intelligent multimedia simulations. A case study is presented which uses an approach based in part on intelligent tutoring system design to integrate formative assessment into the learning of clinical decision‐making skills for nursing students. The approach advocated uses a modular design with an integrated intelligent agent within a multimedia simulation. The application was created using an object‐orientated programming language for the multimedia interface (Delphi) and a logic‐based interpreted language (Prolog) to create an expert assessment system. Domain knowledge is also encoded in a Windows help file reducing some of the complexity of the expert system. This approach offers a method for simplifying the production of an intelligent simulation system. The problems developing intelligent tutoring systems are examined and an argument is made for a practical approach to developing intelligent multimedia simulation systems

Supporting active database learning and training through interactive multimedia

The learning objectives of a database course include aspects from conceptual and theoretical knowledge to practical development and implementation skills. We present an interactive educational multimedia system based on the virtual apprenticeship model for the knowledge- and skills-oriented Web-based education of database course students. Combining knowledge learning and skills training in an integrated environment is a central aspect of our system. We show that tool-mediated independent learning and training in an authentic setting is an alternative to traditional classroom-based approaches

Towards an All-Purpose Content-Based Multimedia Information Retrieval System

The growth of multimedia collections - in terms of size, heterogeneity, and variety of media types - necessitates systems that are able to conjointly deal with several forms of media, especially when it comes to searching for particular objects. However, existing retrieval systems are organized in silos and treat different media types separately. As a consequence, retrieval across media types is either not supported at all or subject to major limitations. In this paper, we present vitrivr, a content-based multimedia information retrieval stack. As opposed to the keyword search approach implemented by most media management systems, vitrivr makes direct use of the object's content to facilitate different types of similarity search, such as Query-by-Example or Query-by-Sketch, for and, most importantly, across different media types - namely, images, audio, videos, and 3D models. Furthermore, we introduce a new web-based user interface that enables easy-to-use, multimodal retrieval from and browsing in mixed media collections. The effectiveness of vitrivr is shown on the basis of a user study that involves different query and media types. To the best of our knowledge, the full vitrivr stack is unique in that it is the first multimedia retrieval system that seamlessly integrates support for four different types of media. As such, it paves the way towards an all-purpose, content-based multimedia information retrieval system

Big Data Model Simulation on a Graph Database for Surveillance in Wireless Multimedia Sensor Networks

Sensors are present in various forms all around the world such as mobile phones, surveillance cameras, smart televisions, intelligent refrigerators and blood pressure monitors. Usually, most of the sensors are a part of some other system with similar sensors that compose a network. One of such networks is composed of millions of sensors connect to the Internet which is called Internet of things (IoT). With the advances in wireless communication technologies, multimedia sensors and their networks are expected to be major components in IoT. Many studies have already been done on wireless multimedia sensor networks in diverse domains like fire detection, city surveillance, early warning systems, etc. All those applications position sensor nodes and collect their data for a long time period with real-time data flow, which is considered as big data. Big data may be structured or unstructured and needs to be stored for further processing and analyzing. Analyzing multimedia big data is a challenging task requiring a high-level modeling to efficiently extract valuable information/knowledge from data. In this study, we propose a big database model based on graph database model for handling data generated by wireless multimedia sensor networks. We introduce a simulator to generate synthetic data and store and query big data using graph model as a big database. For this purpose, we evaluate the well-known graph-based NoSQL databases, Neo4j and OrientDB, and a relational database, MySQL.We have run a number of query experiments on our implemented simulator to show that which database system(s) for surveillance in wireless multimedia sensor networks is efficient and scalable

Towards a synthesis of multimedia and intelligent tutoring systems : a dissertation presented in partial fulfilment of the requirements for the degree of Master of Science in Computer Science at Massey University

Multimedia is being used in almost every field. This study is about the use of multimedia in the area of intelligent tutoring systems. This project studies the advantages and disadvantages of interactive multimedia and intelligent tutoring systems, and analyses the ways of combining these technologies in search of an interesting, learnable, flexible, compelling and technology-enhanced educational tool. Educational packages need to be evaluated for effectiveness. When it comes to computer-based instruction, technical concerns such as multimedia effects are taken seriously and there is not enough emphasis on its educational value. There is not much concern about the appropriateness of the instruction method to the computer medium. This research proposes a framework for evaluating educational packages which include a number of issues. Several pieces of educational software were evaluated using this framework and Diagnosis for crop protection, a multimedia software package that aids in teaching the process of diagnosing crop problems, was selected for modification, as a practical application of the theoretical work. We studied different multimedia system development models and methodologies. We also analysed the cognitive issues and intelligent features that enhance the learnability. Finally, the appropriate intelligent features and other factors that could enhance Diagnosis for crop protection to be a more 'active knowledge constructing' environment have been identified. The current version of Diagnosis for crop protection was represented using an appropriate methodology and the proposed changes were described in detail

Designing Multimedia Learning for Student Employees in a Higher Education Institution

This portfolio explores the multimedia learning design for student employees at a higher education institution to improve employment skills and knowledge. Based on the ADDIE Model, video-based learning, cognitive learning, and multimedia principles, this paper suggested eLearning designs that enhance learners′ comprehension and employee training development approaches. This paper seeks to create and provide employment skills and knowledge training via the learning management system: Desire2learn Brightspace using various eLearning tools, including video-based learning, interactive web-based tools, and web-page learning materials

An Aptitude-Treatment-Interaction-Approach on Motivation and Student's Self-Regulated Multimedia-Based Learning

The goal of this study was to develop the research basics for identifying individual differences in multimedia learning and motivation. Within this study, the effects of implementing motivational design of instruction within multimedia-based learning were tested. Motivational design of instruction was related to the ARCS-model and resulted in using instructional strategies for increasing attention and relevance of the learning material. In addition, an aptitude-treatment-interaction (ATI)-approach was developed which connected motivational design of instruction to mental resources management, motivational processing, pre-motivation, motivation to learn, and knowledge acquisition. For testing the theoretical assumptions, there were four types of a multimedia-based instructional system implemented: One instructional system had no ARCS strategies, one had attention strategies, another had relevance strategies, and one finally had both attention and relevance strategies. Four groups of elementary school students (n = 68) had to learn with the different instructional systems. The effects of learning with these instructional systems were measured on motivation to learn and on knowledge acquisition. Pre-motivation (outcome-valences), pre-knowledge, and cognitive load represented aptitude- and process-variables. Results indicated that a combination of both attention and relevance strategies improved motivation to learn, especially for those students with low levels of pre-motivation. Pre-knowledge increased and cognitive load decreased knowledge acquisition. Finally, open research questions and methodological aspects are outlined. In addition, suggestions for the design of instructional multimedia are given.The goal of this study was to develop the research basics for identifying individual differences in multimedia learning and motivation. Within this study, the effects of implementing motivational design of instruction within multimedia-based learning were tested. Motivational design of instruction was related to the ARCS-model and resulted in using instructional strategies for increasing attention and relevance of the learning material. In addition, an aptitude-treatment-interaction (ATI)-approach was developed which connected motivational design of instruction to mental resources management, motivational processing, pre-motivation, motivation to learn, and knowledge acquisition. For testing the theoretical assumptions, there were four types of a multimedia-based instructional system implemented: One instructional system had no ARCS strategies, one had attention strategies, another had relevance strategies, and one finally had both attention and relevance strategies. Four groups of elementary school students (n = 68) had to learn with the different instructional systems. The effects of learning with these instructional systems were measured on motivation to learn and on knowledge acquisition. Pre-motivation (outcome-valences), pre-knowledge, and cognitive load represented aptitude- and process-variables. Results indicated that a combination of both attention and relevance strategies improved motivation to learn, especially for those students with low levels of pre-motivation. Pre-knowledge increased and cognitive load decreased knowledge acquisition. Finally, open research questions and methodological aspects are outlined. In addition, suggestions for the design of instructional multimedia are given

Multimedia and Knowledge-based Computer-aided Architectural Design

It appears by now fairly accepted to many researchers in the field of the Computer Aided Architectural Design that the way to realize support tools for these aims is by means of the realization of Knowledge Based Assistants. This kind of computer programs, based on the knowledge engineering, finds their power and efficaciousness by their knowledge bases. Nowdays this kind of tools is leaving the research world and it appears evident that the common graphic interfaces and the modalities of dialogue between the architect and the computer, are inadequate to support the exchange of information that the use of these tools requires. The use of the knowledge bases furthermore, presupposes that the conceptual model of the building realized by others, must be made entirely understandable to the architect . The CAAD Laboratory has carried out a system software prototype based on Knowledge Engineering in the field of hospital buildings. In order to overcame the limit of software systems based on usual Knowledge Engineering, by improving architect-computer interaction, at CAAD Lab it is refining building model introducing into the knowledge base two complementary each other methodologies: the conceptual clustering and multimedia technics. This research will make it possible for architects navigate consciously through the domain of the knowledge base already implemented

Context-based multimedia semantics modelling and representation

The evolution of the World Wide Web, increase in processing power, and more network bandwidth have contributed to the proliferation of digital multimedia data. Since multimedia data has become a critical resource in many organisations, there is an increasing need to gain efficient access to data, in order to share, extract knowledge, and ultimately use the knowledge to inform business decisions. Existing methods for multimedia semantic understanding are limited to the computable low-level features; which raises the question of how to identify and represent the high-level semantic knowledge in multimedia resources.In order to bridge the semantic gap between multimedia low-level features and high-level human perception, this thesis seeks to identify the possible contextual dimensions in multimedia resources to help in semantic understanding and organisation. This thesis investigates the use of contextual knowledge to organise and represent the semantics of multimedia data aimed at efficient and effective multimedia content-based semantic retrieval.A mixed methods research approach incorporating both Design Science Research and Formal Methods for investigation and evaluation was adopted. A critical review of current approaches for multimedia semantic retrieval was undertaken and various shortcomings identified. The objectives for a solution were defined which led to the design, development, and formalisation of a context-based model for multimedia semantic understanding and organisation. The model relies on the identification of different contextual dimensions in multimedia resources to aggregate meaning and facilitate semantic representation, knowledge sharing and reuse. A prototype system for multimedia annotation, CONMAN was built to demonstrate aspects of the model and validate the research hypothesis, H₁.Towards providing richer and clearer semantic representation of multimedia content, the original contributions of this thesis to Information Science include: (a) a novel framework and formalised model for organising and representing the semantics of heterogeneous visual data; and (b) a novel S-Space model that is aimed at visual information semantic organisation and discovery, and forms the foundations for automatic video semantic understanding