The Mirror MMDBMS architecture

Handling large collections of digitized multimedia data, usually referred to as multimedia digital libraries, is a major challenge for information technology. The Mirror DBMS is a research database system that is developed to better understand the kind of data management that is required in the context of multimedia digital libraries (see also URL http://www.cs.utwente.nl/~arjen/mmdb.html). Its main features are an integrated approach to both content management and (traditional) structured data management, and the implementation of an extensible object-oriented logical data model on a binary relational physical data model. The focus of this work is aimed at design for scalability

Ten Research Questions for Scalable Multimedia Analytics

International audienceThe scale and complexity of multimedia collections is ever increasing, as is the desire to harvest useful insight from the collections. To optimally support the complex quest for insight, multimedia ana-lytics has emerged as a new research area that combines concepts and techniques from multimedia analysis and visual analytics into a single framework. State of the art multimedia analytics solutions are highly interactive and give users freedom in how they perform their analytics task, but they do not scale well. State of the art scalable database management solutions, on the other hand, are not yet designed for multimedia analytics workloads. In this position paper we therefore argue the need for research on scalable multimedia analytics, a new research area built on the three pillars of visual analytics, multimedia analysis and database management. We propose a specific goal for scalable multimedia analyt-ics and present several important research questions that we believe must be addressed in order to achieve that goal

Towards an All-Purpose Content-Based Multimedia Information Retrieval System

The growth of multimedia collections - in terms of size, heterogeneity, and variety of media types - necessitates systems that are able to conjointly deal with several forms of media, especially when it comes to searching for particular objects. However, existing retrieval systems are organized in silos and treat different media types separately. As a consequence, retrieval across media types is either not supported at all or subject to major limitations. In this paper, we present vitrivr, a content-based multimedia information retrieval stack. As opposed to the keyword search approach implemented by most media management systems, vitrivr makes direct use of the object's content to facilitate different types of similarity search, such as Query-by-Example or Query-by-Sketch, for and, most importantly, across different media types - namely, images, audio, videos, and 3D models. Furthermore, we introduce a new web-based user interface that enables easy-to-use, multimodal retrieval from and browsing in mixed media collections. The effectiveness of vitrivr is shown on the basis of a user study that involves different query and media types. To the best of our knowledge, the full vitrivr stack is unique in that it is the first multimedia retrieval system that seamlessly integrates support for four different types of media. As such, it paves the way towards an all-purpose, content-based multimedia information retrieval system

Bridging the Gap: Connecting Authors to Museum and Archival Collections

This project improves the ability of multimedia authors to interact with the digital collections of museums, archives, and libaries, thereby enhancing experimentation in new forms of humanities scholarship. The project envisions development of an open sources bridge between a widely used digital asset management system (CONTENTdm) and applications that support the Open Knowledge Initiative's standard for interoperability, including open source, multimedia authoring tools. In a collaborative scholarly endeavor, we will use this software bridge to develop a multimedia presentation on the Pacific Northwest Artist Carl Hall (1921-1996) that directly incorporates images and audio from museum and archival digital collections

Academic Library Collections in the Age of Extended Reality (XR)

Extended Reality (XR) introduces a new way to preserve, record, and manage content. Collections traditionally focus on content in the form of books, documents, and multimedia. XR is a new form of media that can be difficult to integrate into current collections. In addition, through linked data, we can preserve the context that surrounds the content as well. Finally, XR media can incorporate digital manifestations of items from a library collection within its application. This technology review will explore the possibilities of XR in collection management, focusing on XR as a user interface, the impact on inventory management, and digital preservation

Low velocity impact response of rc beam with artificial polyethylene aggregate as concrete block infill

In structural design, an ideal situation for saving materials would be to reduce the weight of the structure without having to compromise on its strength and serviceability. A new lightweight composite reinforced concrete section was developed with a novel use of a lightweight concrete block as infill utilizing Artificial Polyethylene Aggregate (APEA and MAPEA). The concrete near the neutral axis acts as a stress transfer medium between the compression and tension zones. Partial replacement of the concrete near the neutral axis could create a reduction in weight and savings in the use of materials. In this experimental work, APEA and MAPEA were utilized as replacement for normal aggregates (NA) at percentages of 0%, 3%, 6%, and 9%, 12%, and 100% in the concrete mix. In this study, the concrete block infill uses the 100% MAPEA as a replacement for coarse aggregate. A total of sixteen beams were prepared measuring 170 mm × 250 mm × 1000 mm, in which four specimens were used as control samples (NRC) and twelve specimens were the reinforced concrete beam incorporated with different size of concrete block infill (RCAI) consisting of 100% MAPEA. All beams were tested with 100 kg steel weight dropped vertically from a height of 0.6 m and 1.54 m, which was equivalent to 3.5 m/s and 5.5 m/s respectively. Based on the experimental results, the impact force, displacement and crack patterns were affected by the impact load. For RCAI specimens, the impact force was larger but smaller displacement value was observed, compared to the NRC specimens. Furthermore, the width of the cracks generated in the RCAI specimens near the mid-span was less than that on the NRC specimen. All experiment results were validated against FEM. The transient impact force histories, displacement and crack patterns obtained from FEM matched reasonably well with the experiment results. The error reported a range of 1% to 15%. The results showed that the proposed use of concrete block infill produced desirable results under the impact loads. The main advantages of the concrete block infill that utilized MAPEA from waste plastic bags due to the weight reduction about 6% in the concrete beams

Improvement of speed response in four-phase DC–DC converter switching using two shunt voltage-source

This study proposes a technique that is able to improve the speed response of a four-phase DC–DC converter switching. The basic concept of the proposed technique is the inclusion of two shunt-connected voltage sources in series to the converter system. Using a higher input voltage to drive the load, a higher current per microsecond output system will be obtained and reverts to its nominal input upon obtaining desired references. Thus, the transient response observed when using this proposed technique is found to be much faster when compared to the conventional converter. Moreover, this technique is easily implemented as it requires only an additional voltage source, power switch, and power diode. The integrated model of the two shunt voltage-source in a four-phase DC–DC converter was simulated in MATLAB/Simulink and validated against the experimental results of a laboratory prototype, 600 W four-phase DC–DC converter. The novelty of this proposed technique is its ability to provide faster operations for critical loads applications, lower output capacitor and lower operating frequency

Measuring usability for application software using the quality in use integration measurement model

User interfaces of application software are designed to make user interaction as efficient and as simple as possible. Market accessibility of any application software is determined by the usability of its user interfaces. A poorly designed user interface will have little value no matter how powerful the program is. Thus, it is significantly important to measure usability during the system development lifecycle in order to avoid user disappointment. Various methods and standards that help measure usability have been developed. However, these methods define usability inconsistently, which makes software engineers hesitant in implementing these methods or standards. The Quality in Use Integrated Measurement (QUIM) model is a consolidated approach for measuring usability through 10 factors, 26 criteria, and 127 metrics. It decomposes usability into factors, criteria, and metrics, and it is a hierarchical model that helps developers with no or little background of usability metrics. Among 127 metrics of QUIM, essential efficiency (EE) is the most specific metric used to measure the usability of user interfaces through an equation. This study involves a comparative analysis between three case studies that use the QUIM model to measure usability in terms of EE for three case studies: (1) Public University Registration System, (2) Restaurant Menu Ordering System, and (3) ATM system. A comparison is made based on the percentage of EE for each element of the use cases in each use case diagram. The results obtained revealed that the user interface design for Restaurant Menu Ordering System scored the highest percentage of EE, thus proving to be the most user-friendly application software among its counterparts

Database support for large-scale multimedia retrieval

With the increasing proliferation of recording devices and the resulting abundance of multimedia data available nowadays, searching and managing these ever-growing collections becomes more and more difficult. In order to support retrieval tasks within large multimedia collections, not only the sheer size, but also the complexity of data and their associated metadata pose great challenges, in particular from a data management perspective. Conventional approaches to address this task have been shown to have only limited success, particularly due to the lack of support for the given data and the required query paradigms. In the area of multimedia research, the missing support for efficiently and effectively managing multimedia data and metadata has recently been recognised as a stumbling block that constraints further developments in the field. In this thesis, we bridge the gap between the database and the multimedia retrieval research areas. We approach the problem of providing a data management system geared towards large collections of multimedia data and the corresponding query paradigms. To this end, we identify the necessary building-blocks for a multimedia data management system which adopts the relational data model and the vector-space model. In essence, we make the following main contributions towards a holistic model of a database system for multimedia data: We introduce an architectural model describing a data management system for multimedia data from a system architecture perspective. We further present a data model which supports the storage of multimedia data and the corresponding metadata, and provides similarity-based search operations. This thesis describes an extensive query model for a very broad range of different query paradigms specifying both logical and executional aspects of a query. Moreover, we consider the efficiency and scalability of the system in a distribution and a storage model, and provide a large and diverse set of index structures for high-dimensional data coming from the vector-space model. Thee developed models crystallise into the scalable multimedia data management system ADAMpro which has been implemented within the iMotion/vitrivr retrieval stack. We quantitatively evaluate our concepts on collections that exceed the current state of the art. The results underline the benefits of our approach and assist in understanding the role of the introduced concepts. Moreover, the findings provide important implications for future research in the field of multimedia data management

Context-aware person identification in personal photo collections

Identifying the people in photos is an important need for users of photo management systems. We present MediAssist, one such system which facilitates browsing, searching and semi-automatic annotation of personal photos, using analysis of both image content and the context in which the photo is captured. This semi-automatic annotation includes annotation of the identity of people in photos. In this paper, we focus on such person annotation, and propose person identification techniques based on a combination of context and content. We propose language modelling and nearest neighbor approaches to context-based person identification, in addition to novel face color and image color content-based features (used alongside face recognition and body patch features). We conduct a comprehensive empirical study of these techniques using the real private photo collections of a number of users, and show that combining context- and content-based analysis improves performance over content or context alone