Strategies for Searching Video Content with Text Queries or Video Examples

The large number of user-generated videos uploaded on to the Internet everyday has led to many commercial video search engines, which mainly rely on text metadata for search. However, metadata is often lacking for user-generated videos, thus these videos are unsearchable by current search engines. Therefore, content-based video retrieval (CBVR) tackles this metadata-scarcity problem by directly analyzing the visual and audio streams of each video. CBVR encompasses multiple research topics, including low-level feature design, feature fusion, semantic detector training and video search/reranking. We present novel strategies in these topics to enhance CBVR in both accuracy and speed under different query inputs, including pure textual queries and query by video examples. Our proposed strategies have been incorporated into our submission for the TRECVID 2014 Multimedia Event Detection evaluation, where our system outperformed other submissions in both text queries and video example queries, thus demonstrating the effectiveness of our proposed approaches

Affect, appeal, and sentiment as factors influencing interaction with multimedia information

Mostly a slight reformulation of the report from a CHORUS workshop.CHORU

A quick search method for audio signals based on a piecewise linear representation of feature trajectories

This paper presents a new method for a quick similarity-based search through long unlabeled audio streams to detect and locate audio clips provided by users. The method involves feature-dimension reduction based on a piecewise linear representation of a sequential feature trajectory extracted from a long audio stream. Two techniques enable us to obtain a piecewise linear representation: the dynamic segmentation of feature trajectories and the segment-based Karhunen-L\'{o}eve (KL) transform. The proposed search method guarantees the same search results as the search method without the proposed feature-dimension reduction method in principle. Experiment results indicate significant improvements in search speed. For example the proposed method reduced the total search time to approximately 1/12 that of previous methods and detected queries in approximately 0.3 seconds from a 200-hour audio database.Comment: 20 pages, to appear in IEEE Transactions on Audio, Speech and Language Processin

Learning style and learning strategies in a multimedia environment

There is a growing realization that it may be expeditious to combine elements from different theories of learning when trying to derive a coherent and usable policy towards computer‐mediated learning. Consideration of the subtle distinction between Computer‐Aided Learning (CAL) and Computer‐Aided Instruction (CAI) conform the basis of a possible classification of computer‐mediated learning, and hence of multimedia tools. This classification enables the development of a continuum upon which to place various strategies for computer‐mediated learning, and hence a means of broadly classifying multimedia learning tools

An Application of Multimedia Services on Transportation: The Use of the World Wide Web (WWW)

INTRODUCTION In recent years, there is an ever-increasing demand and interest in the use of multimedia technology and applications in industry, government and academia. Multimedia is often seen by researchers as the next step forward in interfacing science, technology and community. Yet, the terminology of multimedia bears several meanings. It may refer to Compact Disc (CD), moving pictures or video-conferencing. The multimedia technology referred in this paper is the World Wide Web (WWW) hypertext publishing information system which was developed by and started at the European Laboratory for Particle Physics (CERN) in Geneva, Switzerland. Since the introduction of WWW, its use has increased dramatically within a couple of years in a widely diverse community including government departments, university and research establishments, and commercial organisations. It has significant influence to our communities and our daily lives. Yet, in most cases, applications of WWW services are largely restricted to electronic library referencelcatalogue search facilities, electronic mail systems, electronic conference and discussion systems, electronic news and publishing agents, and remote access to computing resources on the Internet. The primary objective of this paper is to exploit the potential of this multimedia technology as a simple, easy-to-use and effective means of telematics application in transportation research. It is hoped that initiatives are highlighted via this study and hence encourage participations and collaborations from different sectors of industries. In this paper, a brief history of WWW is given in section (2). An overview of the technical aspects in providing a WWW service is presented in section (3) in terms of computer hardware requirements, software installation, network connections, application maintenance and administration, and system security. Compared to most commercially available multimedia software in the market, WWW services are cheap to run, userfriendly and readily available to the public on the Internet. In order to exploit the potential of WWW on transportation research, a study was carried out and results of the findings are reported in section (4). To further substantiate the level of usefulness, two particular WWW applications were chosen amongst other web services and they are reported in section (5) for illustrative purposes. The selected applications are the 'Transportation Resources on the Internet' developed in mid-1994 in the Institute for Transport Studies (ITS) at the University of Leeds in England, and the 'Southern California Real-Time Traffic Report' developed by Maxwell Laboratories, Inc. in collaboration with the California State Department of Transportation in the US. Finally, a set of issues are raised in section (6), highlighting the directions of future development of WWW as an easy-touse, cheap and effective multimedia telematics application on transportation