Search trails using user feedback to improve video search

In this paper we present an innovative approach for aiding users in the difficult task of video search. We use community based feedback mined from the interactions of previous users of our video search system to aid users in their search tasks. This feedback is the basis for providing recommendations to users of our video retrieval system. The ultimate goal of this system is to improve the quality of the results that users find, and in doing so, help users to explore a large and difficult information space and help them consider search options that they may not have considered otherwise. In particular we wish to make the difficult task of search for video much easier for users. The results of a user evaluation indicate that we achieved our goals, the performance of the users in retrieving relevant videos improved, and users were able to explore the collection to a greater extent

IceBreaker: Solving Cold Start Problem for Video Recommendation Engines

Internet has brought about a tremendous increase in content of all forms and, in that, video content constitutes the major backbone of the total content being published as well as watched. Thus it becomes imperative for video recommendation engines such as Hulu to look for novel and innovative ways to recommend the newly added videos to their users. However, the problem with new videos is that they lack any sort of metadata and user interaction so as to be able to rate the videos for the consumers. To this effect, this paper introduces the several techniques we develop for the Content Based Video Relevance Prediction (CBVRP) Challenge being hosted by Hulu for the ACM Multimedia Conference 2018. We employ different architectures on the CBVRP dataset to make use of the provided frame and video level features and generate predictions of videos that are similar to the other videos. We also implement several ensemble strategies to explore complementarity between both the types of provided features. The obtained results are encouraging and will impel the boundaries of research for multimedia based video recommendation systems

An integrated ranking algorithm for efficient information computing in social networks

Social networks have ensured the expanding disproportion between the face of WWW stored traditionally in search engine repositories and the actual ever changing face of Web. Exponential growth of web users and the ease with which they can upload contents on web highlights the need of content controls on material published on the web. As definition of search is changing, socially-enhanced interactive search methodologies are the need of the hour. Ranking is pivotal for efficient web search as the search performance mainly depends upon the ranking results. In this paper new integrated ranking model based on fused rank of web object based on popularity factor earned over only valid interlinks from multiple social forums is proposed. This model identifies relationships between web objects in separate social networks based on the object inheritance graph. Experimental study indicates the effectiveness of proposed Fusion based ranking algorithm in terms of better search results.Comment: 14 pages, International Journal on Web Service Computing (IJWSC), Vol.3, No.1, March 201

Automatically recommending multimedia content for use in group reminiscence therapy

This paper presents and evaluates a novel approach for automatically recommending multimedia content for use in group reminiscence therapy for people with Alzheimer's and other dementias. In recent years recommender systems have seen popularity in providing a personalised experience in information discovery tasks. This personalisation approach is naturally suited to tasks in healthcare, such as reminiscence therapy, where there has been a trend towards an increased emphasis on person-centred care. Building on recent work which has shown benefits to reminiscence therapy in a group setting, we develop and evaluate a system, REMPAD, which profiles people with Alzheimer's and other dementias, and provides multimedia content tailored to a given group context. In this paper we present our system and approach, and report on a user trial in residential care settings. In our evaluation we examine the potential to use early-aggregation and late-aggregation of group member preferences using case-based reasoning combined with a content-based method. We evaluate with respect to accuracy, utility and perceived usefulness. The results overall are positive and we find that our best-performing approach uses early aggregation CBR combined with a content-based method. Also, under different evaluation criteria, we note different performances, with certain configurations of our approach providing better accuracy and others providing better utility

Recommending video content for use in group-based reminiscence therapy

REMPAD is a semi-automated cloud-based system used to facilitate digital reminiscence therapy for patients with mild-to-moderate dementia, enacted in a group setting. REMPAD uses profiles for participants and groups to proactively recommend interactive video content from the Internet to match these profiles. In this chapter, we focus on the design of the system and then the system architecture, the system build, data curation, and usage scenarios. We also report a series of steps carried out as part of our user-centered design approach to system development, and a series of analyses on interaction logs which indicate various levels of effectiveness for different configurations of the recommendation algorithm we use. The results indicate high user satisfaction when using the system, and strong tendency towards repeated use in future

Adaptive image retrieval using a graph model for semantic feature integration

The variety of features available to represent multimedia data constitutes a rich pool of information. However, the plethora of data poses a challenge in terms of feature selection and integration for effective retrieval. Moreover, to further improve effectiveness, the retrieval model should ideally incorporate context-dependent feature representations to allow for retrieval on a higher semantic level. In this paper we present a retrieval model and learning framework for the purpose of interactive information retrieval. We describe how semantic relations between multimedia objects based on user interaction can be learnt and then integrated with visual and textual features into a unified framework. The framework models both feature similarities and semantic relations in a single graph. Querying in this model is implemented using the theory of random walks. In addition, we present ideas to implement short-term learning from relevance feedback. Systematic experimental results validate the effectiveness of the proposed approach for image retrieval. However, the model is not restricted to the image domain and could easily be employed for retrieving multimedia data (and even a combination of different domains, eg images, audio and text documents)