17 research outputs found
Overview of NTCIR-12 Lifelog Task
In this paper we review the NTCIR12-Lifelog pilot task,
which ran at NTCIR-12. We outline the test collection employed,
along with the tasks, the eight submissions and the
findings from this pilot task. We finish by suggesting future
plans for the task
NTCIR Lifelog: The First Test Collection for Lifelog Research
Test collections have a long history of supporting repeatable
and comparable evaluation in Information Retrieval (IR).
However, thus far, no shared test collection exists for IR
systems that are designed to index and retrieve multimodal
lifelog data. In this paper we introduce the first test col-
lection for personal lifelog data. The requirements for such
a test collection are motivated, the process of creating the
test collection is described, along with an overview of the
test collection and finally suggestions are given for possible
applications of the test collection, which has been employed
for the NTCIR12-Lifelog task
Baseline analysis of a conventional and virtual reality lifelog retrieval system
Continuous media capture via a wearable devices is currently one of the most popular methods to establish a comprehensive record of the entirety of an individual's life experience, referred to in the research community as a lifelog. These vast multimodal corpora include visual and other sensor data and are enriched by content analysis, to generate as extensive a record of an individual's life experience. However, interfacing with such datasets remains an active area of research, and despite the advent of new technology and a plethora of competing mediums for processing digital information, there has been little focus on newly emerging platforms such as virtual reality. In this work, we suggest that the increase in immersion and spatial dimensions provided by virtual reality could provide significant benefits to users when compared to more conventional access methodologies. Hence, we motivate virtual reality as a viable method of exploring multimedia archives (specifically lifelogs) by performing a baseline comparative analysis using a novel application prototype built for the HTC Vive and a conventional prototype built for a standard personal computer
An interactive lifelog search engine for LSC2018
In this work, we describe an interactive lifelog search engine developed for the LSC 2018 search challenge at ACM ICMR 2018. The paper introduces the four-step process required to support lifelog search engines and describes the source data for the search engine as well as the approach to ranking chosen for the iterative search engine. Finally the interface used is introduced before we highlight the limits of the current prototype and suggest opportunities for future work.Peer ReviewedPostprint (published version
VRLE: Lifelog Interaction Prototype in Virtual Reality:Lifelog Search Challenge at ACM ICMR 2020
The Lifelog Search Challenge (LSC) invites researchers to share
their prototypes for interactive lifelog retrieval and encourages
competition to develop and evaluate effective methodologies to
achieve this. With this paper we present a novel approach to visual
lifelog exploration based on our research to date utilising virtual
reality as a medium for interactive information retrieval. The VRLE
prototype presented is an iteration on a previous system which
won the first LSC competition at ACM ICMR 2018
LifeSeeker 3.0 : an interactive lifelog search engine for LSC’21
In this paper, we present the interactive lifelog retrieval engine developed for the LSC’21 comparative benchmarking challenge. The LifeSeeker 3.0 interactive lifelog retrieval engine is an enhanced version of our previous system participating in LSC’20 - LifeSeeker 2.0. The system is developed by both Dublin City University and the Ho Chi Minh City University of Science. The implementation of LifeSeeker 3.0 focuses on searching and filtering by text query using a weighted Bag-of-Words model with visual concept augmentation and three weighted vocabularies. The visual similarity search is improved using a bag of local convolutional features; while improving the previous version’s performance, enhancing query processing time, result displaying, and browsing support
LifeSeeker 2.0: interactive lifelog search engine at LSC 2020
In this paper we present our interactive lifelog retrieval engine in
the LSC’20 comparative benchmarking challenge. The LifeSeeker
2.0 interactive lifelog retrieval engine is developed by both Dublin
City University and Ho Chi Minh University of Science, which
represents an enhanced version of the two corresponding interactive lifelog retrieval engines in LSC’19. The implementation of
LifeSeeker 2.0 has been designed to focus on the searching by
text query using a Bag-of-Words model with visual concept augmentation and additional improvements in query processing time,
enhanced result display and browsing support, and interacting with
visual graphs for both query and filter purposes
MemoriEase at the NTCIR-17 Lifelog-5 Task
We present the MemoriEase retrieval system used for our participation in the NTCIR Lifelog-5 Task. We report our method to address the lifelog retrieval problem and discuss our official results of the MemoriEase at Lifelog-5 task. We originally introduced the MemoriEase system for the Lifelog Search Challenge (LSC) as an
interactive lifelog retrieval system. We have modified it to an automatic retrieval system to address the NTCIR Lifelog-5 Task. We
propose the BLIP-2 model as the core embedding model to retrieve
lifelog images from textual queries. The open-sourced Elasticsearch
search engine serves as the main engine in the MemoriEase system.
Some pre-processing and post-processing techniques are applied to
adapt this system to an automatic version and improve the accuracy
of retrieval results. Finally, we discuss the results of the system on
the task, some limitations of the system, and lessons learned from
participating in the Lifelog-5 task for further improvements for the
system in the future
An Interactive Lifelog Search Engine for LSC2018
This thesis consists on developing an interactive lifelog search engine for the LSC 2018 search challenge at ACM ICMR 2018. This search engine is created in order to browse for images from a given lifelog dataset and display them along with some written information related to them and four other images providing contextualization about the searched one. First of all, the work makes an introduction to the relevance of this project. It introduces the reader to the main social problems affronted and the aim of our project to deal with them. Thus, go ahead with the scope of the project introducing to the main objectives fixed. Also, the work is gone by the actual state of the same kind of prototypes that already exist to let the reader see the differences that our project presents. After the project approach is done, it begins a travel trough the methodology and creation process, going deep in the main aspects and the explanation of every election and decision, also remarking the limits of the current prototype. Additionally, the project concludes with a result section where the system is tested with six users. They are asked to find three specific images using the search engine. This test is divided in two sections: first, a qualitative section where the user is asked to test the system and fill out a survey to see how comfortable it is for him. And a second section, more quantitative, where they value the speed of our system. Finally, the project concludes going through the actual and future ethics of lifelogging in general and with a final conclusion further investigation and future improvemen