Experiences and insights from the collection of a novel multimedia EEG dataset

There is a growing interest in utilising novel signal sources such as EEG (Electroencephalography) in multimedia research. When using such signals, subtle limitations are often not readily apparent without significant domain expertise. Multimedia research outputs incorporating EEG signals can fail to be replicated when only minor modifications have been made to an experiment or seemingly unimportant (or unstated) details are changed. This can lead to overoptimistic or overpessimistic viewpoints on the potential real-world utility of these signals in multimedia research activities. This paper describes an EEG/MM dataset and presents a summary of distilled experiences and knowledge gained during the preparation (and utilisiation) of the dataset that supported a collaborative neural-image labelling benchmarking task. The goal of this task was to collaboratively identify machine learning approaches that would support the use of EEG signals in areas such as image labelling and multimedia modeling or retrieval. The contributions of this paper can be listed thus; a template experimental paradigm is proposed (along with datasets and a baseline system) upon which researchers can explore multimedia image labelling using a brain-computer interface, learnings regarding commonly encountered issues (and useful signals) when conducting research that utilises EEG in multimedia contexts are provided, and finally insights are shared on how an EEG dataset was used to support a collaborative neural-image labelling benchmarking task and the valuable experiences gained

A Novel Target Detection Algorithm Combining Foreground and Background Manifold-Based Models

International audienceThis paper focuses on the detection of small objects – more precisely on vehicles in aerial images – on complex backgrounds such as natural backgrounds. A key contribution of the paper is to show that, in such situations, learning a target model and a background model separately is better than training a unique dis-criminative model. This contrasts with standard object detection approaches for which objects vs. background classifiers use the same model as well as the same types of visual features for both. The second contribution lies in the manifold learning approach introduced to build these models. The proposed detection algorithm is validated on the publicly available OIRDS dataset, on which we obtain state-of-the-art results