4,812 research outputs found
CHORUS Deliverable 2.2: Second report - identification of multi-disciplinary key issues for gap analysis toward EU multimedia search engines roadmap
After addressing the state-of-the-art during the first year of Chorus and establishing the existing landscape in
multimedia search engines, we have identified and analyzed gaps within European research effort during our second year.
In this period we focused on three directions, notably technological issues, user-centred issues and use-cases and socio-
economic and legal aspects. These were assessed by two central studies: firstly, a concerted vision of functional breakdown
of generic multimedia search engine, and secondly, a representative use-cases descriptions with the related discussion on
requirement for technological challenges. Both studies have been carried out in cooperation and consultation with the
community at large through EC concertation meetings (multimedia search engines cluster), several meetings with our
Think-Tank, presentations in international conferences, and surveys addressed to EU projects coordinators as well as
National initiatives coordinators. Based on the obtained feedback we identified two types of gaps, namely core
technological gaps that involve research challenges, and “enablers”, which are not necessarily technical research
challenges, but have impact on innovation progress. New socio-economic trends are presented as well as emerging legal
challenges
Frugal Satellite Image Change Detection with Deep-Net Inversion
Change detection in satellite imagery seeks to find occurrences of targeted
changes in a given scene taken at different instants. This task has several
applications ranging from land-cover mapping, to anthropogenic activity
monitory as well as climate change and natural hazard damage assessment.
However, change detection is highly challenging due to the acquisition
conditions and also to the subjectivity of changes. In this paper, we devise a
novel algorithm for change detection based on active learning. The proposed
method is based on a question and answer model that probes an oracle (user)
about the relevance of changes only on a small set of critical images (referred
to as virtual exemplars), and according to oracle's responses updates deep
neural network (DNN) classifiers. The main contribution resides in a novel
adversarial model that allows learning the most representative, diverse and
uncertain virtual exemplars (as inverted preimages of the trained DNNs) that
challenge (the most) the trained DNNs, and this leads to a better re-estimate
of these networks in the subsequent iterations of active learning. Experiments
show the out-performance of our proposed deep-net inversion against the related
work.Comment: arXiv admin note: text overlap with arXiv:2212.1397
Information Extraction on Para-Relational Data.
Para-relational data (such as spreadsheets and diagrams) refers to a type of nearly
relational data that shares the important qualities of relational data but does not
present itself in a relational format. Para-relational data often conveys highly valuable
information and is widely used in many different areas. If we can convert para-relational
data into the relational format, many existing tools can be leveraged for a
variety of interesting applications, such as data analysis with relational query systems
and data integration applications.
This dissertation aims to convert para-relational data into a high-quality relational
form with little user assistance. We have developed four standalone systems, each
addressing a specific type of para-relational data. Senbazuru is a prototype spreadsheet
database management system that extracts relational information from a large
number of spreadsheets. Anthias is an extension of the Senbazuru system to convert
a broader range of spreadsheets into a relational format. Lyretail is an extraction
system to detect long-tail dictionary entities on webpages. Finally, DiagramFlyer is
a web-based search system that obtains a large number of diagrams automatically
extracted from web-crawled PDFs. Together, these four systems demonstrate that
converting para-relational data into the relational format is possible today, and also
suggest directions for future systems.PhDComputer Science and EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/120853/1/chenzhe_1.pd
CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines
Based on the information provided by European projects and national initiatives related to multimedia search as well as domains experts that participated in the CHORUS Think-thanks and workshops, this document reports on the state of the art related to multimedia content search from, a technical, and socio-economic perspective.
The technical perspective includes an up to date view on content based indexing and retrieval technologies, multimedia search in the context of mobile devices and peer-to-peer networks, and an overview of current evaluation and benchmark inititiatives to measure the performance of multimedia search engines.
From a socio-economic perspective we inventorize the impact and legal consequences of these technical advances and point out future directions of research
Adversarial Virtual Exemplar Learning for Label-Frugal Satellite Image Change Detection
Satellite image change detection aims at finding occurrences of targeted
changes in a given scene taken at different instants. This task is highly
challenging due to the acquisition conditions and also to the subjectivity of
changes. In this paper, we investigate satellite image change detection using
active learning. Our method is interactive and relies on a question and answer
model which asks the oracle (user) questions about the most informative display
(dubbed as virtual exemplars), and according to the user's responses, updates
change detections. The main contribution of our method consists in a novel
adversarial model that allows frugally probing the oracle with only the most
representative, diverse and uncertain virtual exemplars. The latter are learned
to challenge the most the trained change decision criteria which ultimately
leads to a better re-estimate of these criteria in the following iterations of
active learning. Conducted experiments show the out-performance of our proposed
adversarial display model against other display strategies as well as the
related work.Comment: arXiv admin note: substantial text overlap with arXiv:2203.1155
- …