13 research outputs found
An evaluation resource for geographic information retrieval
In this paper we present an evaluation resource for geographic information retrieval developed within the Cross Language Evaluation
Forum (CLEF). The GeoCLEF track is dedicated to the evaluation of geographic information retrieval systems. The resource
encompasses more than 600,000 documents, 75 topics so far, and more than 100,000 relevance judgments for these topics. Geographic
information retrieval requires an evaluation resource which represents realistic information needs and which is geographically
challenging. Some experimental results and analysis are reported
Challenges to evaluation of multilingual geographic information retrieval in GeoCLEF
This is the third year of the evaluation of
geographic information retrieval (GeoCLEF)
within the Cross-Language Evaluation Forum
(CLEF). GeoCLEF 2006 presented topics and
documents in four languages (English,
German, Portuguese and Spanish). After two
years of evaluation we are beginning to
understand the challenges to both Geographic
Information Retrieval from text and of
evaluation of the results of geographic
information retrieval. This poster enumerates
some of these challenges to evaluation and
comments on the limitations encountered in the
first two evaluations
GeoCLEF 2007: the CLEF 2007 cross-language geographic information retrieval track overview
GeoCLEF ran as a regular track for the second time within the Cross
Language Evaluation Forum (CLEF) 2007. The purpose of GeoCLEF is to test
and evaluate cross-language geographic information retrieval (GIR): retrieval
for topics with a geographic specification. GeoCLEF 2007 consisted of two sub
tasks. A search task ran for the third time and a query classification task was
organized for the first. For the GeoCLEF 2007 search task, twenty-five search
topics were defined by the organizing groups for searching English, German,
Portuguese and Spanish document collections. All topics were translated into
English, Indonesian, Portuguese, Spanish and German. Several topics in 2007
were geographically challenging. Thirteen groups submitted 108 runs. The
groups used a variety of approaches. For the classification task, a query log
from a search engine was provided and the groups needed to identify the
queries with a geographic scope and the geographic components within the
local queries
GeoCLEF 2006: the CLEF 2006 Ccross-language geographic information retrieval track overview
After being a pilot track in 2005, GeoCLEF advanced to be a regular track within CLEF 2006. The
purpose of GeoCLEF is to test and evaluate cross-language geographic information retrieval (GIR): retrieval for
topics with a geographic specification. For GeoCLEF 2006, twenty-five search topics were defined by the
organizing groups for searching English, German, Portuguese and Spanish document collections. Topics were
translated into English, German, Portuguese, Spanish and Japanese. Several topics in 2006 were significantly
more geographically challenging than in 2005. Seventeen groups submitted 149 runs (up from eleven groups and
117 runs in GeoCLEF 2005). The groups used a variety of approaches, including geographic bounding boxes,
named entity extraction and external knowledge bases (geographic thesauri and ontologies and gazetteers)
How robust are multilingual information retrieval systems?
The results of information retrieval evaluations are often difficult to apply to practical challenges. Recent research interest in the robustness of information systems tries to facilitate the application of research results for practical environments. This paper analyzes a large amount of evaluation experiments from the Cross Language Evaluation Forum (CLEF). Robustness can be interpreted as stressing the importance of difficult topics and is usually measured with the geometric mean of the topic results. Our analysis shows that a small decrease of performance of bi- and multi-lingual retrieval goes along with a tremendous difference between the geometric mean and the average of topics. Consequently, robustness is an important issue especially for cross-language retrieval system evaluation
CLEF 2012: information access evaluation meets multilinguality, multimodality, and visual analytics
DeterminaciĂłn de antiinflamatorios no esteroideos en leche por cromatografĂa de lĂquidos-espectrometrĂa de masa en tándem (LC-
Treballs Finals de Grau de QuĂmica, Facultat de QuĂmica, Universitat de Barcelona, Any: 2015, Tutors: Antoni RĂşbies Prat i Mercè Granados JuanNon-steroidal anti-inflammatory drugs (NSAIDs) are widely used in human and veterinary medicine because of their main properties: anti-inflammatory, analgesic and antipyretic. The use of these drugs has increased significantly over the world in the last decades. The widespread use of NSAIDs can cause serious side effects such as gastric and intestinal disturbances. The control of the presence of residues of NSAIDs in food of animal origin is mandatory following Europe legislation; for this reason analytical methods for milk and meat analysis have to be set up.
In this work, a method based on the Quick, Easy, Cheap, Effective, Rugged, and Safe (QuEChERS) approach was developed for the determination of NSAIDs in milk samples by liquid chromatography-tandem mass spectrometry (LC-MS/MS) with electrospray ionization (ESI) using the Multiple Reaction Monitoring (MRM) mode.
A new sample preparation method was developed, using 5% acetic acid in acetonitrile as extraction system and with a clean-up step by dispersive solid phase extraction (d-SPE) using sorbent C18. Mass spectrometric parameters and chromatographic separation were optimized. Two MRM transitions were monitored for each analyte in positive or negative electrospray mode
GeoCLEF 2008: The CLEF 2008 Cross-Language Geographic Information Retrieval Track Overview
GeoCLEF is an evaluation task running, for the third time, under the scope of the Cross Language Evaluation Forum (CLEF). The purpose of GeoCLEF is to test and evaluate cross-language geographic information retrieval (GIR). The GeoCLEF 2008 task presented twenty-five geographically challenging search topics for English, German and Portuguese. Eleven participants submitted 131 runs, based on a variety of approaches, including sample documents, named entity extraction and ontology based retrieval. The evaluation methodology and results are presented in the paper
GeoCLEF 2007: The CLEF 2007 Cross-Language Geographic Information Retrieval Track Overview
GeoCLEF ran as a regular track for the second time within the Cross Language
Evaluation Forum (CLEF) 2007. The purpose of GeoCLEF is to test and evaluate
cross-language geographic information retrieval (GIR): retrieval for topics with a
geographic specification. GeoCLEF 2007 consisted of two sub tasks. A search task
ran for the third time and a query classification task was organized for the first. For
the GeoCLEF 2007 search task, twenty-five search topics were defined by the
organizing groups for searching English, German, Portuguese and Spanish document
collections. Topics were translated into English, German and Spanish. Several
topics in 2007 were geographically challenging. Thirteen groups submitted 108 runs.
The groups used a variety of approaches. For the classification task, a query log
from a search engine was provided and the groups needed to identify the queries
with a geographic scope and the geographic components within the local queries