The shared task of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V) aims
at providing a common benchmark for testing current corpus-based methods for the identifica-
tion of lexical semantic relations (
synonymy
,
antonymy
,
hypernymy
,
part-whole meronymy
) and
at gaining a better understanding of their respective strengths and weaknesses. The shared task
uses a challenging dataset extracted from EVALution 1.0 (Santus et al., 2015b), which contains
word pairs holding the above-mentioned relations as well as semantically unrelated control items
(
random
). The task is split into two subtasks: (i) identification of related word pairs vs. unre-
lated ones; (ii) classification of the word pairs according to their semantic relation. This paper
describes the subtasks, the dataset, the evaluation metrics, the seven participating systems and
their results. The best performing system in subtask 1 is GHHH (
F
1
= 0
.
790
), while the best
system in subtask 2 is LexNet (
F
1
= 0
.
445
). The dataset and the task description are available at
https://sites.google.com/site/cogalex2016/home/shared-task