He’s passed on! This parrot is no more! He has ceased to be! He’s expired and gone to meet his maker! He’s kicked the bucket, he’s shuffled off his mortal coil, run down the curtain and joined the bleedin ’ choir invisibile! THIS IS AN EX-PARROT! 1 In order for there to be significant improvements in certain areas of natural language processing (such as anaphora resolution) large linguistically annotated resources need to be created which can be used to train, for example, machine learning systems. Annotated corpora of the size needed for modern computational linguistics research cannot however be created by small groups of hand-annotators. Simple Webbased games have demonstrated how it might be possible to do this through Web collaboration. This paper reports on the ongoing work of Phrase Detectives, a game developed in the ANAWIKI project designed for collaborative linguistic annotation on the Web. In this paper we focus on how we recruit and motivate players, incentivise high quality annotations and assess the quality of the data
To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.