Skip to main content
Article thumbnail
Location of Repository

Video databases annotation enhancing using commonsense knowledgebases for indexing and retrieval

By Amjad Altadmri and Amr Ahmed

Abstract

The rapidly increasing amount of video collections, especially on the web, motivated the need for intelligent automated annotation tools for searching, rating, indexing and retrieval purposes. These videos collections contain all types of manually annotated videos. As this annotation is usually incomplete and uncertain and contains misspelling words, search using some keywords almost do retrieve only a portion of videos which actually contains the desired meaning. Hence, this annotation needs filtering, expanding and validating for better indexing and retrieval.\ud \ud In this paper, we present a novel framework for video annotation enhancement, based on merging two widely known commonsense knowledgebases, namely WordNet and ConceptNet. In addition to that, a comparison between these knowledgebases in video annotation domain is presented.\ud Experiments were performed on random wide-domain video clips, from the \emph{vimeo.com} website. Results show that searching for a video over enhanced tags, based on our proposed framework, outperforms searching using the original tags. In addition to that, the annotation enhanced by our framework outperforms both those enhanced by WordNet and ConceptNet individually, in terms of tags enrichment ability, concept diversity and most importantly retrieval performance

Topics: G700 Artificial Intelligence, G400 Computer Science, G710 Speech and Natural Language Processing, G720 Knowledge Representation, G450 Multi-media Computing Science, G540 Databases, G740 Computer Vision
Year: 2009
OAI identifier: oai:eprints.lincoln.ac.uk:2040

Suggested articles

Citations

  1. (2007). A hybrid approach to improving semantic extraction of news video. doi
  2. (2000). A semantic event-detection approach and its application to detecting hunts in wildlife video. doi
  3. (2006). A visual annotation framework using common-sensical and linguistic relationships for semantic media retrieval. doi
  4. (2008). Association and temporal rule mining for post- of semantic concept detection in video. doi
  5. (2008). Combining wordnet and conceptnet for automatic query expansion: a learning approach. doi
  6. (2007). Conceptnet 3: a exible, multilingual semantic network for common sense knowledge. doi
  7. (2004). Conceptnet a practical commonsense reasoning tool-kit. doi
  8. (1995). Cyc: A large-scale investment in knowledge infrastructure. doi
  9. (2008). Learning ontology rules for semantic video annotation. doi
  10. (2006). Query expansion with conceptnet and wordnet: An intrinsic comparison. doi
  11. (2007). Semantic annotation and retrieval of video events using multimedia ontologies. doi
  12. (2005). Semantic annotation of images and videos for multimedia analysis. doi
  13. (2008). Semantic concept learning through massive internet video mining. doi
  14. The stanford nlp log-linear part of speech tagger.
  15. (1998). WordNet: an electronic lexical database. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.