Skip to main content
Article thumbnail
Location of Repository

VisualNet: commonsense knowledgebase for video and image indexing and retrieval application

By Amjad Alabdullah Altadmri and Amr Ahmed

Abstract

The rapidly increasing amount of video collections, available on the web or via broadcasting, motivated research towards building intelligent tools for searching, rating, indexing and retrieval purposes. Establishing a semantic representation of visual data, mainly in textual form, is one of the important tasks.\ud The time needed for building and maintaining Ontologies and knowledge, especially for wide domain, and the efforts for integrating several approaches emphasize the need for unified generic commonsense knowledgebase for visual applications.\ud \ud In this paper, we propose a novel commonsense knowledgebase that forms the link between the visual world and its semantic textual representation. We refer to it as "VisualNet".\ud VisualNet is obtained by our fully automated engine that constructs a new unified structure concluding the knowledge from two commonsense knowledgebases, namely WordNet and ConceptNet. This knowledge is extracted by performing analysis operations on WordNet and ConceptNet contents, and then only useful knowledge in visual domain applications is considered.\ud Moreover, this automatic engine enables this knowledgebase to be developed, updated and maintained automatically, synchronized with any future enhancement on WordNet or ConceptNet.\ud \ud Statistical properties of the proposed knowledgebase, in addition to an evaluation of a sample application results, show coherency and effectiveness of the proposed knowledgebase and its automatic engine

Topics: G700 Artificial Intelligence, G710 Speech and Natural Language Processing, G400 Computer Science, G450 Multi-media Computing Science, G720 Knowledge Representation, G740 Computer Vision, G540 Databases
Year: 2009
OAI identifier: oai:eprints.lincoln.ac.uk:2092

Suggested articles

Citations

  1. (2007). A hybrid approach to improving semantic extraction of news video,” doi
  2. (2006). A visual annotation framework using common-sensical and linguistic relationships for semantic media retrieval,” doi
  3. (2008). Association and temporal rule mining for post-filtering of semantic concept detection in video,” doi
  4. (2008). Combining WordNet and ConceptNet for automatic query expansion: a learning approach,” doi
  5. (2004). Conceptnet a practical commonsense reasoning tool-kit,” doi
  6. (1995). Cyc: A large-scale investment in knowledge infrastructure,” doi
  7. (2006). Query expansion with conceptnet and wordnet: An intrinsic comparison,” doi
  8. (2007). Semantic annotation and retrieval of video events using multimedia ontologies,” doi
  9. (2008). Semantic concept learning through massive internet video mining,” doi
  10. The stanford nlp log-linear part of speech tagger.”
  11. (1999). What are ontologies, and why do we need them?” doi
  12. (1998). WordNet: an electronic lexical database. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.