Skip to main content
Article thumbnail
Location of Repository

Towards a comprehensive survey of the semantic gap in visual image retrieval

By P.G.B. Enser and C.J. Sandom


This paper adopts the premise that the 'semantic gap' is an incompletely surveyed feature in the landscape of visual image retrieval, and proposes a framework within which this deficiency might be made good. Simple classifications of types of image and of types of user are proposed. Consideration is then given in outline to how semantic content is realised by each class of user within each class of image. The argument is advanced that this realisation finds expression in perceptual, generic interpretive and specific interpretive content. This analytic framework provides the basis for the specification of a broadly encompassing evaluation study, which will employ the image/user type classification and the expert domain knowledge of selected user groups in the construction of segmented test collections of real queries, images and relevance judgements. From this study should come a better-informed view on the nature of semantic information need, and on the representation and recovery of semantic content across a broad spectrum of image retrieval activity

Topics: P110 Information Management
Publisher: Springer Verlag
Year: 2003
OAI identifier:

Suggested articles


  1. (1986). Analyzing the Subject of a Picture: A Theoretical Approach. doi
  2. (2002). Content-Based Image Retrieval – What’s Holding It Back? Paper given at the ASCI
  3. (1993). Design Criteria for a Shape Retrieval System. doi
  4. (1998). E.: The Description and Indexing of Images. Report of a survey of ARLIS members,
  5. (2000). End-user Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive.
  6. (1997). Enser, P.G.B.: Analysis of User Need in Image Archives. doi
  7. (1996). et al.: Content-Based Retrieval for Trademark Registration. Multimedia Tools and Applications 3, doi
  8. (1999). Evaluation of Image Retrieval Systems: Role of User Feedback.
  9. (1996). Indexing Images: Testing an Image Description Template. Paper given at the ASIS
  10. (2000). Information Seeking Behaviour in Image Retrieval. doi
  11. (1988). Intellectual Problems of Indexing Picture Collections.
  12. (1999). Margaret E.: Content-based Image Retrieval. A report to the JISC Technology Applications Programme.
  13. (2002). Modelling What Users See When They Look at Images: A Cognitive Viewpoint. In: doi
  14. (1995). Pictorial Information Retrieval. (Progress in Documentation). doi
  15. (1993). Query Analysis in a Visual Information Retrieval Context.
  16. (1995). Query Categories in a Study of Intellectual Access to Digitized Art Images.
  17. (1987). Recognition-by-components: A Theory of Human Image Understanding. Psychological Review 94(2), doi
  18. (2002). Retrieval of Archival Moving Imagery - CBIR Outside the Frame? In: doi
  19. (1999). S.-F.: Image Retrieval: Current Techniques, Promising Directions, and Open Issues. doi
  20. (1998). Searching for Photos - Journalists' Practices in Pictorial
  21. (1962). Studies in Iconology: Humanistic Themes in the Art of the Renaissance. doi
  22. (1967). The Elements of Semiology.
  23. (1997). The Image Retrieval Task: Implications for the Design and Evaluation of Image Databases. New Review of Hypermedia and Multimedia. doi
  24. (1995). The Newspaper Image Database: Empirical Supported Analysis of Users’ Typology and Word Association Clusters. doi
  25. (1998). Trademark Image Retrieval by Shape Similarity. doi
  26. (2001). VIRAMI – Visual Information Retrieval for Archival Moving Imagery. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.