The generation of effective methods for the evaluation of information retrieval systems and techniques is becoming increasingly important as more and more systems are designed and implemented. The present section deals with the evaluation of a variety of automatic indexing and retrieval procedures incorporated Into the SMART automatic document retrieval system. The design of the SMART system is first briefly reviewed. The document file, search requests, and other parameters affecting the evaluation system are then examined in detail, followed by a description of the measures used to assess the effectiveness of the retrieval performance. The main test results are given and tentative conclusions are reached concerning the design of fully automatic information systems. 1
To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.