Z39.50 broadcast searching and Z-server response times: perspectives from CC-interop

This paper begins by briefly outlining the evolution of Z39.50 and the current trends, including the work of the JISC CC-interop project. The research crux of the paper focuses on an investigation conducted with respect to testing Z39.50 server (Z-server) response times in a broadcast (parallel) searching environment. Customised software was configured to broadcast a search to all test Z-servers once an hour, for eleven weeks. The results were logged for analysis. Most Z-servers responded rapidly. 'Network congestion' and local OPAC usage were not found to significantly influence Z-server performance. Response time issues encountered by implementers may be the result of non-response by the Z-server and how Z-client software deals with this. The influence of 'quick and dirty' Z39.50 implementations is also identified as a potential cause of slow broadcast searching. The paper indicates various areas for further research, including setting shorter time-outs and greater end-user behavioural research to ascertain user requirements in this area. The influence more complex searches, such as Boolean, have on response times and suboptimal Z39.50 implementations are also emphasised for further study. This paper informs the LIS research community and has practical implications for those establishing Z39.50 based distributed systems, as well as those in the Web Services community. The paper challenges popular LIS opinion that Z39.50 is inherently sluggish and thus unsuitable for the demands of the modern user

Towards improved performance and interoperability in distributed and physical union catalogues

Purpose of this paper: This paper details research undertaken to determine the key differences in the performance of certain centralised (physical) and distributed (virtual) bibliographic catalogue services, and to suggest strategies for improving interoperability and performance in, and between, physical and virtual models. Design/methodology/approach: Methodically defined searches of a centralised catalogue service and selected distributed catalogues were conducted using the Z39.50 information retrieval protocol, allowing search types to be semantically defined. The methodology also entailed the use of two workshops comprising systems librarians and cataloguers to inform suggested strategies for improving performance and interoperability within both environments. Findings: Technical interoperability was permitted easily between centralised and distributed models, however the various individual configurations permitted only limited semantic interoperability. Significant prescription in cataloguing and indexing guidelines, greater participation in the Program for Collaborative Cataloging (PCC), consideration of future 'FRBR' migration, and greater disclosure to end users are some of the suggested strategies to improve performance and semantic interoperability. Practical implications: This paper informs the LIS research community and union catalogue administrators, but also has numerous practical implications for those establishing distributed systems based on Z39.50 and SRW, as well as those establishing centralised systems. What is original/value of the paper?: The paper moves the discussion of Z39.50 based systems away from anecdotal evidence and provides recommendations based on testing and is intimately informed by the UK cataloguing and systems librarian community

SPEIR: developing a common information environment in Scotland

Purpose - To report on the work of the SPEIR project and indicate its relevance beyond the Scottish information environment. SPEIR was funded by the Scottish Library and Information Council to identify, research, and develop the elements of an internationally interoperable Scottish Common Information Environment (SCIE) for Library, Museum and Archive domain information services, and to determine the best path for future progress. A key focus was to determine the distributed information infrastructure requirements of a pilot Scottish Cultural Portal being developed in parallel with the SPEIR work, building on existing pilot initiatives such as the CAIRNS distributed catalogue and landscaper, the SCONE collections database, the SCAMP staff portal and an embryonic organisational infrastructure based on the Confederation of Scottish Mini-cooperatives (CoSMiC). Design/methodology/approach - A series of practical pilots was undertaken. These were underpinned by relevant desk and field research and conducted within an overarching holistic approach to developing the distributed environment. Practical implications - Key outcomes included the creation of a single upgraded integrated service incorporating an extended distributed catalogue, collections database, and landscaper, the creation of a pilot distributed digital library, the development of open-URL-based facilities to permit portals to incorporate 'canned searches' of the catalogue, the collections database, the SDDL, and other compatible services, an illustrative pilot Scottish terminology mapping service, and various organisational infrastructure and professional support improvements. Originality/value - The embryonic technical and organisational infrastructure reported may provide a model for other small countries (or regions within larger countries) seeking a coherent approach to the development of an interoperable information environment

Subject Classification of Collection-level Descriptions Using DDC for Information Landscaping

Collection-level description (CLD) has emerged as an important tool for facilitating user access to large heterogeneous collections within digital library and hybrid information environments. Such metadata enables "information landscaping" techniques to be deployed, thereby allowing users to survey, discover and identify relevant collections. This can aid the precision of item-level queries by eliminating collections which may produce a significant number of false-drops or may contain no relevant items. The ability to provide suitable subject indexing and subject-based organization within such collection-level environments is an increasingly important user requirement, particularly for landscaping; yet it remains highly problematic owing to, for example, the broad subject coverage of many collections and the item-level nature of controlled vocabularies. In this paper we propose a methodology for the subject designation of collections using the Dewey Decimal Classification (DDC). The proposed approach allows the establishment of reliable, consistent and meaningful DDC class numbers to facilitate improved user browsing and searching tools within CLD systems. The methodology will be demonstrated using the Scottish Collections Network (SCONE) and alternative techniques to facilitate general subject analysis will also discussed

Clumps and collection description in the information environment in the UK with particular reference to Scotland

The role, potential and interaction of networked catalogues and collection-level description have recently been given emphasis in order that efficient resource discovery mechanisms, and the effective organisation of such resources, be facilitated within the UK's developing JISC information environment (IE). This article describes the work of CC-interop, a JISC project, and related projects that inform the development of the IE and its ability to instantiate the functional model of online resource discovery to which JISC aspires. The article reviews the evolution of Z39.50 virtual union catalogue services and collection description services that preceded CC-interop. The paper also discusses how such work is informing regional information environments, with particular reference to Scotland, and reveals how such local arrangements will benefit the wider JISC IE

CC-interop : COPAC/Clumps Continuing Technical Cooperation. Final Project Report

As far as is known, CC-interop was the first project of its kind anywhere in the world and still is. Its basic aim was to test the feasibility of cross-searching between physical and virtual union catalogues, using COPAC and the three functioning "clumps" or virtual union catalogues (CAIRNS, InforM25, and RIDING), all funded or part-funded by JISC in recent years. The key issues investigated were technical interoperability of catalogues, use of collection level descriptions to search union catalogues dynamically, quality of standards in cataloguing and indexing practices, and usability of union catalogues for real users. The conclusions of the project were expected to, and indeed do, contribute to the development of the JISC Information Environment and to the ongoing debate as to the feasibility and desirability of creating a national UK catalogue. They also inhabit the territory of collection level descriptions (CLDs) and the wider services of JISC's Information Environment Services Registry (IESR). The results of this project will also have applicability for the common information environment, particularly through the landscaping work done via SCONE/CAIRNS. This work is relevant not just to HE and not just to digital materials, but encompasses other sectors and domains and caters for print resources as well. Key findings are thematically grouped as follows: System performance when inter-linking COPAC and the Z39.50 clumps. The various individual Z39.50 configurations permit technical interoperability relatively easily but only limited semantic interoperability is possible. Disparate cataloguing and indexing practices are an impairment to semantic interoperability, not just for catalogues but also for CLDs and descriptions of services (like those constituting JISC's IESR). Creating dynamic landscaping through CLDs: routines can be written to allow collection description databases to be output in formats that other UK users of CLDs, including developers of the JISC information environment. Searching a distributed (virtual) catalogue or clump via Z39.50: use of Z39.50 to Z39.50 middleware permits a distributed catalogue to be searched via Z39.50 from such disparate user services as another virtual union catalogue or clump, a physical union catalogue like COPAC, an individual Z client and other IE services. The breakthrough in this Z39.50 to Z39.50 conundrum came with the discovery that the JISC-funded JAFER software (a result of the 5/99 programme) meets many of the requirements and can be used by the current clumps services. It is technically possible for the user to select all or a sub-set of available end destination Z39.50 servers (we call this "landscaping") within this middleware. Comparing results processing between COPAC and clumps. Most distributed services (clumps) do not bring back complete results sets from associated Z servers (in order to save time for users). COPAC on-the-fly routines could feasibly be applied to the clumps services. An automated search set up to repeat its query of 17 catalogues in a clump (InforM25) hourly over nearly 3 months returned surprisingly good results; for example, over 90% of responses were received in less than one second, and no servers showed slower response times in periods of traditionally heavy OPAC use (mid-morning to early evening). User behaviour when cross-searching catalogues: the importance to users of a number of on-screen features, including the ability to refine a search and clear indication that a search is processing. The importance to users of information about the availability of an item as well as the holdings data. The impact of search tools such as Google and Amazon on user behaviour and the expectations of more information than is normally available from a library catalogue. The distrust of some librarians interviewed of the data sources in virtual union catalogues, thinking that there was not true interoperability

Landscaping the future for collaborative collection management

The paper briefly describes the concept and functional components of information environments and information landscapes, including the role of descriptions of collections and their catalogues. The paper then discusses the potential use of landscapes to support collaborative collection management across a range of processes and services, including resource acquisition, discovery, access, and preservation, and demonstrates the application of structured collection-level metadata to support a variety of consortium foci, including location, topic, educational level, and resource format. The paper describes several techniques which can be applied to collection-level metadata to provide landscaping services at regional and national level, including the application of functional granularity from the analytic model of collections and their catalogues, collection hierarchies, and controlled vocabularies. The paper presents examples from the Scottish Collections Network, a national operational information environment and landscaping service, including consortia based on collection subject (Scottish Visual Arts Group) and location (Glasgow Academic Libraries Together). The paper concludes by discussing the extension of information environments to incorporate archive and museum collections, and the potential impact of new and emerging collection description standards

SPEIR: Scottish Portals for Education, Information and Research. Final Project Report: Elements and Future Development Requirements of a Common Information Environment for Scotland

The SPEIR (Scottish Portals for Education, Information and Research) project was funded by the Scottish Library and Information Council (SLIC). It ran from February 2003 to September 2004, slightly longer than the 18 months originally scheduled and was managed by the Centre for Digital Library Research (CDLR). With SLIC's agreement, community stakeholders were represented in the project by the Confederation of Scottish Mini-Cooperatives (CoSMiC), an organisation whose members include SLIC, the National Library of Scotland (NLS), the Scottish Further Education Unit (SFEU), the Scottish Confederation of University and Research Libraries (SCURL), regional cooperatives such as the Ayrshire Libraries Forum (ALF)1, and representatives from the Museums and Archives communities in Scotland. Aims; A Common Information Environment For Scotland The aims of the project were to: o Conduct basic research into the distributed information infrastructure requirements of the Scottish Cultural Portal pilot and the public library CAIRNS integration proposal; o Develop associated pilot facilities by enhancing existing facilities or developing new ones; o Ensure that both infrastructure proposals and pilot facilities were sufficiently generic to be utilised in support of other portals developed by the Scottish information community; o Ensure the interoperability of infrastructural elements beyond Scotland through adherence to established or developing national and international standards. Since the Scottish information landscape is taken by CoSMiC members to encompass relevant activities in Archives, Libraries, Museums, and related domains, the project was, in essence, concerned with identifying, researching, and developing the elements of an internationally interoperable common information environment for Scotland, and of determining the best path for future progress

Clumps and collection description in the information environment in the UK with particular reference to Scotland

The role, potential and interaction of networked catalogues and collection-level description have recently been given emphasis in order that efficient resource discovery mechanisms, and the effective organisation of such resources, be facilitated within the UK's developing JISC information environment (IE). This article describes the work of CC-interop, a JISC project, and related projects that inform the development of the IE and its ability to instantiate the functional model of online resource discovery to which JISC aspires. The article reviews the evolution of Z39.50 virtual union catalogue services and collection description services that preceded CC-interop. The paper also discusses how such work is informing regional information environments, with particular reference to Scotland, and reveals how such local arrangements will benefit the wider JISC IE