Large-Scale Analysis of the Accuracy of the Journal Classification Systems of Web of Science and Scopus

Journal classification systems play an important role in bibliometric analyses. The two most important bibliographic databases, Web of Science and Scopus, each provide a journal classification system. However, no study has systematically investigated the accuracy of these classification systems. To examine and compare the accuracy of journal classification systems, we define two criteria on the basis of direct citation relations between journals and categories. We use Criterion I to select journals that have weak connections with their assigned categories, and we use Criterion II to identify journals that are not assigned to categories with which they have strong connections. If a journal satisfies either of the two criteria, we conclude that its assignment to categories may be questionable. Accordingly, we identify all journals with questionable classifications in Web of Science and Scopus. Furthermore, we perform a more in-depth analysis for the field of Library and Information Science to assess whether our proposed criteria are appropriate and whether they yield meaningful results. It turns out that according to our citation-based criteria Web of Science performs significantly better than Scopus in terms of the accuracy of its journal classification system

Discipline Formation in Information Management: Case Study of Scientific and Technological Information Services

Discipline formation in information management is investigated through a case study of the origi-nation and development of information services for scientific and technical information in Australia. Particular reference is made to a case of AESIS, a national geoscience, minerals and petroleum reference database coordinated by the Australian Mineral Foundation. This study pro-vided a model for consideration of similar services and their contribution to the discipline. The perspective adopted is to consider information management at operational, analytical and strate-gic levels. Political and financial influences are considered along with analysis of scope, perform-ance and quality control. Factors that influenced the creation, transitions, and abeyance of the service are examined, and some conclusions are drawn about an information management disci-pline being exemplified by such services

The SIMBAD astronomical database

Simbad is the reference database for identification and bibliography of astronomical objects. It contains identifications, `basic data', bibliography, and selected observational measurements for several million astronomical objects. Simbad is developed and maintained by CDS, Strasbourg. Building the database contents is achieved with the help of several contributing institutes. Scanning the bibliography is the result of the collaboration of CDS with bibliographers in Observatoire de Paris (DASGAL), Institut d'Astrophysique de Paris, and Observatoire de Bordeaux. When selecting catalogues and tables for inclusion, priority is given to optimal multi-wavelength coverage of the database, and to support of research developments linked to large projects. In parallel, the systematic scanning of the bibliography reflects the diversity and general trends of astronomical research. A WWW interface to Simbad is available at: http://simbad.u-strasbg.fr/SimbadComment: 14 pages, 5 Postscript figures; to be published in A&A

Discovery Tools and Local Metadata Requirements in Academic Libraries

As the second decade of the twenty-first century commences, academic librarians who work to promote collection access must not only contend with a vast array of content available in a wide range of formats, but they must also ensure that new technologies developed to accommodate user search behaviors yield satisfactory outcomes. Next generation discovery tools are designed to streamline the search process and facilitate better search results by incorporating metadata from proprietary and local collections, then by providing relevancy-ranked results. This paper investigates the implications of discovery tool use for accessing materials housed in institutional repositories and special collections, in particular, how the discovery of these materials depends on local metadata creation practices. This paper surveys current research pertaining to metadata quality issues that may put unique local collections at risk for being overlooked in meta-search relevancy rankings, and considers ways in which academic libraries can address this issue as well as areas for future research

The metric tide: report of the independent review of the role of metrics in research assessment and management

This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

The New Knowledge Environment: Quality Initiatives in Health Sciences Libraries

published or submitted for publicatio