Caveats for the Use of Citation Indicators in Research and Journal Evaluations

Ageing of publications, percentage of self-citations, and impact vary from journal to journal within fields of science. The assumption that citation and publication practices are homogenous within specialties and fields of science is invalid. Furthermore, the delineation of fields and among specialties is fuzzy. Institutional units of analysis and persons may move between fields or span different specialties. The match between the citation index and institutional profiles varies among institutional units and nations. The respective matches may heavily affect the representation of the units. Non-ISI journals are increasingly cornered into "transdisciplinary" Mode-2 functions with the exception of specialist journals publishing in languages other than English. An "externally cited impact factor" can be calculated for these journals. The citation impact of non-ISI journals will be demonstrated using Science and Public Policy as the example

From individual scientific visibility to collective competencies : the example of an academic department in social science

The article discusses the role of university department in social sciences. It studies how to describe the three missions of university department: education, research and consultancy services for public and private organisations. It also proposes tools to evaluate to what extend these missions are connected. Until now, evaluation in this domain has focused primarily on research activities and far too few indicators have been developed for the other two missions. Moreover, evaluation is often performed on an individual basis, so that the synergy generated by work collectives is rarely evaluated. The purpose of this article is to propose a method for identifying and describing the competencies of a social science research and teaching department. By means of this method can be used to study the articulation between the department's different activities—research, expertise and teaching—can be studied. Maps of an activity are generated, which can serve as a basis for strategic planning of future trends. The approach is based on an analysis of "traces" (articles, contracts, research reports, postgraduate training modules) of the activity of the different components of the Social Science Department, using lexicographic analysis tools. With keywords, titles, summaries and synopses of lectures, it is possible to draw up "maps" representing the department's main competencies.

Mapping the knowledge base of information policy: clusters of documents, people and ideas

This thesis investigates aspects of the intellectual and social structure of the field of information policy through a detailed examination of the serials literature. The aims of the research are to explore how information policy scholarship is organised—in terms of its relation to other fields and disciplines; whether it constitutes a distinct specialty in its own right; and what kinds of institutional structures and arrangements exist to support research and scholarship. In Part One, a literature review identifies previous bibliometric and other studies which are relevant to studies of scholarly disciplines and knowledge communities. It discusses the interdisciplinary problem-oriented nature of information policy and considers some of the modes of enquiry which characterise investigations this area. Part Two consists of a series of experiments carried out on a test collection of 771 periodical articles drawn from the Social science Citation Index The empirical work comprised four linked studies: a bibliometric census study an analysis of document clustering; an author cocit.ation study; and a content analysis. Extensive use was made of multivariate statistical techniques, notably principal components analysis, hierarchical clustering, discriminant and correspondence analysis to identify statistically significant and meaningful patterns and structures within the test collection. The study concludes that information policy is a growing and reasonably distinctive field of study with strong links to library and information science, law, media studies, and the political sciences. It is suggested that the field is not unified and that research is still primarily organised along national and traditional disciplinary lines, with little evidence of significant collaborative activity across institutions or sectors. The research base is highly dispersed, with practitioners playing a major role in the production of knowledge. In institutional terms, the field is very thinly spread, with few signs of concentration