Boyack, K.

Glänzel, W.

Gläser, J.

Havemann, F.

Scharnhorst, A.

Thijs, B.

Van Eck, N.J.

Van Velden, T.

Waltman, L.R.

Leiden University Scholary Publications

Topic identification challengeKevin Boyack1 • Wolfgang Glänzel2 • Jochen Gläser3 •Frank Havemann4 • Andrea Scharnhorst5 • Bart Thijs2 •Nees Jan van Eck6 • Theresa Velden3,7 • Ludo Waltmann6Received: 6 June 2016 / Published online: 15 March 2017 Akadémiai Kiadó, Budapest, Hungary 2017Over the last two years, a group of researchers used a shared dataset in order to comparetheir approaches to the identification of thematic structures in a set of 111,616 papers onastronomy and astrophysics published in 59 journals between 2003 and 2010. The out-comes of this comparative exercise are published in a special issue of Scientometrics& Jochen GläserJochen.Glaser@ztg.tu-berlin.deKevin Boyackkboyack@mapofscience.comWolfgang Glänzelwolfgang.glanzel@kuleuven.beFrank Havemannfrank.havemann@ib.hu-berlin.deAndrea Scharnhorstandrea.scharnhorst@dans.knaw.nlNees Jan van Eckecknjpvan@cwts.leidenuniv.nlTheresa Veldenvelden@ztg.tu-berlin.deLudo Waltmannwaltmanlr@cwts.leidenuniv.nl1 SciTech Strategies, Inc., Albuquerque, NM 87122, USA2 ECOOM and Department of MSI, KU Leuven, Louvain, Belgium3 ZTG, TU Berlin, HBS1, Hardenbergstr. 16-18, 10623 Berlin, Germany4 Institut für Bibliotheks-und Informationswissenschaft, Humboldt-Universität zu Berlin,Dorotheenstr. 26, 10099 Berlin, Germany5 DANS-KNAW, Anna van Saksenlaan 51, The Hague, The Netherlands6 Centre for Science and Technology Studies, Leiden University, Leiden, The Netherlands7 University of Michigan, School of Information, Ann Arbor, MI 48109, USA123Scientometrics (2017) 111:1223–1224DOI 10.1007/s11192-017-2307-0(Gläser et al. 2017). Now that Clarivate Analytics kindly agreed to make this datasetavailable to interested researchers in the bibliometrics community, we suggest to extendthis comparative approach.We challenge you to participate in the comparative topic identification exercise.The challenge is not to develop the best partitioning of the dataset. We believe this to beimpossible because there is not one single best solution. Instead, we challenge you to gainas much information as possible about your own approach and the reasons why it produceda particular solution, and how it compares to solutions produced by other approaches. Wechallenge you to comparatively discuss advantages and disadvantages of approaches totopic identification and thus to contribute to a cumulative body of knowledge on thesuitability of data models and algorithms for the identification of topics.Thanks to Clarivate Analytics, we are able to offer access to the dataset with an efficientlicense agreement.While participating in the ‘‘Web of Science comparative topic identification exer-cise,’’ you will be provided with access to the Clarivate Analytics ‘‘Web of Sciencecomparative topic identification exercise’’ dataset. You may access and use thisdataset from March 1, 2017 through December 31, 2018 only for the exercise above,subject to the ‘‘Clarivate Analytics Terms’’, including the ‘‘Web of Science: CustomData Set Product Terms’’ in the ‘‘Product/Service Terms’’, available on our Terms ofBusiness site: http://clarivate.com/tob/. By accessing and/or using our data, you arelegally bound by and hereby consent to these terms. If you do not agree to theseterms, then you may not access or use our data. Any extension or further use of ourdata beyond December 31, 2018 is strictly prohibited unless you receive prior writtenpermission from Clarivate Analytics.The dataset can be obtained by sending an email to jason.rollins@thomsonreuters.com.We will also offer access to a website where solutions can be deposited and downloadedfor comparisons. The website, which also offers some tools for a comparative analysis ofsolutions and individual clusters, is www.topic-challenge.info.If there are enough participants, we will run sessions on the comparative exercise at thenext ISSI conferences and dedicated workshops.We hope that many of you will take up the challenge and thus contribute to cumulativeprogress in bibliometrics.ReferenceGläser, J., Glänzel, W., & Scharnhorst, A. (2017). Same data—Different results? Towards a comparativeapproach to the identification of thematic structures in science. In J. Gläser, A. Scharnhorst & W.Glänzel (Eds.), Same data—Different results? Towards a comparative approach to the identification ofthematic structures in science. Special Issue of Scientometrics. doi:10.1007/s11192-017-2296-z.1224 Scientometrics (2017) 111:1223–1224123

Topic identification challenge

https://scholarlypublications.universiteitleiden.nl/access/item%3A2944601/download

Topic identification challenge

Abstract

Similar works

Full text

Available Versions

Leiden University Scholary Publications