This article is (c) Emerald Group Publishing and permission has been granted for this version to appear here. Emerald does not grant permission for this article to be further copied/distributed or hosted elsewhere without the express permission from Emerald Group Publishing Limitedurpose
– Title and URL mentions have recently been proposed as web visibility indicators instead of inlink counts. The objective of this study is to determine the accuracy of these alternative web mention indicators in the Spanish academic system, taking into account their complexity (multi-domains) and diversity (different official languages).
Design/methodology/approach
– Inlinks, title and URL mentions from 76 Spanish universities were manually extracted from the main search engines (Google, Google Scholar, Yahoo!, Bing and Exalead). Several statistical methods, such as correlation, difference tests and regression models, were used.
Findings
– Web mentions, despite some limitations, can be used as substitutes for inlinks in the Spanish academic system, although these indicators are more likely to be influenced by the environment (language, web domain policy, etc.) than inlinks.
Research limitations/implications
– Title mentions provide unstable results caused by the multiple name variants which an institution can present (such as acronyms and other language versions). URL mentions are more stable, but they may present atypical points due to some shortcomings, the effect of which is that URL mentions do not have the same meaning as inlinks.
Practical implications
– Web mentions should be used with caution and after a cleaning-up process. Moreover, these counts do not necessarily signify connectivity, so their use in global web analysis should be limited.
Originality/value
– Web mentions have previously been used in some specific academic systems (US, UK and China), but this study analyses, in depth and for the first time, an entire non-English speaking European country (Spain), with complex academic web behaviour, which helps to better explain previous web mention results.Ortega, JL.; Orduña Malea, E.; Aguillo, IF. (2014). Are web mentions accurate substitutes for inlinks for Spanish universities?. Online Information Review. 38(1):59-77. doi:10.1108/OIR-10-2012-0189S5977381Adecannby, J. (2011), “Web link analysis of interrelationship between top ten African universities and world universities”, Annals of Library and Information Studies, Vol. 58 No. 2, pp. 128-138.Aguillo, I. (2009). Measuring the institution’s footprint in the web. Library Hi Tech, 27(4), 540-556. doi:10.1108/073788309Aguillo, I.F. , Ortega, J.L. and Fernández, M. (2008), “Webometric ranking of world universities: introduction, methodology, and future developments”, Higher Education in Europe, Vol. 33 Nos 2/3, pp. 234-244.Aguillo, I. F., Granadino, B., Ortega, J. L., & Prieto, J. A. (2006). Scientific research activity and communication measured with cybermetrics indicators. Journal of the American Society for Information Science and Technology, 57(10), 1296-1302. doi:10.1002/asi.20433Barabási, A.-L., & Albert, R. (1999). Emergence of Scaling in Random Networks. Science, 286(5439), 509-512. doi:10.1126/science.286.5439.509Bar-Ilan, J. (2005). The use of web search engines in information science research. Annual Review of Information Science and Technology, 38(1), 231-288. doi:10.1002/aris.1440380106Bar-Ilan, J. (2004). A microscopic link analysis of academic institutions within a country - the case of Israel. Scientometrics, 59(3), 391-403. doi:10.1023/b:scie.0000018540.33706.c1Bar-Ilan, J. (2005). What do we know about links and linking? A framework for studying links in academic environments. Information Processing & Management, 41(4), 973-986. doi:10.1016/j.ipm.2004.02.005Björneborn, L., & Ingwersen, P. (2004). Toward a basic framework for webometrics. Journal of the American Society for Information Science and Technology, 55(14), 1216-1227. doi:10.1002/asi.20077Bland, J.M. and Altman, D.G. (1996), “Transforming data”, British Medical Journal, Vol. 312 No. 7033, p.Cronin, B., Snyder, H. W., Rosenbaum, H., Martinson, A., & Callahan, E. (1998). Invoked on the Web. Journal of the American Society for Information Science, 49(14), 1319-1328. doi:10.1002/(sici)1097-4571(1998)49:143.0.co;2-wFriedman, M. (1937). The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance. Journal of the American Statistical Association, 32(200), 675-701. doi:10.1080/01621459.1937.10503522Harries, G., Wilkinson, D., Price, L., Fairclough, R., & Thelwall, M. (2004). Hyperlinks as a data source for science mapping. Journal of Information Science, 30(5), 436-447. doi:10.1177/0165551504046736Heimeriks, G. and Van den Besselaar, P. (2006), “Analyzing hyperlink networks: the meaning of hyperlink based indicators of knowledge”, Cybermetrics, Vol. 10, available at: http://cybermetrics.cindoc.csic.es/articles/v10i1p1.pdf (accessed 10 July 2013).Heimeriks, G., Hörlesberger, M., & Van den Besselaar, P. (2003). Scientometrics, 58(2), 391-413. doi:10.1023/a:1026296812830Kousha, K. and Horri, A. (2004), “The relationship between scholarly publishing and the counts of academic inlinks to Iranian university web sites: exploring academic link creation motivations”, Journal of Information Management and Scientometrics, Vol. 1 No. 2, pp. 13-22.Kousha, K., & Thelwall, M. (2009). Google book search: Citation analysis for social science and the humanities. Journal of the American Society for Information Science and Technology, 60(8), 1537-1549. doi:10.1002/asi.21085Kretschmer, H., & Aguillo, I. F. (2004). Visibility of collaboration on the Web. Scientometrics, 61(3), 405-426. doi:10.1023/b:scie.0000045118.68430.fdOrduña-Malea, E. (2012), “Fuentes de enlaces web para análisis cibermétricos (2012)”, Anuario Thinkepi, Vol. 6 No. 1, pp. 276-280.Orduña-Malea, E. (2013), “Espacio universitario español en la Web (2010): estudio descriptivo de instituciones y productos académicos a través del análisis de subdominios y subdirectorios”, Revista Española de Documentación Científica, Vol. 36 No. 3.Orduña-Malea, E., & Ontalba-Ruipérez, J.-A. (2012). Proposal for a multilevel university cybermetric analysis model. Scientometrics, 95(3), 863-884. doi:10.1007/s11192-012-0868-5Orduña-Malea, E., Serrano-Cobos, J., Ontalba-Ruipérez, J. A., & Lloret-Romero, N. (2010). Presencia y visibilidad web de las universidades públicas españolas. Revista española de Documentación Científica, 33(2), 246-278. doi:10.3989/redc.2010.2.740Ortega, J. L., & Aguillo, I. F. (2008). Visualization of the Nordic academic web: Link analysis using social network tools. Information Processing & Management, 44(4), 1624-1633. doi:10.1016/j.ipm.2007.09.010Ortega, J. L., & Aguillo, I. F. (2009). Análisis estructural de la web académica iberoamericana. Revista española de Documentación Científica, 32(3), 51-65. doi:10.3989/redc.2009.3.689Ortega, J. L., Aguillo, I., Cothey, V., & Scharnhorst, A. (2007). Maps of the academic web in the European Higher Education Area — an exploration of visual web indicators. Scientometrics, 74(2), 295-308. doi:10.1007/s11192-008-0218-9Qiu, J., Chen, J., & Wang, Z. (2004). An analysis of backlink counts and Web Impact Factorsfor Chinese university websites. Scientometrics, 60(3), 463-473. doi:10.1023/b:scie.0000034387.76981.83Seeber, M., Lepori, B., Lomi, A., Aguillo, I., & Barberio, V. (2012). Factors affecting web links between European higher education institutions. Journal of Informetrics, 6(3), 435-447. doi:10.1016/j.joi.2012.03.001Seidman, E. (2007), “We are flattered, but …”, Bing Community, available at: www.bing.com/community/site_blogs/b/search/archive/2007/03/28/we-are-flattered-but.aspx (accessed 20 October 2012).Smith, A.G. (1999), “A tale of two web spaces: comparing sites using web impact factors”, Journal of Documentation, Vol. 55 No. 5, pp. 577-592.Smith, A., & Thelwall, M. (2002). Scientometrics, 54(3), 363-380. doi:10.1023/a:1016030415822Stuart, D., & Thelwall, M. (2006). Investigating triple helix relationships using URL citations: a case study of the UK West Midlands automobile industry. Research Evaluation, 15(2), 97-106. doi:10.3152/147154406781775968Thelwall, M. (2001). Extracting macroscopic information from Web links. Journal of the American Society for Information Science and Technology, 52(13), 1157-1168. doi:10.1002/asi.1182Thelwall, M. (2002). An initial exploration of the link relationship between UK university Web sites. Aslib Proceedings, 54(2), 118-126. doi:10.1108/00012530210435248Thelwall, M. and Aguillo, I.F. (2003), “La salud de las web universitarias españolas”, Revista Española de Documentación Científica, Vol. 26 No. 3, pp. 291-305.Thelwall, M., & Kousha, K. (2008). Online presentations as a source of scientific impact? An analysis of PowerPoint files citing academic journals. Journal of the American Society for Information Science and Technology, 59(5), 805-815. doi:10.1002/asi.20803Thelwall, M., & Sud, P. (2011). A comparison of methods for collecting web citation data for academic organizations. Journal of the American Society for Information Science and Technology, 62(8), 1488-1497. doi:10.1002/asi.21571Thelwall, M., & Sud, P. (2012). Webometric research with the Bing Search API 2.0. Journal of Informetrics, 6(1), 44-52. doi:10.1016/j.joi.2011.10.002Thelwall, M., & Zuccala, A. (2008). A university-centred European Union link analysis. Scientometrics, 75(3), 407-420. doi:10.1007/s11192-007-1831-8Thelwall, M., Tang, R., & Price, L. (2003). Scientometrics, 56(3), 417-432. doi:10.1023/a:1022387105904Thelwall, M., Binns, R., Harries, G., Page-Kennedy, T., Price, L., & Wilkinson, D. (2002). Scientometrics, 53(1), 95-111. doi:10.1023/a:1014836021080Vaughan, L. (2012). An Alternative Data Source for Web Hyperlink Analysis: «Sites Linking In» at Alexa Internet. Collnet Journal of Scientometrics and Information Management, 6(1), 31-42. doi:10.1080/09737766.2012.10700922Vaughan, L., & Romero-Frías, E. (2012). Exploring Web keyword analysis as an alternative to link analysis: a multi-industry case. Scientometrics, 93(1), 217-232. doi:10.1007/s11192-012-0640-xVaughan, L., & Shaw, D. (2003). Bibliographic and Web citations: What is the difference? Journal of the American Society for Information Science and Technology, 54(14), 1313-1322. doi:10.1002/asi.10338Vaughan, L., & Yang, R. (2012). Web data as academic and business quality estimates: A comparison of three data sources. Journal of the American Society for Information Science and Technology, 63(10), 1960-1972. doi:10.1002/asi.22659Vaughan, L., & You, J. (2010). Word co-occurrences on Webpages as a measure of the relatedness of organizations: A new Webometrics concept. Journal of Informetrics, 4(4), 483-491. doi:10.1016/j.joi.2010.04.005Vaughan, L., Kipp, M. E. I., & Gao, Y. (2007). Why are Websites co-linked? The case of Canadian universities. Scientometrics, 72(1), 81-92. doi:10.1007/s11192-007-1707-y(The) Washington Post(2009), “It's official: Yahoo-Microsoft announce ten-year search/ad pact”, The Washington Post, available at: www.washingtonpost.com/wp-dyn/content/article/2009/07/29/AR2009072901108.html (accessed 27 February 2013).Wilkinson, D., Harries, G., Thelwall, M., & Price, L. (2003). Motivations for academic web site interlinking: evidence for the Web as a novel source of information on informal scholarly communication. Journal of Information Science, 29(1), 49-56. doi:10.1177/016555150302900105Zhang, Y. (2006). The Effect of Open Access on Citation Impact: A Comparison Study Based on Web Citation Analysis. Libri, 56(3). doi:10.1515/libr.2006.14
