Data fluidity in DARIAH -- pushing the agenda forward

This paper provides both an update concerning the setting up of the European DARIAH infrastructure and a series of strong action lines related to the development of a data centred strategy for the humanities in the coming years. In particular we tackle various aspect of data management: data hosting, the setting up of a DARIAH seal of approval, the establishment of a charter between cultural heritage institutions and scholars and finally a specific view on certification mechanisms for data

Peer review innovations in Humanities: how can scholars in A&H profit of the "wisdom of the crowds"?

Though supported by a large number of scholars in Scientific, Technical, and Medical (STM) disciplines traditional peer review does not live up to the needs of an efficient scholarly communication system and of quality research control. Therefore journals in STM are experimenting different forms of refereeing in combination with more traditional peer review system. Such is the case of PLoSONE, Biology Direct, Atmospheric Chemistry and Physics, Electronic Transactions on Artificial Intelligence, and JIME. However in STM disciplines public peer review is not regarded an alternative to more traditional quality certification forms. It may be the case in the Arts & Humanities. In A&H publishing system peer review is by far a less common practice. Therefore the adoption of a social peer review process could be very useful to foster research in humanities. Scholars in A&H can profit of the interactive evaluation forms of the public peer-review to strengthen the scholarly debate, to foster active international and interdisciplinary discussions, to focus social attention on topics in Humanities, to broaden the borders of the cultural and intellectual discourse among non-scholars (public debate). This paper will provide some examples of how social peer review has been adopted by innovative communities of scholars in humanities to publish new experimental digital book models. In the digital environment the concepts of “document”, of “completeness of a document” and of “evaluation” is fast changing. In a close future in scholarly publishing it might become possible to overcome the rigid distinction between ex-ante and ex-post evaluation as the evaluation process might become an enduring part of the text itsel

The metric tide: report of the independent review of the role of metrics in research assessment and management

This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration. This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. The report starts by tracing the history of metrics in research management and assessment, in the UK and internationally. It looks at the applicability of metrics within different research cultures, compares the peer review system with metric-based alternatives, and considers what balance might be struck between the two. It charts the development of research management systems within institutions, and examines the effects of the growing use of quantitative indicators on different aspects of research culture, including performance management, equality, diversity, interdisciplinarity, and the ‘gaming’ of assessment systems. The review looks at how different funders are using quantitative indicators, and considers their potential role in research and innovation policy. Finally, it examines the role that metrics played in REF2014, and outlines scenarios for their contribution to future exercises

DeWitt Wallace Library Biennial Report 2011-2013

Summary of library activities for 2011-201

Good Applications for Crummy Entity Linkers? The Case of Corpus Selection in Digital Humanities

Over the last decade we have made great progress in entity linking (EL) systems, but performance may vary depending on the context and, arguably, there are even principled limitations preventing a "perfect" EL system. This also suggests that there may be applications for which current "imperfect" EL is already very useful, and makes finding the "right" application as important as building the "right" EL system. We investigate the Digital Humanities use case, where scholars spend a considerable amount of time selecting relevant source texts. We developed WideNet; a semantically-enhanced search tool which leverages the strengths of (imperfect) EL without getting in the way of its expert users. We evaluate this tool in two historical case-studies aiming to collect a set of references to historical periods in parliamentary debates from the last two decades; the first targeted the Dutch Golden Age, and the second World War II. The case-studies conclude with a critical reflection on the utility of WideNet for this kind of research, after which we outline how such a real-world application can help to improve EL technology in general.Comment: Accepted for presentation at SEMANTiCS '1

Publication practices in motion: The benefits of open access publishing for the humanities

The changes we have seen in recent years in the scholarly publishing world - including the growth of digital publishing and changes to the role and strategies of publishers and libraries alike - represent the most dramatic paradigm shift in scholarly communications in centuries. This volume brings together leading scholars from across the humanities to explore that transformation and consider the challenges and opportunities it brings

The University as Publisher: Summary of a Meeting Held at UC Berkeley on November 1, 2007

With the advent of electronic publishing, the scholarly communication landscape at universities has become increasingly diverse. Multiple stakeholders including university presses, libraries, and central IT departments are challenged by the increasing volume and the rapidity of production of these new forms of publication in an environment of economic uncertainties. As a response to these increasing pressures, as well as the recent publication of important reports and papers on the topic, the Center for Studies in Higher Education (CSHE) convened a meeting of experts titled, The University as Publisher. The event was sponsored as part of the A.W. Mellon Foundation-funded Future of Scholarly Communication project at CSHE.Our goal was to explore among stakeholders -- faculty, publishers, CIOs, librarians, and researchers -- the implications of the academic community, in some structure, taking over many, if not all, aspects of scholarly publishing. Two themes were the focus of the public panels: Institutional Roles in Evaluation, Quality Assessment, and Selection and Structuring and Budgeting Models for Publishing within the University Community. Our discussions included the importance of distinguishing between informal dissemination and formal publishing and the challenges that each presents to the university community. The harsh economic realities of high-quality formal scholarly publication, not least of which are managing peer review and editorial processes, were emphasized. Understanding disciplinary needs was cited as paramount throughout the discussions; the needs and traditions of scholars in the sciences and humanities, as well as among myriad disciplines, will likely demand different dissemination and publishing models and solutions. An additional theme that emerged was acknowledging the diverse forms electronic dissemination takes in the academy and the need to foster a spectrum of alternatives in publication forms, business models, and the peer review process. Budgetary and academic freedom concerns were explored as well. Regarding the expensive infrastructure required for electronic dissemination and publishing, it was agreed that there is enormous duplication among the university press, IT, and the library