Impact measures for libraries and information services

PURPOSE - To demonstrate the importance of impact / outcome research in libraries. DESIGN/METHODOLOGY/APPROACH - The paper gives an overview of purposes and methods used in impact research and illustrates this through project experiences. FINDINGS - Various projects worldwide are trying to prove that use of library services can positively influence skills and competences, attitudes and behaviour of users. The benefits that users experience by using library services can be assessed in terms of knowledge gained, higher information literacy, higher academic or professional success, social inclusion, and increase in individual well-being. RESEARCH LIMITATIONS/IMPLICATIONS - The main problem of impact research is, that influences on an individual are manifold and that therefore it is difficult to trace changes and improvements back to the library. The paper shows methods that are tested and used at the present. More investigation is needed to identify methods that could be used to show a library’s overall impact or to develop measures that would permit benchmarking between institutions. PRACTICAL IMPLICATIONS - The paper shows practical examples of impact assessment, covering “soft” methods like surveys, interviews, focus groups, observation and quantitative methods like tests, analysis of publications, or usage data. ORIGINALITY/VALUE - The paper acquaints libraries with a topic that is not yet well known and, by showing practical examples, demonstrates how libraries can attempt to assess their impact

Users’ Continued Usage of Online Healthcare Virtual Communities: An Empirical Investigation in the Context of HIV Support Communities

This study uses data from an online HIV/AIDS health support virtual community to examine whether users’ emotional states and the social support they receive influence their continued usage. We adopt grief theory to conceptualize the negative emotions that people living with HIV/AIDS could experience. Linguistic analysis is used to measure the emotional states of the users and the informational and emotional support that they receive. Results show that users showing a higher level of disbelief and yearning are more likely to leave the community while those with a high level of anger and depression are more likely to stay on. Users who receive more informational support are more likely to leave once they have obtained the information they sought, but those who receive more emotional support are more likely to stay on. The findings of this study can help us better understand users’ support seeking behavior in online support VCs

Personalisation and recommender systems in digital libraries

Widespread use of the Internet has resulted in digital libraries that are increasingly used by diverse communities of users for diverse purposes and in which sharing and collaboration have become important social elements. As such libraries become commonplace, as their contents and services become more varied, and as their patrons become more experienced with computer technology, users will expect more sophisticated services from these libraries. A simple search function, normally an integral part of any digital library, increasingly leads to user frustration as user needs become more complex and as the volume of managed information increases. Proactive digital libraries, where the library evolves from being passive and untailored, are seen as offering great potential for addressing and overcoming these issues and include techniques such as personalisation and recommender systems. In this paper, following on from the DELOS/NSF Working Group on Personalisation and Recommender Systems for Digital Libraries, which met and reported during 2003, we present some background material on the scope of personalisation and recommender systems in digital libraries. We then outline the working group’s vision for the evolution of digital libraries and the role that personalisation and recommender systems will play, and we present a series of research challenges and specific recommendations and research priorities for the field

ACCESS: An Inception Report

Imagine a world in which all groups of citizens coming together to realize some public benefit measure and communicate the character and consequences of their work. Imagine further that all those groups have adopted a common reporting system that enables their individual reports to be compared, thus creating powerful descriptions of the relative and collective performance of citizen association for public benefit. Imagine, too, that this common measuring and reporting carries across to all forms of public-private partnership and corporate social responsibility. This is the world envisioned by ACCESS.For the past 18 months a growing number of concerned actors have been meeting, studying, and testing opinion around one of the great structural weaknesses in the world's institutional infrastructure -- inefficient and weak social investment markets. This inception report sets out the results of this enquiry in the form of a proposal to establish a reporting standard for nonprofit organizations seeking to produce social, environmental and, increasingly, financial returns. The ACCESS Reporting standard is one important contribution to redressing a major global system weakness, but it is certainly not the only one. Nor is it one that can operate in isolation from other initiatives. Accordingly, the ACCESS proposed plan of work involves convening a global dialogue on NGO transparency, accountability and performance with the objective of promoting ACCESS and other practical solutions to the challenges of social investment and civil society accountability.This report sets out the background and rationale for these proposals. You will meet the ACCESS sponsors and pilot project partners. Parts of the report are descriptive and analytical but other parts are necessarily theoretical and technical in nature. We make no apology for this. Part of the reason that in 2003 the world does not yet have a reporting standard for social actors is that the theory and technique have not been mastered. For those with a strong orientation toward strategy and action, however, these aspects are presented as well

Standardised library instruction assessment: an institution-specific approach

Introduction We explore the use of a psychometric model for locally-relevant, information literacy assessment, using an online tool for standardised assessment of student learning during discipline-based library instruction sessions. Method A quantitative approach to data collection and analysis was used, employing standardised multiple-choice survey questions followed by individual, cognitive interviews with undergraduate students. The assessment tool was administered to five general education psychology classes during library instruction sessions. AnalysisDescriptive statistics were generated by the assessment tool. Results. The assessment tool proved a feasible means of measuring student learning. While student scores improved on every survey question, there was uneven improvement from pre-test to post-test for different questions. Conclusion Student scores showed more improvement for some learning outcomes over others, thus, spending time on fewer concepts during instruction sessions would enable more reliable evaluation of student learning. We recommend using digital learning objects that address basic research skills to enhance library instruction programmes. Future studies will explore different applications of the assessment tool, provide more detailed statistical analysis of the data and shed additional light on the significance of overall scores

TB STIGMA – MEASUREMENT GUIDANCE

TB is the most deadly infectious disease in the world, and stigma continues to play a significant role in worsening the epidemic. Stigma and discrimination not only stop people from seeking care but also make it more difficult for those on treatment to continue, both of which make the disease more difficult to treat in the long-term and mean those infected are more likely to transmit the disease to those around them. TB Stigma – Measurement Guidance is a manual to help generate enough information about stigma issues to design and monitor and evaluate efforts to reduce TB stigma. It can help in planning TB stigma baseline measurements and monitoring trends to capture the outcomes of TB stigma reduction efforts. This manual is designed for health workers, professional or management staff, people who advocate for those with TB, and all who need to understand and respond to TB stigma

Clustering the information space using top-ranking sentences : a study of user interaction

By considering sentences selected by a query-biased sentence extraction model from the top-retrieved documents, we create a personalised information space which is characterised by the presence of search terms. We cluster this information space, and enable searchers to interact with the resulting clusters. In order to examine whether users can recognise, and benefit from, the clustered organisation, we compare user interaction and performance between an actual clustering and a pseudo-clustering of the information space for completing information seeking tasks. The results provide evidence for the utility and meaningfulness of the clustered organisation