User-Based Data Collection Techniques and Strategies for Evaluating Networked Information Services

published or submitted for publicatio

Tackling Ageing Continence through Theory, Tools & Technology

Originally presented at ‘Aging and Society: An Interdisciplinary Conference’, University of California, Berkeley (2011), this article was double-blind peer reviewed, receiving scores of 96% and 73%. It outlines the interdisciplinary research of the cross-Research-Council-funded New Dynamics of Ageing Tackling Ageing Continence through Theory Tools & Technology (TACT3) project (2008–12), which brought together designers, social scientists, bio-engineers, chemists and care-management services to understand the challenges faced by an ageing population in the management of continence. Bichard’s Work Package, ‘Challenging Environmental Barriers to Continence’, explored the need for public toilet provision as essential for quality of life, health and well-being. It developed a life-course methodology that considered ageing from birth through to advanced age (0–101 years), and involved inclusive design research with members of the public and providers of facilities to assess public expectations and provider limitations in service provision. As co-investigator on TACT3, this research built on Bichard’s previous work for the VivaCity2020 consortium (Bichard REF Output 2). Whereas the VivaCity2020 work focused on architectural barriers in toilet provision, the TACT3 project examined the problem in service provision, and how, through inclusive design research, service-design solutions might be explored and implemented. Bichard’s contribution to the TACT3 project produced The Great British Public Toilet Map (http://greatbritishpublictoiletmap.rca.ac.uk/), a public participation website that provides information and locations of public toilets, encouraging members of the public to contact relevant local authorities that have not released information in the format of Open Data. Secondary analysis of TACT3 data for references to issues of personal safety and community initiative in toilet provision was used for the ESRC-funded Robust Accessible Toilets (RATs) project (2011) and produced Publicly Accessible Toilets: An Inclusive Design Guide (2011). Related published conference papers include those in ‘Cumulus 2010’ (China) and ‘Include 2011’ (UK)

US government information: selected current issues in public access vs. private competition

Web information systems are having a profound effect on the way information is being disseminated today. Current technological advances have caused many government agencies to re-evaluate their practice of contracting with private sector vendors who have traditionally repackaged and marketed the agency\u27s raw data. These new opportunities for government agencies wishing to make information publicly accessible have blurred the traditional distinctions between public and private dissemination activities. Low-cost public dissemination of information has resulted in private sector vendors arguing that public electronic distribution and publication creates unfair competition. New partnerships, such as the recent venture between the National Technical Information Service (NTIS) and the commercial search engine, Northern Light, in developing the ``usgovsearch\u27\u27 product are also being explored. From another viewpoint, library associations are strongly supporting legislation that would broaden,strengthen, and enhance public access to electronic government information. Key issues to be discussed are: (1) the debate concerning public vs. private access to government information; (2) Does electronic access to government information eliminate the need for printed documents? and (3) Joint efforts -- when should the government team up with private sector allies to charge for information services and access

A Factor Framework for Experimental Design for Performance Evaluation of Commercial Cloud Services

Given the diversity of commercial Cloud services, performance evaluations of candidate services would be crucial and beneficial for both service customers (e.g. cost-benefit analysis) and providers (e.g. direction of service improvement). Before an evaluation implementation, the selection of suitable factors (also called parameters or variables) plays a prerequisite role in designing evaluation experiments. However, there seems a lack of systematic approaches to factor selection for Cloud services performance evaluation. In other words, evaluators randomly and intuitively concerned experimental factors in most of the existing evaluation studies. Based on our previous taxonomy and modeling work, this paper proposes a factor framework for experimental design for performance evaluation of commercial Cloud services. This framework capsules the state-of-the-practice of performance evaluation factors that people currently take into account in the Cloud Computing domain, and in turn can help facilitate designing new experiments for evaluating Cloud services.Comment: 8 pages, Proceedings of the 4th International Conference on Cloud Computing Technology and Science (CloudCom 2012), pp. 169-176, Taipei, Taiwan, December 03-06, 201

On Evaluating Commercial Cloud Services: A Systematic Review

Background: Cloud Computing is increasingly booming in industry with many competing providers and services. Accordingly, evaluation of commercial Cloud services is necessary. However, the existing evaluation studies are relatively chaotic. There exists tremendous confusion and gap between practices and theory about Cloud services evaluation. Aim: To facilitate relieving the aforementioned chaos, this work aims to synthesize the existing evaluation implementations to outline the state-of-the-practice and also identify research opportunities in Cloud services evaluation. Method: Based on a conceptual evaluation model comprising six steps, the Systematic Literature Review (SLR) method was employed to collect relevant evidence to investigate the Cloud services evaluation step by step. Results: This SLR identified 82 relevant evaluation studies. The overall data collected from these studies essentially represent the current practical landscape of implementing Cloud services evaluation, and in turn can be reused to facilitate future evaluation work. Conclusions: Evaluation of commercial Cloud services has become a world-wide research topic. Some of the findings of this SLR identify several research gaps in the area of Cloud services evaluation (e.g., the Elasticity and Security evaluation of commercial Cloud services could be a long-term challenge), while some other findings suggest the trend of applying commercial Cloud services (e.g., compared with PaaS, IaaS seems more suitable for customers and is particularly important in industry). This SLR study itself also confirms some previous experiences and reveals new Evidence-Based Software Engineering (EBSE) lessons

Envisioning the Future of a Mature IR: A Midlife Assessment of ScholarWorks@UMassAmherst

The University of Massachusetts Amherst Libraries launched its institutional repository (IR), ScholarWorks@UMassAmherst, in July 2006. To date, the IR has over 57,000 works that have been downloaded over 25 million times all over the world. Over the past six years, the content of the IR has expanded from mainly postprints and Electronic Theses and Dissertations (ETDs) to include podcasts, datasets, open educational resources (OER), and other shareable open content that has no other logical home. As continued growth has pushed the limits of the software as designed, we decided to conduct a full assessment of the IR in order to qualitatively assess whether the IR meets the needs of staff and stakeholders. The assessment involved two parts: (1) evaluating the IR according to a set of defined criteria adapted from the University of Pennsylvania’s Platform Functionality Review, and (2) soliciting feedback from stakeholders, including those who edit journals or organize conferences (a functionality that is separate from other parts of the IR) and those who manage non-journal or conference collections within the IR. While stakeholders expressed satisfaction with the service provided by the Libraries and the IR provider, they also requested additional features that would make the platform more user-friendly, flexible, and responsive to new content types and customizations that extend beyond the hard limits of the software. Editors and collections administrators were particularly vocal in requesting additional features, such as the ability to accommodate languages other than English and support for big datasets. The assessment raises concerns about the current IR’s ability to adapt to changes in the scholarly publishing landscape that are on the horizon and provides critical data to inform the next iteration of the repository. Hopefully, others can apply this strategy to their own institutional repository in order to better prepare for a flexible, robust future that supports open scholarship

The educational scorecard: The Start of our Journey

Against a backdrop of public sector cuts, increasing university fees and high youth unemployment, we are facing challenges in Higher Education to demonstrate the value of our courses. Assessing the value of learning, however, is not straight forward. This paper reports on a study of evaluation processes on a post-graduate, professionally accredited diploma delivered at a selection of post 1992 universities. The driver for the study was a concern that current evaluation processes do not fully demonstrate the value of the course nor take into account the needs of multiple stakeholders. The project included benchmarking University evaluation processes and conducting a dialogue with stakeholders. The study adopted a qualitative management research approach, involving: a review of current practice, comparison with a sample of equivalent courses, and consultation (in the form of focus groups and semi-structured interviews) with a sample of students and employers. The paper discusses findings and proposes recommendations for future evaluation procedures in the design of an ‘educational scorecard’ for the course. Kaplan and Norton’s ‘balanced scorecard (1996) concept was adapted to provide a mechanism to represent and balance the needs of different stakeholder groups in the education process. We argue that we cannot truly assess accountability and comparability without engaging a range of stakeholders, not only in soliciting their views on the outcome of the learning but also in the design and implementation of evaluation processes. The ‘educational scorecard’ presented in this paper is developed specifically for the post-graduate diploma in Human Resource Management (PDHRM) at Leeds Metropolitan University and the report concludes with some initial reflections on the benefits of adopting the scorecard methodology The proposed model is flexible and may be adapted for other HE institutions and courses