Evaluating advanced search interfaces using established information-seeking model

When users have poorly defined or complex goals search interfaces offering only keyword searching facilities provide inadequate support to help them reach their information-seeking objectives. The emergence of interfaces with more advanced capabilities such as faceted browsing and result clustering can go some way to some way toward addressing such problems. The evaluation of these interfaces, however, is challenging since they generally offer diverse and versatile search environments that introduce overwhelming amounts of independent variables to user studies; choosing the interface object as the only independent variable in a study would reveal very little about why one design out-performs another. Nonetheless if we could effectively compare these interfaces we would have a way to determine which was best for a given scenario and begin to learn why. In this article we present a formative framework for the evaluation of advanced search interfaces through the quantification of the strengths and weaknesses of the interfaces in supporting user tactics and varying user conditions. This framework combines established models of users, user needs, and user behaviours to achieve this. The framework is applied to evaluate three search interfaces and demonstrates the potential value of this approach to interactive IR evaluation

Discovery-led refinement in e-discovery investigations: sensemaking, cognitive ergonomics and system design.

Given the very large numbers of documents involved in e-discovery investigations, lawyers face a considerable challenge of collaborative sensemaking. We report findings from three workplace studies which looked at different aspects of how this challenge was met. From a sociotechnical perspective, the studies aimed to understand how investigators collectively and individually worked with information to support sensemaking and decision making. Here, we focus on discovery-led refinement; specifically, how engaging with the materials of the investigations led to discoveries that supported refinement of the problems and new strategies for addressing them. These refinements were essential for tractability. We begin with observations which show how new lines of enquiry were recursively embedded. We then analyse the conceptual structure of a line of enquiry and consider how reflecting this in e-discovery support systems might support scalability and group collaboration. We then focus on the individual activity of manual document review where refinement corresponded with the inductive identification of classes of irrelevant and relevant documents within a collection. Our observations point to the effects of priming on dealing with these efficiently and to issues of cognitive ergonomics at the human–computer interface. We use these observations to introduce visualisations that might enable reviewers to deal with such refinements more efficiently

How Registries Can Help Performance Measurement Improve Care

Suggests ways to better utilize databases of clinical information to evaluate care processes and outcomes and improve measurements of healthcare quality and costs, comparative clinical effectiveness research, and medical product safety surveillance

Searching Data: A Review of Observational Data Retrieval Practices in Selected Disciplines

A cross-disciplinary examination of the user behaviours involved in seeking and evaluating data is surprisingly absent from the research data discussion. This review explores the data retrieval literature to identify commonalities in how users search for and evaluate observational research data. Two analytical frameworks rooted in information retrieval and science technology studies are used to identify key similarities in practices as a first step toward developing a model describing data retrieval

Supporting young people: an evaluation of recent reforms to youth support services in 11 local areas [+ handout]

This survey examines the progress made in 11 local authority areas in developing new arrangements to integrate the work of various youth support agencies. An accompanying handout is included

Building a Strategic Learning and Evaluation System for Your Organization

The current state of evaluation in the philanthropic and nonprofit sectors points to the need for a more strategic approach to evaluation. In this guide, we provide a framework and set of practices that can help organizations be more systematic, coordinated, and intentional about what to evaluate, when, why, with whom, and with what resources

Building Medical Homes in State Medicaid and CHIP Programs

Presents strategies, best practices, and lessons learned from ten states' efforts to advance the medical home model of comprehensive and coordinated care in Medicaid and Children's Health Insurance Programs in order to improve quality and contain costs

Presenting evidence-based health information for people with multiple sclerosis : the IN-DEEP project protocol

Background - Increasingly, evidence-based health information, in particular evidence from systematic reviews, is being made available to lay audiences, in addition to health professionals. Research efforts have focused on different formats for the lay presentation of health information. However, there is a paucity of data on how patients integrate evidence-based health information with other factors such as their preferences for information and experiences with information-seeking. The aim of this project is to explore how people with multiple sclerosis (MS) integrate health information with their needs, experiences, preferences and values and how these factors can be incorporated into an online resource of evidence-based health information provision for people with MS and their families.Methods - This project is an Australian-Italian collaboration between researchers, MS societies and people with MS. Using a four-stage mixed methods design, a model will be developed for presenting evidence-based health information on the Internet for people with MS and their families. This evidence-based health information will draw upon systematic reviews of MS interventions from The Cochrane Library. Each stage of the project will build on the last. After conducting focus groups with people with MS and their family members (Stage 1), we will develop a model for summarising and presenting Cochrane MS reviews that is integrated with supporting information to aid understanding and decision making. This will be reviewed and finalised with people with MS, family members, health professionals and MS Society staff (Stage 2), before being uploaded to the Internet and evaluated (Stages 3 and 4).Discussion - This project aims to produce accessible and meaningful evidence-based health information about MS for use in the varied decision making and management situations people encounter in everyday life. It is expected that the findings will be relevant to broader efforts to provide evidence-based health information for patients and the general public. The international collaboration also permits exploration of cultural differences that could inform international practice.<br /

Solutions for Impact Investors: From Strategy to Implementation

In writing this monograph, our main goal is to provide impact investors with tools to tighten the link between their investment decisions and impact creation. Our intent is threefold: to attract more capital to impact investing; to assist impact investors as they move from organizational change to executing and refining their impact investment decision-making process; and to narrow the gap within foundations between program professionals and investment professionals thereby contributing to a mutual understanding and implementation of a portfolio approach to impact investing.Additionally, we intend to help break down the barriers making it difficult to identify opportunities in impact investing. To this end, we provide examples throughout the monograph and at www.rockpa.org/impactinvesting of impact investment opportunities in most major asset classes.While we understand the important role that impact investors can play in providing financial capital, we also want to acknowledge the wide range of non-financial resources needed to address the world's problems. Our intent with this monograph is not to provide a comprehensive list of investments across asset classes nor any type of investment advice with regard to the selected profiles. We strongly encourage the reader to conduct their own assessment and evaluation for risk and suitability before considering any investment