Searching as learning: Novel measures for information interaction research

There is growing recognition of the importance of learning as a search outcome and of the need to provide support for it. Yet, before we can consider learning as a part of search, we need to know how to assess it. This panel will focus on methods and measures for assessing learning in the context of search tasks and their outcomes. The panel will be interactive as the audience will be encouraged to engage in contributing their own experiences and ideas related to measures and methods to study learning as a part of search processes. Ideas and experiences with explicit and implicit indicators of learning and with evaluating learning outcomes will be shared during a dialogue between the audience and panelists. Outcomes from the panel discussions will contribute to formulating a research agenda for “search as learning.” The outcomes will be shared with the audience (and the wider ASIST community).Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/111136/1/meet14505101021.pd

Complex search task: how to make a phone safe for a child

There are many factors in task design that might make it ‘complex’: having multiple components, having multiple cross-dependent components, tasks that involve comparison, evaluation, estimation, or learning. In this paper, we discuss a case study of a complex task we may consider to be highly natural, a common concern for many people, and one that ‘should’ have a clear answer, but doesn’t: how do you make a phone safe for a child. For this question, there is a lot of opinion online, many possibilities for actions, many variations in hardware and software, but ultimately no one clear and correct answer for everyday phone users. We found very little objective behaviours that separated people in terms of performance but instead have begun to identify some successful tactics that are not directly linked to domain knowledge

Search literacy: learning to search to learn

People can often find themselves out of their depth when they face knowledge-based problems, such as faulty technology, or medical concerns. This can also happen in everyday domains that users are simply inexperienced with, like cooking. These are common exploratory search conditions, where users don’t quite know enough about the domain to know if they are submitting a good query, nor if the results directly resolve their need or can be translated to do so. In such situations, people turn to their friends for help, or to forums like StackOverflow, so that someone can explain things to them and translate information to their specific need. This short paper describes work-in-progress within a Google-funded project focusing on Search Literacy in these situations, where improved search skills will help users to learn as they search, to search better, and to better comprehend the results. Focusing on the technology-problem domain, we present initial results from a qualitative study of questions asked and answers given in StackOverflow, and present plans for designing search engine support to help searchers learn as they search

SenseCluster for exploring large data repositories

Exploring and making sense of large data repositories has become a daunting task. This is especially the case for end users who often have limited access to the data due to the complexity of the retrieval process and limited availability of IT support for developing custom queries and reports based on the data. Consequently, traditional interfaces are no longer meeting these requirements. Instead, novel interfaces are required to fully support the sense making process. In this paper, we followed a design science approach and introduced a query clustering system (Sense Cluster) that could serve as a quick exploration tool for making better sense of large data repositories. We also present an evaluation of the effectiveness of our artifact using cognitive walkthroughs

User Interaction with Linked Data: An Exploratory Search Approach

NoIt is becoming increasingly popular to expose government and citywide sensor data as linked data. Linked data appears to offer a great potential for exploratory search in supporting smart city goals of helping users to learn and make sense of complex and heterogeneous data. However, there are no systematic user studies to provide an insight of how browsing through linked data can support exploratory search. This paper presents a user study that draws on methodological and empirical underpinning from relevant exploratory search studies. The authors have developed a linked data browser that provides an interface for user browsing through several datasets linked via domain ontologies. In a systematic study that is qualitative and exploratory in nature, they have been able to get an insight on central issues related to exploratory search and browsing through linked data. The study identifies obstacles and challenges related to exploratory search using linked data and draws heuristics for future improvements. The authors also report main problems experienced by users while conducting exploratory search tasks, based on which requirements for algorithmic support to address the observed issues are elicited. The approach and lessons learnt can facilitate future work in browsing of linked data, and points at further issues that have to be addressed

The relationship of (perceived) epistemic cognition to interaction with resources on the internet

Information seeking and processing are key literacy practices. However, they are activities that students, across a range of ages, struggle with. These information seeking processes can be viewed through the lens of epistemic cognition: beliefs regarding the source, justification, complexity, and certainty of knowledge. In the research reported in this article we build on established research in this area, which has typically used self-report psychometric and behavior data, and information seeking tasks involving closed-document sets. We take a novel approach in applying established self-report measures to a large-scale, naturalistic, study environment, pointing to the potential of analysis of dialogue, web-navigation – including sites visited – and other trace data, to support more traditional self-report mechanisms. Our analysis suggests that prior work demonstrating relationships between self-report indicators is not paralleled in investigation of the hypothesized relationships between self-report and trace-indicators. However, there are clear epistemic features of this trace data. The article thus demonstrates the potential of behavioral learning analytic data in understanding how epistemic cognition is brought to bear in rich information seeking and processing tasks

A Survey of Definitions and Models of Exploratory Search

International audienceExploratory search has an unclear and open-ended definition. The complexity of the task and the difficulty of defining this activity are reflected in the limits of existing evaluation methods for exploratory search systems. In order to improve them, we intend to design an evaluation method based on a user-centered model of exploratory search. In this work, we identified and defined the characteristics of exploratory search and used them as an information seeking model evaluation grid. We tested this analytic grid on two information seeking models: Ellis' and Marchionini's models. The results show that Marchonini's model does not match our evaluation method's requirements whereas on the other hand Ellis' model could be adapted to better suit exploratory search

INNOVATION IN DESIGNING HEALTH INFORMATION WEBSITES: RESULTS FROM A QUANTITATIVE STUDY

A wealth of health information exists on the Internet, but successfully finding that information is not easy. One of the issues causing this is the lack of tools for exploring information and assisting in navigation within health websites. As a result, relevant information cannot be easily discovered. We hope to rectify this issue from the design perspective. Based on previous work, we have created a prototype website called Better Health Explorer to better support such information seeking behaviours. This paper reports on a quantitative study evaluating this prototype. The results demonstrate several improvements in health information seeking supported by the tool. Furthermore, we have identified three general design characteristics that should to be considered when designing consumer health websites. These findings have design implications for health information seeking applications, as well as identifying directions for further research