The effects of topic familiarity on user search behavior in question answering systems

This paper reports on experiments that attempt to characterize the relationship between users and their knowledge of the search topic in a Question Answering (QA) system. It also investigates user search behavior with respect to the length of answers presented by a QA system. Two lengths of answers were compared; snippets (one to two sentences of text) and exact answers. A user test was conducted, 92 factoid questions were judged by 44 participants, to explore the participants’ preferences, feelings and opinions about QA system tasks. The conclusions drawn from the results were that participants preferred and obtained higher accuracy in finding answers from the snippets set. However, accuracy varied according to users’ topic familiarity; users were only substantially helped by the wider context of a snippet if they were already familiar with the topic of the question, without such familiarity, users were about as accurate at locating answers from the snippets as they were in exact set

Hypermedia learning and prior knowledge: Domain expertise vs. system expertise

Prior knowledge is often argued to be an important determinant in hypermedia learning, and may be thought of as including two important elements: domain expertise and system expertise. However, there has been a lack of research considering these issues together. In an attempt to address this shortcoming, this paper presents a study that examines how domain expertise and system expertise influence students’ learning performance in, and perceptions of, a hypermedia system. The results indicate that participants with lower domain knowledge show a greater improvement in their learning performance than those with higher domain knowledge. Furthermore, those who enjoy using the Web more are likely to have positive perceptions of non-linear interaction. Discussions on how to accommodate the different needs of students with varying levels of prior knowledge are provided based on the results

Why We Read Wikipedia

Wikipedia is one of the most popular sites on the Web, with millions of users relying on it to satisfy a broad range of information needs every day. Although it is crucial to understand what exactly these needs are in order to be able to meet them, little is currently known about why users visit Wikipedia. The goal of this paper is to fill this gap by combining a survey of Wikipedia readers with a log-based analysis of user activity. Based on an initial series of user surveys, we build a taxonomy of Wikipedia use cases along several dimensions, capturing users' motivations to visit Wikipedia, the depth of knowledge they are seeking, and their knowledge of the topic of interest prior to visiting Wikipedia. Then, we quantify the prevalence of these use cases via a large-scale user survey conducted on live Wikipedia with almost 30,000 responses. Our analyses highlight the variety of factors driving users to Wikipedia, such as current events, media coverage of a topic, personal curiosity, work or school assignments, or boredom. Finally, we match survey responses to the respondents' digital traces in Wikipedia's server logs, enabling the discovery of behavioral patterns associated with specific use cases. For instance, we observe long and fast-paced page sequences across topics for users who are bored or exploring randomly, whereas those using Wikipedia for work or school spend more time on individual articles focused on topics such as science. Our findings advance our understanding of reader motivations and behavior on Wikipedia and can have implications for developers aiming to improve Wikipedia's user experience, editors striving to cater to their readers' needs, third-party services (such as search engines) providing access to Wikipedia content, and researchers aiming to build tools such as recommendation engines.Comment: Published in WWW'17; v2 fixes caption of Table

Evaluating tag-based information access in image collections

The availability of social tags has greatly enhanced access to information. Tag clouds have emerged as a new "social" way to find and visualize information, providing both one-click access to information and a snapshot of the "aboutness" of a tagged collection. A range of research projects explored and compared different tag artifacts for information access ranging from regular tag clouds to tag hierarchies. At the same time, there is a lack of user studies that compare the effectiveness of different types of tag-based browsing interfaces from the users point of view. This paper contributes to the research on tag-based information access by presenting a controlled user study that compared three types of tag-based interfaces on two recognized types of search tasks - lookup and exploratory search. Our results demonstrate that tag-based browsing interfaces significantly outperform traditional search interfaces in both performance and user satisfaction. At the same time, the differences between the two types of tag-based browsing interfaces explored in our study are not as clear. Copyright 2012 ACM

Internet source evaluation: The role of implicit associations and psychophysiological self-regulation

This study focused on middle school students\u2019 source evaluation skills as a key component of digital literacy. Specifically, it examined the role of two unexplored individual factors that may affect the evaluation of sources providing information about the controversial topic of the health risks associated with the use of mobile phones. The factors were the implicit association of mobile phone with health or no health, and psychophysiological self-regulation as reflected in basal Heart Rate Variability (HRV). Seventy-two seventh graders read six webpages that provided contrasting information on the unsettled topic of the potential health risks related to the use of mobile phones. Then they were asked to rank-order the six websites along the dimension of reliability (source evaluation). Findings revealed that students were able to discriminate between the most and least reliable websites, justifying their ranking in light of different criteria. However, overall, they were little accurate in rank-ordering all six Internet sources. Both implicit associations and HRV correlated with source evaluation. The interaction between the two individual variables was a significant predictor of participants\u2019 performance in rank-ordering the websites for reliability. A slope analysis revealed that when students had an average psychophysiological self-regulation, the stronger their association of the mobile phone with health, the better their performance on source evaluation. Theoretical and educational significances of the study are discussed

Characterizing Interdisciplinarity of Researchers and Research Topics Using Web Search Engines

Researchers' networks have been subject to active modeling and analysis. Earlier literature mostly focused on citation or co-authorship networks reconstructed from annotated scientific publication databases, which have several limitations. Recently, general-purpose web search engines have also been utilized to collect information about social networks. Here we reconstructed, using web search engines, a network representing the relatedness of researchers to their peers as well as to various research topics. Relatedness between researchers and research topics was characterized by visibility boost-increase of a researcher's visibility by focusing on a particular topic. It was observed that researchers who had high visibility boosts by the same research topic tended to be close to each other in their network. We calculated correlations between visibility boosts by research topics and researchers' interdisciplinarity at individual level (diversity of topics related to the researcher) and at social level (his/her centrality in the researchers' network). We found that visibility boosts by certain research topics were positively correlated with researchers' individual-level interdisciplinarity despite their negative correlations with the general popularity of researchers. It was also found that visibility boosts by network-related topics had positive correlations with researchers' social-level interdisciplinarity. Research topics' correlations with researchers' individual- and social-level interdisciplinarities were found to be nearly independent from each other. These findings suggest that the notion of "interdisciplinarity" of a researcher should be understood as a multi-dimensional concept that should be evaluated using multiple assessment means.Comment: 20 pages, 7 figures. Accepted for publication in PLoS On