SUPPORT EFFECTIVE DISCOVERY MANAGEMENT IN VISUAL ANALYTICS

Visual analytics promises to supply analysts with the means necessary to ana- lyze complex datasets and make effective decisions in a timely manner. Although significant progress has been made towards effective data exploration in existing vi- sual analytics systems, few of them provide systematic solutions for managing the vast amounts of discoveries generated in data exploration processes. Analysts have to use off line tools to manually annotate, browse, retrieve, organize, and connect their discoveries. In addition, they have no convenient access to the important discoveries captured by collaborators. As a consequence, the lack of effective discovery manage- ment approaches severely hinders the analysts from utilizing the discoveries to make effective decisions. In response to this challenge, this dissertation aims to support effective discov- ery management in visual analytics. It contributes a general discovery manage- ment framework which achieves its effectiveness surrounding the concept of patterns, namely the results of users’ low-level analytic tasks. Patterns permit construction of discoveries together with users’ mental models and evaluation. Different from the mental models, the categories of patterns that can be discovered from data are pre- dictable and application-independent. In addition, the same set of information is often used to annotate patterns in the same category. Therefore, visual analytics sys- tems can semi-automatically annotate patterns in a formalized format by predicting what should be recorded for patterns in popular categories. Using the formalized an- notations, the framework also enhances the automation and efficiency of a variety of discovery management activities such as discovery browsing, retrieval, organization, association, and sharing. The framework seamlessly integrates them with the visual interactive explorations to support effective decision making. Guided by the discovery management framework, our second contribution lies in proposing a variety of novel discovery management techniques for facilitating the discovery management activities. The proposed techniques and framework are im- plemented in a prototype system, ManyInsights, to facilitate discovery management in multidimensional data exploration. To evaluate the prototype system, two long- term case studies are presented. They investigated how the discovery management techniques worked together to benefit exploratory data analysis and collaborative analysis. The studies allowed us to understand the advantages, the limitations, and design implications of ManyInsights and its underlying framework

Exploring exploratory search when conducting literature review tasks

The last two decades have seen a growing interest in exploratory and complex searches in the information-seeking and retrieval community. Despite the plethora of proposed definitions and support interfaces for Exploratory Search, the key dimensions and characteristics of exploratory search remain unclear, leading to uncertainty. In the realm of information-seeking and retrieval, exploring academic literature for relevant references, including theses, publications, and reports, is widely recognised as an exploratory search task. This task becomes even more challenging when searchers have limited prior knowledge of the subject matter. Therefore, this thesis aims to understand the main dimensions and characteristics of exploratory search tasks, mainly focusing on literature review tasks. The original contributions of this thesis are fourfold: Firstly, it offers a conceptual model of exploratory search, consolidating an array of characteristics about the core dimensions of exploratory search—namely, the problem context, users, and search process. Secondly, through a series of empirical studies, the thesis validates this model and introduces additional dimensions and characteristics, including ‘Knowledge Gain.’ Thirdly, it investigates the impact of the support exploratory interfaces on users’ behaviours, perceptions, search outcomes, and overall experiences during exploratory searches within academic contexts. Lastly, serving as a specialised application of the exploratory search model, the thesis introduces a tailored version to cater to the requirements of literature review tasks. These insights aid in understanding the richness and multifaceted nature of exploratory searches and have the potential to shape design support user interfaces within the Information Seeking and Retrieval community.The last two decades have seen a growing interest in exploratory and complex searches in the information-seeking and retrieval community. Despite the plethora of proposed definitions and support interfaces for Exploratory Search, the key dimensions and characteristics of exploratory search remain unclear, leading to uncertainty. In the realm of information-seeking and retrieval, exploring academic literature for relevant references, including theses, publications, and reports, is widely recognised as an exploratory search task. This task becomes even more challenging when searchers have limited prior knowledge of the subject matter. Therefore, this thesis aims to understand the main dimensions and characteristics of exploratory search tasks, mainly focusing on literature review tasks. The original contributions of this thesis are fourfold: Firstly, it offers a conceptual model of exploratory search, consolidating an array of characteristics about the core dimensions of exploratory search—namely, the problem context, users, and search process. Secondly, through a series of empirical studies, the thesis validates this model and introduces additional dimensions and characteristics, including ‘Knowledge Gain.’ Thirdly, it investigates the impact of the support exploratory interfaces on users’ behaviours, perceptions, search outcomes, and overall experiences during exploratory searches within academic contexts. Lastly, serving as a specialised application of the exploratory search model, the thesis introduces a tailored version to cater to the requirements of literature review tasks. These insights aid in understanding the richness and multifaceted nature of exploratory searches and have the potential to shape design support user interfaces within the Information Seeking and Retrieval community

5 − 4 ≠ 4 − 3: On the Uneven Gaps between Different Levels of Graded User Satisfaction in Interactive Information Retrieval Evaluation

Similar to other ground truth measures, graded user satisfaction has been frequently employed as a continuous variable in information retrieval evaluation based on the assumption that intervals between adjacent grades are quantitatively equal. To examine the validity of equal-gap assumption and explore dynamic perceptual thresholds triggering grade changes in search evaluation, we investigate the extent to which users are sensitive to changes in search efforts and outcomes across different gaps of graded satisfaction. Experiments on four user study datasets (15,337 queries) indicate that 1) User satisfaction sensitivity, especially to offline evaluation metrics, changes significantly across gaps in satisfaction scale; 2) the size and direction of changes in sensitivity vary across study settings, search types, and intentions, especially within “3-5” scale subrange. This study speaks to the fundamentals of user-centered evaluation and advances the knowledge of heterogeneity in satisfaction sensitivity to search efforts and gains and implicit changes in evaluation thresholds

ShopWithMe!: Collaborative Information Searching and Shopping for Online Retail

We present research on the development and evaluation of a collaborative search and shopping system for online retail tasks based on domain specific product requirements. We describe the design rationale for the system development and inclusion of collaborative features, including search, chat, clip-board, product suggestions, shared views, and shopping cart with a focus on how these features are used for collaborative online retail shopping and information searching and sharing. Our research goal is to understand whether collaborative search tools are useful in supporting actual collaborative online retail shopping tasks for experience goods. We describe system development and report findings from preliminary user studies of the system, using mixed methods analysis, with an emphasis on the qualitative findings. The findings highlight that systems for the online shopping domain can support searching, shared views, and group communication to aid in collaborative shopping for experience goods by improving information sharing among group members. Implications are that ecommerce systems, websites, and web apps should support collaboration based on product types

Analysis of web information-seeking behavior of users with different levels of health literacy

Literacia em Saúde é definida como "o nível pelo qual os indivíduos podem obter, processar, compreender e comunicar informação relacionada com saúde necessária para tomar decisões de saúde informadas". Os utilizadores com um baixo nível de literacia em saúde têm menos conhecimentos das suas condições médicas, maior dificuldade em seguir as instruções e compreender a informação dada pelos médicos. Cada vez mais, as pessoas recorrem à web para pesquisar sobre informação de saúde. As dificuldades que os utilizadores de baixa literacia têm no mundo real provavelmente persistem no mundo virtual. O principal objetivo deste estudo é analisar os comportamentos de pesquisa de utilizadores com diferentes níveis de literacia em saúde. Pretende-se identificar diferenças entre pessoas com baixa e alta literacia de saúde que depois possam ser utilizadas para a melhoria dos sistemas de recuperação e contribuir, entre outros, para facilitar o acesso à informação e educação das pessoas com baixa literacia. Este estudo surge na sequência de um trabalho prévio que incluiu a anotação dos registos de vídeo de uma experiência com utilizadores realizada anteriormente. Com base na versão preliminar de análise do trabalho anterior, foi proposto um esquema de classificação de eventos que engloba tipos de interação relativos ao navegador, motor de pesquisa e páginas web. Cada tipo de interação é composto por eventos que, por sua vez estão associados a variáveis de análise. Dentro deste esquema, foram construídos módulos para analisar as interrogações de pesquisa submetidas. Com base neste esquema, foi revista a anotação dos vídeos e foi realizada a análise de dados de forma descritiva e inferencial. Os principais resultados demonstram que o grupo de baixa literacia em saúde utilizou sobretudo a caixa do motor de pesquisa e a funcionalidade de voltar atrás; interagiu mais tempo com página de resultados do motor de pesquisa, clicando mais com o botão esquerdo do rato e fazendo scrolling. Por outro lado, o grupo de alta literacia em saúde utilizou mais a barra de endereço e a funcionalidade de selecionar o texto do URL. Na página de resultados do motor de pesquisa este grupo fez mais cliques com o botão direito. A nível de reformulação de interrogações, que ocorrem no contexto da mesma necessidade de informação, os utilizadores com baixa literacia em saúde usaram mais as reformulações "totalmente novas", ou seja, sem termos em comum com a interrogação anterior. Por sua vez, o grupo de alta literacia em saúde fez mais reformulações.Health Literacy is "the level by which individuals can obtain, process, understand and communicate health-related information necessary to make informed health decisions". Users with a low level of health literacy are less aware of their medical conditions, more difficult to follow instructions and understand doctors' information. Increasingly, people turn to the web to search for health information. Low literacy users' difficulties in the real world are likely to continue to exist in the virtual world. The main objective of this study is to analyze the search behavior of users with different levels of health literacy. It intends to identify differences between people with low and high health literacy that can then be used to improve retrieval systems and contribute, among others, to facilitate access to information and education by people with low literacy. This study follows a previous work that included annotating video records of experience with users previously carried out. Based on the preliminary analysis version of the previous work, an event classification scheme was proposed that includes types of interactions related to the browser, search engine, and web pages. Each type of interaction is composed of events that, in turn, are associated with analysis variables. Within this scheme, modules were built to analyze the formulation of search queries. Based on this scheme, the annotation of the videos was revised, and the data analysis was performed in a descriptive and inferential manner. The main results demonstrate that the low health literacy group used mainly the search engine box and the backward feature. On the search engine results page, they clicked more with the left mouse button. On the results page, they spent more time on the interaction, mainly scrolling. On the other hand, the high health literacy group made more use of the address bar and the functionality of selecting the URL text. On the search engine results page, this group made more right-clicks. At the level of reformulations, which occur in the context of the same need for information, users with low health literacy used more "totally new" reformulations, that is, without terms in common with the previous question. In turn, the high health literacy group did more reformulations

The Search as Learning Spaceship: Toward a Comprehensive Model of Psychological and Technological Facets of Search as Learning

Using a Web search engine is one of today’s most frequent activities. Exploratory search activities which are carried out in order to gain knowledge are conceptualized and denoted as Search as Learning (SAL). In this paper, we introduce a novel framework model which incorporates the perspective of both psychology and computer science to describe the search as learning process by reviewing recent literature. The main entities of the model are the learner who is surrounded by a specific learning context, the interface that mediates between the learner and the information environment, the information retrieval (IR) backend which manages the processes between the interface and the set of Web resources, that is, the collective Web knowledge represented in resources of different modalities. At first, we provide an overview of the current state of the art with regard to the five main entities of our model, before we outline areas of future research to improve our understanding of search as learning processes. Copyright © 2022 von Hoyer, Hoppe, Kammerer, Otto, Pardi, Rokicki, Yu, Dietze, Ewerth and Holtz

The Search as Learning Spaceship: Toward a Comprehensive Model of Psychological and Technological Facets of Search as Learning

Using a Web search engine is one of today’s most frequent activities. Exploratory search activities which are carried out in order to gain knowledge are conceptualized and denoted as Search as Learning (SAL). In this paper, we introduce a novel framework model which incorporates the perspective of both psychology and computer science to describe the search as learning process by reviewing recent literature. The main entities of the model are the learner who is surrounded by a specific learning context, the interface that mediates between the learner and the information environment, the information retrieval (IR) backend which manages the processes between the interface and the set of Web resources, that is, the collective Web knowledge represented in resources of different modalities. At first, we provide an overview of the current state of the art with regard to the five main entities of our model, before we outline areas of future research to improve our understanding of search as learning processes

A case-based system for lesson plan construction

Planning for teaching imposes a significant burden on teachers, as teachers need to prepare different lesson plans for different classes according to various constraints. Statistical evidence shows that lesson planning in the Malaysian context is done in isolation and lesson plan sharing is limited. The purpose of this thesis is to investigate whether a case-based system can reduce the time teachers spend on constructing lesson plans. A case-based system was designed SmartLP. In this system, a case consists of a problem description and solution pair and an attributevalue representation for the case is used. SmartLP is a synthesis type of CBR system which attempts to create a new solution by combining parts of previous solutions in the adaptation. Five activities in the CBR cycle retrieve, reuse, revise, review and retain are created via three types of design: application, architectural and user interface. The inputs are the requirements and constraints of the curriculum and the student facilities available, and the output is the solution, i.e. appropriate elements of a lesson plan. The retrieval module consists of five types of search advanced search, hierarchical, Boolean, basic and browsing. Solving a problem in this system involves obtaining a problem description, measuring the similarity of the current problem to previous problems stored in a database, retrieving one or more similar cases and attempting to reuse the solution of the retrieved cases, possibly after adaptation. Case adaptation for multiple lesson plans helps teachers to customise the retrieved plan to suit their constraints. This is followed by case revision, which allows users to access and revise their constructed lesson plans in the system. Validation mechanisms, through case verification, ensure that the retained cases are of quality. A formative study was conducted to investigate the effects of SmartLP on performance. The study revealed that all the lesson plans constructed with SmartLP assistance took significantly less time than the control lesson plans constructed without SmartLP assistance, although they might have access to computers and other tools. No significant difference in writing quality, measured by a scoring system, was noticed for the control group, who constructed lesson plans on the same tasks without receiving any assistance. The limitations of SmartLP are indicated and the focus of further research is proposed. Keywords: Case-based system, CBR approach, knowledge acquisition, knowledge representation, case representation, evaluation, lesson planning

Taxonomy of Usage Issues for Consumer-centric Online Health Information Provision

Consumers are increasingly using Internet portals when searching for relevant health information. Despite the broad range of health information portals (HIPs) available, usage problems with such portals are still widely recognized and reported. In this study, we analyzed usage data from an operational health information portal and identified ways in which these problems can be addressed. While previous usage data and log analysis research has focused more on user behaviors, query structures, and human-computer interaction issues, this study covers more comprehensive issues such as content. We describe a taxonomy of usage issues derived from a literature analysis. We describe how we validated and refined the taxonomy based on analyzing the usage data from an operational health portal. Findings from the usage data indicate that a range of content issues exist that lead to unsuccessful searches. The analysis also highlights that users’ ineffective information seeking strategies are not well supported by the system’s design. We use this taxonomy to propose a usage-driven, consumer-centered approach for dynamic improvements of HIPs. We also discuss the study’s limitations and directions for future research

Young people and the evaluation of information on the World Wide Web: Principles, practice and beliefs

A recurrent theme in LIS literature is the tendency of young people not to evaluate rigorously the information with which they come into contact. Although many information literacy models stress the need to take a critical approach, the reality of behaviour is often very different. Recent research conducted in an English high school has explored the importance that teenagers attach to ten particular evaluative criteria. 149 youngsters contributed data via an online questionnaire. Participants felt that information on the Web should be current/topical, free from spelling and grammatical errors and easily verifiable elsewhere but authorship was much less of a priority to them. The findings are likely to be of special relevance to information literacy teachers who are defining priorities for their own programmes