The construction of mental models of information-rich web spaces: the development process and the impact of task complexity

This study investigated the dynamic process of people constructing mental models of an information-rich web space during their interactions with the system and the impact of task complexity on model construction. In the study, subjects' mental models of MedlinePlus were measured at three time points: after subjects freely explored the system for 5 minutes, after the first search session, and after the second search session. During the first search session, the 39 subjects were randomly divided into two groups; one group completed 12 simple search tasks and the other group completed 3 complex search tasks. During the second search session, all subjects completed a set of 4 simple tasks and 2 complex tasks. Measures of the subjects' mental models included a concept listing protocol, a semi-structured interview, and a drawing task. The analysis revealed that subjects' mental models were a rich representation of the cognitive and emotional processes involved in their interaction with information systems. The mental models consisted of three dimensions (structure, evaluation and emotion, and (expected) behaviors); the structure and evaluation/emotion dimensions consisted of four components each: system, content, information organization, and interface. The construction of mental models was a process coordinated by people's internal cognitive structure and the external sources (the system, system feedback, and tasks) and a process distributed through time, in the sense that earlier mental models impacted later ones. Task complexity also impacted the construction of mental models by influencing what objects in the system were perceived and represented by the user, the specificity of the representations, and the user's feelings about the objects. Based on the study results, recommendations for employing mental models as a tool to assist designers in constructing user models, eliciting user requirements, and performing usability evaluations are put forward

E-Health information seeking behavior of older Finnish adults from the value-based care point of view

Health information seeking behavior is a widely discussed topic in the field of information studies. However, the current study is about observing and evaluating the efficiency of health information seeking behavior through E-Health service and devices. The main reason that motivated the researcher to carry out the current research was high cost of healthcare services in Finland. It is expected that health information obtained through electronic or online sources would help people to improve their health conditions. Therefore, this thesis is an empirical study on observing E-Health information seeking behavior and evaluating the efficiency of E-Health service and devices. In order to estimate the efficiency of E-Health service and products, this study considered some criteria generated by previous studies. These criteria were employed in the current study as indicators of the health information seeking efficiency. The current study developed a customized model of health information seeking behavior based on the general model of information seeking behavior. The model contains some further criteria to measure the efficiency of the information seeking process. The primary tool to collect data were a multiple-choice questionnaire. The questionnaires were distributed through two main methods, namely hard copy and online. The participants in this study were either Finnish older adults who were over 50 years old, or other persons who were responsible for providing health information for them. The results of this study show that using E-Health service and products has neither a positive effect on improving the health condition of patients, nor does it motivate people to a healthier lifestyle, or make them feel more satisfied. However, it is expected that the results provide a framework for further studies to develop more efficient E-Health-related tools and services

Trust and risk in consumer acceptance of e-services

Thesis (Ph.D. (Information Systems))--University of the Witwatersrand, Faculty of Commerce, Law & Management, School of Economic and Business Sciences, 2015Electronic services (or e-services) are defined as any service whose delivery is based on Internet, IT and communications technology, and which incorporates a large self-service component. They offer consumers the promise of increased convenience, lower-cost of transacting, greater choice and accessibility by eliminating space and time constraints to their interactions with service providers. Benefits of e-services cannot however materialize without consumer acceptance. Unfortunately, uncertainty and fears of opportunism still characterize the online context and varying degrees of consumer acceptance and engagement in use of e-services has thus been observed. The extant literature considers consumer perceptions of risk and their trust beliefs amongst the most important psychological states influencing their online behavior. However, despite the number of empirical studies that have explored the effects of trust and risk perceptions on consumer acceptance of e-services, the field remains fragmented and the posited research models are contradictory. For example, the trust-risk relationship has been modeled differently in past studies and the causal relationship between trust and risk perceptions has not been clarified. In addition, research into the antecedents of trust has not been integrated to provide an answer as to which are the most significant antecedents. Furthermore, past research has paid more attention to initial trust or risk perceptions and has not adequately examined whether these perceptions change over time or how they come to influence later stage acceptance of e-services. To address these gaps in our understanding of trust and risk in consumer acceptance of e-services, this thesis adopted three research designs, namely meta-analytic approaches, cross-sectional surveys and longitudinal designs. First, a meta-analytic study1 was used to aggregate empirical findings from across prior studies in e-service. This allowed the nature of the relationship between trust, perceived risk, and acceptance of e-services to be synthesized and for competing nomological models of the trust-risk-acceptance relationship to be compared. 52 studies were examined and it was found that trust is most important to form consumer positive attitude for acceptance. By comparing competing models, it found that trust and risk are significantly related and trust may influence risk in consumer acceptance of e-services. 1 Presented at 34th International Conference on Information Systems (ICIS 2013), Milano, Italy. iv Moderator analysis within the meta-analysis was also carried out to determine if different types of consumer cultures (e.g., Western versus Eastern), different types of e-services (e.g., commercial versus non-commercial), or different objects of trust (e.g., trust in vendor versus trust in website technology) influence the relationships between trust, risk and acceptance of e-services. Furthermore, the antecedents of trust as suggested by past research were examined via a second meta-analysis of 59 prior studies2. The antecedents of trust were classified as vendor and institution-based antecedents, technological-based antecedents, knowledge-based antecedents, and consumer characteristics-based antecedents. Technological-based antecedents were found the most significant antecedents of trust. For all antecedents, studies classified as having been carried out in Eastern cultures reported on average stronger effect sizes than those carried out in Western cultures. In addition to the meta-analytical studies, this thesis also carried out cross-sectional and longitudinal investigations to study trust and risk in an understudied context of e-services, namely consumer acceptance of online health information services. The motivation to adopt this context is because previous studies of e-services were mostly focused on commercial (e.g., e-commerce, e-shopping and e-banking, etc) and mostly on non-commercial context such as e-government. However, e-health services are relatively under-explored. Moreover, the Web has become an important health information dissemination channel. People are increasingly searching for health information online and engaging in the self-management of their health. Trust and risk are considered important to the online health context, and it therefore served as an appropriate e-service context for empirical analysis. Two cross-sectional studies3,4 were carried out to explain user acceptance of online health information services. This cross-sectional work was underpinned by multiple theoretical perspectives namely Theory of Reasoned Action (TRA), Health Belief Model (HBM) and Extended Valence Framework (EVF). Findings showed that multiple dimensions of trust (trust in provider, trust in website and trust in institutional structures) have both direct and indirect effects, via perceived usefulness, on consumer acceptance. 2 Presented at 18th Pacific Asia Conference on Information Systems (PACIS 2014), Chengdu, China. 3 Forthcoming at 35th International Conference on Information Systems (ICIS 2014), Auckland, New Zealand. 4 Forthcoming at 25th Australasian Conference on Information Systems (ACIS 2014), Auckland, New Zealand. v One-dimensional risk was not found to have a significant influence on consumer acceptance. However, multi-dimensional risk (performance risk, psychological risk and time risk) did combine with health belief variables such as perceived susceptibility and severity to influence consumer acceptance. Because cross-sectional data is limited in its ability to address causal connections amongst phenomena, two longitudinal investigations were also carried out. These investigations were used to explain whether trust beliefs and risk perceptions change over time in consumer acceptance of e-services, how early stage trust and risk perceptions influence later stage acceptance and usage behaviors, and whether there is reciprocal causality between trust and risk perceptions. This work was underpinned by TRA and Expectation-Confirmation Theory (ECT), and employed both path modeling and cross-lagged structural equation modeling techniques. The results showed that trust, risk perceptions and perceived usefulness are important to the prediction of consumer acceptance of online health services at both the early and later usage phases5. Furthermore, trust in provider and trust in website have reciprocal relations and empirical data supported the influence of risk perceptions on trust. Through the meta-analytic design, cross-sectional approaches and longitudinal designs, this thesis contributes to research on e-services in a number of ways. First, meta-analytic approaches integrated the available evidence from prior studies, which resulted in the generation of a dataset which was larger in scope and scale than could feasibly be achieved in any single research study. This dataset could then be used to compare competing nomological models found in the literature. In so doing, results have improved our understanding of how trust and risk are related, how they combine to influence consumer acceptance, as well as identifying the most important antecedents of trust. Results provide a benchmark against which future studies can compare their effect sizes. Moreover, by examining the heterogeneity of effect sizes, the meta-analysis has also identified moderators that can account for observed inconsistencies in the effect sizes reported by prior studies. Together, the findings have extended our understanding of how trust and risk relate to e-service acceptance in different e-service contexts, across 5 Presented at 18th Pacific Asia Conference on Information Systems (PACIS 2014), Chengdu, China. vi different consumer cultures, and whether trust in the vendor or technology platform has relatively greater importance to consumers. Second, this thesis also integrated trust into HBM to examine online health information seeking as both a health behavior and online consumer behavior. Results help us better understand this specific case of e-service acceptance. Third, this study is also the first to develop and validate a dynamic trust and risk model in consumer acceptance of online health information services. The longitudinal design integrates trust into the theoretical framework of TRA and ECT to develop the dynamic research model. Tests of the model have made a key contribution to the development of a theory that explains the dynamic nature of e-service acceptance. Furthermore, the cross-lagged longitudinal design contributed to our understanding of the casual relationship between consumers’ trust and risk perceptions in the context of online health information services. Taken together this thesis illustrates how meta-analysis and structural equation modeling can be integrated together to approach the fragmented and contradictory nature of the field. Moreover, this thesis addresses the lack of longitudinal studies on acceptance, and presents a novel method, cross-lagged structural equation modeling, to examine controversial causal relationships within the field of Information Systems. This thesis also has important practical implications. It provides insights into the relative importance of trust and risk perceptions necessary to inform practitioners on risk reduction and trust-building mechanisms. The investigation into the antecedents of trust reveals especially important factors which are within the control of e-service providers. With this understanding, practitioners can be better positioned to establish their online service offerings. Website designers can also benefit from understanding the extent to which particular antecedents of trust (e.g., ease of use and system quality) are important for e-service acceptance. By studying the online health information services context, this thesis has also shed light on the general perceptions and attitudes of consumers towards this high-potential area of e-service

The development of a reference database of health information resources to facilitate informed lifestyle choice

This study investigates, within the current health care situation, the interrelationship of the user, resources and tool in the design of a prototype WELLNESS database-driven web site. A shift has taken place in health care, in which the base of conventional medicine has broadened to integrate other systems, practices and worldviews. These include complementary and alternative medicine, health promotion, disease prevention and wellness. Emphasis is placed on the need to take personal responsibility for one's own health and wellness. The global burden of chronic disease, reaching epidemic proportions, is increasingly linked to risk factors resulting from personal lifestyle choices. The growing evidence of the user's need to make personal, informed, lifestyle choices and their reliance on the Web for health information, required investigation. WELLNESS, a specific orientation to health and wellness, formed the framework within which the user and resources were defined and the tool designed. The user was profiled as the WELLNESS health information seeker, hereby contributing significantly to an understanding of the user in this new context. The user profile informed the establishment of resource selection criteria and tool design. The identification of WELLNESS content selection criteria, within a five-dimensional model, was required to ensure quality, relevant and credible resources. The tool is comprised of the WELLNESS thesaurus and WELLNESS database-driven web site. The WELLNESS thesaurus was constructed based on a combination of relevant thesauri. It will be used as an indexing tool. An investigation of existing health information web sites highlighted the importance of designing a specific WELLNESS database-driven web site. A database host was identified against which the original study's conceptual schema was assessed. A low-fidelity prototype web site was designed as the interface between the WELLNESS health information seeker and the database of WELLNESS health information resources. This study has epidemiological, philosophical, epistemological, sociological and psychological relevance. The provision of access to WELLNESS health information resources, made available in the WELLNESS database-driven web site, for personal, informed lifestyle choice by the WELLNESS health information seeker could potentially contribute to the reduction of the global burden of chronic disease.Information ScienceD.Litt. et Phil. (Information Science

Analysis of the relationships between eye tracking information and text comprehension levels in healthcare

Health information can be found more easily than ever through a variety of digital texts: from health forums online, informative websites, or phone apps that monitor your health. It is important that the patients are able to comprehend this information correctly as it can lead to important decisions regarding their health. However, the average patient will have difficulties understanding digital texts as they contain medical terminology. Reading such content requires multiple cognitive processes and memory to fully grasp the communicated information. The data used in this project comes from an eye tracking experiment involving human subjects reading health related texts and answering questions about these texts. The eye tracking data includes information about the number of eye fixations, fixations’ durations and positions in different areas of interest of the screen. The read paragraph also had different complexities and there were different types of questions. First, a quantitative analysis involving multiple ANOVAs was performed to uncover the effect of different chosen factors. After some feature engineering guided by the previous analysis, machine learning was used to classify whether a participant would answer correctly or not using eye tracking data and variables relative to the text and questions. The initial analysis showed that increasing levels of complexity of the digital text resulted in more eye fixations and longer reading times and that different questions provoked different reading behaviors. More importantly, the random forest classification model was successful with a 96% accuracy thanks to the engineered features, showing that human decisions can almost be predicted using only our eyes’ behaviors

Developing Learning Analytics for Epistemic Commitments in a Collaborative Information Seeking Environment

Learning analytics sits at the confluence of learning, information, and computer sciences. Using a distinctive account of learning analytics as a form of assessment, I first argue for its potential in pedagogically motivated learning design, suggesting a particular construct – epistemic cognition in literacy contexts – to probe using learning analytics. I argue for a recasting of epistemic cognition as ‘epistemic commitments’ in collaborative information tasks drawing a novel alignment between information seeking and multiple document processing (MDP) models, with empirical and theoretical grounding given for a focus on collaboration and dialogue in such activities. Thus, epistemic commitments are seen in the ways students seek, select, and integrate claims from multiple sources, and the ways in which their collaborative dialogue is brought to bear in this activity. Accordingly, the empirical element of the thesis develops two pedagogically grounded literacy based tasks: a MDP task, in which pre-selected documents were provided to students; and a collaborative information seeking task (CIS), in which students could search the web. These tasks were deployed at scale (n > 500) and involved writing an evaluative review, followed by a pedagogically supported peer assessment task. Assessment outcomes were analysed in the context of a new epistemic commitments-oriented set of trace data, and psychometric data regarding the participants’ epistemic cognition. Demonstrating the value of the methodological and conceptual approach taken, qualitative analyses indicate clear epistemic activity, and stark differences in behaviour between groups, the complexity of which is challenging to model computationally. Despite this complexity, quantitative analyses indicate that up to 30% of variance in output scores can be modelled using behavioural indicators. The explanatory potential of behaviourally-oriented models of epistemic commitments grounded in tool-interaction and collaborative dialogue is demonstrated. The thesis provides an exemplification of theoretically positioned analytic development, drawing on interdisciplinary literatures in addressing complex learning contexts

The impact of concept map visualizations on the information behavior, perceptions of performance, learning and use with novices in the information retrieval context

In examining undergraduate students in the information retrieval environment for the impact of computer generated concept maps, two primary research questions were considered: 1) what is the impact of display type on the novice searcher’s information behavior; and 2) what is the impact of different display types on the user’s perceptions of performance, knowledge and overall use of the system.Sixty participants in this experiment were given hypothetical information needs on two different medical topics (cholesterol, depression). Participants’ explored one of three interactive visualization displays using these medical topics, answered a pre- and post-test instrument and then completed a final questionnaire on their perceptions of the displays. Different types of inferential statistical tests were used to examine the research questions. When appropriate, factorial ANOVAs, mixed between-within ANOVAs, and chi square tests of independence were conducted.Five main findings resulted from this research: 1) for all display types (LIST, SOM, PFNET) there is an increase in the number of participant search terms and in the incorporation of MeSH terminology from the visualizations following exposure to those displays; 2) there is a relationship between the display type and the interface level from which PFNET participants chose terms; 3) searchers’ feelings of confidence, satisfaction, success, and relevance increased across all groups after system interaction; however, pretest feelings of confidence and satisfaction seem to be dependent upon the participant’s self-reported prior knowledge of the search topic; 4) feelings of confidence and satisfaction on the topic participants reported less pre-test knowledge on (cholesterol) shifted to match post-test ratings of confidence and satisfaction on the topic they had more pre-test knowledge on (depression); and 5) participants rated the PFNET system more visually appealing, easier to understand and more likely to be used in the future if given the option. Overall findings suggest that all displays were useful to the participants in this experiment and that the PFNET display was particularly useful for the novice searcher.Ph.D., Information Science -- Drexel University, 200

Examining the Design and Usability of Telemedicine Communications: A Mixed-methods Study

This dissertation describes a mixed-methods study that examines the usability of telemedicine provider interfaces. This study consisted of content analysis, survey, and think aloud methodologies, which afford a multifaceted corpus of data for which to draw inferences and identify design features and functions that negatively impact usability. Usability is a critical component of the user experience with a telemedicine provider interface and can suede or impede the acceptance and adoption of telemedicine. Telemedicine has the potential to increase quality healthcare access and positive health outcomes for individuals who use it, and usability is a key component of technology acceptance and effective use. Empirical testing of health information technology (HIT) and telemedicine is advocated for as it is the most valuable method of research to understand humans\u27 cognitive processing of information as they interact with technology. In addition, using activity theory and mobile interface theory as a lens in which to understand human activities and interaction with telemedicine provider interfaces, including the telemedicine provider websites and their mobile-responsive websites in this study, is an effective tool for drawing reasonable inferences regarding the usability of telemedicine communications. Considering the rate at which an unprecedented amount of health information becomes available online and HIT facilitates the delivery of healthcare, usability testing and user-centered, iterative design practices become increasingly essential in order to design effective—and safe—health information and technology that enhance the patient-experience, the affordability and accessibility of healthcare, health literacy and patient empowerment, and positive health outcomes. Usability testing plays an increasingly important role in characterizing obstacles to achieving these initiatives of the modern patient-centered health paradigm and telemedicine. The mixed-methods usability testing performed in this study offers a principled approach to usability testing and is ecologically valid because it involves real human subjects. This study fulfills a void in research on the usability of telemedicine communications and reveals usability problems that may not be anticipated by designers of HIT and health information providers. Drawing from the insight gained from this mixed-method study, design features and functions that enhance the usability of health communications are offered. This study draws insight from the human factors, technical communication, and health and medical fields to develop systematic, practical usability testing methods that can be replicated and applied in many fields. The design recommendations resulting from this study will be valuable to programmers; systems analysts; clinicians and nurses; technical communicators; information architects; visual designers; and others in similar roles

Accessibility of Health Data Representations for Older Adults: Challenges and Opportunities for Design

Health data of consumer off-the-shelf wearable devices is often conveyed to users through visual data representations and analyses. However, this is not always accessible to people with disabilities or older people due to low vision, cognitive impairments or literacy issues. Due to trade-offs between aesthetics predominance or information overload, real-time user feedback may not be conveyed easily from sensor devices through visual cues like graphs and texts. These difficulties may hinder critical data understanding. Additional auditory and tactile feedback can also provide immediate and accessible cues from these wearable devices, but it is necessary to understand existing data representation limitations initially. To avoid higher cognitive and visual overload, auditory and haptic cues can be designed to complement, replace or reinforce visual cues. In this paper, we outline the challenges in existing data representation and the necessary evidence to enhance the accessibility of health information from personal sensing devices used to monitor health parameters such as blood pressure, sleep, activity, heart rate and more. By creating innovative and inclusive user feedback, users will likely want to engage and interact with new devices and their own data