Cognition-aware systems to support information intake and learning

Knowledge is created at an ever-increasing pace putting us under constant pressure to consume and acquire new information. Information gain and learning, however, require time and mental resources. While the proliferation of ubiquitous computing devices, such as smartphones, enables us to consume information anytime and anywhere, technologies are often disruptive rather than sensitive to the current user context. While people exhibit different levels of concentration and cognitive capacity throughout the day, applications rarely take these performance variations into account and often overburden their users with information or fail to stimulate. This work investigates how technology can be used to help people effectively deal with information intake and learning tasks through cognitive context-awareness. By harvesting sensor and usage data from mobile devices, we obtain people's levels of attentiveness, receptiveness, and cognitive performance. We subsequently use this cognition-awareness in applications to help users process information more effectively. Through a series of lab studies, online surveys, and field experiments we follow six research questions to investigate how to build cognition-aware systems. Awareness of user's variations in levels of attention, receptiveness, and cognitive performance allows systems to trigger appropriate content suggestions, manage user interruptions, and adapt User Interfaces in real-time to match tasks to the user's cognitive capacities. The tools, insights, and concepts described in this book allow researchers and application designers to build systems with an awareness of momentary user states and general circadian rhythms of alertness and cognitive performance

USING TRANSACTION COST ECONOMICS SAFEGUARDING TO REDUCE THE DIFFUSION OF DISINFORMATION ON SOCIAL MEDIA

Human users contribute to the spread of disinformation on Social Media. To reduce the spread, we apply Transaction Cost Economics (TCE) Safeguarding, which penalises the sharing of disinformation. Using the economic theory TCE positions Social Media platforms as free markets, in which actors are motivated to protect their assets and peer reputation. We conducted a study exploring TCE Safeguarding as a market correction mechanism to change the disinformation diffusion behaviour of users. Our findings show that users will be less likely to post a comment and more likely to correct their previous disinformation diffusion actions when TCE Safeguarding is applied. Focusing on Social Media as a market rather than its individual components may provide a mechanism to address the fake news phenomenon

USING TRANSACTION COST ECONOMICS SAFEGUARDING TO REDUCE THE DIFFUSION OF DISINFORMATION ON SOCIAL MEDIA

Human users contribute to the spread of disinformation on Social Media. To reduce the spread, we apply Transaction Cost Economics (TCE) Safeguarding, which penalises the sharing of disinformation. Using the economic theory TCE positions Social Media platforms as free markets, in which actors are motivated to protect their assets and peer reputation. We conducted a study exploring TCE Safeguarding as a market correction mechanism to change the disinformation diffusion behaviour of users. Our findings show that users will be less likely to post a comment and more likely to correct their previous disinformation diffusion actions when TCE Safeguarding is applied. Focusing on Social Media as a market rather than its individual components may provide a mechanism to address the fake news phenomenon

Three Preventative Interventions to Address the Fake News Phenomenon on Social Media

Fake news on social media undermines democracies and civil society. To date the research response has been message centric and reactive. This does not address the problem of fake news contaminating social media populations with disinformation, nor address the fake news producers and disseminators who are predominantly human social media users. Our research proposes three preventative interventions - two that empower social media users and one social media structural change to reduce the spread of fake news. Specifically, we investigate how i) psychological inoculation; ii) digital media literacy and iii) Transaction Cost Economy safeguarding through reputation ranking could elicit greater cognitive elaboration from social media users. Our research provides digital scalable preventative interventions to empower social media users with the aim to reduce the population size exposed to fake news

Building Cognition-Aware Systems: A Mobile Toolkit for Extracting Time-of-Day Fluctuations of Cognitive Performance

People’s alertness fluctuates across the day: at some times we are highly focused while at others we feel unable to concentrate. So far, extracting fluctuation patterns has been time and cost-intensive. Using an in-the-wild approach with 12 participants, we evaluated three cognitive tasks regarding their adequacy as a mobile and economical assessment tool of diurnal changes in mental performance. Participants completed the five-minute test battery on their smartphones multiple times a day for a period of 1-2 weeks. Our results show that people’s circadian rhythm can be obtained under unregulated non-laboratory conditions. Along with this validation study, we release our test battery as an open source library for future work towards cognition-aware systems as well as a tool for psychological and medical research. We discuss ways of integrating the toolkit and possibilities for implicitly measuring performance variations in common applications. The ability to detect systematic patterns in alertness levels will allow cognition-aware systems to provide in-situ assistance in accordance with users’ current cognitive capabilities and limitations

Impact of video summary viewing on episodic memory recall:design guidelines for video summarizations

Reviewing lifelogging data has been proposed as a useful tool to support human memory. However, the sheer volume of data (particularly images) that can be captured by modern lifelogging systems makes the selection and presentation of material for review a challenging task. We present the results of a five-week user study involving 16 participants and over 69,000 images that explores both individual requirements for video summaries and the differences in cognitive load, user experience, memory experience, and recall experience between review using video summarisations and non-summary review techniques. Our results can be used to inform the design of future lifelogging data summarisation systems for memory augmentation

Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load

Current digital systems are largely blind to users’ cognitive states. Systems that adapt to users’ states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing cognitive states, and cognitive load specifically, involve obtrusive technologies, such as physiological sensors attached to users’ bodies. This paper present an unobtrusive indicator of the users’ cognitive load based on thermal imaging that is applicable in real-world. We use a commercial thermal camera to monitor a person’s forehead and nose temperature changes to estimate their cognitive load. To assess the effect of different levels of cognitive load on facial temperature we conducted a user study with 12 participants. The study showed that different levels of the Stroop test and the complexity of reading texts affect facial temperature patterns, thereby giving a measure of cognitive load. To validate the feasibility for real-time assessments of cognitive load, we conducted a second study with 24 participants, we analyzed the temporal latency of temperature changes. Our system detected temperature changes with an average latency of 0.7 seconds after users were exposed to a stimulus, outperforming latency in related work that used other thermal imaging techniques. We provide empirical evidence showing how to unobtrusively detect changes in cognitive load in real-time. Our exploration of exposing users to different content types gives rise to thermal-based activity tracking, which facilitates new applications in the field of cognition-aware computing

Technologies to Support Critical Thinking in an Age of Misinformation (Dagstuhl Seminar 22172)

This report documents the program and the outcomes of Dagstuhl Seminar 22172 "Technologies to Support Critical Thinking in an Age of Misinformation". This seminar brought together experts from computer science, behavioural psychology, journalists, and policy makers to examine and define the challenges of misinformation and fake news in the internet and social networks. This included discussions of what constitutes misinformation, technological advances for both spreading and mitigating misinformation, and discussions around policies that can be created and implemented to address propagators, both active and passive, of misinformation. The goal of this report is to summarize and present the various challenges and options for the development and implementation of technologies to support critical thinking

Learnabiltiy of Sound Cues for Environmental Features: Auditory Icons, Earcons, Spearcons, and Speech

Presented at the 14th International Conference on Auditory Display (ICAD2008) on June 24-27, 2008 in Paris, France.Awareness of features in our environment is essential for many daily activities. While often awareness of such features comes from vision, this modality is sometimes unavailable or undesirable. In these instances, auditory cues can be an excellent method of representing environmental features. The study reported here investigated the learnability of well known (auditory icons, earcons, and speech) and more novel (spearcons, earcon-icon hybrids, and sized hybrids) sonification techniques for representing common environmental features. Spearcons, which are speech stimuli that have been greatly sped up, were found to be as learnable as speech, while earcons unsurprisingly were much more difficult to learn. Practical implications are discussed

Text Priming - Effects of Text Visualizations on Readers Prior to Reading

Part 5: Personalisation and VisualisationInternational audienceLiving in our information society poses the challenge of having to deal with a plethora of information. While most content is represented through text, keyword extraction and visualization techniques allow the processing and adjustment of text presentation to the readers’ individual requirements and preferences. In this paper, we investigate four types of text visualizations and their feasibility to give readers an overview before they actually engage with a text: word clouds, highlighting, mind maps, and image collages. In a user study with 50 participants, we assessed the effects of such visualizations on reading comprehension, reading time, and subjective impressions. Results show that (1) mind maps best support readers in getting the gist of a text, (2) they also give better subjective impressions on text content and structure, and (3) highlighting keywords in a text before reading helps to reduce reading time. We discuss a set of guidelines to inform the design of automated systems for creating text visualizations for reader support