A Research Agenda for Hybrid Intelligence:Augmenting Human Intellect With Collaborative, Adaptive, Responsible, and Explainable Artificial Intelligence

We define hybrid intelligence (HI) as the combination of human and machine intelligence, augmenting human intellect and capabilities instead of replacing them and achieving goals that were unreachable by either humans or machines. HI is an important new research focus for artificial intelligence, and we set a research agenda for HI by formulating four challenges

Spatial Acumen in the Digital Age: The Transformative Power of STEM-Enriched Mobile Textbooks in Geography

Integrating technology into learning has become a pivotal necessity in the digital age. This underscores the imperative for educators, serving as facilitators, to organize and implement digital technology within instructional processes adeptly. Central to this application is educators’ perceptions of the utilization of mobile digital textbooks. Crucially, this study, rooted in a qualitative research design, sought to elucidate teachers’ perceptions regarding the employment of the Mobile Digital Textbook, integrated with a STEM approach, to enhance students’ spatial thinking and Higher-Order Thinking Skills (HOTS). Data collection was meticulously executed through semi-structured interviews involving fifteen geography educators from eight East Java, Indonesia, secondary institutions. With the aid of NVIVO software, the data were systematically organized and categorized based on pre-established criteria. The findings revealed a predominantly positive perception among the fifteen participants towards using the Mobile Digital Textbook with the STEM approach in fostering students’ spatial thinking and HOTS. The implications of this research underscore the significance of continuous training and support for educators in assimilating digital technology, particularly mobile digital textbooks, to elevate instructional quality and cultivate students’ advanced cognitive abilities

Communication, Machines & Human Augmentics

This essay reformulates the question of human augmentation as a problem of advanced human-machine communication, theorizing that such communication implies robust artificial intelligence and necessitates understanding the relational role new technologies play in human-machine communication. We focus on the questions, “When do electronic tools cease to be ‘simply’ tools, and become meaningfully part of ourselves,” and, “When might we think of these tools as augmenting our selves, rather than simply amplifying our capabilities?” These questions, already important to the medical and rehabilitative fields, loom larger with increasing commodification of pervasive augmentation technologies, and indicate the verge on which human-machine communication now finds itself. Through analyses of human and machine agency, mediated through a theory of close human-machine communication, we argue that the critical element in discussions of human-machine communication is an increase in sense of agency, extending the traditional human-computer interface dictum to provide an internal locus of control

The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms

Recently, the HCI community has seen increased interest in the design of teaching augmentation (TA): tools that extend and complement teachers' pedagogical abilities during ongoing classroom activities. Examples of TA systems are emerging across multiple disciplines, taking various forms: e.g., ambient displays, wearables, or learning analytics dashboards. However, these diverse examples have not been analyzed together to derive more fundamental insights into the design of teaching augmentation. Addressing this opportunity, we broadly synthesize existing cases to propose the TA framework. Our framework specifies a rich design space in five dimensions, to support the design and analysis of teaching augmentation. We contextualize the framework using existing designs cases, to surface underlying design trade-offs: for example, balancing actionability of presented information with teachers' needs for professional autonomy, or balancing unobtrusiveness with informativeness in the design of TA systems. Applying the TA framework, we identify opportunities for future research and design.Comment: to be published in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 17 pages, 10 figure

Exploring Potentially Abusive Ethical, Social and Political Implications of Mixed Reality Research in HCI

In recent years, Mixed Reality (MR) headsets have increasingly made advances in terms of capability, affordability and end-user adoption, slowly becoming everyday technology. HCI research typically explores positive aspects of these technologies, focusing on interaction, presence and immersive experiences. However, such technological advances and paradigm shifts often fail to consider the ``dark patterns'', with potential abusive scenarios, made possible by new technologies (cf. smartphone addiction, social media anxiety disorder). While these topics are getting recent attention in related fields and with the general population, this workshop is aimed at starting an active exploration of abusive, ethical, social and political scenarios of MR research inside the HCI community. With an HCI lens, workshop participants will engage in critical reviews of emerging MR technologies and applications and develop a joint research agenda to address them

Human-centered augmented translation: against antagonistic dualisms

Industry commentators have recently proposed the concept of ‘augmented translation’. Drawing on the notions of ‘antagonistic dualisms’ and ‘human-centered artificial intelligence’ (HCAI), this paper considers various definitions of ‘augmentation’ from an augmented cognition standpoint including definitions focussing on problem-solving, interdisciplinary field theories, and cognition supported by sensing technologies and AI. It is suggested that translation has been an augmented activity for some decades now. However, according to other views of augmented cognition, the level of augmentation is low in comparison to what could theoretically be achieved if the sensing and technological mitigations envisaged for augmented cognition could be realised. Translation technology has not been driven by an empowerment or intelligence amplification (IA) agenda, but by an emulation and artificial intelligence (AI) agenda. The mechanisms, technical and ethical challenges of achieving augmented translation, beyond what is currently in place in translation tools, are tentatively explored. It is, in conclusion, suggested that the HCAI focus on intelligence amplification rather than on replacement of human ability, on a move from emulation to empowerment, is pointing the way forward

Cognitive Heat: Exploring the Usage of Thermal Imaging to Unobtrusively Estimate Cognitive Load

Current digital systems are largely blind to users’ cognitive states. Systems that adapt to users’ states show great potential for augmenting cognition and for creating novel user experiences. However, most approaches for sensing cognitive states, and cognitive load specifically, involve obtrusive technologies, such as physiological sensors attached to users’ bodies. This paper present an unobtrusive indicator of the users’ cognitive load based on thermal imaging that is applicable in real-world. We use a commercial thermal camera to monitor a person’s forehead and nose temperature changes to estimate their cognitive load. To assess the effect of different levels of cognitive load on facial temperature we conducted a user study with 12 participants. The study showed that different levels of the Stroop test and the complexity of reading texts affect facial temperature patterns, thereby giving a measure of cognitive load. To validate the feasibility for real-time assessments of cognitive load, we conducted a second study with 24 participants, we analyzed the temporal latency of temperature changes. Our system detected temperature changes with an average latency of 0.7 seconds after users were exposed to a stimulus, outperforming latency in related work that used other thermal imaging techniques. We provide empirical evidence showing how to unobtrusively detect changes in cognitive load in real-time. Our exploration of exposing users to different content types gives rise to thermal-based activity tracking, which facilitates new applications in the field of cognition-aware computing

Gapeau: Enhancing the Sense of Distance to Others with a Head-Mounted Sensor

Human perception lacks the capabilities to accurately assess distance. The recent Covid-19 pandemic outbreak rendered this ability particularly important. Augmenting our sense of distance can help maintain safe separation from others when required. To explore how systems can help users maintain physical distance, we designed, implemented and evaluated Gapeau - a head-mounted system for augmenting the sense of distance. Our system uses proximity sensors and thermal sensing to detect and measure the distance to other people. We conducted a validation protocol, an experiment, in which we compared different feedback modalities, and an in-the-wild study to evaluate Gapeau\u27s performance and suitability for use in social contexts. We found that our system enabled users to more accurately determine whether they were maintaining a safe distance from others. Vibration and auditory feedback were found most effective and usable. Gapeau was perceived as socially acceptable. Our work contributes insights for augmented sensing systems with social relevance