Towards an Indexical Model of Situated Language Comprehension for Cognitive Agents in Physical Worlds

We propose a computational model of situated language comprehension based on the Indexical Hypothesis that generates meaning representations by translating amodal linguistic symbols to modal representations of beliefs, knowledge, and experience external to the linguistic system. This Indexical Model incorporates multiple information sources, including perceptions, domain knowledge, and short-term and long-term experiences during comprehension. We show that exploiting diverse information sources can alleviate ambiguities that arise from contextual use of underspecific referring expressions and unexpressed argument alternations of verbs. The model is being used to support linguistic interactions in Rosie, an agent implemented in Soar that learns from instruction.Comment: Advances in Cognitive Systems 3 (2014

Referential precedents in spoken language comprehension: a review and meta-analysis

Listeners’ interpretations of referring expressions are influenced by referential precedents—temporary conventions established in a discourse that associate linguistic expressions with referents. A number of psycholinguistic studies have investigated how much precedent effects depend on beliefs about the speaker’s perspective versus more egocentric, domain-general processes. We review and provide a meta-analysis of visual-world eyetracking studies of precedent use, focusing on three principal effects: (1) a same speaker advantage for maintained precedents; (2) a different speaker advantage for broken precedents; and (3) an overall main effect of precedents. Despite inconsistent claims in the literature, our combined analysis reveals surprisingly consistent evidence supporting the existence of all three effects, but with different temporal profiles. These findings carry important implications for existing theoretical explanations of precedent use, and challenge explanations based solely on the use of information about speakers’ perspectives

e-Pedagogy: the pedagogies of e-learning

The aim of this research was to establish effective e-learning practice in higher education. This was achieved by looking at examples of different pedagogic techniques employed in several cases. The effectiveness of these techniques was established by looking at the students' outcomes on these courses. This study has adopted a sequential mixed methodology characterized by an initial phase of qualitative data collection and analysis, which was followed by a phase of quantitative data collection and analysis. The first phase of the study involved collecting a year of data from a postgraduate programme. A grounded approach was used to analyse one million words of online conferences or discussions, and led to the emergence of 29 pedagogic behaviours. These pedagogic behaviours were then developed into a coding instrument. The second phase, hypothetico-deductive analysis, confirmed their presence in three other cases, five million words of online interactions, and established their associations with students' learning and outcomes. The findings suggest seven clusters of pedagogies correlated with students' grades and the effect size calculation revealed an educational significance for all of them. This indicates that if they are employed in online classrooms they are likely to enhance students' learning and outcomes

Challenges in Collaborative HRI for Remote Robot Teams

Collaboration between human supervisors and remote teams of robots is highly challenging, particularly in high-stakes, distant, hazardous locations, such as off-shore energy platforms. In order for these teams of robots to truly be beneficial, they need to be trusted to operate autonomously, performing tasks such as inspection and emergency response, thus reducing the number of personnel placed in harm's way. As remote robots are generally trusted less than robots in close-proximity, we present a solution to instil trust in the operator through a `mediator robot' that can exhibit social skills, alongside sophisticated visualisation techniques. In this position paper, we present general challenges and then take a closer look at one challenge in particular, discussing an initial study, which investigates the relationship between the level of control the supervisor hands over to the mediator robot and how this affects their trust. We show that the supervisor is more likely to have higher trust overall if their initial experience involves handing over control of the emergency situation to the robotic assistant. We discuss this result, here, as well as other challenges and interaction techniques for human-robot collaboration.Comment: 9 pages. Peer reviewed position paper accepted in the CHI 2019 Workshop: The Challenges of Working on Social Robots that Collaborate with People (SIRCHI2019), ACM CHI Conference on Human Factors in Computing Systems, May 2019, Glasgow, U

Turn-boundary projection: Looking ahead

Coordinating with others is hard; and yet we accomplish this every day when we take turns in a conversation. How do we do this? The present study introduces a new method of measuring turn-boundary projection that enables researchers to achieve more valid, flexible, and temporally informative data on online turn projection: tracking an observer’s gaze from the current speaker to the next speaker. In this preliminary investigation, participants consistently looked at the current speaker during their turn. Additionally, they looked to the next speaker before her turn began, and sometimes even before the current speaker finished speaking. This suggests that observer gaze is closely aligned with perceptual processes of turn-boundary projection, and thus may equip the field with the tools to explore how we manage to take turns

The effect of a worked example on online debate quality in an information systems course

The current study investigates the effects of preparing learners for an online debate through a worked example in terms of student perception, participation, level of cognitive skill, and electronic interaction patterns. There has been a change in the focus of distance learning research from comparative media studies to the means to improve the quality of distance education. One of the key elements in this changing impetus are strategies to promote interaction such as the introduction of structure or scaffolding argumentation (McIsaac & Blocher, 1998). One such strategy is the online debate in which students are organized into teams to take a position on an issue and argue on its behalf (Jeong, 2004). The debate is constrained through the addition of rules and specific message headers. Well-designed quality interaction holds the potential to create more satisfied learners and higher quality learning outcomes (Muirhead, 2002), but in the absence of quality, interaction has been found to actually lead to a decrease in satisfaction, participation, and performance (Joung & Keller, 2004; Kreijns, Kirschner, & Jochems, 2002). One way to ensure quality within interactive exercises such as online debate is to prepare students through a worked example. A worked example models an expert’s work and demonstrates desired behaviors for the learner to study (Atkinson, Derry, Renkl, & Wortham, 2000). Students were randomly assigned to teams to participate in an online debate with half being given access to a worked example before participating. In order to examine the effects of the worked example on students’ perceived satisfaction and level of preparedness, a survey was administered at various points throughout the semester. Additionally, debate transcripts were analyzed for participation, cognitive skill, and interaction patterns. The results demonstrate that students prepared through a worked example participated more frequently, wrote more words or phrases that encouraged the participation of others, and used higher-order thinking skills. The conclusion was that worked examples can be used to model behaviors for students to emulate. The implication being that instructors should consider providing worked examples before engaging students in online debate and future research should examine the efficacy of a worked example in preparing learners for other types of interactive activities

The effect of a worked example on online debate quality in an information systems course

The current study investigates the effects of preparing learners for an online debate through a worked example in terms of student perception, participation, level of cognitive skill, and electronic interaction patterns. There has been a change in the focus of distance learning research from comparative media studies to the means to improve the quality of distance education. One of the key elements in this changing impetus are strategies to promote interaction such as the introduction of structure or scaffolding argumentation (McIsaac & Blocher, 1998). One such strategy is the online debate in which students are organized into teams to take a position on an issue and argue on its behalf (Jeong, 2004). The debate is constrained through the addition of rules and specific message headers. Well-designed quality interaction holds the potential to create more satisfied learners and higher quality learning outcomes (Muirhead, 2002), but in the absence of quality, interaction has been found to actually lead to a decrease in satisfaction, participation, and performance (Joung & Keller, 2004; Kreijns, Kirschner, & Jochems, 2002). One way to ensure quality within interactive exercises such as online debate is to prepare students through a worked example. A worked example models an expert’s work and demonstrates desired behaviors for the learner to study (Atkinson, Derry, Renkl, & Wortham, 2000). Students were randomly assigned to teams to participate in an online debate with half being given access to a worked example before participating. In order to examine the effects of the worked example on students’ perceived satisfaction and level of preparedness, a survey was administered at various points throughout the semester. Additionally, debate transcripts were analyzed for participation, cognitive skill, and interaction patterns. The results demonstrate that students prepared through a worked example participated more frequently, wrote more words or phrases that encouraged the participation of others, and used higher-order thinking skills. The conclusion was that worked examples can be used to model behaviors for students to emulate. The implication being that instructors should consider providing worked examples before engaging students in online debate and future research should examine the efficacy of a worked example in preparing learners for other types of interactive activities

Coordination in telephone-based remote interpreting

Telephone-based remote interpreting has come into widespread use in multilingual encounters, all the more so in times of refugee crises and the large influx of asylum-seekers into Europe. Nevertheless, the linguistic practices in this mode of communication have not yet been examined comprehensively. This article therefore investigates selected aspects of turn-taking and clarification sequences during semi-authentic telephone-interpreted counselling sessions for refugees (Arabic–German). A quantitative analysis reveals that limited audibility makes it more difficult for interpreters to claim their turn successfully; in most cases, however, turn-taking occurs smoothly. The trouble sources that trigger queries are mainly content-related and interpreters vary greatly in the ways they deal with such difficulties. Contrary to what one might expect, the study shows that coordination fails only rarely during telephone-based remote interpreting