Towards Building Economic Models of Conversational Search

Various conceptual and descriptive models of conversational search have been proposed in the literature -- while useful, they do not provide insights into how interaction between the agent and user would change in response to the costs and benefits of the different interactions. In this paper, we develop two economic models of conversational search based on patterns previously observed during conversational search sessions, which we refer to as: Feedback First where the agent asks clarifying questions then presents results, and Feedback After where the agent presents results, and then asks follow up questions. Our models show that the amount of feedback given/requested depends on its efficiency at improving the initial or subsequent query and the relative cost of providing said feedback. This theoretical framework for conversational search provides a number of insights that can be used to guide and inform the development of conversational search agents. However, empirical work is needed to estimate the parameters in order to make predictions specific to a given conversational search setting.Comment: To appear in ECIR 202

Towards building economic models of conversational search

Various conceptual and descriptive models of conversational search have been proposed in the literature – while useful, they do not provide insights into how interaction between the agent and user would change in response to the costs and benefits of the different interactions. In this paper, we develop two economic models of conversational search based on patterns previously observed during conversational search sessions, which we refer to as: Feedback First where the agent asks clarifying questions then presents results, and Feedback After where the agent presents results, and then asks follow up questions. Our models show that the amount of feedback given/requested depends on its efficiency at improving the initial or subsequent query and the relative cost of providing said feedback. This theoretical framework for conversational search provides a number of insights that can be used to guide and inform the development of conversational search agents. However, empirical work is needed to estimate the parameters in order to make predictions specific to a given conversational search setting

The teacher as action researcher : Using technology to capture pedagogic form

The paper argues that we make best use of learning technologies if we begin with an understanding of educational problems, and use this analysis to target the solutions we should be demanding from technology. The focus is to address the issue from the perspective of teachers and lecturers – the 'teaching community', and to consider how they could become the experimental innovators and reflective practitioners who will use technology well. Teachers could become 'action researchers', collaborating to produce their own development of knowledge about teaching with technology. For this to be possible, they must be able to share that knowledge, and the paper proposes the use of an online learning activity management system (LAMS) as a way of capturing and sharing the pedagogic forms teachers design. An action research approach, like all research, needs a theoretical framework from which to challenge practice, and paper shows how teachers could use the Conversational Framework to design and test an optimally effective learning experience. Examples of 'generic' learning designs illustrate how such approach can help the teaching community rethink their teaching, collectively, and embrace the best of conventional and digital methods. In this way they will be more likely to harness technology to the needs of education, rather than simply search for the problems to which the latest technology is a solution

Conversational Exploratory Search via Interactive Storytelling

Conversational interfaces are likely to become more efficient, intuitive and engaging way for human-computer interaction than today's text or touch-based interfaces. Current research efforts concerning conversational interfaces focus primarily on question answering functionality, thereby neglecting support for search activities beyond targeted information lookup. Users engage in exploratory search when they are unfamiliar with the domain of their goal, unsure about the ways to achieve their goals, or unsure about their goals in the first place. Exploratory search is often supported by approaches from information visualization. However, such approaches cannot be directly translated to the setting of conversational search. In this paper we investigate the affordances of interactive storytelling as a tool to enable exploratory search within the framework of a conversational interface. Interactive storytelling provides a way to navigate a document collection in the pace and order a user prefers. In our vision, interactive storytelling is to be coupled with a dialogue-based system that provides verbal explanations and responsive design. We discuss challenges and sketch the research agenda required to put this vision into life.Comment: Accepted at ICTIR'17 Workshop on Search-Oriented Conversational AI (SCAI 2017

An Analysis of Mixed Initiative and Collaboration in Information-Seeking Dialogues

The ability to engage in mixed-initiative interaction is one of the core requirements for a conversational search system. How to achieve this is poorly understood. We propose a set of unsupervised metrics, termed ConversationShape, that highlights the role each of the conversation participants plays by comparing the distribution of vocabulary and utterance types. Using ConversationShape as a lens, we take a closer look at several conversational search datasets and compare them with other dialogue datasets to better understand the types of dialogue interaction they represent, either driven by the information seeker or the assistant. We discover that deviations from the ConversationShape of a human-human dialogue of the same type is predictive of the quality of a human-machine dialogue.Comment: SIGIR 2020 short conference pape

To what extent could Business Process Management Suite (BPMS) contribute positively to e-learning?

The purpose of this paper is to evaluate the effectiveness of Business Process Management Suite (BPMS) as a teaching-learning technology with the lens of the conversational framework (Laurillard 2002). The paper hopes to link commercial technological development with research in teaching-learning technologies and bring about better collaboration between the two. This theoretical evaluation aims to address the preliminary question - could educational communities adopt BPMS, a tool that has evolved from the commercial world to further enhance teaching-learning process? The scope of this paper and its evaluative study will be limited to using the conversational framework. The paper will briefly discuss BPMS and its relation to business process and business process management to provide a brief introduction. The main section of this paper will be a detailed analysis of key BPMS components against the conversational framework. The conclusion will provide a summary of the effectiveness of BPMS as a teaching-learning tool based on the requirements set out by the conversational framework. The results of the conclusion could lead to further empirical research on BPMS as a teaching-learning technology tool and may be the opportunity to request funding to carry out a proof of concept

Effectiveness of Corporate Social Media Activities to Increase Relational Outcomes

This study applies social media analytics to investigate the impact of different corporate social media activities on user word of mouth and attitudinal loyalty. We conduct a multilevel analysis of approximately 5 million tweets regarding the main Twitter accounts of 28 large global companies. We empirically identify different social media activities in terms of social media management strategies (using social media management tools or the web-frontend client), account types (broadcasting or receiving information), and communicative approaches (conversational or disseminative). We find positive effects of social media management tools, broadcasting accounts, and conversational communication on public perception

Dialogue based interfaces for universal access.

Conversation provides an excellent means of communication for almost all people. Consequently, a conversational interface is an excellent mechanism for allowing people to interact with systems. Conversational systems are an active research area, but a wide range of systems can be developed with current technology. More sophisticated interfaces can take considerable effort, but simple interfaces can be developed quite rapidly. This paper gives an introduction to the current state of the art of conversational systems and interfaces. It describes a methodology for developing conversational interfaces and gives an example of an interface for a state benefits web site. The paper discusses how this interface could improve access for a wide range of people, and how further development of this interface would allow a larger range of people to use the system and give them more functionality