Game-inspired Pedagogical Conversational Agents: A Systematic Literature Review

Pedagogical conversational agents (PCAs) are an innovative way to help learners improve their academic performance via intelligent dialog systems. However, PCAs have not yet reached their full potential. They often fail because users perceive conversations with them as not engaging. Enriching them with game-based approaches could contribute to mitigating this issue. One could enrich a PCA with game-based approaches by gamifying it to foster positive effects, such as fun and motivation, or by integrating it into a game-based learning (GBL) environment to promote effects such as social presence and enable individual learning support. We summarize PCAs that are combined with game-based approaches under the novel term “game-inspired PCAs”. We conducted a systematic literature review on this topic, as previous literature reviews on PCAs either have not combined the topics of PCAs and GBL or have done so to a limited extent only. We analyzed the literature regarding the existing design knowledge base, the game elements used, the thematic areas and target groups, the PCA roles and types, the extent of artificial intelligence (AI) usage, and opportunities for adaptation. We reduced the initial 3,034 records to 50 fully coded papers, from which we derived a morphological box and revealed current research streams and future research recommendations. Overall, our results show that the topic offers promising application potential but that scholars and practitioners have not yet considered it holistically. For instance, we found that researchers have rarely provided prescriptive design knowledge, have not sufficiently combined game elements, and have seldom used AI algorithms as well as intelligent possibilities of user adaptation in PCA development. Furthermore, researchers have scarcely considered certain target groups, thematic areas, and PCA roles. Consequently, our paper contributes to research and practice by addressing research gaps and structuring the existing knowledge base

Adaptive architecture: Regulating human building interaction

In this paper we explore regulatory, technical and interactional implications of Adaptive Architecture, a novel trend emerging in the built environment. We provide a comprehensive description of the emergence and history of the term, with reference to the current state of the art and policy foundations supporting it e.g. smart city initiatives and building regulations. As Adaptive Architecture is underpinned by the Internet of Things (IoT), we are interested in how regulatory and surveillance issues posed by the IoT manifest in buildings too. To support our analysis, we utilise a prominent concept from architecture, Stuart Brand’s Shearing Layers model, which describes the different physical layers of a building and how they relate to temporal change. To ground our analysis, we use three cases of Adaptive Architecture, namely an IoT device (Nest Smart Cam IQ); an Adaptive Architecture research prototype, (ExoBuilding); and a commercial deployment (the Edge). In bringing together Shearing Layers, Adaptive Architecture and the challenges therein, we frame our analysis under 5 key themes. These are guided by emerging information privacy and security regulations. We explore the issues Adaptive Architecture needs to face for: A – ‘Physical & information security’; B – ‘Establishing responsibility’; C – ‘occupant rights over flows, collection, use & control of personal data’; D- ‘Visibility of Emotions and Bodies’; & E – ‘Surveillance of Everyday Routine Activities’. We conclude by summarising key challenges for Adaptive Architecture, regulation and the future of human building interaction

An AI-Based Goal-Oriented Agent for Advanced On-Board Automation

In the context of fierce competition arising in the space economy, the number of satellites and constellations that will be placed in orbit is set to increase considerably in the upcoming years. In such a dynamic environment, raising the autonomy level of the next space missions is key to maintaining a competitive edge in terms of the scientific, technological, and commercial outcome. We propose the adoption of an AI-based autonomous agent aiming to fully enable spacecraft’s goal-oriented autonomy. The implemented cognitive architecture collects input starting from the sensing of the surrounding operating environment and defines a low-level schedule of tasks that will be carried out throughout the specified horizon. Furthermore, the agent provides a planner module designed to find optimal solutions that maximize the outcome of the pursued objective goal. The autonomous loop is closed by comparing the expected outcome of these scheduled tasks against the real environment measurements. The entire algorithmic pipeline was tested in a simulated operational environment, specifically developed for replicating inputs and resources relative to Earth Observation missions. The autonomous reasoning agent was evaluated against the classical, non-autonomous, mission control approach, considering both the quantity and the quality of collected observation data in addition to the quantity of the observation opportunities exploited throughout the simulation time. The preliminary simulation results point out that the adoption of our software agent enhances dramatically the effectiveness of the entire mission, increasing and optimizing in-orbit activities, on the one hand, reducing events\u27 response latency (opportunities, failures, malfunctioning, etc.) on the other. In the presentation, we will cover the description of the high-level algorithmic structure of the proposed goal-oriented reasoning model, as well as a brief explanation of each internal module’s contribution to the overall agent’s architecture. Besides, an overview of the parameters processed as input and the expected algorithms\u27 output will be provided, to contextualize the placement of the proposed solution. Finally, an Earth Observation use case will be used as the benchmark to test the performances of the proposed approach against the classical one, highlighting promising conclusions regarding our autonomous agent’s adoption

Adaptive Architecture:Regulating human building interaction

In this paper, we explore the regulatory, technical and interactional implications of Adaptive Architecture (AA) and how it will recalibrate the nature of human-building interaction. We comprehensively unpack the emergence and history of this novel concept, reflecting on the current state of the art and policy foundations supporting it. As AA is underpinned by the Internet of Things (IoT), we consider how regulatory and surveillance issues posed by the IoT are manifesting in the built environment. In our analysis, we utilise a prominent architectural model, Stuart Brand’s Shearing Layers, to understand temporal change and informational flows across different physical layers of a building. We use three AA applications to situate our analysis, namely a smart IoT security camera; an AA research prototype; and an AA commercial deployment. Focusing on emerging information privacy and security regulations, particularly the EU General Data Protection Regulation 2016, we examine AA from 5 perspectives: physical & information security risks; challenges of establishing responsibility; enabling occupant rights over flows, collection, use & control of personal data; addressing increased visibility of emotions and bodies; understanding surveillance of everyday routine activities. We conclude with key challenges for AA regulation and the future of human–building interaction

Thinking- Skins

Under the guiding concept of a thinking skin, the research project examines the transferability of cyber-physical systems to the application field of façades. It thereby opens up potential increases in the performance of automated and adaptive façade systems and provides a conceptual framework for further research and development of intelligent building envelopes in the current age of digital transformation. The project is characterized by the influence of digital architectural design methods and the associated computational processing of information in the design process. The possible establishment of relationships and dependencies in an architecture understood as a system, in particular, are the starting point for the conducted investigation. With the available automation technologies, the possibility of movable building constructions, and existing computer-based control systems, the technical preconditions for the realisation of complex and active buildings exist today. Against this background, dynamic and responsive constructions that allow adaptations in the operation of the building are a current topic in architecture. In the application field of the building envelope, the need for such designs is evident, particularly with regards to the concrete field of adaptive façades. In its mediating role, the façade is confronted with the dynamic influences of the external microclimate of a building and the changing comfort demands of the indoor climate. The objective in the application of adaptive façades is to increase building efficiency by balancing dynamic influencing factors and requirements. Façade features are diverse and with the increasing integration of building services, both the scope of fulfilled façade functions and the complexity of today’s façades increase. One challenge is the coordination of adaptive functions to ensure effective reactions of the façade as a complete system. The ThinkingSkins research project identifies cyber-physical systems as a possible solution to this challenge. This involves the close integration of physical systems with their digital control. Important features are the decentralized organization of individual system constituents and their cooperation via an exchange of information. Developments in recent decades, such as the miniaturisation of computer technology and the availability of the Internet, have established the technical basis required for these developments. Cyber-physical systems are already employed in many fields of application. Examples are decentralized energy supply, or transportation systems with autonomous vehicles. The influence is particularly evident in the transformation of the industrial sector to Industry 4.0, where formerly mechatronic production plants are networked into intelligent technical systems with the aim of achieving higher and more flexible productivity. In the ThinkingSkins research project it is assumed that the implementation of cyber-physical systems based on the role model of cooperating production plants in IIndustry 4.0 can contribute to an increase in the performance of façades. Accordingly, the research work investigates a possible transfer of cyber-physical systems to the application field of building envelopes along the research question: How can cyber-physical systems be applied to façades, in order to enable coordinated adaptations of networked individual façade functions? To answer this question, four partial studies are carried out, which build upon each other. The first study is based on a literature review, in which the understanding and the state-of-the-art development of intelligent façade systems is examined in comparison to the exemplary field of application of cyber-physical systems in the manufacturing industry. In the following partial study, a second literature search identifies façade functions that can be considered as components of a cyber-physical façade due to their adaptive feasibility and their effect on the façade performance. For the evaluation of the adaptive capabilities, characteristics of their automated and adaptive implementation are assigned to the identified façade functions. The resulting superposition matrix serves as an organizational tool for the third investigation of the actual conditions in construction practice. In a multiple case study, realized façade projects in Germany are examined with regard to their degree of automation and adaptivity. The investigation includes interviews with experts involved in the projects as well as field studies on site. Finally, an experimental examination of the technical feasibility of cyber-physical façade systems is carried out through the development of a prototype. In the sense of an internet of façade functions, the automated adaptive façade functions ventilation, sun protection as well as heating and cooling are implemented in decentrally organized modules. They are connected to a digital twin and can exchange data with each other via a communication protocol. The research project shows that the application field of façades has not yet been exploited for the implementation of cyber-physical systems. With the automation technologies used in building practice, however, many technical preconditions for the development of cyber-physical façade systems already exist. Many features of such a system are successfully implemented within the study by the development of a prototype. The research project therefore comes to the conclusion that the application of cyber-physical systems to the façade is possible and offers a promising potential for the effective use of automation technologies. Due to the lack of artificial intelligence and machine learning strategies, the project does not achieve the goal of developing a façade in the sense of a true ThinkingSkin as the title indicates. A milestone is achieved by the close integration of the physical façade system with a decentralized and integrated control system. In this sense, the researched cyber-physical implementation of façades represents a conceptual framework for the realisation of corresponding systems in building practice, and a pioneer for further research of ThinkingSkins

ThinkingSkins:

New technologies and automation concepts emerge in the digitalization of our environment. This is, for example, reflected by intelligent production systems in Industry 4.0. A core aspect of such systems is their cyber-physical implementation, which aims to increase productivity and flexibility through embedded computing capacities and the cooperation of decentrally networked production plants. This development stage of automation has not yet been achieved in the current state-of-the-art of façades. Being responsible for the execution of adaptive measures, façade automation is part of hierarchically and centrally organised Building Automation Systems (BAS). The research project ThinkingSkins is guided by the hypothesis that, aiming at an enhanced overall building performance, façades can be implemented as cyber-physical systems. Accordingly, it addresses the research question: How can cyber-physical systems be applied to façades, in order to enable coordinated adaptations of networked individual façade functions? The question is approached in four partial investigations. First, a comprehensive understanding of intelligent systems in both application fields, façades and Industry 4.0, is elaborated by a literature review. Subsequently, relevant façade functions are identified by a second literature review in a superposition matrix, which also incorporates characteristics for a detailed assessment of each function’s adaptive capacities. The third investigation focuses on existing conditions in building practice by means of a multiple case study analysis. Finally, the technical feasibility of façades implemented as cyber-physical systems is investigated by developing a prototype. The research project identifies the possibility and promising potential of cyberphysical façades. As result, the doctoral dissertation provides a conceptual framework for the implementation of such systems in building practice and for further research

Engineering Self-Adaptive Collective Processes for Cyber-Physical Ecosystems

The pervasiveness of computing and networking is creating significant opportunities for building valuable socio-technical systems. However, the scale, density, heterogeneity, interdependence, and QoS constraints of many target systems pose severe operational and engineering challenges. Beyond individual smart devices, cyber-physical collectives can provide services or solve complex problems by leveraging a “system effect” while coordinating and adapting to context or environment change. Understanding and building systems exhibiting collective intelligence and autonomic capabilities represent a prominent research goal, partly covered, e.g., by the field of collective adaptive systems. Therefore, drawing inspiration from and building on the long-time research activity on coordination, multi-agent systems, autonomic/self-* systems, spatial computing, and especially on the recent aggregate computing paradigm, this thesis investigates concepts, methods, and tools for the engineering of possibly large-scale, heterogeneous ensembles of situated components that should be able to operate, adapt and self-organise in a decentralised fashion. The primary contribution of this thesis consists of four main parts. First, we define and implement an aggregate programming language (ScaFi), internal to the mainstream Scala programming language, for describing collective adaptive behaviour, based on field calculi. Second, we conceive of a “dynamic collective computation” abstraction, also called aggregate process, formalised by an extension to the field calculus, and implemented in ScaFi. Third, we characterise and provide a proof-of-concept implementation of a middleware for aggregate computing that enables the development of aggregate systems according to multiple architectural styles. Fourth, we apply and evaluate aggregate computing techniques to edge computing scenarios, and characterise a design pattern, called Self-organising Coordination Regions (SCR), that supports adjustable, decentralised decision-making and activity in dynamic environments.Con lo sviluppo di informatica e intelligenza artificiale, la diffusione pervasiva di device computazionali e la crescente interconnessione tra elementi fisici e digitali, emergono innumerevoli opportunità per la costruzione di sistemi socio-tecnici di nuova generazione. Tuttavia, l'ingegneria di tali sistemi presenta notevoli sfide, data la loro complessità—si pensi ai livelli, scale, eterogeneità, e interdipendenze coinvolti. Oltre a dispositivi smart individuali, collettivi cyber-fisici possono fornire servizi o risolvere problemi complessi con un “effetto sistema” che emerge dalla coordinazione e l'adattamento di componenti fra loro, l'ambiente e il contesto. Comprendere e costruire sistemi in grado di esibire intelligenza collettiva e capacità autonomiche è un importante problema di ricerca studiato, ad esempio, nel campo dei sistemi collettivi adattativi. Perciò, traendo ispirazione e partendo dall'attività di ricerca su coordinazione, sistemi multiagente e self-*, modelli di computazione spazio-temporali e, specialmente, sul recente paradigma di programmazione aggregata, questa tesi tratta concetti, metodi, e strumenti per l'ingegneria di ensemble di elementi situati eterogenei che devono essere in grado di lavorare, adattarsi, e auto-organizzarsi in modo decentralizzato. Il contributo di questa tesi consiste in quattro parti principali. In primo luogo, viene definito e implementato un linguaggio di programmazione aggregata (ScaFi), interno al linguaggio Scala, per descrivere comportamenti collettivi e adattativi secondo l'approccio dei campi computazionali. In secondo luogo, si propone e caratterizza l'astrazione di processo aggregato per rappresentare computazioni collettive dinamiche concorrenti, formalizzata come estensione al field calculus e implementata in ScaFi. Inoltre, si analizza e implementa un prototipo di middleware per sistemi aggregati, in grado di supportare più stili architetturali. Infine, si applicano e valutano tecniche di programmazione aggregata in scenari di edge computing, e si propone un pattern, Self-Organising Coordination Regions, per supportare, in modo decentralizzato, attività decisionali e di regolazione in ambienti dinamici

Value Co-Creation in Smart Services: A Functional Affordances Perspective on Smart Personal Assistants

In the realm of smart services, smart personal assistants (SPAs) have become a popular medium for value co-creation between service providers and users. The market success of SPAs is largely based on their innovative material properties, such as natural language user interfaces, machine learning-powered request handling and service provision, and anthropomorphism. In different combinations, these properties offer users entirely new ways to intuitively and interactively achieve their goals and thus co-create value with service providers. But how does the nature of the SPA shape value co-creation processes? In this paper, we look through a functional affordances lens to theorize about the effects of different types of SPAs (i.e., with different combinations of material properties) on users’ value co-creation processes. Specifically, we collected SPAs from research and practice by reviewing scientific literature and web resources, developed a taxonomy of SPAs’ material properties, and performed a cluster analysis to group SPAs of a similar nature. We then derived 2 general and 11 cluster-specific propositions on how different material properties of SPAs can yield different affordances for value co-creation. With our work, we point out that smart services require researchers and practitioners to fundamentally rethink value co-creation as well as revise affordances theory to address the dynamic nature of smart technology as a service counterpart

An adaptive environment for personal information management

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.This dissertation reports the results of research into the provision of adaptive user interfaces to support individuals in the management of their personal information. Many individuals find that they have increased responsibility for managing aspects of their own lives, including the information associated with their jobs. In contrast with traditional approaches to information management, which are generally driven by organisational or business requirements, the requirements of personal information management systems tend to be less rigidly defined. This dissertation employs research from the areas of personal information management and adaptive user interfaces - systems which can monitor how they are used, and adapt on a personal level to their user - to address some of the particular requirements of personal information management systems. An adaptive user interface can be implemented using a variety of techniques, and this dissertation draws on research from the area of software agents to suggest that reactive software agents can be fruitfully applied to realise the required adaptivity. The reactive approach is then used in the specification and development of an adaptive interface which supports simple elements of personal information management tasks. The resulting application is evaluated by means of user trials and a usability inspection, and the theoretical architectures and techniques used in the specification and development of the software are critically appraised. The dissertation demonstrates an application of reactive software agents in adaptive systems design and shows how the behaviour of the system can be specified based on the analysis of some representative personal information management tasks.EPSRC (Award Reference Number 95700906