PRESENCE: A human-inspired architecture for speech-based human-machine interaction

Recent years have seen steady improvements in the quality and performance of speech-based human-machine interaction driven by a significant convergence in the methods and techniques employed. However, the quantity of training data required to improve state-of-the-art systems seems to be growing exponentially and performance appears to be asymptotic to a level that may be inadequate for many real-world applications. This suggests that there may be a fundamental flaw in the underlying architecture of contemporary systems, as well as a failure to capitalize on the combinatorial properties of human spoken language. This paper addresses these issues and presents a novel architecture for speech-based human-machine interaction inspired by recent findings in the neurobiology of living systems. Called PRESENCE-"PREdictive SENsorimotor Control and Emulation" - this new architecture blurs the distinction between the core components of a traditional spoken language dialogue system and instead focuses on a recursive hierarchical feedback control structure. Cooperative and communicative behavior emerges as a by-product of an architecture that is founded on a model of interaction in which the system has in mind the needs and intentions of a user and a user has in mind the needs and intentions of the system

Symbol Emergence in Robotics: A Survey

Humans can learn the use of language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form a symbol system and obtain semiotic skills through their autonomous mental development. Recently, many studies have been conducted on the construction of robotic systems and machine-learning methods that can learn the use of language through embodied multimodal interaction with their environment and other systems. Understanding human social interactions and developing a robot that can smoothly communicate with human users in the long term, requires an understanding of the dynamics of symbol systems and is crucially important. The embodied cognition and social interaction of participants gradually change a symbol system in a constructive manner. In this paper, we introduce a field of research called symbol emergence in robotics (SER). SER is a constructive approach towards an emergent symbol system. The emergent symbol system is socially self-organized through both semiotic communications and physical interactions with autonomous cognitive developmental agents, i.e., humans and developmental robots. Specifically, we describe some state-of-art research topics concerning SER, e.g., multimodal categorization, word discovery, and a double articulation analysis, that enable a robot to obtain words and their embodied meanings from raw sensory--motor information, including visual information, haptic information, auditory information, and acoustic speech signals, in a totally unsupervised manner. Finally, we suggest future directions of research in SER.Comment: submitted to Advanced Robotic

Towards Collaborative Plan Acquisition through Theory of Mind Modeling in Situated Dialogue

Collaborative tasks often begin with partial task knowledge and incomplete initial plans from each partner. To complete these tasks, agents need to engage in situated communication with their partners and coordinate their partial plans towards a complete plan to achieve a joint task goal. While such collaboration seems effortless in a human-human team, it is highly challenging for human-AI collaboration. To address this limitation, this paper takes a step towards collaborative plan acquisition, where humans and agents strive to learn and communicate with each other to acquire a complete plan for joint tasks. Specifically, we formulate a novel problem for agents to predict the missing task knowledge for themselves and for their partners based on rich perceptual and dialogue history. We extend a situated dialogue benchmark for symmetric collaborative tasks in a 3D blocks world and investigate computational strategies for plan acquisition. Our empirical results suggest that predicting the partner's missing knowledge is a more viable approach than predicting one's own. We show that explicit modeling of the partner's dialogue moves and mental states produces improved and more stable results than without. These results provide insight for future AI agents that can predict what knowledge their partner is missing and, therefore, can proactively communicate such information to help their partner acquire such missing knowledge toward a common understanding of joint tasks

Value creation and change in social structures: the role of entrepreneurial innovation from an emergence perspective

Aim: Our aim is to develop a more complete understanding of how processes that entrepreneurs perform interact with wider society and the causal effects of society on entrepreneurial behaviour and vice versa. We aim to show how entrepreneurial agency is put into effect in relation to the disruption of social structure and social change. This has implications for innovation and entrepreneurship policy and practice, and for entrepreneurship theory. We also investigate the role of ‘value’ in these processes. Contribution to the literature Our central argument is that emergent forms (or ‘emergents’) may be short lived (ephemeral) but have causal power on the performance of the actors in the system of inter-relationships in the innovation ecosystem. The emphasis on inter-related social processes and ontological stratification provides theoretical development of extant entrepreneurship theory on new venture creation (by explaining process), effectuation (by linking individualism and holism) and opportunity recognition (by deconstructing opportunity into anticipation, ontology and process). Methodology The paper takes an 'emergence' perspective as a way to understand entrepreneurial processes that give rise to innovation. The anticipation of value and the inter-relationship with social and organisational structures are fundamental to this perspective. A longitudinal analysis of a case study of the development of a new business model within an entrepreneurial firm is described. The case is followed through seven phases in which the relationship between process and emergent ontological status is shown to have destabilising and stabilising effects which produce emergent properties. Results and Implications One methodological contribution is framing how to conceptualise the empirical evidence. Emergents have causal effects on the anticipations of value inherent in their particular system of innovation. This causality is manifest as the attraction of resource in the firm; the stabilisation of the emergent constitutes strategy in the enterprise. A key role of the entrepreneurs in our case study was the creation and maintenance of evolving ontological materiality, as meaningful to themselves and to those with whom they interacted. In simple terms, they made things meaningful to people who mattered

Sustainable Development and Integral Ecology: The Philippine Ecological Experience

Two of the most important concepts that are related to environmental care and our present ecological situation are sustainable development and integral ecology. Pope Francis in his encyclical letter Laudato Si’ focused on these concepts and stressed the need to safeguard our environment to ensure that while we meet the needs of the present generation we also do not compromise the needs of the future generation. He proposes a development that is both sustainable and integral, a development that is authentically just and for the common good. In this paper I discuss the ideals of sustainable development and integral ecology as expounded by various scholars and from both the western and oriental perspectives and as discussed in Pope Francis’ Laudato Si’. The last section of the paper highlights the Philippine ecological situation to serve not as an ideal but a kind of mirror as to what is happening in a developing country like the Philippines which is situated in an area where different ecological factors converge. The Philippines has always been at the center of the many ecological crises mainly because of human and natural factors. In the end, I stress that sustainable development must be premised on integral ecology and this should be the case not only in the Philippines but in the entire planet

The evolution of pedagogic models for work-based learning within a virtual university

The process of designing a pedagogic model for work-based learning within a virtual university is not a simple matter of using ‘off the shelf’ good practice. Instead, it can be characterised as an evolutionary process that reflects the backgrounds, skills and experiences of the project partners. Within the context of a large-scale project that was building a virtual university for work-based learners, an ambitious goal was set: to base the development of learning materials on a pedagogic model that would be adopted across the project. However, the reality proved to be far more complex than simply putting together an appropriate model from existing research evidence. Instead, the project progressed through a series of redevelopments, each of which was pre-empted by the involvement of a different team from within the project consortium. The pedagogic models that evolved as part of the project will be outlined, and the reasons for rejecting each will be given. They moved from a simple model, relying on core computer-based materials (assessed by multiple choice questions with optional work-based learning), to a more sophisticated model that integrated different forms of learning. The challenges that were addressed included making learning flexible and suitable for work-based learning, the coherence of accreditation pathways, the appropriate use of the opportunities provided by online learning and the learning curves and training needs of the different project teams. Although some of these issues were project-specific (being influenced by the needs of the learners, the aims of the project and the partners involved), the evolutionary process described in this case study illustrates that there can be a steep learning curve for the different collaborating groups within the project team. Whilst this example focuses on work-based learning, the process and the lessons may equally be applicable to a range of learning scenarios