Simulated role-playing from crowdsourced data

Thesis (Ph. D.)--Massachusetts Institute of Technology, School of Architecture and Planning, Program in Media Arts and Sciences, 2013.Cataloged from PDF version of thesis.Includes bibliographical references (p. 173-178).Collective Artificial Intelligence (CAl) simulates human intelligence from data contributed by many humans, mined for inter-related patterns. This thesis applies CAI to social role-playing, introducing an end-to-end process for compositing recorded performances from thousands of humans, and simulating open-ended interaction from this data. The CAI process combines crowdsourcing, pattern discovery, and case-based planning. Content creation is crowdsourced by recording role-players online. Browser-based tools allow nonexperts to annotate data, organizing content into a hierarchical narrative structure. Patterns discovered from data power a novel system combining plan recognition with case-based planning. The combination of this process and structure produces a new medium, which exploits a massive corpus to realize characters who interact and converse with humans. This medium enables new experiences in videogames, and new classes of training simulations, therapeutic applications, and social robots. While advances in graphics support incredible freedom to interact physically in simulations, current approaches to development restrict simulated social interaction to hand-crafted branches that do not scale to the thousands of possible patterns of actions and utterances observed in actual human interaction. There is a tension between freedom and system comprehension due to two bottlenecks, making open-ended social interaction a challenge. First is the authorial effort entailed to cover all possible inputs. Second, like other cognitive processes, imagination is a bounded resource. Any individual author only has so much imagination. The convergence of advances in connectivity, storage, and processing power is bringing people together in ways never before possible, amplifying the imagination of individuals by harnessing the creativity and productivity of the crowd, revolutionizing how we create media, and what media we can create. By embracing data-driven approaches, and capitalizing on the creativity of the crowd, authoring bottlenecks can be overcome, taking a step toward realizing a medium that robustly supports player choice. Doing so requires rethinking both technology and division of labor in media production. As a proof of concept, a CAI system has been evaluated by recording over 10,000 performances in The Restaurant Game, automating an Al-controlled waitress who interacts in the world, and converses with a human via text or speech. Quantitative results demonstrate how CAI supports significantly more open-ended interaction with humans, while focus groups reveal factors for improving engagement.by Jeffrey David Orkin.Ph.D

An Environment for Stroke Therapy Game Authoring

Stroke is the leading cause of disability in the industrialized world. The disabilities caused by stroke can significantly impact the quality of daily life for stroke survivors. Studies show that a high number of daily body movement repetitions can help recover lost motor functionality. However, many stroke patients do not perform the home exercises needed to reach this high number of repetitions. Games for rehabilitation have been shown to provide motivation to perform home exercises. However, because stroke can leave survivors with different levels of disability, custom games are required. Creating custom games, though, is time consuming and requires advanced programming knowledge. A tool for quick and easy game development is a solution to this problem. In this masterΓÇÖs project, I collaborated with a doctoral occupational therapy student to take steps towards developing a game authoring environment custom to therapists

Developing serious games for cultural heritage: a state-of-the-art review

Although the widespread use of gaming for leisure purposes has been well documented, the use of games to support cultural heritage purposes, such as historical teaching and learning, or for enhancing museum visits, has been less well considered. The state-of-the-art in serious game technology is identical to that of the state-of-the-art in entertainment games technology. As a result, the field of serious heritage games concerns itself with recent advances in computer games, real-time computer graphics, virtual and augmented reality and artificial intelligence. On the other hand, the main strengths of serious gaming applications may be generalised as being in the areas of communication, visual expression of information, collaboration mechanisms, interactivity and entertainment. In this report, we will focus on the state-of-the-art with respect to the theories, methods and technologies used in serious heritage games. We provide an overview of existing literature of relevance to the domain, discuss the strengths and weaknesses of the described methods and point out unsolved problems and challenges. In addition, several case studies illustrating the application of methods and technologies used in cultural heritage are presented

Automating Virtualization of Machinery for enabling efficient Virtual Engineering Methods

Virtual engineering as a new working method in product development should make it much easier to validate the development progress and facilitate team communication. Work steps are brought forward and start with the virtual components instead of real ones. To validate mechanical and electrical CAD as well as programming, automated virtualization systems should create the virtual twin of the machine at the push of a button. For this purpose, generic intelligence is added to enable complex interactive virtual models that can be used for training, monitoring and many other applications. Advanced applications are for example training and support applications, especially in combination with augmented reality and remote collaboration. We propose a system that combines virtual reality, virtual engineering and artificial intelligence methods for the product development process. Geometry analysis algorithms are used to process mechanical CAD data and thus, for example, to automatically parameterize kinematic simulations. In combination with electrical CAD data and the simulations of electric circuits as well as the original machine program allow simulating the behavior of the machine and the user interaction with it. This article will describe the virtualization method in detail and present various use-cases in special machine construction. It will also propose a novel method to use causal discovery in complex machine simulations

Languages of games and play: A systematic mapping study

Digital games are a powerful means for creating enticing, beautiful, educational, and often highly addictive interactive experiences that impact the lives of billions of players worldwide. We explore what informs the design and construction of good games to learn how to speed-up game development. In particular, we study to what extent languages, notations, patterns, and tools, can offer experts theoretical foundations, systematic techniques, and practical solutions they need to raise their productivity and improve the quality of games and play. Despite the growing number of publications on this topic there is currently no overview describing the state-of-the-art that relates research areas, goals, and applications. As a result, efforts and successes are often one-off, lessons learned go overlooked, language reuse remains minimal, and opportunities for collaboration and synergy are lost. We present a systematic map that identifies relevant publications and gives an overview of research areas and publication venues. In addition, we categorize research perspectives along common objectives, techniques, and approaches, illustrated by summaries of selected languages. Finally, we distill challenges and opportunities for future research and development

Empowering Users to Create Augmented Reality-Based Solutions – Deriving Design Principles for No-Code AR Authoring Tools

Grounded on an experimental study with 18 participants, we derive 15 design principles for no-code AR authoring tools in an organizational setting. The study consists of two distinct treatments that aim to augment lightweight processes with AR. The outcomes are two interactive tutorials utilizing AR instructions. Following the no-code approach, the participants were empowered to create relevant AR content using a reduced interface and no need for advanced configurations or coding. The study thus combines two research streams with the aim of better understanding mechanisms for AR use in a professional context. As prior work has shown, despite the potential benefits, the adoption of AR authoring tools is limited because ramping up AR to productive use is heavily dependent on consulting and custom software solutions. Our novel approach bears the potential to broaden application domains and empower professionals to apply AR