MASELTOV Deliverable D7.1.1: Incidental Learning Framework

This is the first steps towards creating an ‘Incidental learning framework’, and it is a work in progress. It is intended that the Incidental learning framework will facilitate the creation of technology rich learning opportunities for immigrants within cities. The framework will be a descriptive mechanism that permits analysis, a generative tool to support software system design, and it will facilitate the communication of learning design ideas both visually and textually. The framework focuses on incidental learning i.e. learning that is spontaneous and unplanned, in the knowledge domains of interest to the MASELTOV project including health care, culture, and language and information access. However, it provides links and triggers to structured and reflective learning to back up and deepen learning that happens incidentally. This document describes the initial version of the Incidental Learning Framework, presents a few examples of its use, and describes some conclusions and recommendations for work towards the next version of the framework including • Using the framework to develop it, • Extending the literature review, • Gathering evidence about immigrants day-to-day lives, • Running design workshop(s) using the framework

Augmented reality in heritage apps: current trends in Europe

Although augmented reality (AR) has come to play an increasingly important role in a wide range of areas, its use remains rather limited in the realm of heritage education. This paper sets out to analyze which heritage-related apps can be found in Europe that partly or wholly use AR as a tool to help users learn about dierent types of heritage. Our study only identified a limited number of such apps and we used this sample both to paint a portrait of the current state of the question and also to highlight certain observable trends. The results showed that most such apps used AR to reconstruct spaces and buildings, and to a lesser extent, objects. Many of these apps used an academic mode of communication to provide a temporal perspective of monumental and (mainly) historical heritage. The paper also outlines future lines of research dedicated to finding more apps that could be used to increase the current sample size. This would allow for a more comprehensive assessment of such apps from an educational point of view. Several case studies are proffered in order to highlight the keys to successful use of AR in heritage apps

Users' performance of accessible sound-only computer games

This work is conducted at two levels to meet the requirements of this research. The first objective is to develop a better understanding of how to design better sound-only games for a wide range of users. A new theoretical framework has been crafted to achieve this objective (Human Understanding Theory of Novel Games with Simplex, or the HUNGS theory). Such a theory aims to capture the current consensus about user requirements (as far as it is possible to do so) whilst understanding the principles and practices of interactive systems, namely the design of accessible sound-only games. The second objective is to understand better the psychology of intended users of such games. The importance of the present work is to test psychological concepts in the very different and very popular context of computer games. Implications found for users at work or working on serious tasks may not generalize to game players. To achieve the second requirement, a number of existing games were explored before a new game was designed (namely the Totally Lost game), using a range of methods. The Totally Lost game and different versions of the same game have been designed and evaluated based on user experiences

Virtual Heritage: new technologies for edutainment

Cultural heritage represents an enormous amount of information and knowledge. Accessing this treasure chest allows not only to discover the legacy of physical and intangible attributes of the past but also to provide a better understanding of the present. Museums and cultural institutions have to face the problem of providing access to and communicating these cultural contents to a wide and assorted audience, meeting the expectations and interests of the reference end-users and relying on the most appropriate tools available. Given the large amount of existing tangible and intangible heritage, artistic, historical and cultural contents, what can be done to preserve and properly disseminate their heritage significance? How can these items be disseminated in the proper way to the public, taking into account their enormous heterogeneity? Answering this question requires to deal as well with another aspect of the problem: the evolution of culture, literacy and society during the last decades of 20th century. To reflect such transformations, this period witnessed a shift in the museum’s focus from the aesthetic value of museum artifacts to the historical and artistic information they encompass, and a change into the museums’ role from a mere "container" of cultural objects to a "narrative space" able to explain, describe, and revive the historical material in order to attract and entertain visitors. These developments require creating novel exhibits, able to tell stories about the objects and enabling visitors to construct semantic meanings around them. The objective that museums presently pursue is reflected by the concept of Edutainment, Education + Entertainment. Nowadays, visitors are not satisfied with ‘learning something’, but would rather engage in an ‘experience of learning’, or ‘learning for fun’, being active actors and players in their own cultural experience. As a result, institutions are faced with several new problems, like the need to communicate with people from different age groups and different cultural backgrounds, the change in people attitude due to the massive and unexpected diffusion of technology into everyday life, the need to design the visit by a personal point of view, leading to a high level of customization that allows visitors to shape their path according to their characteristics and interests. In order to cope with these issues, I investigated several approaches. In particular, I focused on Virtual Learning Environments (VLE): real-time interactive virtual environments where visitors can experience a journey through time and space, being immersed into the original historical, cultural and artistic context of the work of arts on display. VLE can strongly help archivists and exhibit designers, allowing to create new interesting and captivating ways to present cultural materials. In this dissertation I will tackle many of the different dimensions related to the creation of a cultural virtual experience. During my research project, the entire pipeline involved into the development and deployment of VLE has been investigated. The approach followed was to analyze in details the main sub-problems to face, in order to better focus on specific issues. Therefore, I first analyzed different approaches to an effective recreation of the historical and cultural context of heritage contents, which is ultimately aimed at an effective transfer of knowledge to the end-users. In particular, I identified the enhancement of the users’ sense of presence in VLE as one of the main tools to reach this objective. Presence is generally expressed as the perception of 'being there', i.e. the subjective belief of users that they are in a certain place, even if they know that the experience is mediated by the computer. Presence is related to the number of senses involved by the VLE and to the quality of the sensorial stimuli. But in a cultural scenario, this is not sufficient as the cultural presence plays a relevant role. Cultural presence is not just a feeling of 'being there' but of being - not only physically, but also socially, culturally - 'there and then'. In other words, the VLE must be able to transfer not only the appearance, but also all the significance and characteristics of the context that makes it a place and both the environment and the context become tools capable of transferring the cultural significance of a historic place. The attention that users pay to the mediated environment is another aspect that contributes to presence. Attention is related to users’ focalization and concentration and to their interests. Thus, in order to improve the involvement and capture the attention of users, I investigated in my work the adoption of narratives and storytelling experiences, which can help people making sense of history and culture, and of gamification approaches, which explore the use of game thinking and game mechanics in cultural contexts, thus engaging users while disseminating cultural contents and, why not?, letting them have fun during this process. Another dimension related to the effectiveness of any VLE is also the quality of the user experience (UX). User interaction, with both the virtual environment and its digital contents, is one of the main elements affecting UX. With respect to this I focused on one of the most recent and promising approaches: the natural interaction, which is based on the idea that persons need to interact with technology in the same way they are used to interact with the real world in everyday life. Then, I focused on the problem of presenting, displaying and communicating contents. VLE represent an ideal presentation layer, being multiplatform hypermedia applications where users are free to interact with the virtual reconstructions by choosing their own visiting path. Cultural items, embedded into the environment, can be accessed by users according to their own curiosity and interests, with the support of narrative structures, which can guide them through the exploration of the virtual spaces, and conceptual maps, which help building meaningful connections between cultural items. Thus, VLE environments can even be seen as visual interfaces to DBs of cultural contents. Users can navigate the VE as if they were browsing the DB contents, exploiting both text-based queries and visual-based queries, provided by the re-contextualization of the objects into their original spaces, whose virtual exploration can provide new insights on specific elements and improve the awareness of relationships between objects in the database. Finally, I have explored the mobile dimension, which became absolutely relevant in the last period. Nowadays, off-the-shelf consumer devices as smartphones and tablets guarantees amazing computing capabilities, support for rich multimedia contents, geo-localization and high network bandwidth. Thus, mobile devices can support users in mobility and detect the user context, thus allowing to develop a plethora of location-based services, from way-finding to the contextualized communication of cultural contents, aimed at providing a meaningful exploration of exhibits and cultural or tourist sites according to visitors’ personal interest and curiosity

Simplifying Authoring of Adaptive Hypermedia Structures in an eLearning Context

Full version unavailable due to 3rd party copyright restrictions.In an eLearning context, Adaptive Hypermedia Systems have been developed to improve learning success by increasing learner satisfaction, learning speed, and educational effectiveness. However, creating adaptive eLearning content and structures is still a time consuming and complicated task, in particular if individual lecturers are the intended authors. The way of thinking that is needed to create adaptive structures as well as the workflows is one that lecturers are unaccustomed to. The aim of this research project is to develop a concept that helps authors create adaptive eLearning content and structures, which focuses on its applicability for lecturers as intended authors. The research is targeted at the sequencing of content, which is one of the main aspects of adaptive eLearning. To achieve this aim the problem has been viewed from the author’s side. First, in terms of complexity of thoughts and threads, explanations about content structures have been found in storytelling theory. It also provides insights into how authors work, how story worlds are created, story lines intertwined, and how they are all merged together into one content. This helps us understand how non technical authors create content that is understandable and interesting for recipients. Second, the linear structure of learning content has been investigated to extract all the information that can be used for sequencing purposes. This investigation led to an approach that combines existing models to ease the authoring process for adaptive learning content by relating linear content from different authors and therefore defining interdependencies that delinearise the content structure. The technical feasibility of the authoring methods for adaptive learning content has been proven by the implementation of the essential parts in a research prototype and by authoring content from real life lectures with the prototype’s editor. The content and its adaptive structure obtained by using the concept of this research have been tested with the prototype’s player and monitor. Additionally, authoring aspects of the concept have been shown along with practical examples and workflows. Lastly, the interviewees who took part in expert interviews have agreed that the concept significantly reduces authoring complexity and potentially increases the amount of lecturers that are able to create adaptive content. The concept represents the common and traditional authoring process for linear content to a large extent. Compared to existing approaches the additional work needed is limited, and authors do not need to delve into adaptive structures or other authors’ content structures and didactic approaches

Augmented Reality

Augmented Reality (AR) is a natural development from virtual reality (VR), which was developed several decades earlier. AR complements VR in many ways. Due to the advantages of the user being able to see both the real and virtual objects simultaneously, AR is far more intuitive, but it's not completely detached from human factors and other restrictions. AR doesn't consume as much time and effort in the applications because it's not required to construct the entire virtual scene and the environment. In this book, several new and emerging application areas of AR are presented and divided into three sections. The first section contains applications in outdoor and mobile AR, such as construction, restoration, security and surveillance. The second section deals with AR in medical, biological, and human bodies. The third and final section contains a number of new and useful applications in daily living and learning

Player attitudes to avatar development in digital games: an exploratory study of single-player role-playing games and other genres

Digital games incorporate systems that allow players to customise and develop their controllable in-game representative (avatar) over the course of a game. Avatar customisation systems represent a point at which the goals and values of players interface with the intentions of the game developer forming a dynamic and complex relationship between system and user. With the proliferation of customisable avatars through digital games and the ongoing monetisation of customisation options through digital content delivery platforms it is important to understand the relationship between player and avatar in order to provide a better user experience and to develop an understanding of the cultural impact of the avatar. Previous research on avatar customisation has focused on the users of virtual worlds and massively multiplayer games, leaving single-player avatar experiences. These past studies have also typically focused on one particular aspect of avatar customisation and those that have looked at all factors involved in avatar customisation have done so with a very small sample. This research has aimed to address this gap in the literature by focusing primarily on avatar customisation features in single-player games, aiming to investigate the relationship between player and customisation systems from the perspective of the players of digital games. To fulfill the research aims and objectives, the qualitative approach of interpretative phenomenological analysis was adopted. Thirty participants were recruited using snowball and purposive sampling (the criteria being that participants had played games featuring customisable avatars) and accounts of their experiences were gathered through semi-structured interviews. Through this research, strategies of avatar customisation were explored in order to demonstrate how people use such systems. The shortcomings in game mechanics and user interfaces were highlighted so that future games can improve the avatar customisation experience

Immersive Journalism as Storytelling

"This book sets out cutting-edge new research and examines future prospects on 360-degree video, virtual reality (VR), and augmented reality (AR) in journalism, analyzing and discussing virtual world experiments from a range of perspectives. Featuring contributions from a diverse range of scholars, Immersive Journalism as Storytelling highlights both the opportunities and the challenges presented by this form of storytelling. The book discusses how immersive journalism has the potential to reach new audiences, change the way stories are told, and provide more interactivity within the news industry. Aside from generating deeper emotional reactions and global perspectives, the book demonstrates how it can also diversify and upskill the news industry. Further contributions address the challenges, examining how immersive storytelling calls for reassessing issues of journalism ethics and truthfulness, transparency, privacy, manipulation, and surveillance, and questioning what it means to cover reality when a story is told in virtual reality. Chapters are grounded in empirical data such as content analyses and expert interviews, alongside insightful case studies that discuss Euronews, Nonny de la Peña’s Project Syria, and The New York Times’ NYTVR application. This book is written for journalism teachers, educators, and students, as well as scholars, politicians, lawmakers, and citizens with an interest in emerging technologies for media practice.

Investigating the potential of mobile games as learning environments for independent adult skill development

The research described in this thesis is grounded in the fields of independent adult learning, user experience for mobile applications and game design. It considers the case for mobile game-based learning in the context of informal microlearning and investigates the potential of mobile games to assist the independent skills development of adults. Initial research found that adults expressed positive attitudes towards the idea of learning with a mobile game, while even those who did not use mobile games recreationally appeared positive to using them if they perceived them as an effective way to develop their skills. Guidelines were then developed to inform the design of effective mobile learning games based on theories of adult learning, game-based engagement, mobile usability and mobile game design. These guided the development of a mobile game prototype aimed at assisting adults, speakers of English as a second language, to build their academic vocabulary. To evaluate the effectiveness of the prototype, a mixed methods approach combining quantitative and qualitative data collection instruments was utilised. Player engagement and system usability were measured rather than direct measures of learning outcomes. Overall the results were encouraging since evaluation participants were found to be engaged by the activity and able to easily pick up the game and play. Additionally, qualitative data on participants’ experiences and perceptions were collected, which supported initial research findings on the positive attitudes of adults towards using mobile games for learning. Though caution is recommended when generalising the evaluation results, the potential of mobile games for the independent learning of adults was supported. Overall this research offers a rationale for the use of mobile game-based learning, an insight into the nature of adult learners’ needs and their mobile devices usage patterns, a critical discussion on the type of learning that would be appropriate for the context, a set of guidelines for the design of mobile learning games, and finally a discussion of evaluation methods along with a collection of empirical data on the post-experiential attitudes of adults with regards to mobile games for learning