Designing intelligent support for learning from and in everyday contexts

Motivation and engagement in learning benefit from a good match of learning settings and materials to individual learner contexts. This includes intrinsic context factors such as prior knowledge and personal interests but also extrinsic factors such as the current environment. Recent developments in adaptive and intelligent technology enable the personalisation of context-aware learning. For example, computer vision algorithms, machine translation, and Augmented Reality make it possible to support the creation of meaningful connections between learners and their context. However, for successful adoption in everyday life, these technologies also need to consider the learner experience. This thesis investigates the design of personalised context-aware learning experiences through the lens of ubiquitous and self-directed language learning as a multi-faceted learning domain. Specifically, it presents and discusses the design, implementation, and evaluation of technology support for learning in and from learners’ everyday contexts with a strong focus on the learner perspective and user experience. The work is guided by four different roles that technology can take on in context-aware ubiquitous learning: For enhancing learning situations, it can (1) sense and (2) trigger in learners’ everyday contexts. For enhancing learning contents, it can (3) augment activities and (4) generate learning material from learner everyday contexts. With regards to the sensing role, the thesis investigates how learners typically use mobile learning apps in everyday contexts. Activity and context logging, combined with experience sampling, confirm that mobile learning sessions spread across the day and occur in different settings. However, they are typically short and frequently interrupted. This indicates that learners may benefit from better integrating learning into everyday contexts, e.g. by supporting task resumption. Subsequently, we explore how this integration could be supported with intelligent triggers linked to opportune moments for learning. We conceptualise and evaluate different trigger types based on interaction patterns and context detection. Our findings show that simple interactions (e.g. plugging in headphones) are promising for capturing both availability and willingness to engage in a learning activity. We discuss how similar interaction triggers could be adapted to match individual habits. In the area of enhancing learning contents, we first investigate how enjoyable everyday activities could be augmented for learning without disrupting these activities. Specifically, we assess the learner experience with interactive grammar support in e-readers and adapted captions for audio-visual media. Participants in our studies felt that the learning augmentations successfully supported their learning process. The information load of the learning support should match the learners’ current needs to maintain the activity flow. Learners may need encouragement to opt for novel concepts optimised for learning (e.g. time-synchronised captions) rather than sticking to habits (e.g. standard captions). Next, the thesis explores learner needs and preferences in generating their own personalised learning material from their context. We design and evaluate automated content generation methods that generate learning opportunities from objects in the learner’s environment. The connection to the learner’s context is established with state-of-the-art technology, such as object detection and Augmented Reality. Through several user studies, we show that learning performance and engagement with auto-generated personalised learning material is comparable to predefined and manually generated content. Findings further indicate that the success of personalisation depends on the effort required to generate content and whether the generation results match the learner’s expectations. Through the different perspectives examined in this thesis, we provide new insights into challenges and opportunities that we synthesise in a framework for context-aware ubiquitous learning technology. The findings also have more general implications for the interaction design of personalised and context-aware intelligent systems. Notably, for the auto-generation of personalised content, it is essential to consider not only correctness from a technological perspective but also how users may perceive the results.Lernmotivation und Engagement profitieren davon, wenn Lernumgebungen und Lernmaterialien auf den individuellen Kontext der Lernenden abgestimmt sind. Dieser umfasst sowohl intrinsische Faktoren wie Vorkenntnisse und persönliche Interessen, aber auch extrinsische Faktoren wie die aktuelle Umgebung. Aktuelle Weiterentwicklungen im Bereich adaptiver und intelligenter Technologien ermöglichen es, Lernen kontextbewusst zu personalisieren. So können mithilfe von Computer-Vision-Algorithmen, maschineller Übersetzung und Augmented Reality sinnvolle Verknüpfungen zwischen Lernenden und ihrem Kontext geschaffen werden. Allerdings müssen diese Technologien für einen erfolgreichen Einsatz im Alltag auch die Lernerfahrung mit einbeziehen. Diese Arbeit untersucht die Gestaltung personalisierter kontextbewusster Lernerfahrungen aus der Perspektive des ubiquitären und self-directed Learning im Sprachenlernen, einem vielseitigen Lernbereich. Insbesondere wird die Konzeption, Implementierung und Evaluierung von Technologieunterstützung für das Sprachenlernen in und aus dem Alltagskontext der Lernenden vorgestellt und diskutiert, wobei der Schwerpunkt auf der Perspektive der Lernenden und der Nutzererfahrung liegt. Die Arbeit orientiert sich an vier verschiedenen Rollen, die Technologie im kontextbewussten Lernen einnehmen kann. Um Lernsituationen anzureichern, kann Technologie im Alltagskontext von Lernenden (1) erfassen und (2) auslösen. Um Lerninhalte anzureichern, kann Technologie aus dem Alltagskontext (3) Aktivitäten augmentieren und (4) Inhalte generieren. Im Hinblick auf die erfassende Rolle von Technologie wird in dieser Arbeit untersucht, wie die Lernenden mobile Lern-Apps in alltäglichen Kontexten nutzen. Die Aufzeichnung von Aktivitäten und Kontexten in Kombination mit Experience Sampling bestätigt, dass Lerneinheiten im mobilen Lernen über den Tag verteilt sind und in verschiedenen Umgebungen stattfinden. Allerdings sind sie in der Regel kurz und werden häufig unterbrochen. Dies deutet darauf hin, dass die Lernenden von einer besseren Integration des Lernens in ihren Alltagskontext profitieren könnten, z. B. durch Unterstützung des Wiedereinstiegs nach einer Unterbrechung. Anschließend untersuchen wir, wie diese Integration durch intelligente Trigger unterstützt werden könnte, die mit passenden Lernzeitpunkten verknüpft sind. Wir konzipieren und evaluieren verschiedene Arten von Triggern auf Basis von Interaktionsmustern und Kontexterkennung. Unsere Ergebnisse zeigen, dass einfache Interaktionen (z. B. das Einstecken von Kopfhörern) vielversprechend dafür sind, sowohl die Verfügbarkeit als auch die Bereitschaft für eine Lernaktivität zu erfassen. Wir diskutieren, wie ähnliche Interaktionstrigger an individuelle Gewohnheiten angepasst werden können. Im Bereich der Augmentierung von Lerninhalten untersuchen wir zunächst, wie unterhaltsame Alltagsaktivitäten für das Lernen aufbereitet werden können, ohne diese Aktivitäten zu beeinträchtigen. Konkret bewerten wir die Lernerfahrung mit interaktiver Grammatikunterstützung in E-Readern und angepassten Untertiteln für audiovisuelle Medien. Die Teilnehmer:innen unserer Studien fanden, dass die Lernunterstützung ihren Lernprozess erfolgreich förderte. Die Informationslast im Lernsystem sollte auf die aktuellen Bedürfnisse der Lernenden angepasst werden, damit das Flow-Erlebnis nicht beeinträchtigt wird. Die Lernenden brauchen möglicherweise Ermutigung dafür, sich für neuartige, lernoptimierte Konzepte zu entscheiden (z. B. zeitsynchrone Untertitel), anstatt an Gewohnheiten festzuhalten (z. B. Standarduntertitel). Als Nächstes werden in dieser Arbeit die Bedürfnisse und Präferenzen der Lernenden bei der Erstellung ihres eigenen personalisierten Lernmaterials aus ihrem Kontext untersucht. Insbesondere werden Methoden zur automatischen Generierung von Inhalten entwickelt und evaluiert, die Lernmöglichkeiten aus Objekten in der Umgebung des Lernenden generieren. Die Verbindung zum Kontext des Lernenden wird durch aktuelle Technologien wie Objekterkennung und Augmented Reality hergestellt. Wir zeigen anhand mehrerer Nutzerstudien, dass die Lernleistung und das Engagement bei automatisch personalisiertem Lernmaterial mit vordefinierten und manuell erstellten Inhalten vergleichbar sind. Die Ergebnisse zeigen außerdem, dass der Erfolg der Personalisierung vom Aufwand abhängt, der für die Erstellung der Inhalte erforderlich ist, und davon, ob die generierten Materialien den Erwartungen der Lernenden entsprechen. Die verschiedenen Perspektiven, die in dieser Arbeit untersucht werden, bieten neue Einblicke in Herausforderungen und Möglichkeiten, die wir in einem Framework für kontextbewusste ubiquitäre Lerntechnologie zusammenfassen. Die Ergebnisse haben auch allgemeinere Auswirkungen auf die Gestaltung der Interaktion mit personalisierten und kontextbewussten intelligenten Systemen. Beispielsweise ist es bei der automatischen Generierung personalisierter Inhalte wichtig, nicht nur die Korrektheit aus technologischer Sicht zu berücksichtigen, sondern auch, wie die Nutzer die Ergebnisse wahrnehmen

Multi-Dimensional-Personalization in mobile contexts

During the dot com era the word "personalisation” was a hot buzzword. With the fall of the dot com companies the topic has lost momentum. As the killer application for UMTS or the mobile internet has yet to be identified, the concept of Multi-Dimensional-Personalisation (MDP) could be a candidate. Using this approach, a recommendation of mobile advertisement or marketing (i.e., recommendations or notifications), online content, as well as offline events, can be offered to the user based on their known interests and current location. Instead of having to request or pull this information, the new service concept would proactively provide the information and services – with the consequence that the right information or service could therefore be offered at the right place, at the right time. The growing availability of "Location-based Services“ for mobile phones is a new target for the use of personalisation. "Location-based Services“ are information, for example, about restaurants, hotels or shopping malls with offers which are in close range / short distance to the user. The lack of acceptance for such services in the past is based on the fact that early implementations required the user to pull the information from the service provider. A more promising approach is to actively push information to the user. This information must be from interest to the user and has to reach the user at the right time and at the right place. This raises new requirements on personalisation which will go far beyond present requirements. It will reach out from personalisation based only on the interest of the user. Besides the interest, the enhanced personalisation has to cover the location and movement patterns, the usage and the past, present and future schedule of the user. This new personalisation paradigm has to protect the user’s privacy so that an approach supporting anonymous recommendations through an extended "Chinese Wall“ will be described

Characteristics of Smartphone Applications for Nutrition Improvement in Community Settings: A Scoping Review

Reproduced by permission of Oxford University Press https://academic.oup.com Copyright © 2019 American Society for NutritionSmartphone applications are increasingly being used to support nutrition improvement in community settings. However, there is a scarcity of practical literature to support researchers and practitioners in choosing or developing health applications. This work maps the features, key content, theoretical approaches, and methods of consumer testing of applications intended for nutrition improvement in community settings. A systematic, scoping review methodology was used to map published, peer-reviewed literature reporting on applications with a specific nutrition-improvement focus intended for use in the community setting. After screening, articles were grouped into 4 categories: dietary self-monitoring trials, nutrition improvement trials, application description articles, and qualitative application development studies. For mapping, studies were also grouped into categories based on the target population and aim of the application or program. Of the 4818 titles identified from the database search, 64 articles were included. The broad categories of features found to be included in applications generally corresponded to different behavior change support strategies common to many classic behavioral change models. Key content of applications generally focused on food composition, with tailored feedback most commonly used to deliver educational content. Consumer testing before application deployment was reported in just over half of the studies. Collaboration between practitioners and application developers promotes an appropriate balance of evidence-based content and functionality. This work provides a unique resource for program development teams and practitioners seeking to use an application for nutrition improvement in community settings

Obesity prevention in infants using m-Health: the Growing Healthy program

About one quarter of Australian pre-school children are overweight. Early childhood is an important period for establishing behaviours that will affect weight gain and health across the life course. Early feeding choices, including breast and/or formula, timing of introduction of solids, physical activity and electronic media use among infants and young children are considered likely determinants of childhood obesity. Parents play a primary role in shaping these behaviours through parental modelling, feeding styles and the food and physical activity environments provided. Children from low socio-economic backgrounds have higher rates of obesity making early intervention particularly important. However, such families are often more difficult to reach and may be less likely to participate in traditional programs that support healthy behaviours. Parents across all socio-demographic groups frequently access primary health care (PHC) services including nurses in community health services and general practices, providing unparalleled opportunity for engagement to influence family behaviours. One emerging and promising area that might maximise engagement at a low cost is the provision of support for healthy parenting through electronic media such as the Internet or smart phones. This is referred to as mobile or m-health. The Growing Healthy study aimed to explore the feasibility of providing information and support for healthy parenting through electronic media in the form of an application for smart phones (app) and a website. Our background research suggested this as an emerging and promising area for engagement with families with young children and may provide a referral option for primary health care providers. It is also an intervention with a relatively low cost and potential for high reach. As families with young children have high levels of engagement with PHC services, these could be leveraged to recruit study participants via referral to the app. Complementing and not replacing the information and support provided by these existing primary health care services was an important objective as was ensuring the online information and support aligned with that provided by primary health care services and national guidelines. The aim was to make the app a ‘trusted source’ of information and support for families with children from birth to nine months of age.The research reported in this paper is a project of the Australian Primary Health Care Research Institute which is supported by a grant from the Australian Government Department of Health and Ageing under the Primary Health Care Research Evaluation and Development Strategy

A case study of MMO2's Madic: A framework for creating mobile internet systems

Mobile Internet applications on ubiquitous mobile networks allows real-time, anywhere, anytime connectivity to services. Due to its scalability and potential cost savings, mobile communication is being increasingly applied in the business and consumer communities to create innovative data and voice application, which run over the Internet infrastructure. This paper reports on a case study at an organisation that created an innovative approach to developing mobile applications developed by third party independent developers. A conceptual wireless reference model is presented that was used to define the various system components required to create effective mobile applications

A User Modeling Shared Challenge Proposal

Comparative evaluation in the areas of User Modeling, Adaptation and Personalization (UMAP) is significantly challenging. It has always been difficult to rigorously compare different approaches to personalization, as the function of the resulting systems is, by their nature, heavily influenced by the behavior of the users involved in trialing the systems. Developing comparative evaluations in this space would be a huge advancement as it would enable shared comparison across research. Here we present a proposal for a shared challenge generation in UMAP, focusing on user model generation using logged mobile phone data, with an assumed purpose of supporting mobile phone notification suggestion. The dataset, evaluation metrics, and challenge operation are described

The Serums Tool-Chain:Ensuring Security and Privacy of Medical Data in Smart Patient-Centric Healthcare Systems

Digital technology is permeating all aspects of human society and life. This leads to humans becoming highly dependent on digital devices, including upon digital: assistance, intelligence, and decisions. A major concern of this digital dependence is the lack of human oversight or intervention in many of the ways humans use this technology. This dependence and reliance on digital technology raises concerns in how humans trust such systems, and how to ensure digital technology behaves appropriately. This works considers recent developments and projects that combine digital technology and artificial intelligence with human society. The focus is on critical scenarios where failure of digital technology can lead to significant harm or even death. We explore how to build trust for users of digital technology in such scenarios and considering many different challenges for digital technology. The approaches applied and proposed here address user trust along many dimensions and aim to build collaborative and empowering use of digital technologies in critical aspects of human society