Visually Explaining Uncertain Price Predictions in Agrifood: A User-Centred Case-Study

The rise of ‘big data’ in agrifood has increased the need for decision support systems that harvest the power of artificial intelligence. While many such systems have been proposed, their uptake is limited, for example because they often lack uncertainty representations and are rarely designed in a user-centred way. We present a prototypical visual decision support system that incorporates price prediction, uncertainty, and visual analytics techniques. We evaluated our prototype with 10 participants who are active in different parts of agrifood. Through semi-structured interviews and questionnaires, we collected quantitative and qualitative data about four metrics: usability, usefulness and needs, model understanding, and trust. Our results reveal that the first three metrics can directly and indirectly affect appropriate trust, and that perception differences exist between people with diverging experience levels in predictive modelling. Overall, this suggests that user-centred approaches are key for increasing uptake of visual decision support systems in agrifood

Preface to Proceedings of the 1st Workshop on Recommender Systems in Technology Enhanced Learning (RecSysTEL 2010)

AbstractTechnology enhanced learning (TEL) aims to design, develop and test socio-technical innovations that will support and enhance learning practices of both individuals and organisations. It is an application domain that generally addresses all types of technology research & development aiming to support teaching and learning activities. Information retrieval is a pivotal activity in TEL, and the deployment of recommender systems has attracted increased interest during the past years.Recommendation methods, techniques and systems open an interesting new approach to facilitate and support learning and teaching. There are plenty of resources available on the Web, both in terms of digital learning content and people resources (e.g. other learners, experts, tutors) that can be used to facilitate teaching and learning tasks. The challenge is to develop, deploy and evaluate systems that provide learners and teachers with meaningful guidance in order to help identify suitable learning resources from a potentially overwhelming variety of choices.The 1st Workshop on Recommender Systems for Technology Enhanced Learning (RecSysTEL) builds upon the tradition of a series of workshops on Social Information Retrieval for Technology Enhanced Learning (SIRTEL), Context-Aware Recommendation for Learning and Towards User Modelling and Adaptive Systems for All (TUMAS-A)a. RecSysTEL was organised jointly by the 4th ACM Conference on Recommender Systems (RecSys 2010) and the 5th European Conference on Technology Enhanced Learning (EC-TEL 2010), on 29–30 September 2010 in Barcelona, Spain. Its main goal was to bring together researchers and practitioners who are working on topics related to the design, development and testing of recommender systems in educational settings as well as present the current status of research in this area and create cross-disciplinary liaisons between the RecSys and ECTEL communities. Overall, its contributions outline the rich potential of TEL as an application area for recommender systems and identify the challenges of developing such systems in a TEL context

Towards a Comprehensive Human-Centred Evaluation Framework for Explainable AI

While research on explainable AI (XAI) is booming and explanation techniques have proven promising in many application domains, standardised human-centred evaluation procedures are still missing. In addition, current evaluation procedures do not assess XAI methods holistically in the sense that they do not treat explanations' effects on humans as a complex user experience. To tackle this challenge, we propose to adapt the User-Centric Evaluation Framework used in recommender systems: we integrate explanation aspects, summarise explanation properties, indicate relations between them, and categorise metrics that measure these properties. With this comprehensive evaluation framework, we hope to contribute to the human-centred standardisation of XAI evaluation.Comment: This preprint has not undergone any post-submission improvements or corrections. This work was an accepted contribution at the XAI world Conference 202

Panorama of Recommender Systems to Support Learning

This chapter presents an analysis of recommender systems in TechnologyEnhanced Learning along their 15 years existence (2000-2014). All recommender systems considered for the review aim to support educational stakeholders by personalising the learning process. In this meta-review 82 recommender systems from 35 different countries have been investigated and categorised according to a given classification framework. The reviewed systems have been classified into 7 clusters according to their characteristics and analysed for their contribution to the evolution of the RecSysTEL research field. Current challenges have been identified to lead the work of the forthcoming years.Hendrik Drachsler has been partly supported by the FP7 EU Project LACE (619424). Katrien Verbert is a post-doctoral fellow of the Research Foundation Flanders (FWO). Olga C. Santos would like to acknowledge that her contributions to this work have been carried out within the project Multimodal approaches for Affective Modelling in Inclusive Personalized Educational scenarios in intelligent Contexts (MAMIPEC -TIN2011-29221-C03-01). Nikos Manouselis has been partially supported with funding CIP-PSP Open Discovery Space (297229

Learning Analytics Dashboards

status: publishe

Dataset-driven research for improving recommender systems for learning

Verbert, K., Drachsler, H., Manouselis, N., Wolpers, M., Vuorikari, R., & Duval, E. (2011). Dataset-driven research for improving recommender systems for learning. In Ph. Long, & G. Siemens (Eds.), Proceedings of 1st International Conference Learning Analytics & Knowledge (pp. 44-53). February, 27-March, 1, 2011, Banff, Alberta, Canada. http://dl.acm.org/citation.cfm?id=2090122&CFID=77368864&CFTOKEN=72282583In the world of recommender systems, it is a common practice to use public available datasets from different application environments (e.g. MovieLens, Book-Crossing, or EachMovie) in order to evaluate recommendation algorithms. These datasets are used as benchmarks to develop new recommendation algorithms and to compare them to other algorithms in given settings. In this paper, we explore datasets that capture learner interactions with tools and resources. We use the datasets to evaluate and compare the performance of different recommendation algorithms for Technology Enhanced Learning (TEL). We present an experimental comparison of the accuracy of several collaborative filtering algorithms applied to these TEL datasets and elaborate on implicit relevance data, such as downloads and tags, that can be used to augment explicit relevance evidence in order to improve the performance of recommendation algorithms.dataTEL, STELLAR, AlterEgo, VOA3

Designing Augmented Reality Applications for Personal Health Decision-Making

Augmented reality (AR) is a technology that can assist with our daily decision-making tasks by presenting information that extends the physical world. However, little work has been done to understand the effect of the layout of AR interfaces on decision-making. In this paper, we present PHARA, an AR-based personal assistant that supports decision-making for healthier food products. In a controlled user study (n=28), we explored the use of four different AR layouts on two different devices: Microsoft HoloLens and smartphone. Using subjective and objective means, we measured their effects on decision-making tasks that occur when people hold food products in their hands. We found that pie and grid layouts perform better on the smartphone, whereas a stacked layout works better on the reduced field-of-view of the Microsoft HoloLens, potentially at the cost of some affordances such as time spent and actions

Tracking Data in Open Learning Environments

The collection and management of learning traces, metadata about actions that students perform while they learn, is a core topic in the domain of Learning Analytics. In this paper, we present a simple architecture for collecting and managing learning traces. We describe requirements, different components of the architecture, and our experiences with the successful deployment of the architecture in two different case studies: a blended learning university course and an enquiry based learning secondary school course. The architecture relies on trackers, collecting agents that fetch data from external services, for flexibility and configurability. In addition, we discuss how our architecture meets the requirements of different learning environments, critical reflections and remarks on future work

Communicating Uncertainty in Digital Humanities Visualization Research

Due to their historical nature, humanistic data encompass multiple sources of uncertainty. While humanists are accustomed to handling such uncertainty with their established methods, they are cautious of visualizations that appear overly objective and fail to communicate this uncertainty. To design more trustworthy visualizations for humanistic research, therefore, a deeper understanding of its relation to uncertainty is needed. We systematically reviewed 126 publications from digital humanities literature that use visualization as part of their research process, and examined how uncertainty was handled and represented in their visualizations. Crossing these dimensions with the visualization type and use, we identified that uncertainty originated from multiple steps in the research process from the source artifacts to their datafication. We also noted how besides known uncertainty coping strategies, such as excluding data and evaluating its effects, humanists also embraced uncertainty as a separate dimension important to retain. By mapping how the visualizations encoded uncertainty, we identified four approaches that varied in terms of explicitness and customization. This work contributes with two empirical taxonomies of uncertainty and it's corresponding coping strategies, as well as with the foundation of a research agenda for uncertainty visualization in the digital humanities. Our findings further the synergy among humanists and visualization researchers, and ultimately contribute to the development of more trustworthy, uncertainty-aware visualizations