Improving Reachability and Navigability in Recommender Systems

In this paper, we investigate recommender systems from a network perspective and investigate recommendation networks, where nodes are items (e.g., movies) and edges are constructed from top-N recommendations (e.g., related movies). In particular, we focus on evaluating the reachability and navigability of recommendation networks and investigate the following questions: (i) How well do recommendation networks support navigation and exploratory search? (ii) What is the influence of parameters, in particular different recommendation algorithms and the number of recommendations shown, on reachability and navigability? and (iii) How can reachability and navigability be improved in these networks? We tackle these questions by first evaluating the reachability of recommendation networks by investigating their structural properties. Second, we evaluate navigability by simulating three different models of information seeking scenarios. We find that with standard algorithms, recommender systems are not well suited to navigation and exploration and propose methods to modify recommendations to improve this. Our work extends from one-click-based evaluations of recommender systems towards multi-click analysis (i.e., sequences of dependent clicks) and presents a general, comprehensive approach to evaluating navigability of arbitrary recommendation networks

Contextualised Browsing in a Digital Library's Living Lab

Contextualisation has proven to be effective in tailoring \linebreak search results towards the users' information need. While this is true for a basic query search, the usage of contextual session information during exploratory search especially on the level of browsing has so far been underexposed in research. In this paper, we present two approaches that contextualise browsing on the level of structured metadata in a Digital Library (DL), (1) one variant bases on document similarity and (2) one variant utilises implicit session information, such as queries and different document metadata encountered during the session of a users. We evaluate our approaches in a living lab environment using a DL in the social sciences and compare our contextualisation approaches against a non-contextualised approach. For a period of more than three months we analysed 47,444 unique retrieval sessions that contain search activities on the level of browsing. Our results show that a contextualisation of browsing significantly outperforms our baseline in terms of the position of the first clicked item in the result set. The mean rank of the first clicked document (measured as mean first relevant - MFR) was 4.52 using a non-contextualised ranking compared to 3.04 when re-ranking the result lists based on similarity to the previously viewed document. Furthermore, we observed that both contextual approaches show a noticeably higher click-through rate. A contextualisation based on document similarity leads to almost twice as many document views compared to the non-contextualised ranking.Comment: 10 pages, 2 figures, paper accepted at JCDL 201

Improving case study research in medical education: A systematised review

Context:Case study research (CSR) is a research approach that guides holistic investigation of a real phenomenon. This approach may be useful in medical education to provide critical analyses of teaching and learning, and to reveal the underlying elements of leadership and innovation. There are variations in the definition, design and choice of methods, which may diminish the value of CSR as a form of inquiry.Objectives:This paper reports an analysis of CSR papers in the medical education literature. The review aims to describe how CSR has been used and how more consistency might be achieved to promote understanding and value.Methods:A systematised review was undertaken to quantify the number of CSR articles published in scholarly medical education journals over the last 10 years. A typology of CSR proposed by Thomas and Myers to integrate the various ways in which CSR is constructed was applied.Results:Of the 362 full‐text articles assessed, 290 were excluded as they did not meet the eligibility criteria; 76 of these were titled ‘case study’. Of the 72 included articles, 50 used single‐case and 22 multi‐case design; 46 connected with theory and 26 were atheoretical. In some articles it was unclear what the subject was or how the subject was being analysed.Conclusions:In this study, more articles titled ‘case study’ failed than succeeded in meeting the eligibility criteria. Well‐structured, clearly written CSR in medical education has the potential to increase understanding of more complex situations, but this review shows there is considerable variation in how it is conducted, which potentially limits its utility and translation into education practice. Case study research might be of more value in medical education if researchers were to follow more consistently principles of design, and harness rich observation with connection of ideas and knowledge to engage the reader in what is most interesting

You can't always sketch what you want: Understanding Sensemaking in Visual Query Systems

Visual query systems (VQSs) empower users to interactively search for line charts with desired visual patterns, typically specified using intuitive sketch-based interfaces. Despite decades of past work on VQSs, these efforts have not translated to adoption in practice, possibly because VQSs are largely evaluated in unrealistic lab-based settings. To remedy this gap in adoption, we collaborated with experts from three diverse domains---astronomy, genetics, and material science---via a year-long user-centered design process to develop a VQS that supports their workflow and analytical needs, and evaluate how VQSs can be used in practice. Our study results reveal that ad-hoc sketch-only querying is not as commonly used as prior work suggests, since analysts are often unable to precisely express their patterns of interest. In addition, we characterize three essential sensemaking processes supported by our enhanced VQS. We discover that participants employ all three processes, but in different proportions, depending on the analytical needs in each domain. Our findings suggest that all three sensemaking processes must be integrated in order to make future VQSs useful for a wide range of analytical inquiries.Comment: Accepted for presentation at IEEE VAST 2019, to be held October 20-25 in Vancouver, Canada. Paper will also be published in a special issue of IEEE Transactions on Visualization and Computer Graphics (TVCG) IEEE VIS (InfoVis/VAST/SciVis) 2019 ACM 2012 CCS - Human-centered computing, Visualization, Visualization design and evaluation method

Overcoming barriers to experimentation in business-to-business living labs

Business-to-business (B2B) living lab projects have been mentioned in different areas of academic research, but the innovation management literature requires deeper analysis of their potential opportunities and challenges. Real-life experimentation is a key requirement for living labs as it enables deeper insights in the potential success of innovations. However, the literature has not provided insights on how living lab projects can implement real-life experimentation in B2B innovation projects and does not describe appropriate conditions for experimentation in these settings. In this study, we identified three main barriers preventing real-life experimentation in B2B living lab projects: the technological complexity, the need for integration, and the difficulty in identifying testers. The barriers are discussed in detailed and potential solutions are provided to help overcome these barriers and stimulate the adoption of real-life experimentation in B2B innovation projects