Summarisation and visualisation of e-Health data repositories

At the centre of the Clinical e-Science Framework (CLEF) project is a repository of well organised, detailed clinical histories, encoded as data that will be available for use in clinical care and in-silico medical experiments. We describe a system that we have developed as part of the CLEF project, to perform the task of generating a diverse range of textual and graphical summaries of a patient’s clinical history from a data-encoded model, a chronicle, representing the record of the patient’s medical history. Although the focus of our current work is on cancer patients, the approach we describe is generalisable to a wide range of medical areas

Associating characters with events in films

The work presented here combines the analysis of a film's audiovisual features with the analysis of an accompanying audio description. Specifically, we describe a technique for semantic-based indexing of feature films that associates character names with meaningful events. The technique fuses the results of event detection based on audiovisual features with the inferred on-screen presence of characters, based on an analysis of an audio description script. In an evaluation with 215 events from 11 films, the technique performed the character detection task with Precision = 93% and Recall = 71%. We then go on to show how novel access modes to film content are enabled by our analysis. The specific examples illustrated include video retrieval via a combination of event-type and character name and our first steps towards visualization of narrative and character interplay based on characters occurrence and co-occurrence in events

Understanding User Behaviour through Action Sequences: from the Usual to the Unusual

Action sequences, where atomic user actions are represented in a labelled, timestamped form, are becoming a fundamental data asset in the inspection and monitoring of user behaviour in digital systems. Although the analysis of such sequences is highly critical to the investigation of activities in cyber security applications, existing solutions fail to provide a comprehensive understanding due to the complex semantic and temporal characteristics of these data. This paper presents a visual analytics approach that aims to facilitate a user-involved, multi-faceted decision making process during the identification and the investigation of “unusual” action sequences. We first report the results of the task analysis and domain characterisation process. Then we describe the components of our multi-level analysis approach that comprises of constraint-based sequential pattern mining and semantic distance based clustering, and multi-scalar visualisations of users and their sequences. Finally, we demonstrate the applicability of our approach through a case study that involves tasks requiring effective decision-making by a group of domain experts. Although our solution here is tightly informed by a user-centred, domain-focused design process, we present findings and techniques that are transferable to other applications where the analysis of such sequences is of interest

Maintenance Informatics Dashboard Design for Through-life Engineering Services

This article introduces maintenance informatics dashboard design approach for visualising maintenance, repair and overhaul events on a timeline. This paper presents a proposed methodology for aggregate visualisation techniques and a 2D graphical plot method as well as a summary of events on a timeline. In this paper, these events are occurrences which are classified and categorised into levels. The occurrences are accumulated over time as historical information and represented in a visual format over a timeline based on an entity relationship diagram. The information modelling technique with respect to data visualisation is emphasised. The result is a single-page-view of maintenance activities. The maintenance activities of aircraft engines are visualised to ease the accessibility of getting accurate and relevant information for making better maintenance decision. The result can be used to gain insight of the root cause of the events from inception to end of life of the engine

Visual Analytics for Health Monitoring and Risk Management in CARRE

With the rise of wearable sensor technologies, an increasing number of wearable health and medical sensors are available on the market, which enables not only people but also doctors to utilise them to monitor people’s health in such a consistent way that the sensors may become people’s lifetime companion. The consistent measurements from a variety of wearable sensors implies that a huge amount of data needs to be processed, which cannot be achieved by traditional processing methods. Visual analytics is designed to promote knowledge discovery and utilisation of big data via mature visual paradigms with well-designed user interactions and has become indispensable in big data analysis. In this paper we introduce the role of visual analytics for health monitoring and risk management in the European Commission funded project CARRE which aims to provide innovative means for the management of cardiorenal diseases with the assistance of wearable sensors. The visual analytics components of timeline and parallel coordinates for health monitoring and of node-link diagrams, chord diagrams and sankey diagrams for risk analysis are presented to achieve ubiquitous and lifelong health and risk monitoring to promote people’s health

A visual analytics approach for visualisation and knowledge discovery from time-varying personal life data

A thesis submitted to the University of Bedfordshire, in ful filment of the requirements for the degree of Doctor of PhilosophyToday, the importance of big data from lifestyles and work activities has been the focus of much research. At the same time, advances in modern sensor technologies have enabled self-logging of a signi cant number of daily activities and movements. Lifestyle logging produces a wide variety of personal data along the lifespan of individuals, including locations, movements, travel distance, step counts and the like, and can be useful in many areas such as healthcare, personal life management, memory recall, and socialisation. However, the amount of obtainable personal life logging data has enormously increased and stands in need of effective processing, analysis, and visualisation to provide hidden insights owing to the lack of semantic information (particularly in spatiotemporal data), complexity, large volume of trivial records, and absence of effective information visualisation on a large scale. Meanwhile, new technologies such as visual analytics have emerged with great potential in data mining and visualisation to overcome the challenges in handling such data and to support individuals in many aspects of their life. Thus, this thesis contemplates the importance of scalability and conducts a comprehensive investigation into visual analytics and its impact on the process of knowledge discovery from the European Commission project MyHealthAvatar at the Centre for Visualisation and Data Analytics by actively involving individuals in order to establish a credible reasoning and effectual interactive visualisation of such multivariate data with particular focus on lifestyle and personal events. To this end, this work widely reviews the foremost existing work on data mining (with the particular focus on semantic enrichment and ranking), data visualisation (of time-oriented, personal, and spatiotemporal data), and methodical evaluations of such approaches. Subsequently, a novel automated place annotation is introduced with multilevel probabilistic latent semantic analysis to automatically attach relevant information to the collected personal spatiotemporal data with low or no semantic information in order to address the inadequate information, which is essential for the process of knowledge discovery. Correspondingly, a multi-signi ficance event ranking model is introduced by involving a number of factors as well as individuals' preferences, which can influence the result within the process of analysis towards credible and high-quality knowledge discovery. The data mining models are assessed in terms of accurateness and performance. The results showed that both models are highly capable of enriching the raw data and providing significant events based on user preferences. An interactive visualisation is also designed and implemented including a set of novel visual components signifi cantly based upon human perception and attentiveness to visualise the extracted knowledge. Each visual component is evaluated iteratively based on usability and perceptibility in order to enhance the visualisation towards reaching the goal of this thesis. Lastly, three integrated visual analytics tools (platforms) are designed and implemented in order to demonstrate how the data mining models and interactive visualisation can be exploited to support different aspects of personal life, such as lifestyle, life pattern, and memory recall (reminiscence). The result of the evaluation for the three integrated visual analytics tools showed that this visual analytics approach can deliver a remarkable experience in gaining knowledge and supporting the users' life in certain aspects

MyHealthAvatar and CARRE: case studies of interactive visualisation for Internet-enabled sensor-assisted health monitoring and risk analysis

With the progress of wearable sensor technologies, more wearable health sensors have been made available on the market, which enables not only people to monitor their health and lifestyle in a continuous way but also doctors to utilise them to make better diagnoses. Continuous measurement from a variety of wearable sensors implies that a huge amount of data needs to be collected, stored, processed and presented, which cannot be achieved by traditional data processing methods. Visualisation is designed to promote knowledge discovery and utilisation via mature visual paradigms with well-designed user interactions and has become indispensable in data analysis. In this paper we introduce the role of visualisation in wearable sensor-assisted health analysis platforms by case studies of two projects funded by the European Commission: MyHealthAvatar and CARRE. The former focuses on health sensor data collection and lifestyle tracking while the latter aims to provide innovative means for the management of cardiorenal diseases with the assistance of wearable sensors. The roles of visualisation components including timeline, parallel coordinates, map, node-link diagrams, Sankey diagrams, etc. are introduced and discussed