3DIR: three-dimensional information retrieval from 3D building information modelling environments.

More and more information is being packed into Building Information Models (BIMs), with the 3D geometrical model serving as the central index to lead users to the many other types of building information. The Three-Dimensional Information Retrieval (3DIR) project investigates information retrieval from such environments, where information or documents are linked to a 3D artefact. In these situations, the 3D visualisation or 3D geometry of the building can be exploited when formulating information retrieval queries, computing the relevance of information items to the query, or visualising search results. Following reviews of literature in BIM/CAD and information retrieval, a clear gap was identified in the practice of information retrieval from BIM/CAD systems. End users were consulted to ascertain the precise user requirements in such an information retrieval system. Scenario-based design was adopted to design a software prototype. The 3DIR system was developed as an add-in under the Autodesk Revit BIM platform. The 3DIR prototype creates an index of all text data attached to the 3D model. The user is able to search for information by selecting specific 3D objects, by keyword and by specifying particular 3D regions of the model. Relationships between 3D objects are also used to rank search results. Search results are displayed by highlighting 3D objects in the 3D model. Findings from the evaluation of the prototype demonstrate its usefulness but suggest directions for future development. It is concluded that a tight coupling between text-based retrieval and the 3D model is extremely effective in 3D BIM environments

Distributed D3: A web-based distributed data visualisation framework for Big Data

The influx of Big Data has created an ever-growing need for analytic tools targeting towards the acquisition of insights and knowledge from large datasets. Visual perception as a fundamental tool used by humans to retrieve information from the outside world around us has its unique ability to distinguish patterns pre-attentively. Visual analytics via data visualisations is therefore a very powerful tool and has become ever more important in this era. Data-Driven Documents (D3.js) is a versatile and popular web-based data visualisation library that has tended to be the standard toolkit for visualising data in recent years. However, the library is technically inherent and limited in capability by the single thread model of a single browser window in a single machine, and therefore not able to deal with large datasets. The main objective of this thesis is to overcome this limitation and address possible challenges by developing the Distributed D3 framework that employs distributed mechanism to enable the possibility of delivering web-based visualisations for large-scale data, which also allows to effectively utilise the graphical computational resources of the modern visualisation environments. As a result, the first contribution is that the integrated version of Distributed D3 framework has been developed for the Data Observatory. The work proves the concept of Distributed D3 is feasible in reality and also enables developers to collaborate on large-scale data visualisations by using it on the Data Observatory. The second contribution is that the Distributed D3 has been optimised by investigating the potential bottlenecks for large-scale data visualisation applications. The work finds the key performance bottlenecks of the framework and shows an improvement of the overall performance by 35.7% after optimisations, which improves the scalability and usability of Distributed D3 for large-scale data visualisation applications. The third contribution is that the generic version of Distributed D3 framework has been developed for the customised environments. The work improves the usability and flexibility of the framework and makes it ready to be published in the open-source community for further improvements and usages.Open Acces

Three-Dimensional Information Retrieval (3DIR): exploiting 3D geometry and model topology in information retrieval from BIM environments

In building modelling environments, more and more information is being crammed into 2D/3D building and product models. This is particularly true given the rise of Building Information Modelling (BIM, Eastman et al., 2011). The Three-Dimensional Information Retrieval (3DIR) project investigates information retrieval from these environments, where information or documents are linked to a 3D building model. In these situations, the 3D visualization or 3D geometry of the building can be exploited when formulating information retrieval queries, computing the relevance of information items to the query, or visualizing search results. Managing such building information repositories in this way would take advantage of human strengths in vision, spatial cognition and visual memory (Lansdale and Edmonds, 1992; Robertson et al., 1998). Information retrieval is associated with documents, and a critic might argue that documents are relics from the pre-BIM age that are no longer relevant in the era of BIM. However, the challenge of information retrieval is pertinent whether we are dealing with documents which are coarse grains of information or building object parameters/attributes as finer grains of information. Demian and Fruchter (2005) demonstrated that traditional retrieval computations can be applied with good results to 3D building models where textual or symbolic data are treated as very short documents. In this sense, it is almost a question of semantics whether the information being retrieved comes from object properties embedded in the BIM, or from external documents linked to the BIM. The challenge remains of retrieving non-geometric or textual information. This paper describes the findings of the 3DIR project whose aim was to improve information retrieval when retrieving information or documents linked to a 3D artefact, or non-geometric information embedded in the model of the artefact. The central objective was to develop an information retrieval toolset for documents/information linked to 3D building models which exploits 3D geometry and model visualisation. Such a toolset is essentially a search engine for retrieving information with a BIM platform. As a further objective, the toolset should leverage topological relationships in the 3D model to enhance information retrieval

Animating the evolution of software

The use and development of open source software has increased significantly in the last decade. The high frequency of changes and releases across a distributed environment requires good project management tools in order to control the process adequately. However, even with these tools in place, the nature of the development and the fact that developers will often work on many other projects simultaneously, means that the developers are unlikely to have a clear picture of the current state of the project at any time. Furthermore, the poor documentation associated with many projects has a detrimental effect when encouraging new developers to contribute to the software. A typical version control repository contains a mine of information that is not always obvious and not easy to comprehend in its raw form. However, presenting this historical data in a suitable format by using software visualisation techniques allows the evolution of the software over a number of releases to be shown. This allows the changes that have been made to the software to be identified clearly, thus ensuring that the effect of those changes will also be emphasised. This then enables both managers and developers to gain a more detailed view of the current state of the project. The visualisation of evolving software introduces a number of new issues. This thesis investigates some of these issues in detail, and recommends a number of solutions in order to alleviate the problems that may otherwise arise. The solutions are then demonstrated in the definition of two new visualisations. These use historical data contained within version control repositories to show the evolution of the software at a number of levels of granularity. Additionally, animation is used as an integral part of both visualisations - not only to show the evolution by representing the progression of time, but also to highlight the changes that have occurred. Previously, the use of animation within software visualisation has been primarily restricted to small-scale, hand generated visualisations. However, this thesis shows the viability of using animation within software visualisation with automated visualisations on a large scale. In addition, evaluation of the visualisations has shown that they are suitable for showing the changes that have occurred in the software over a period of time, and subsequently how the software has evolved. These visualisations are therefore suitable for use by developers and managers involved with open source software. In addition, they also provide a basis for future research in evolutionary visualisations, software evolution and open source development

Visualising software in cyberspace

The problems of maintaining software systems are well documented. The increasing size and complexity of modern software serves only to worsen matters. Software maintainers are typically confronted with very large and very complex software systems, of which they may have little or no prior knowledge. At this stage they will normally have some maintenance task to perform, though possibly little indication of where or how to start. They need to investigate and understand the software to some extent in order to begin maintenance. This understanding process is termed program comprehension. There are various theories on program comprehension, many of which put emphasis on the construction of a mental model of the software within the mind of the maintainor. These same theories hypothesise a number of techniques employed by the maintainer for the creation and revision of this mental model. Software visualisation attempts to provide tool support for generating, supplementing and verifying the maintainer’s mental model. The majority of software visualisations to date have concentrated on producing two dimensional representations and animations of various aspects of a software system. Very little work has been performed previously regarding the issues involved in visualising software within a virtual reality environment. This research represents a significant first step into this exciting field and offers insight into the problems posed by this new media. This thesis provides an identification of the possibilities afforded byU3D graphics for software visualisation and program comprehension. It begins by defining seven key areas of 3D software visualisation, followed by the definition of two terms, visualisation and representation. These two terms provide a conceptual division between a visualisation and the elements of which it is comprised. This division enables improved discussion of the properties of a 3D visualisation and particularly the idenfification of properties that are desirable for a successful visualisation. A number of such desirable properties are suggested for both visualisations and representations, providing support for the design and evaluation of a 3D software visualisation system. Also presented are a number of prototype visualisations, each providing a different approach to the visualisation of a software system. The prototypes help demonstrate the practicalities and feasibility of 3D software visualisation. Evaluation of these prototypes is performed using a variety of techniques, the results of which emphasise the fact that there is substantial potential for the application of 3D graphics and virtual reality to software visualisation

Cognition-Based Evaluation of Visualisation Frameworks for Exploring Structured Cultural Heritage Data

It is often claimed that Information Visualisation (InfoVis) tools improve the audience’s engagement with the display of cultural heritage (CH) collections, open up CH content to new audiences and support teaching and learning through interactive experiences. But there is a lack of studies systematically evaluating these claims, particularly from the perspective of modern educational theory. As far as the author is aware no experimental investigation has been undertaken until now, that attempts to measure deeper levels of user engagement and learning with InfoVis tools. The investigation of this thesis complements InfoVis research by initiating a human-centric approach since little previous research has attempted to incorporate and integrate human cognition as one of the fundamental components of InfoVis. In this thesis, using Bloom’s taxonomy of learning objectives as well as individual learning characteristics (i.e. cognitive preferences), I have evaluated the visitor experience of an art collection both with and without InfoVis tools (between subjects design). Results indicate that whilst InfoVis tools have some positive effect on the lower levels of learning, they are less effective for higher levels. In addition, this thesis shows that InfoVis tools seem to be more effective when they match specific cognitive preferences. These results have implications for both the designers of tools and for CH venues in terms of expectation of effectiveness and exhibition design; the proposed cognitive based evaluation framework and the results of this investigation could provide a valuable baseline for assessing the effectiveness of visitors’ interaction with the artifacts of online and physical exhibitions where InfoVis tools such as Timelines and Maps along with storytelling techniques are being used

NarDis:Narrativizing Disruption -How exploratory search can support media researchers to interpret ‘disruptive’ media events as lucid narratives

This project investigates how CLARIAH’s exploratory search and linked open data (LO D) browser DIVE+ supports media researchers to construct narratives about events, especially ‘disruptive’ events such as terrorist attacks and natural disasters. This project approaches this question by conducting user studies to examine how researchers use and create narratives with exploratory search tools, particularly DIVE+, to understand media events. These user studies were organized as workshops (using co-creation as an iterative approach to map search practices and storytelling data, including: focus groups & interviews; tasks & talk aloud protocols; surveys/questionnaires; and research diaries) and included more than 100 (digital) humanities researchers across Europe. Insights from these workshops show that exploratory search does facilitate the development of new research questions around disruptive events. DIVE+ triggers academic curiosity, by suggesting alternative connections between entities. Beside learning about research practices of (digital) humanities researchers and how these can be supported with digital tools, the pilot also culminated in improvements to the DIVE+ browser. The pilot helped optimize the browser’s functionalities, making it possible for users to annotate paths of search narratives, and save these in CLARIAH’s overarching, personalised, user space. The pilot was widely promoted at (inter)national conferences, and DIVE+ won the international LO DLAM (Linked Open Data in Libraries, Archives and Museums) Challenge Grand Prize in Venice (2017)