Moving Usability Testing onto the Web

Abstract: In order to remotely obtain detailed usability data by tracking user behaviors within a given web site, a server-based usability testing environment has been created. Web pages are annotated in such a way that arbitrary user actions (such as "mouse over link" or "click back button") can be selected for logging. In addition, the system allows the experiment designer to interleave interactive questions into the usability evaluation, which for instance could be triggered by a particular sequence of actions. The system works in conjunction with clustering and visualization algorithms that can be applied to the resulting log file data. A first version of the system has been used successfully to carry out a web usability evaluation

Collaborative trails in e-learning environments

This deliverable focuses on collaboration within groups of learners, and hence collaborative trails. We begin by reviewing the theoretical background to collaborative learning and looking at the kinds of support that computers can give to groups of learners working collaboratively, and then look more deeply at some of the issues in designing environments to support collaborative learning trails and at tools and techniques, including collaborative filtering, that can be used for analysing collaborative trails. We then review the state-of-the-art in supporting collaborative learning in three different areas – experimental academic systems, systems using mobile technology (which are also generally academic), and commercially available systems. The final part of the deliverable presents three scenarios that show where technology that supports groups working collaboratively and producing collaborative trails may be heading in the near future

Using access information in the dynamic visualisation of web sites

Includes bibliographical references.Log file analysis provides a cost-effective means to detennine web site usage. However, current methods of displaying log analysis results tend to be limited in that they either contain no reference to a web site's structure, or else they portray this structure as a standard graph or tree. This dissertation presents a visual representation of web server log information, which addresses these limitations by incorporating log file data into a visualisation of a web site's layout. The devised visualisation utilizes properties unique to web sites in order to create a compromise between the clutter-prone network graph and the infonnation incomplete tree representations that have traditionally been used to depict web sites. As such, the visualisation emphasises typical web site features such as the home page, sub-sites and navigation bars. This approach pennitted the introduction of the concept of implying the presence of links without explicitly rendering them. This notion has many implications, not least of which is the reduction of cluttering. The visualisation combined several other techniques to address the issues of structure and data representation, data exploration, scalability and context maintenance. Assessment of the visualisation consisted of a heuristic evaluation by an expert from the web site usage industry, a test to detelmine the intuitiveness of the representation, and a series of user experiments. Results of the assessment were generally promising although a few areas of concern, such as the difficulty experienced by users in navigating the visualisation with a trackball, were identified. These issues should not prove to be too difficult to overcome however. The visualisation could thus be said to have successfully met the aim of developing a representation of web site usage infonnation that incorporates site structure and treats web sites as unique entities, thereby taking advantage of their particular characteristics. It is hoped such a visualisation will be of benefit to web site designers and administrators in analysing and ultimately improving their web sites

Desire Lines: Open Educational Collections, Memory and the Social Machine

This paper delineates the initial ideas around the development of the Co-Curate North East project. The idea of computerised machines which have a social use and impact was central to the development of the project. The project was designed with and for schools and communities as a digital platform which would collect and aggregate ‘memory’ resources and collections around local area studies and social identity. It was a co-curation process supported by museums and curators which was about the ‘meshwork’ between ‘official’ and ‘unofficial’ archives and collections and the ways in which materials generated from within the schools and community groups could themselves be re-narrated and exhibited online as part of self-organised learning experiences. This paper looks at initial ideas of social machines and the ways in machines can be used in identity and memory studies. It examines ideas of navigation and visualisation of data and concludes with some initial findings from the early stages of the project about the potential for machines and educational work

Is spatial intelligibility critical to the design of largescale virtual environments?

This paper discusses the concept of 'intelligibility', a concept usually attributed to the design of real-world environments and suggests how it might be applied to the construction of virtual environments. In order to illustrate this concept, a 3d, online, collaborative environment, AlphaWorld, is analyzed in a manner analogous to spatial analysis techniques applied to cities in the real world. The outcome of this form of spatial analysis is that AlphaWorld appears to be highly 'intelligible' at the small-scale, 'local neighborhood' level, and yet is completely 'unintelligible' at a global level. This paper concludes with a discussion of the relevance of this finding to virtual environment design plus future research applications

Workflow and tools to track and visualize behavioural data from a Virtual Reality environment using a lightweight GIS

[EN] Evaluating user behaviour in Virtual Reality is a challenge for every re-searcher involved in designing and executing experiments in immersive envi-ronments. Behavioural information could lead to relevant findings in pres-ence, engagement or, for example, the mood of the player during a VR ex-perience. Saving this kind of information and exploding it in an appropriateway could lead researchers or even game designers to identify relevant be-havioural patterns or correlations. In this article, we are proposing a simple,replicable workflow and a set of scripted tools in order to acquire user¿s navi-gational data and visualize it using the inherent capabilities of a GeographicInformation System. Our workflow goes from data acquisition in Unity3Dwith C to the final representation in a map using Leaflet, an open-sourceGIS JavaScript based, passing through the pre-processing of XML files. Us-ing a GIS to visualize navigational data is a flexible, ecological and effectivesolution that improves productivity and awareness on data storytelling ca-pabilities.This work was supported by the Spanish Ministry of Science, Innovation and Universities funded project ATHENEA-DPI2017-91537-EXP and by the European Commission project RHUMBO H2020-MSCA-ITN-2018-813234.Soler-Domínguez, JL.; Contero, M.; Alcañiz Raya, ML. (2019). Workflow and tools to track and visualize behavioural data from a Virtual Reality environment using a lightweight GIS. SoftwareX. 10:1-6. https://doi.org/10.1016/j.softx.2019.100269S161

Augmenting citation chain aggregation with article maps

Presentation slides available at: https://www.gesis.org/fileadmin/upload/kmir2014/paper4_slides.pdfThis paper presents Voyster, an experimental system that combines citation chain aggregation (CCA) and spatial-semantic maps to support citation search. CCA uses a three-list view to represent the citation network surrounding a ‘pearl’ of known relevant articles, whereby cited and citing articles are ranked according to number of pearl relations. As the pearl grows, this overlap score provides an effective proxy for relevance. However, when the pearl is small or multi-faceted overlap ranking provides poor discrimination. To address this problem we augment the lists with a visual map, wherein articles are organized according to their content similarity. We demonstrate how the article map can help the user to make relevant choices during the early stages of the search pro-cess and also provide useful insights into the thematic structure of the local citation network