Current Practices for Product Usability Testing in Web and Mobile Applications

Software usability testing is a key methodology that ensures applications are intuitive and easy to use for the target audience. Usability testing has direct benefits for companies as usability improvements often are fundamental to the success of a product. A standard usability test study includes the following five steps: obtain suitable participants, design test scripts, conduct usability sessions, interpret test outcomes, and produce recommendations. Due to the increasing importance for more usable applications, effective techniques to develop usable products, as well as technologies to improve usability testing, have been widely utilized. However, as companies are developing more cross-platform web and mobile apps, traditional single-platform usability testing has shortcomings with respect to ensuring a uniform user experience. In this report, a new strategy is proposed to promote a consistent user experience across all application versions and platforms. This method integrates the testing of different application versions, e.g., the website, mobile app, mobile website. Participants are recruited with a better-defined criterion according to their preferred devices. The usability session is conducted iteratively on several different devices, and the test results of individual application versions are compared on a per-device basis to improve the test outcomes. This strategy is expected to extend on current practices for usability testing by incorporating cross-platform consistency of software versions on most devices

Investigating the effectiveness of an efficient label placement method using eye movement data

This paper focuses on improving the efficiency and effectiveness of dynamic and interactive maps in relation to the user. A label placement method with an improved algorithmic efficiency is presented. Since this algorithm has an influence on the actual placement of the name labels on the map, it is tested if this efficient algorithms also creates more effective maps: how well is the information processed by the user. We tested 30 participants while they were working on a dynamic and interactive map display. Their task was to locate geographical names on each of the presented maps. Their eye movements were registered together with the time at which a given label was found. The gathered data reveal no difference in the user's response times, neither in the number and the duration of the fixations between both map designs. The results of this study show that the efficiency of label placement algorithms can be improved without disturbing the user's cognitive map. Consequently, we created a more efficient map without affecting its effectiveness towards the user

Measuring children's search behaviour on a large scale

Children often experience problems during information-seeking using traditional search interfaces and search technologies, that are designed for adults. This is because children engage with the world in fundamentally different ways than adults. To design search technologies that support children in effective and enjoyable information-seeking, more research is needed to examine children’s specific skills and needs concerning information-seeking. Therefore, we developed an application that can monitor children’s search behaviour on a large scale. In this paper, we present the steps taken to develop this application. The basis of the application is UsaProxy, an existing system that is used to monitor the user’s usage of websites. We have increased the accuracy of UsaProxy and have developed an application that is able to extract useful information from UsaProxy’s log files

Improving Mobile Web Experience at Dyn Inc.

Recommendations were made to implement content and layout optimizations enabling pages to dynamically adapt to varying screen sizes. A mobile website design with logical content grouping, spacing and positioning appear to provide a more intuitive experience and may improve the overall usability of Dyn\u27s checkout process. This MQP report examines Dyn Inc.\u27s efforts to enhance mobile usability of their checkout process through the implementation of adaptive web design. Two eye-tracking user experience studies were conducted to identify and evaluate mobile-specific drivers of usability. Companies engaging in e-commerce stand to gain a significant competitive advantage through website optimizations resulting in increased mobile usability

Navigating the Web: A Qualitative Eye Tracking-based Study of Translators’ Web Search Behaviour

This Element reports an investigation of translators’ use of web-based resources and search engines. The study adopted a qualitative eye tracking-based methodology utilising a combination of gaze replay and retrospective think aloud (RTA) to elicit data. The main contribution of this Element lies in presenting not only an alternative eye tracking methodology for investigating translators’ web search behaviour but also a systematic approach to gauging the reasoning behind translators’ highly complex and context-dependent interaction with search engines and the Web

Eyes don\u27t lie: understanding users\u27 first impressions on website design using eye tracking

Websites are becoming more prevalent these days. They need to create a favorable first impression on the users during initial exposure. After allocating their attention to stimuli, users form a cognitive representation of the visual information leading to first impression. Hence, first impression is important to evaluate the effectiveness of a website. This research tries to examine the amount of exposure time needed to form first impression; identify the web design factors that influence the formation of users\u27 first impression; study the emotional responses of users on website design; and finally understand the relationship between first impression and eye movement. Eye movements on displays indicate spatial focus of attention. Eye tracking can provide fixation points where users focus their attention on stimuli. In this study eye tracking has been used to study users\u27 first impression on website design. The study was conducted in two phases. In the first phase, participants were presented with the stimuli of twenty five university websites\u27 screen shots of home pages on the eye tracker with no time restrain and asked to move on to the next stimuli when they feel that they have formed their initial impression of the website. On viewing each homepage, participants were asked to rate the page on their first impressions and emotional response. In the second phase, users were shown their gaze plots from the eye tracker device for the previous stimuli viewed, followed by a short interview. Twenty students from a mid west university were recruited to participate in the experiment. Quantitative analysis was performed on the various fixation data extracted from the eye tracker as well as on the data collected from survey. Open coding was performed on the qualitative data obtained from the interview. The results show that first impressions are formed within 180ms after allocating their attention to stimuli. The qualitative analysis identified various issues with the website design and also revealed a number of ways in which the website design can be improved that affects impression --Abstract, page iii

Navigating the Web. A Qualitative Eye Tracking–Based Study of Translators' Web Search Behaviour

This Element reports an investigation of translators' use of web-based resources and search engines. The study adopted a qualitative eye tracking-based methodology utilising a combination of gaze replay and retrospective think aloud (RTA) to elicit data. The main contribution of this Element lies in presenting not only an alternative eye tracking methodology for investigating translators' web search behaviour but also a systematic approach to gauging the reasoning behind translators' highly complex and context-dependent interaction with search engines and the Web

The effect of dyslexia on information retrieval: A pilot study

Purpose – The purpose of the paper is to resolve a gap in our knowledge of how people with dyslexia interact with Information Retrieval (IR) systems, specifically an understanding of their information searching behaviour. Very little research has been undertaken with this particular user group, and given the size of the group (an estimated 10% of the population) this lack of knowledge needs to be addressed. Design/Methodology/Approach - We use elements of the dyslexia cognitive profile to design a logging system recording the difference between two sets of participants: dyslexic and control users. We use a standard Okapi interface together with two standard TREC topics in order to record the information searching behaviour of these users. We gather evidence from various sources, including quantitative information on search logs, together with qualitative information from interviews and questionnaires. We record variables on queries, documents, relevance assessments and sessions in the search logs. We use this evidence to examine the difference in searching between the two sets of users, in order to understand the effect of dyslexia on the information searching behaviour. A topic analysis is also conducted on the quantitative data to show any effect on the results from the information need. Research limitations/implications – As this is a pilot study, only 10 participants were recruited for the study, 5 for each user group. Due to ethical issues, the number of topics per search was restricted to one topic only. The study shows that the methodology applied is useful for distinguishing between the two user groups, taking into account differences between topic. We outline further research on the back of this pilot study in four main areas. A different approach from the proposed methodology is needed to measure the effect on query variables, which takes account of topic variation. More details on users are needed such as reading abilities, speed of language processing and working memory to distinguish the user groups. Effect of topic on search interaction must be measured in order to record the potential impact on the dyslexic user group. Work is needed on relevance assessment and effect on precision and recall for users who may not read many documents. Findings – Using the log data, we establish the differences in information searching behaviour of control and dyslexic users i.e. in the way the two groups interact with Okapi, and that qualitative information collected (such as experience etc) may not be able to account for these differences. Evidence from query variables was unable to distinguish between groups, but differences on topic for the same variables were recorded. Users who view more documents tended to judge more documents as being relevant, either in terms of the user group or topic. Session data indicated that there may be an important difference between the number of iterations used in a search between the user groups, as there may be little effect from the topic on this variable. Originality/Value – This is the first study of the effect of dyslexia on information search behaviour, and provides some evidence to take the field forward