Measuring and comparing the reliability of the structured walkthrough evaluation method with novices and experts

Effective evaluation of websites for accessibility remains problematic. Automated evaluation tools still require a significant manual element. There is also a significant expertise and evaluator effect. The Structured Walkthrough method is the translation of a manual, expert accessibility evaluation process adapted for use by novices. The method is embedded in the Accessibility Evaluation Assistant (AEA), a web accessibility knowledge management tool. Previous trials examined the pedagogical potential of the tool when incorporated into an undergraduate computing curriculum. The results of the evaluations carried out by novices yielded promising, consistent levels of validity and reliability. This paper presents the results of an empirical study that compares the reliability of accessibility evaluations produced by two groups (novices and experts). The main results of this study indicate that overall reliability of expert evaluations was 76% compared to 65% for evaluations produced by novices. The potential of the Structured Walkthrough method as a useful and viable tool for expert evaluators is also examined. Copyright 2014 ACM

Embedding accessibility and usability: considerations for e-learning research and development projects

This paper makes the case that if e‐learning research and development projects are to be successfully adopted in real‐world teaching and learning contexts, then they must effectively address accessibility and usability issues; and that these need to be integrated throughout the project. As such, accessibility and usability issues need to be made explicit in project documentation, along with allocation of appropriate resources and time. We argue that accessibility and usability are intrinsically inter‐linked. An integrated accessibility and usability evaluation methodology that we have developed is presented and discussed. The paper draws on a series of mini‐case studies from e‐learning projects undertaken over the past 10 years at the Open University

Labour Market Information Driven, Personalized, OER Recommendation System for Lifelong Learners

In this paper, we suggest a novel method to aid lifelong learners to access relevant OER based learning content to master skills demanded on the labour market. Our software prototype 1) applies Text Classification and Text Mining methods on vacancy announcements to decompose jobs into meaningful skills components, which lifelong learners should target; and 2) creates a hybrid OER Recommender System to suggest personalized learning content for learners to progress towards their skill targets. For the first evaluation of this prototype we focused on two job areas: Data Scientist, and Mechanical Engineer. We applied our skill extractor approach and provided OER recommendations for learners targeting these jobs. We conducted in-depth, semi-structured interviews with 12 subject matter experts to learn how our prototype performs in terms of its objectives, logic, and contribution to learning. More than 150 recommendations were generated, and 76.9% of these recommendations were treated as useful by the interviewees. Interviews revealed that a personalized OER recommender system, based on skills demanded by labour market, has the potential to improve the learning experience of lifelong learners.Comment: This paper has been accepted to be published in the proceedings of CSEDU 2020 by SciTePres

Guide on the Side and LibWizard Tutorials side-by-side: How do the two platforms for split-screen online tutorials compare?

Split-screen tutorials are an appealing and effective way for libraries to create online learning objects where learners interact with real-time web content. Many libraries are using the University of Arizona’s award-winning, open source platform, Guide on the Side; in 2016, Springshare released a proprietary alternative, LibWizard Tutorials. This article reviews the advantages and limitations of this kind of tutorial. It also examines the differences between each platform’s distinctive characteristics. These platforms create similar split-screen tutorials, but have differences that affect diverse aspects of installation, administration, authoring and editing, student learning, data management, and accessibility. Libraries now have the opportunity to consider and compare alternative platforms and decide which one is best suited to their needs, priorities and resources

Accessibility of websites of the European national tourism boards

Purpose: The aim is to find out the current state of accessibility of the websites of European national tourism boards. Furthermore, the identification of the most common errors in terms of accessibility as well as recommendations leading to their correction is aimed for. Design/methodology/approach: The study is based on methods of testing the availability of web systems. The testing included automated tools, namely AChecker and Accessibility Evaluation Tool, as well as the WCAG 2.1 checklist developed by WebAIM initiative. Findings: The research has shown a relatively high accessibility of those websites. Nevertheless, some accessibility violations have been identified that can significantly complicate the accessibility of those websites for users using various assistive devices or other alternative hardware or software means. The most commonly identified errors include: failure to use alternative text for content-relevant images, the absence of text or audio transcripts for videos shared via Youtube, missing descriptions for text form elements and missing label for search form. Practical implications: The results of the research can be used in the evaluation of web presentations at the level of tourism boards and destination management. Originality/Value: The main output of this article is the application of web testing methodology on a comprehensive set of national tourist boards.peer-reviewe

Exploring the Usability of Municipal Web Sites: A Comparison Based on Expert Evaluation Results from Four Case Studies

The usability of public administration web sites is a key quality attribute for the successful implementation of the Information Society. Formative usability evaluation aims at finding and reporting usability problems as early as possible in the development process. The objective of this paper is to present and comparatively analyze the results of an expert usability evaluation of 4 municipality web sites. In order to document usability problems an extended set of heuristics was used that is based on two sources: usability heuristics and ergonomic criteria. The explanatory power of heuristics was supplemented with a set of usability guidelines. The evaluation results revealed that a set of specific tasks with clearly defined goals helps to identify many severe usability problems that occur frequently in the municipality web sites. A typical issue for this category of web sites is the lack of information support for the user.Formative Usability Evaluation, User Testing, Expert Evaluation, Heuristic Evaluation, Ergonomic Criteria, Usability Problem, Municipal Web Sites

Information Technology and the Workplace: Implications for Persons with Disabilities

The Internet improves access to employment and community for many people. However, there is growing concern that many Web sites are inaccessible to people with certain disabilities. This article examines the impact on people with disabilities of online human resources processes used for employee recruitment, benefits, and training. In 2002, Cornell University staff reviewed the accessibility of 10 Job boards and 31 corporate e-recruiting Web sites. Human resource (HR) professionals are well positioned to report on key issues regarding these processes. A survey of 433 HR representatives was conducted regarding their organizations\u27 use of information and Web technology in HR processes; knowledge of computer/Web barriers to employees with disabilities; and familiarity with assistive technology and resources. The authors summarize current literature and legislation relevant to Web accessibility, and discuss implications of their findings for businesses and people with disabilities in the workplace

The Effect of Expertise on the Relation between Implicit and Explicit Attitude Measures:An formation Availability/Accessibility Perspective

In this paper, three experiments investigate the role of expertise as a moderator of the relationship between implicit and explicit measures of attitudesobject knowledge and expertise; attitude measurement; implicit measures of attitudes; Implicit Association Test

BCAS: A Web-enabled and GIS-based Decision Support System for the Diagnosis and Treatment of Breast Cancer

For decades, geographical variations in cancer rates have been observed but the precise determinants of such geographic differences in breast cancer development are unclear. Various statistical models have been proposed. Applications of these models, however, require that the data be assembled from a variety of sources, converted into the statistical models’ parameters and delivered effectively to researchers and policy makers. A web-enabled and GIS-based system can be developed to provide the needed functionality. This article overviews the conceptual web-enabled and GIS-based system (BCAS), illustrates the system’s use in diagnosing and treating breast cancer and examines the potential benefits and implications for breast cancer research and practice