Principles in Patterns (PiP) : Heuristic Evaluation of Course and Class Approval Online Pilot (C-CAP)

The PiP Evaluation Plan documents four distinct evaluative strands, the first of which entails an evaluation of the PiP system pilot (WP7:37). Phase 1 of this evaluative strand focuses on the heuristic evaluation of the PiP Course and Class Approval Online Pilot system (C-CAP). Heuristic evaluation is an established usability inspection and testing technique and is most commonly deployed in Human-Computer Interaction (HCI) research, e.g. to test user interface designs, technology systems testing, etc. The success of heuristic evaluation in detecting 'major' and 'minor' usability problems is well documented, but its principal limitation is its inability to capture data on all possible usability problems. For this reason heuristic evaluation is often used as a precursor to user testing, e.g. so that user testing focuses on deeper system issues rather than on those that can easily be debugged. Heuristic evaluation nevertheless remains an important usability inspection technique and research continues to demonstrate its success in detecting usability problems which would otherwise evade detection in user testing sessions. For this reason experts maintain that heuristic evaluation should be used to complement user testing. This is reflected in the PiP Evaluation Plan, which proposes protocol analysis, stimulated recall and pre- and post-test questionnaire instruments to comprise user testing (see WP7:37 phases 2, 3 and 4 of PiP Evaluation Plan). This brief report summarises the methodology deployed, presents the results of the heuristic evaluation and proposes solutions or recommendations to address the heuristic violations that were found to exist in the C-CAP system. It is anticipated that some solutions will be implemented within the lifetime of the project. This is consistent with the incremental systems design methodology that PiP has adopted

The Effects of Information and Visual Website Design on User Frustration

When shopping online, customers may be less likely to buy a product if they feel frustrated with the website’s interface. However, few studies have investigated what attributes contribute to frustration with websites’ design. The goal of this study was to determine whether deficiencies in the information and visual design of a website can cause frustration. In a within-subjects design, participants were asked to do several tasks on four different versions of a website and afterwards were asked to complete a survey for each version. The results showed that color and information deficiency did cause frustration in users. These results will likely help website designers (or even marketing researchers) in designing more effective websites, as well as ways that can help the consumer have a more enjoyable online experience

Principles in Patterns (PiP) : Project Evaluation Synthesis

Evaluation activity found the technology-supported approach to curriculum design and approval developed by PiP to demonstrate high levels of user acceptance, promote improvements to the quality of curriculum designs, render more transparent and efficient aspects of the curriculum approval and quality monitoring process, demonstrate process efficacy and resolve a number of chronic information management difficulties which pervaded the previous state. The creation of a central repository of curriculum designs as the basis for their management as "knowledge assets", thus facilitating re-use and sharing of designs and exposure of tacit curriculum design practice, was also found to be highly advantageous. However, further process improvements remain possible and evidence of system resistance was found in some stakeholder groups. Recommendations arising from the findings and conclusions include the need to improve data collection surrounding the curriculum approval process so that the process and human impact of C-CAP can be monitored and observed. Strategies for improving C-CAP acceptance among the "late majority", the need for C-CAP best practice guidance, and suggested protocols on the knowledge management of curriculum designs are proposed. Opportunities for further process improvements in institutional curriculum approval, including a re-engineering of post-faculty approval processes, are also recommended

Evaluasi Usability pada Aplikasi Perangkat Bergerak SIP Dispendukcapil Jember dengan Metode Heuristic Evaluation dan Usability Testing

SIP Dispendukcapil Jember adalah aplikasi mobile yang dikembangkan oleh Dinas Kependudukan dan Pencatatan Sipil Kabupaten Jember yang digunakan sebagai sarana untuk melakukan layanan penduduk secara online. Berdasarkan hasil wawancara kepada pengembang dan pengguna aplikasi terdapat beberapa keluhan terkait dengan aplikasi SIP yang berkaitan dengan aspek usability. Berdasarkan permasalahan yang telah didapatkan maka perlu dilakukannya evaluasi usability pada aplikasi SIP. Evaluasi dilakukan dengan menggunakan dua metode yaitu usability testing dengan aspek effectiveness, efficiency dan satisfaction yang dilakukan oleh responden dan heuristic evaluation dengan menggunakan sembilan prinsip heuristic yang dilakukan oleh evalutor. Berdasarkan hasil evaluasi yang telah dilakukan, diperoleh 19 permasalahan usability. 14 permasalahan ditemukan pada saat melakukan heuristic evaluation dan 5 permasalahan ditemukan pada saat usability testing. Evaluasi dilakukan dengan menggunakan dua metode tersebut menemukan 3 permasalahan usability yang sama. Pengujian usability menghasilkan tingkat effectiviness sebesar 80%, efficiency sebesar 67% dan satisfaction dengan rata-rata 45,62. Permasalahan usability dengan menggunakan heuristic evaluation berdasarkan 9 prinsip Monroy. Masalah ditemukan paling banyak pada prinsip MA04 achieve consistency dan MA06 have the app remember important stuff and not the user masing-masing sebanyak 4 permasalahan. Secara keseluruhan pada heuristic evaluation ditemukan masalah sebanyak 14. Permasalahan usability ditemukan 3 permasalahan pada kategori Minor usability problem, 6 permasalahan Mayor usability problem dan 5 permasalahan usability catsastrophe

Examining the Design and Usability of Telemedicine Communications: A Mixed-methods Study

This dissertation describes a mixed-methods study that examines the usability of telemedicine provider interfaces. This study consisted of content analysis, survey, and think aloud methodologies, which afford a multifaceted corpus of data for which to draw inferences and identify design features and functions that negatively impact usability. Usability is a critical component of the user experience with a telemedicine provider interface and can suede or impede the acceptance and adoption of telemedicine. Telemedicine has the potential to increase quality healthcare access and positive health outcomes for individuals who use it, and usability is a key component of technology acceptance and effective use. Empirical testing of health information technology (HIT) and telemedicine is advocated for as it is the most valuable method of research to understand humans\u27 cognitive processing of information as they interact with technology. In addition, using activity theory and mobile interface theory as a lens in which to understand human activities and interaction with telemedicine provider interfaces, including the telemedicine provider websites and their mobile-responsive websites in this study, is an effective tool for drawing reasonable inferences regarding the usability of telemedicine communications. Considering the rate at which an unprecedented amount of health information becomes available online and HIT facilitates the delivery of healthcare, usability testing and user-centered, iterative design practices become increasingly essential in order to design effective—and safe—health information and technology that enhance the patient-experience, the affordability and accessibility of healthcare, health literacy and patient empowerment, and positive health outcomes. Usability testing plays an increasingly important role in characterizing obstacles to achieving these initiatives of the modern patient-centered health paradigm and telemedicine. The mixed-methods usability testing performed in this study offers a principled approach to usability testing and is ecologically valid because it involves real human subjects. This study fulfills a void in research on the usability of telemedicine communications and reveals usability problems that may not be anticipated by designers of HIT and health information providers. Drawing from the insight gained from this mixed-method study, design features and functions that enhance the usability of health communications are offered. This study draws insight from the human factors, technical communication, and health and medical fields to develop systematic, practical usability testing methods that can be replicated and applied in many fields. The design recommendations resulting from this study will be valuable to programmers; systems analysts; clinicians and nurses; technical communicators; information architects; visual designers; and others in similar roles