Building of a Lifelong Ohana – Evaluating usability of an online resource site for LTEC online master’s program students

The purpose of this project was to design and evaluate an online orientation and resource site for online LTEC Master’s students to help navigate their academic journey at the University of Hawaii at Manoa, using the free LMS Canvas Instructure. Resource content was determined by consulting four LTEC faculty who are knowledgeable with the program and orientation as subject matter expert, conjointly based on the designer’s experience as the office manager and LTEC Master’s student, and frequently asked questions by LTEC students. Revisions and improvements were made to the site with feedback and rapid prototyping from three iteration of usability testings involving 11 LTEC current students and alumni. Qualitative and quantitative data from the pre and post questionnaires, usability tests, and post interview were analyzed to identify any usability issues. Based on Neilsen’s (1995) 5-level scale for rating the severity of usability problems, each problem was rated and fixed by prioritizing highest severity of the usability issue. Overall, the feedback from the usability study suggested that the orientation resource site is user friendly, easy to navigate, and will be a welcomed addition to existing support provided by the department. Usability testings proved to be an effective means to evaluate such resource site, and the data gained can be rapidly translated into improvements to optimize the user experience. A future step for this project will be to continue to gather data from its target audience, to further improve on usability and expand on the website content to better serve LTEC students

The assessment of usability of electronic shopping: A heuristic evaluation

Today there are thousands of electronic shops accessible via the Web. Some provide user-friendly features whilst others seem not to consider usability factors at all. Yet, it is critical that the electronic shopping interface is user-friendly so as to help users to obtain their desired results. This study applied heuristic evaluation to examine the usability of current electronic shopping. In particular, it focused on four UK-based supermarkets offering electronic services: including ASDA, Iceland, Sainsbury, and Tesco. The evaluation consists of two stages: a free-flow inspection and a task-based inspection. The results indicate that the most significant and common usability problems have been found to lie within the areas of ‘User Control and Freedom’ and ‘Help and Documentation’. The findings of this study are applied to develop a set of usability guidelines to support the future design of effective interfaces for electronic shopping

Cloud based testing of business applications and web services

This paper deals with testing of applications based on the principles of cloud computing. It is aimed to describe options of testing business software in clouds (cloud testing). It identifies the needs for cloud testing tools including multi-layer testing; service level agreement (SLA) based testing, large scale simulation, and on-demand test environment. In a cloud-based model, ICT services are distributed and accessed over networks such as intranet or internet, which offer large data centers deliver on demand, resources as a service, eliminating the need for investments in specific hardware, software, or on data center infrastructure. Businesses can apply those new technologies in the contest of intellectual capital management to lower the cost and increase competitiveness and also earnings. Based on comparison of the testing tools and techniques, the paper further investigates future trend of cloud based testing tools research and development. It is also important to say that this comparison and classification of testing tools describes a new area and it has not yet been done

HELIN Data Analytics Task Force Final Report

The main task undertaken by the HELIN Data Analytics Task Force was to conduct a proof-of-concept usability test of HELIN OneSearch, which is the Consortium’s brand name for the Encore Duet discovery service. After the initial meeting in November 2014, the Task Force met 6 times in 2015 to plan and execute a prototype test. Staff members from EBSCO Information Services’ User Research group acted as usability test advisers and coordinators and attended all meetings, either onsite or via WebEx. Task Force members collaborated to come up with specific scenarios and personas which would best emphasize patron likes, dislikes and general understanding of OneSearch. Using a small sample of volunteer student test subjects from 3 different HELIN institutions, testing took place in mid-April. The results were analyzed by EBSCO and presented at the final meeting of the Task Force on April 28. Based on this limited testing, general findings were as follows: Students who don’t receive prior information instruction are generally not aware of OneSearch. Students who do know about OneSearch do not necessarily understand the difference between OneSearch and the HELIN Catalog. Most students still continue to do their research by searching database lists, LibGuides, the Journal A to Z list, and the HELIN catalog (although not necessarily in that order). When features and operation of OneSearch are explained to students, they recognize its usefulness (especially facets, which many referred to as “filters”). Lack of clarity on how to get directly to full text items causes frustration. A larger and more comprehensive usability test would be needed to draw out more specific conclusions. Secondary tasks undertaken by the Task Force included trials and reviews of 5 data analysis tools, as well as a review of EBSCO User Research, which is quantitative data on the use of OneSearch available directly from EBSCO. The remainder of this document is a detailed account of the proceedings of the HELIN Data Analytics Task Force

Usefulness and Usability of a Personal Health Record and Survivorship Care Plan for Colorectal Cancer Survivors: Survey Study

Background: As a result of improvements in cancer screening, treatment, and supportive care, nearly two-thirds of individuals diagnosed with colorectal cancer (CRC) live for 5 years after diagnosis. An ever-increasing population of CRC survivors creates a need for effective survivorship care to help manage and mitigate the impact of CRC and its treatment. Personal health records (PHRs) and survivorship care plans provide a means of supporting the long-term care of cancer survivors. Objective: The purpose of this study is to characterize the usefulness of a CRC PHR and survivorship care plan and to describe the usability of these technologies in a population of CRC survivors. To our knowledge, this is the first study to assess a PHR and survivorship care plan specifically targeting CRC survivors. Methods: Twenty-two patients with CRC were recruited from surgery clinics of an academic medical center and Veterans Affairs hospital in Indianapolis and provided access to an online Colorectal Cancer Survivor’s Personal Health Record (CRCS-PHR). Survey data were collected to characterize the usefulness of the CRCS-PHR and describe its usability in a population of CRC survivors. CRC survivors were surveyed 6 months after being provided online access. Means and proportions were used to describe the usefulness and ease of using the CRC website. Open-ended questions were qualitatively coded using the constant comparative method. Results: CRC survivors perceived features related to their health care (ie, summary of cancer treatment history, follow-up care schedule, description of side effects, and list of community resources) to be more useful than communication features (ie, creating online relationships with family members or caregivers, communicating with doctor, and secure messages). CRC survivors typically described utilizing traditional channels (eg, via telephone or in person) to communicate with their health care provider. Participants had overall positive perceptions with respect to ease of use and overall satisfaction. Major challenges experienced by participants included barriers to system log-in, lack of computer literacy or experience, and difficulty entering their patient information. Conclusions: For CRC, survivors may find the greater value in a PHR’s medical content than the communication functions, which they have available elsewhere. These findings regarding the usefulness and usability of a PHR for the management of CRC survivorship provide valuable insights into how best to tailor these technologies to patients’ needs. These findings can inform future design and development of PHRs for purposes of both cancer and chronic disease management

Evaluating the impact of physical activity apps and wearables: interdisciplinary review

Background: Although many smartphone apps and wearables have been designed to improve physical activity, their rapidly evolving nature and complexity present challenges for evaluating their impact. Traditional methodologies, such as randomized controlled trials (RCTs), can be slow. To keep pace with rapid technological development, evaluations of mobile health technologies must be efficient. Rapid alternative research designs have been proposed, and efficient in-app data collection methods, including in-device sensors and device-generated logs, are available. Along with effectiveness, it is important to measure engagement (ie, users’ interaction and usage behavior) and acceptability (ie, users’ subjective perceptions and experiences) to help explain how and why apps and wearables work. Objectives: This study aimed to (1) explore the extent to which evaluations of physical activity apps and wearables: employ rapid research designs; assess engagement, acceptability, as well as effectiveness; use efficient data collection methods; and (2) describe which dimensions of engagement and acceptability are assessed. Method: An interdisciplinary scoping review using 8 databases from health and computing sciences. Included studies measured physical activity, and evaluated physical activity apps or wearables that provided sensor-based feedback. Results were analyzed using descriptive numerical summaries, chi-square testing, and qualitative thematic analysis. Results: A total of 1829 abstracts were screened, and 858 articles read in full. Of 111 included studies, 61 (55.0%) were published between 2015 and 2017. Most (55.0%, 61/111) were RCTs, and only 2 studies (1.8%) used rapid research designs: 1 single-case design and 1 multiphase optimization strategy. Other research designs included 23 (22.5%) repeated measures designs, 11 (9.9%) nonrandomized group designs, 10 (9.0%) case studies, and 4 (3.6%) observational studies. Less than one-third of the studies (32.0%, 35/111) investigated effectiveness, engagement, and acceptability together. To measure physical activity, most studies (90.1%, 101/111) employed sensors (either in-device [67.6%, 75/111] or external [23.4%, 26/111]). RCTs were more likely to employ external sensors (accelerometers: P=.005). Studies that assessed engagement (52.3%, 58/111) mostly used device-generated logs (91%, 53/58) to measure the frequency, depth, and length of engagement. Studies that assessed acceptability (57.7%, 64/111) most often used questionnaires (64%, 42/64) and/or qualitative methods (53%, 34/64) to explore appreciation, perceived effectiveness and usefulness, satisfaction, intention to continue use, and social acceptability. Some studies (14.4%, 16/111) assessed dimensions more closely related to usability (ie, burden of sensor wear and use, interface complexity, and perceived technical performance). Conclusions: The rapid increase of research into the impact of physical activity apps and wearables means that evaluation guidelines are urgently needed to promote efficiency through the use of rapid research designs, in-device sensors and user-logs to assess effectiveness, engagement, and acceptability. Screening articles was time-consuming because reporting across health and computing sciences lacked standardization. Reporting guidelines are therefore needed to facilitate the synthesis of evidence across disciplines