Fine-Grained Product Class Recognition for Assisted Shopping

Assistive solutions for a better shopping experience can improve the quality of life of people, in particular also of visually impaired shoppers. We present a system that visually recognizes the fine-grained product classes of items on a shopping list, in shelves images taken with a smartphone in a grocery store. Our system consists of three components: (a) We automatically recognize useful text on product packaging, e.g., product name and brand, and build a mapping of words to product classes based on the large-scale GroceryProducts dataset. When the user populates the shopping list, we automatically infer the product class of each entered word. (b) We perform fine-grained product class recognition when the user is facing a shelf. We discover discriminative patches on product packaging to differentiate between visually similar product classes and to increase the robustness against continuous changes in product design. (c) We continuously improve the recognition accuracy through active learning. Our experiments show the robustness of the proposed method against cross-domain challenges, and the scalability to an increasing number of products with minimal re-training.Comment: Accepted at ICCV Workshop on Assistive Computer Vision and Robotics (ICCV-ACVR) 201

An exploration of the potential of Automatic Speech Recognition to assist and enable receptive communication in higher education

The potential use of Automatic Speech Recognition to assist receptive communication is explored. The opportunities and challenges that this technology presents students and staff to provide captioning of speech online or in classrooms for deaf or hard of hearing students and assist blind, visually impaired or dyslexic learners to read and search learning material more readily by augmenting synthetic speech with natural recorded real speech is also discussed and evaluated. The automatic provision of online lecture notes, synchronised with speech, enables staff and students to focus on learning and teaching issues, while also benefiting learners unable to attend the lecture or who find it difficult or impossible to take notes at the same time as listening, watching and thinking

What Is Known About the Impact of Impairments on Information Seeking and Searching?

Information seeking and access are essential for users in all walks of life, from addressing personal needs such as finding flights to locating information needed to complete work tasks. Over the past decade or so, the general needs of people with impairments have increasingly been recognized as something to be addressed, an issue embedded both in international treaties and in state legislation. The same tendency can be found in research, where a growing number of user studies including people with impairments have been conducted. The purpose of these studies is typically to uncover potential barriers for access to information, especially in the context of inaccessible search user interfaces. This literature review provides an overview of research on the information seeking and searching of users with impairments. The aim is to provide an overview to both researchers and practitioners who work with any of the user groups identified. Some diagnoses are relatively well represented in the literature (for instance, visual impairment), but there is very little work in other areas (for instance, autism) and in some cases no work at all (for instance, aphasia). Gaps are identified in the research, and suggestions are made regarding areas where further research is needed

Digital Media Usage of Sensory Impaired Users in Wales 2018 Report

What benefits have digital media brought to sensory impaired users in Wales and what are the barriers that affect people who have sensory loss in using digital technologies

Digital Media Usage of Sensory Impaired Users in Wales 2018 Report

This document reports the main statistical findings from a survey of digital media usage and attitudes of sensory impaired users in Wales. The report offers a comprehensive review of the benefits that digital media has brought to sensory impaired users in Wales and some of the barriers that affect people who have sensory loss. Reported data shows that although only used by half of the sight-impaired community, digital media is crucial to the wellbeing of the sight-impaired users. However, blind and partially sighted people who responded to the questionnaire demonstrate a disadvantaged level of digital media engagement. This report has identified a number of barriers facing people who are sensory impaired in Wales in accessing information, education and services. Barriers were identified mainly in the areas of financial restraints, access to training opportunities, and web accessibility. In addition to emphasise the importance of financial support, digital skills training and web accessibility, the report also recommend a new technology design agenda to the industry in both public and private sectors. Authors endorse what Graham Pullin (2009) suggests the ‘resonant design’ approach, which incorporates disabled and non-disabled users based on coincident needs. Design should emphasize on users and tailor the technology capacity around the need of the user, even such design might look like low-tech and long-lasting