Usability and content verification of a mobile tool to help a deaf person with pharmaceutical instruction

>Magister Scientiae - MScThis thesis describes a multi-disciplinary collaboration towards iterative development of a mobile communication tool to support a Deaf person in understanding usage directions for medication dispensed at a pharmacy. We are improving usability and correctness of the user interface. The tool translates medicine instruction given in English text to South African Sign Language videos, which are relayed to a Deaf user on a mobile phone. Communication between pharmacists and Deaf patients were studied to extract relevant exchanges between the two users. We incorporated the common elements of these dialogues to represent content in a veri able manner to ensure that the mobile tool relays the correct information to the Deaf user. Instructions are made available for a Deaf patient in sign language videos on a mobile device. A pharmacy setup was created to conduct trials of the tool with groups of end users, in order to collect usability data with recorded participant observation, questionnaires and focus group discussions. Subsequently, pre-recorded sign language videos, stored on a phone's memory card, were tested for correctness. Lastly we discuss the results and implications of the study and provide a conclusion to our research

Video quality requirements for South African Sign Language communications over mobile phones.

Includes abstract.Includes bibliographical references.This project aims to find the minimum video resolution and frame rate that supports intelligible cell phone based video communications in South African Sign Language

Semi-synchronous video for deaf telephony with an adapted synchronous codec

Magister Scientiae - MScCommunication tools such as text-based instant messaging, voice and video relay services, real-time video chat and mobile SMS and MMS have successfully been used among Deaf people. Several years of field research with a local Deaf community revealed that disadvantaged South African Deaf people preferred to communicate with both Deaf and hearing peers in South African Sign Language as opposed to text. Synchronous video chat and video relay services provided such opportunities. Both types of services are commonly available in developed regions, but not in developing countries like South Africa. This thesis reports on a workaround approach to design and develop an asynchronous video communication tool that adapted synchronous video codecs to store-and-forward video delivery. This novel asynchronous video tool provided high quality South African Sign Language video chat at the expense of some additional latency. Synchronous video codec adaptation consisted of comparing codecs, and choosing one to optimise in order to minimise latency and preserve video quality. Traditional quality of service metrics only addressed real-time video quality and related services. There was no such standard for asynchronous video communication. Therefore, we also enhanced traditional objective video quality metrics with subjective assessment metrics conducted with the local Deaf community.South Afric

Softbridge: a socially aware framework for communication bridges over digital divides

Computer scientists must align social and technical factors for communication technologies in developing regions yet lack a framework to do so. The novel Softbridge framework comprises several components to address this gap. The Softbridge stack abstraction supplements the established Open Systems Interconnect model with a collection of technical layers clustered around 'people' issues. The Softbridge stack aligns the technological design of communication systems with awareness of social factors characteristic of developing regions. In a similar fashion, a new evaluation abstraction called Quality of Communication augments traditional Quality of Service by considering socio-cultural factors of a user's perception of system performance. The conceptualisation of these new abstractions was driven by long-term experimental interventions within two South African digital divides. One field study concerned communication bridges for socio-economically disadvantaged Deaf users. The second field study concerned a wireless telehealth system between rural nurses and doctors. The application domains were quite different yet yielded similarities that informed the Softbridge and Quality of Communication abstractions. The third Softbridge component is an iterative socially aware software engineering method that includes action research. This method was used to guide cyclical interventions with target communities to solve community problems with communication technologies. The Softbridge framework components are recursive products of this iterative approach, emerging via critical reflection on the design, evaluation and methodological processes of the respective field studies. Quantitative and qualitative data were triangulated on a series of communication prototypes for each field study with usage metrics, semi-structured interviews, focus groups and observation in the field. Action research journals documented the overall process to achieve post-positivist recoverability rather than positivistic replicability. Analysis of the results from both field studies was iteratively synthesised to develop the Softbridge framework and consider its implications. The most significant finding is that awareness of social issues helps explain why users might not accept a technically sound communication system. It was found that when facilitated effectively by intermediaries, the Softbridge framework enables unintended uses of experimental artefacts that empower users to appropriate communication technologies on their own. Thus, the Softbridge framework helps to align technical and socio-cultural factors

A Mobile Deaf-to-hearing communication aid for medical diagnosis

>Magister Scientiae - MScMany South African Deaf people use their mobile phones for communication with SMSs yet they would prefer to converse in South African Sign Language. Deaf people with a capital `D' are different from deaf or hard of hearing as they primarily use sign language to communicate. This study explores how to design and evaluate a prototype that will allow a Deaf person using SASL to tell a hearing doctor how s/he is feeling and provide a way for the doctor to respond. A computer{based prototype was designed and evaluated with the Deaf people in a previous study. Results from the user trial of the computer{based mock{up indicated that Deaf users would like to see the prototype on a cell phone. Those user trial results, combined with our own user survey results conducted with Deaf people, are used as requirements. We built a prototype for a mobile phone browser by embedding SASL videos inside XHTML pages using Adobe Flash. The prototype asks medical questions using SASL videos. These questions are arranged in an organized way that helps in identifying a medical problem. The answers to the questions are then displayed in English and shown to the doctor on the phone. A content authoring tool was also designed and implemented. The content authoring tool is used for populating the prototype in a context free manner allowing for plug and play scenarios such as a doctor's office, Department of Home A airs or police station. A focus group consisting of Deaf people was conducted to help in the design and pilot trial of the system. A final user trial was conducted with more than thirty Deaf people and the results are presented and analyzed. Data is collected with questionnaires, semi-structured interviews and video recordings. The results indicate that most of the Deaf people found the system easy to learn, easy to navigate through, did not get lost and understood the sign language in the videos on the mobile phone. The hand gestures and facial expressions on the sign language videos were clear. Most of them indicated they would like to use the system for free, and that the system did not ask too many questions. Most of them were happy with the quality of the sign language videos on the mobile phone and would consider using the system in real life. Finally they felt their private information was safe while using the system. Many South African Deaf people use their mobile phones for communication with SMSs yet they would prefer to converse in South African Sign Language. Deaf people with a capital `D' are different from deaf or hard of hearing as they primarily use sign language to communicate. This study explores how to design and evaluate a prototype that will allow a Deaf person using SASL to tell a hearing doctor how s/he is feeling and provide a way for the doctor to respond. A computer{based prototype was designed and evaluated with the Deaf people in a previous study. Results from the user trial of the computer{based mock{up indicated that Deaf users would like to see the prototype on a cell phone. Those user trial results, combined with our own user survey results conducted with Deaf people, are used as requirements. We built a prototype for a mobile phone browser by embedding SASL videos inside XHTML pages using Adobe Flash. The prototype asks medical questions using SASL videos. These questions are arranged in an organized way that helps in identifying a medical problem. The answers to the questions are then displayed in English and shown to the doctor on the phone. A content authoring tool was also designed and implemented. The content authoring tool is used for populating the prototype in a context free manner allowing for plug and play scenarios such as a doctor's office, Department of Home A airs or police station. A focus group consisting of Deaf people was conducted to help in the design and pilot trial of the system. A final user trial was conducted with more than thirty Deaf people and the results are presented and analyzed. Data is collected with questionnaires, semi-structured interviews and video recordings. The results indicate that most of the Deaf people found the system easy to learn, easy to navigate through, did not get lost and understood the sign language in the videos on the mobile phone. The hand gestures and facial expressions on the sign language videos were clear. Most of them indicated they would like to use the system for free, and that the system did not ask too many questions. Most of them were happy with the quality of the sign language videos on the mobile phone and would consider using the system in real life. Finally they felt their private information was safe while using the system.South Afric

Inclusion of sign language users via information and communication technology, Journal of Telecommunications and Information Technology, 2006, nr 2

The paper addresses the situation of sign language users (mostly deaf people) in the context of inclusion as a political goal. For several reasons, there is often still some confusion with the terms of deaf and hearing impaired. In order to overcome this confusion, a survey is given over the needs of people who have a sign language as their preferred language as well as the needs of people who decide on preferring spoken language (mostly hard-of-hearing people). One should also doubt that the whole target group of people with disabilities in the hearing area consists of two separate groups only. Starting from the right of self-determination, the better solution seems to be the individual right of a person to choose any offers which are useful for her/him. As for other groups of people with special needs, ICT is seen as a big chance for improving their situation in terms of life and job chances. Several projects and experiences are reporte

Emotional engineering of artificial representations of sign languages

The fascination and challenge of making an appropriate digital representation of sign language for a highly specialised and culturally rich community such as the Deaf, has brought about the development and production of several digital representations of sign language (DRSL). These range from pictorial depictions of sign language, filmed video recordings to animated avatars (virtual humans). However, issues relating to translating and representing sign language in the digital-domain and the effectiveness of various approaches, has divided the opinion of the target audience. As a result there is still no universally accepted digital representation of sign language. For systems to reach their full potential, researchers have postulated that further investigation is needed into the interaction and representational issues associated with the mapping of sign language into the digital domain. This dissertation contributes a novel approach that investigates the comparative effectiveness of digital representations of sign language within different information delivery contexts. The empirical studies presented have supported the characterisation of the prescribed properties of DRSL's that make it an effective communication system, which when defined by the Deaf community, was often referred to as "emotion". This has led to and supported the developed of the proposed design methodology for the "Emotional Engineering of Artificial Sign Languages", which forms the main contribution of this thesis