Assessment of Access Methods for Mobile Maps for Individuals Who are Blind or Visually Impaired

When people go to a mall, museums, or other such locations they tend to rely on maps to find their way around. However, for people who are blind or visually impaired (BVI) maps are not easily accessible and they depend on other means, such as a guide, to get around. Research has only just begun to investigate providing maps for people who are BVI on touch screen devices. Many different types of feedback have been used: audio (sound), tactile (touch), audio-tactile, and multitouch. Some research has been conducted on the benefit of using multiple fingers (multitouch) and has found conflicting results. Yet, no known research has been conducted on the comparison of using audio feedback to that of tactile feedback. In this study, we look to try and answer two questions. 1.) Is audio equal to or better than tactile? As well as: 2.) Does multiple fingers help? Participants were asked to use seven different methods (4 audio, 3 tactile) to explore an overview map and an individual map and answer questions about them. Results showed that overall, audio cues are similar or better than tactile cues which is beneficial since it requires less battery to generate audio cues than tactile cues. It was also shown that the use of multiple fingers was more beneficial in tasks that are spatially demanding. While those who have tactile experience benefited when using two fingers with each finger represented by a different instrument played to separated ears

Environmentally Responsive Hydrogels:Development and Integration with Hard Materials

abstract: Environmentally responsive hydrogels are one interesting class of soft materials. Due to their remarkable responsiveness to stimuli such as temperature, pH, or light, they have attracted widespread attention in many fields. However, certain functionality of these materials alone is often limited in comparison to other materials such as silicon; thus, there is a need to integrate soft and hard materials for the advancement of environmental-ly responsive materials. Conventional hydrogels lack good mechanical properties and have inherently slow response time, important characteristics which must be improved before the hydrogels can be integrated with silicon. In the present dissertation work, both these important attrib-utes of a temperature responsive hydrogel, poly(N-isopropylacrylamide) (PNIPAAm), were improved by adopting a low temperature polymerization process and adding a sili-cate compound, tetramethyl orthosilicate. Furthermore, the transition temperature was modulated by adjusting the media quality in which the hydrogels were equilibrated, e.g. by adding a co-solvent (methanol) or an anionic surfactant (sodium dodecyl sulfate). In-terestingly, the results revealed that, based on the hydrogels’ porosity, there were appre-ciable differences when the PNIPAAm hydrogels interacted with the media molecules. Next, an adhesion mechanism was developed in order to transfer silicon thin film onto the hydrogel surface. This integration provided a means of mechanical buckling of the thin silicon film due to changes in environmental stimuli (e.g., temperature, pH). We also investigated how novel transfer printing techniques could be used to generate pat-terned deformation of silicon thin film when integrated on a planar hydrogel substrate. Furthermore, we explore multilayer hybrid hydrogel structures formed by the integration of different types of hydrogels that have tunable curvatures under the influence of differ-ent stimuli. Silicon thin film integration on such tunable curvature substrates reveal char-acteristic reversible buckling of the thin film in the presence of multiple stimuli. Finally, different approaches of incorporating visible light response in PNIPAAm are discussed. Specifically, a chemical chromophore- spirobenzopyran was synthesized and integrated through chemical cross-linking into the PNIPAAm hydrogels. Further, methods of improving the light response and mechanical properties were also demonstrat-ed. Interestingly, such a system was shown to have potential application as light modulated topography altering systemDissertation/ThesisDoctoral Dissertation Chemical Engineering 201

Voice and Touch Diagrams (VATagrams) Diagrams for the Visually Impaired

If a picture is worth a thousand words would you rather read the two pages of text or simply view the image? Most would choose to view the image; however, for the visually impaired this isn’t always an option. Diagrams assist people in visualizing relationships between objects. Most often these diagrams act as a source for quickly referencing information about relationships. Diagrams are highly visual and as such, there are few tools to support diagram creation for visually impaired individuals. To allow the visually impaired the ability to share the same advantages in school and work as sighted colleagues, an accessible diagram tool is needed. A suitable tool for the visually impaired to create diagrams should allow these individuals to: 1. easily define the type of relationship based diagram to be created, 2. easily create the components of a relationship based diagram, 3. easily modify the components of a relationship based diagram, 4. quickly understand the structure of a relationship based diagram, 5. create a visual representation which can be used by the sighted, and 6. easily accesses reference points for tracking diagram components. To do this a series of prototypes of a tool were developed that allow visually impaired users the ability to read, create, modify and share relationship based diagrams using sound and gestural touches. This was accomplished by creating a series of applications that could be run on an iPad using an overlay that restricts the areas in which a user can perform gestures. These prototypes were tested for usability using measures of efficiency, effectiveness and satisfaction. The prototypes were tested with visually impaired, blindfolded and sighted participants. The results of the evaluation indicate that the prototypes contain the main building blocks that can be used to complete a fully functioning application to be used on an iPad

How touch and hearing influence visual processing in sensory substitution, synaesthesia and cross-modal correspondences

Sensory substitution devices (SSDs) systematically turn visual dimensions into patterns of tactile or auditory stimulation. After training, a user of these devices learns to translate these audio or tactile sensations back into a mental visual picture. Most previous SSDs translate greyscale images using intuitive cross-sensory mappings to help users learn the devices. However more recent SSDs have started to incorporate additional colour dimensions such as saturation and hue. Chapter two examines how previous SSDs have translated the complexities of colour into hearing or touch. The chapter explores if colour is useful for SSD users, how SSD and veridical colour perception differ and how optimal cross-sensory mappings might be considered. After long-term training, some blind users of SSDs report visual sensations from tactile or auditory stimulation. A related phenomena is that of synaesthesia, a condition where stimulation of one modality (i.e. touch) produces an automatic, consistent and vivid sensation in another modality (i.e. vision). Tactile-visual synaesthesia is an extremely rare variant that can shed light on how the tactile-visual system is altered when touch can elicit visual sensations. Chapter three reports a series of investigations on the tactile discrimination abilities and phenomenology of tactile-vision synaesthetes, alongside questionnaire data from synaesthetes unavailable for testing. Chapter four introduces a new SSD to test if the presentation of colour information in sensory substitution affects object and colour discrimination. Chapter five presents experiments on intuitive auditory-colour mappings across a wide variety of sounds. These findings are used to predict the reported colour hallucinations resulting from LSD use while listening to these sounds. Chapter six uses a new sensory substitution device designed to test the utility of these intuitive sound-colour links for visual processing. These findings are discussed with reference to how cross-sensory links, LSD and synaesthesia can inform optimal SSD design for visual processing