447 research outputs found

    A HoloLens Application to Aid People who are Visually Impaired in Navigation Tasks

    Get PDF
    Day-to-day activities such as navigation and reading can be particularly challenging for people with visual impairments. Reading text on signs may be especially difficult for people who are visually impaired because signs have variable color, contrast, and size. Indoors, signage may include office, classroom, restroom, and fire evacuation signs. Outdoors, they may include street signs, bus numbers, and store signs. Depending on the level of visual impairment, just identifying where signs exist can be a challenge. Using Microsoft\u27s HoloLens, an augmented reality device, I designed and implemented the TextSpotting application that helps those with low vision identify and read indoor signs so that they can navigate text-heavy environments. The application can provide both visual information and auditory information. In addition to developing the application, I conducted a user study to test its effectiveness. Participants were asked to find a room in an unfamiliar hallway. Those that used the TextSpotting application completed the task less quickly yet reported higher levels of ease, comfort, and confidence, indicating the application\u27s limitations and potential in providing an effective means to navigate unknown environments via signage

    Vision-Based Tactile Paving Detection Method in Navigation Systems for Visually Impaired Persons

    Get PDF
    In general, a visually impaired person relies on guide canes in order to walk outside besides depending only on a tactile pavement as a warning and directional tool in order to avoid any obstructions or hazardous situations. However, still a lot of training is needed in order to recognize the tactile pattern, and it is quite difficult for persons who have recently become visually impaired. This chapter describes the development and evaluation of vision-based tactile paving detection method for visually impaired persons. Some experiments will be conducted on how it works to detect the tactile pavement and identify the shape of tactile pattern. In this experiment, a vision-based method is proposed by using MATLAB including the Arduino platform and speaker as guidance tools. The output of this system based on the result found from tactile detection in MATLAB then produces auditory output and notifies the visually impaired about the type of tactile detected. Consequently, the development of tactile pavement detection system can be used by visually impaired persons for easy detection and navigation purposes

    Review of Machine Vision-Based Electronic Travel Aids

    Get PDF
    Visual impaired people have navigation and mobility problems on the road. Up to now, many approaches have been conducted to help them navigate around using different sensing techniques. This paper reviews several machine vision- based Electronic Travel Aids (ETAs) and compares them with those using other sensing techniques. The functionalities of machine vision-based ETAs are classified from low-level image processing such as detecting the road regions and obstacles to high-level functionalities such as recognizing the digital tags and texts. In addition, the characteristics of the ETA systems for blind people are particularly discussed

    Implementación de tecnologías RFID e IoT inalámbricas en el Modelado de información de construcción (BIM)

    Get PDF
    ABSTRACT: The integration and installation of innovative Radio Frequency Identification (RFID) technologies in combination with wireless Internet of Things (IoT) technologies in Building Information Modelling (BIM), assigned building elements, can create connectivity between the physical- and the virtual world. Beyond the identification of physical objects, further information can be connected, which can be made available to different user groups during the entire life cycle of the building structure. This provides a high level of transparency, in that by scanning the tagged building elements, complete associated information can be accessed and presented to users via applications, in visual and audio form. One use of an RFID and BIM-supported electronic guidance system, namely for the visually impaired, has already been investigated in my bachelor thesis at the University of Applied Sciences (Technische Hochschule Mittelhessen, THM). This Master’s Thesis focuses on the implementation of passive RFID technology into BIM models in combining them with open-source software applications. BIM represents the digital twin of building models in the digital world and can be linked to physical structures (buildings, roads, sewer systems and such others) and building materials (e.g. textiles, mineral and plastic floor coverings, concrete components) by integrating RFID tags. Connecting the parametric BIM models with the physical building elements by using RFID and wireless IoT technologies in a multi-platform application enables the BIM building models to be actively used throughout the life cycle of a building, not only by the facility management, but also by the public for various use cases. During the literature review, suitable software and hardware components were selected, and a prototype multi-platform application for a navigation and positioning system was developed as proof of concept for the Industry Foundation Classes (IFC) file. (See Demo Version at https://opennavibim.herokuapp.com/ ). The challenge was to read the RFID tags in different installation scenarios. Depending on the installation situations (under, over or in the material), various requirements were specified for RFID tags and readers (RFID, handhold personal digital assistant “PDA”). In this field, further hardware developments are necessary.RESUMEN: Mediante la integración e instalación de la innovadora tecnología de identificación por radiofrecuencia (RFID, Radio Frequency Identification) en el modelado digital de información de construcción (BIM, Building Information Modelling), con la interconexión inalámbrica del internet de las cosas (IoT, Internet of Things), es posible crear una conectividad entre el mundo físico y el virtual. Más allá de la mera identificación de objetos existentes, esta conectividad permite incorporar información adicional, que puede ponerse en disposición de los diferentes grupos de usuarios que intervienen durante el ciclo completo de vida de la estructura de la edificación. Se consigue un alto de nivel de transparencia en ese traspaso de información, accesible por medio del escaneado de los elementos etiquetados en la edificación, al tener una completa información asociada que es presentada a los usuarios vía aplicaciones en formato visual o de audio. Una investigación en la aplicación de tecnología RFID basada en BIM para un sistema de navegación electrónica, destinada a personas con discapacidad visual, ha sido desarrollada en mi trabajo fin de grado en la Universidad de Ciencias Aplicadas de Mittelhessen (THM). El presente Trabajo Fin de Master se centra en la implementación de tecnología RFID pasiva en modelos BIM combinados con aplicaciones de software libre. El modelo BIM representa el gemelo digital de los elementos de construcción en el mundo virtual, permitiendo establecer una relación del modelo con estructuras físicas (edificios, carreteras o sistemas de alcantarillado, entre otros) y materiales de construcción (por ejemplo, textiles, cubiertas de suelo minerales o plásticas, componentes de hormigón, …) por medio de la integración de etiquetas RFID. La conexión de los modelos paramétricos BIM con los elementos físicos del edificio, mediante el uso de tecnologías RFID e IoT inalámbricas en una aplicación multiplataforma, permite que los modelos de construcción BIM se utilicen activamente a lo largo del ciclo de vida de un edificio, no solo por la gestión de las instalaciones, sino también por el público para diversos casos de uso. Durante la revisión bibliográfica, se seleccionaron los componentes de software y hardware adecuados, y se desarrolló un prototipo de aplicación multiplataforma para un sistema de navegación y posicionamiento como prueba de viabilidad del concepto del modelo Industry Foundation Classes (IFC). (Véase la versión de demostración en https://opennavibim.herokuapp.com/ ). La lectura de las etiquetas RFID en diferentes en diferentes situaciones de instalación presenta un desafío, dependiendo de la instalación (debajo, encima o en el material) los requisitos impuestos a las etiquetas y lectores RFID son diferentes. Por lo tanto, es necesario seguir desarrollando el hardware en este ámbito.Máster en Ingeniería de Caminos, Canales y Puertos (Plan 2020

    Overcoming barriers and increasing independence: service robots for elderly and disabled people

    Get PDF
    This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable

    BLINDSHOPPING: NAVIGATION SYSTEM

    Get PDF
    The QR trail is an android application that designed to encourage visually challenged person to participate in more normal activities as normal person does. Moreover, this application can be used by normal person as well to navigate around places when the person lost in a way. The main purpose of the project is to provide a navigation system for the visually challenged person to move around autonomously in supermarkets or hypermarkets and do some shopping. The application will provide a guidance for visually impaired person through voice command from the smartphone as the user need to scan QR codes on the floor which contains the details of current location and instruction to move from one point of the shopping mall to another point. The development of this application will use Eclipse development tool. The programming language that will be used the development process in Java language and ZXing library. The rapid application development methodology is applied in development process of this application which consists 4 stages which are system design, prototype cycle, system testing and implication

    Indoor navigation for the visually impaired : enhancements through utilisation of the Internet of Things and deep learning

    Get PDF
    Wayfinding and navigation are essential aspects of independent living that heavily rely on the sense of vision. Walking in a complex building requires knowing exact location to find a suitable path to the desired destination, avoiding obstacles and monitoring orientation and movement along the route. People who do not have access to sight-dependent information, such as that provided by signage, maps and environmental cues, can encounter challenges in achieving these tasks independently. They can rely on assistance from others or maintain their independence by using assistive technologies and the resources provided by smart environments. Several solutions have adapted technological innovations to combat navigation in an indoor environment over the last few years. However, there remains a significant lack of a complete solution to aid the navigation requirements of visually impaired (VI) people. The use of a single technology cannot provide a solution to fulfil all the navigation difficulties faced. A hybrid solution using Internet of Things (IoT) devices and deep learning techniques to discern the patterns of an indoor environment may help VI people gain confidence to travel independently. This thesis aims to improve the independence and enhance the journey of VI people in an indoor setting with the proposed framework, using a smartphone. The thesis proposes a novel framework, Indoor-Nav, to provide a VI-friendly path to avoid obstacles and predict the user s position. The components include Ortho-PATH, Blue Dot for VI People (BVIP), and a deep learning-based indoor positioning model. The work establishes a novel collision-free pathfinding algorithm, Orth-PATH, to generate a VI-friendly path via sensing a grid-based indoor space. Further, to ensure correct movement, with the use of beacons and a smartphone, BVIP monitors the movements and relative position of the moving user. In dark areas without external devices, the research tests the feasibility of using sensory information from a smartphone with a pre-trained regression-based deep learning model to predict the user s absolute position. The work accomplishes a diverse range of simulations and experiments to confirm the performance and effectiveness of the proposed framework and its components. The results show that Indoor-Nav is the first type of pathfinding algorithm to provide a novel path to reflect the needs of VI people. The approach designs a path alongside walls, avoiding obstacles, and this research benchmarks the approach with other popular pathfinding algorithms. Further, this research develops a smartphone-based application to test the trajectories of a moving user in an indoor environment
    corecore