143 research outputs found

    Real-time video streaming with multi-camera for a telepresence wheelchair

    Full text link
    © 2016 IEEE. This paper presents a new approach for telepresence wheelchairs equipped with multiple cameras. The aim of this system is to provide effective assistance for the elderly and people with disabilities. The work explores the integration of the Internet of Things, such as multimedia, wireless Internet communication, and automation control techniques into a powered wheelchair system. In particular, multiple videos are streamed in real-time from an array of cameras mounted on the wheelchair, allowing wide visualization surrounding the wheelchair. By using video communication and interaction, remote users can assist to navigate a wheelchair via the Internet through wireless connections in a distant location. The experimental results show that video streaming can achieve high-quality video with the streaming rate up to 30 frames per second (fps) in real-time. The average round-trip time is under 27 milliseconds (ms). The results confirmed the effectiveness of the proposed system for tele-monitoring and remote control to achieve safer navigation tasks for wheelchair users

    Real-time transmission of panoramic images for a telepresence wheelchair

    Full text link
    © 2015 IEEE. This paper proposes an approach to transmit panoramic images in real-time for a telepresence wheelchair. The system can provide remote monitoring and assistive assistance for people with disabilities. This study exploits technological advancement in image processing, wireless communication networks, and healthcare systems. High resolution panoramic images are extracted from the camera which is mounted on the wheelchair. The panoramic images are streamed in real-time via a wireless network. The experimental results show that streaming speed is up to 250 KBps. The subjective quality assessments show that the received images are smooth during the streaming period. In addition, in terms of the objective image quality evaluation the average peak signal-to-noise ratio of the reconstructed images is measured to be 39.19 dB which reveals high quality of images

    A telepresence wheelchair with 360-degree vision using WebRTC

    Full text link
    © 2020 The Author(s). This paper presents an innovative approach to develop an advanced 360-degree vision telepresence wheelchair for healthcare applications. The study aims at improving a wide field of view surrounding the wheelchair to provide safe wheelchair navigation and efficient assistance for wheelchair users. A dual-fisheye camera is mounted in front of the wheelchair to capture images which can be then streamed over the Internet. Aweb real-time communication (WebRTC) protocol was implemented to provide efficient video and data streaming. An estimation model based on artificial neural networks was developed to evaluate the quality of experience (QoE) of video streaming. Experimental results confirmed that the proposed telepresence wheelchair system was able to stream a 360-degree video surrounding the wheelchair smoothly in real-time. The average streaming rate of the entire 360-degree video was 25.83 frames per second (fps), and the average peak signal to noise ratio (PSNR) was 29.06 dB. Simulation results of the proposed QoE estimation scheme provided a prediction accuracy of 94%. Furthermore, the results showed that the designed system could be controlled remotely via the wireless Internet to follow the desired path with high accuracy. The overall results demonstrate the effectiveness of our proposed approach for the 360-degree vision telepresence wheelchair for assistive technology applications

    Real-time transmission of panoramic images for a telepresence wheelchair

    Full text link

    A Study of Enhanced Robot Autonomy in Telepresence

    Get PDF

    Uma arquitetura de telerreabilitação baseada em realidade aumentada para apoiar o treinamento de usuários de cadeiras de rodas motorizadas

    Get PDF
    Many people worldwide have been experimenting a decrease in their mobility as a result of aging, accidents and degenerative diseases. In many cases, a Powered Wheelchair (PW) is an alternative help. Currently, in Brazil, patients can receive a PW from the Unified Health System, following prescription criteria. However, they do not have an appropriate previous training for driving the PW. Consequently, users might suffer accidents since a customized training protocol is not available. Nevertheless, due to financial and/or health limitations, many users are unable to attend a rehabilitation center. To overcome these limitations, we developed an Augmented Reality (AR) Telerehabilitation System Architecture based on the Power Mobility Road Test (PMRT), for supporting PW user’s training. In this system, the therapists can remotely customize and evaluate training tasks and the user can perform the training in safer conditions. Video stream and data transfer between each environment were made possible through UDP (User Datagram Protocol). To evaluate and present the system architecture potential, a preliminary test was conducted with 3 spinal cord injury participants. They performed 3 basic training protocols defined by a therapist. The following metrics were adopted for evaluation: number of control commands; elapsed time; number of collisions; biosignals and a questionary was used to evaluate system features by participants. Results demonstrate the specific needs of individuals using a PW, thanks to adopted (qualitative and emotional) metrics. Also, the results have shown the potential of the training system with customizable protocols to fulfill these needs. User’s evaluation demonstrates that the combination of AR techniques with PMRT adaptations, increases user’s well-being after training sessions. Furthermore, a training experience helps users to overcome their displacement problems, as well as for appointing challenges before large scale use. The proposed system architecture allows further studies on telerehabilitation of PW users.CAPES - Coordenação de Aperfeiçoamento de Pessoal de Nível SuperiorTese (Doutorado)Muitas pessoas em todo o mundo estão vivenciando uma diminuição de sua mobili- dade como resultado de envelhecimento, acidentes e doenças degenerativas. Em muitos casos, uma cadeira de rodas motorizada (CRM) é uma ajuda alternativa. Atualmente, no Brasil, os pacientes podem receber uma CRM do Sistema Único de Saúde, seguindo os critérios de prescrição. No entanto, eles não têm um treinamento prévio apropriado para dirigir a CRM. Conseqüentemente, os usuários podem sofrer acidentes, pois um protocolo de treinamento personalizado não está disponível. Além disto, devido a limi- tações financeiras e / ou de saúde, muitos usuários não podem comparecer a um centro de reabilitação. Para superar essas limitações, desenvolvemos uma arquitetura de sistema de telereabilitação com Realidade Aumentada (RA) baseado no PMRT (Power Mobility Road Test), para apoiar o treinamento de usuários de CRM. Nesse sistema, os terapeutas podem personalizar e avaliar remotamente as tarefas de treinamento e o usuário pode realizar o treinamento em condições mais seguras. O fluxo de vídeo e a transferência de dados entre cada ambiente foram possíveis através do UDP (User Datagram Protocol). Para avaliar e apresentar o potencial da arquitetura do sistema, foi realizado um teste preliminar de três participantes com lesão medular. Eles realizaram três protocolos básicos de treinamento definidos por um terapeuta. As seguintes métricas adotadas para avaliação foram: número de comandos de controle; tempo decorrido; número de colisões e biossinais. Além disso, um questionário foi usado para avaliar os recursos do sistema. Os resultados demonstram as necessidades específicas dos indivíduos que usam uma CRM, graças às métricas adotadas (qualitativas e emocionais). Além disso, os resultados mostraram o potencial do sistema de treinamento com protocolos personalizáveis para atender a essas necessidades. A avaliação do usuário demonstra que a combinação de técnicas de RA com adaptações PMRT aumenta o bem-estar do usuário após as sessões de treinamento. Além disso, esta experiência de treinamento ajuda os usuários a superar seus problemas de deslocamento, bem como a apontar desafios antes do uso em larga escala. A arquitetura de sistema proposta, permite estudos adicionais sobre a telerreabilitação de usuários de CRM

    Enhanced life-size holographic telepresence framework with real-time three-dimensional reconstruction for dynamic scene

    Get PDF
    Three-dimensional (3D) reconstruction has the ability to capture and reproduce 3D representation of a real object or scene. 3D telepresence allows the user to feel the presence of remote user that was remotely transferred in a digital representation. Holographic display is one of alternatives to discard wearable hardware restriction, it utilizes light diffraction to display 3D images to the viewers. However, to capture a real-time life-size or a full-body human is still challenging since it involves a dynamic scene. The remaining issue arises when dynamic object to be reconstructed is always moving and changes shapes and required multiple capturing views. The life-size data captured were multiplied exponentially when working with more depth cameras, it can cause the high computation time especially involving dynamic scene. To transfer high volume 3D images over network in real-time can also cause lag and latency issue. Hence, the aim of this research is to enhance life-size holographic telepresence framework with real-time 3D reconstruction for dynamic scene. There are three stages have been carried out, in the first stage the real-time 3D reconstruction with the Marching Square algorithm is combined during data acquisition of dynamic scenes captured by life-size setup of multiple Red Green Blue-Depth (RGB-D) cameras. Second stage is to transmit the data that was acquired from multiple RGB-D cameras in real-time and perform double compression for the life-size holographic telepresence. The third stage is to evaluate the life-size holographic telepresence framework that has been integrated with the real-time 3D reconstruction of dynamic scenes. The findings show that by enhancing life-size holographic telepresence framework with real-time 3D reconstruction, it has reduced the computation time and improved the 3D representation of remote user in dynamic scene. By running the double compression for the life-size holographic telepresence, 3D representations in life-size is smooth. It has proven can minimize the delay or latency during acquired frames synchronization in remote communications

    The Evolving Technology-Augmented CourtroomBefore, During, and After the Pandemic

    Get PDF
    Even before the COVID-19 Pandemic, technology was changing the nature of America’s courtrooms. Access to case management and e-filing data and documents coupled with electronic display of information and evidence at trial, remote appearances, electronic court records, and assistive technology for those with disabilities defined the technology-augmented trial courtroom. With the advent of the Pandemic and the need for social distancing, numerous courts moved to remote appearances, virtual hearings, and even virtual trials. This Article reviews the nature of technology-augmented courtrooms and discusses virtual hearings and trials at length, reviewing legality, technology, human factors, and public acceptance, and concludes that virtual hearings will continue after the Pandemic

    The Evolving Technology-Augmented CourtroomBefore, During, and After the Pandemic

    Get PDF
    Even before the COVID-19 Pandemic, technology was changing the nature of America’s courtrooms. Access to case management and e-filing data and documents coupled with electronic display of information and evidence at trial, remote appearances, electronic court records, and assistive technology for those with disabilities defined the technology-augmented trial courtroom. With the advent of the Pandemic and the need for social distancing, numerous courts moved to remote appearances, virtual hearings, and even virtual trials. This Article reviews the nature of technology-augmented courtrooms and discusses virtual hearings and trials at length, reviewing legality, technology, human factors, and public acceptance, and concludes that virtual hearings will continue after the Pandemic
    corecore