Towards Assistive Feeding with a General-Purpose Mobile Manipulator

General-purpose mobile manipulators have the potential to serve as a versatile form of assistive technology. However, their complexity creates challenges, including the risk of being too difficult to use. We present a proof-of-concept robotic system for assistive feeding that consists of a Willow Garage PR2, a high-level web-based interface, and specialized autonomous behaviors for scooping and feeding yogurt. As a step towards use by people with disabilities, we evaluated our system with 5 able-bodied participants. All 5 successfully ate yogurt using the system and reported high rates of success for the system's autonomous behaviors. Also, Henry Evans, a person with severe quadriplegia, operated the system remotely to feed an able-bodied person. In general, people who operated the system reported that it was easy to use, including Henry. The feeding system also incorporates corrective actions designed to be triggered either autonomously or by the user. In an offline evaluation using data collected with the feeding system, a new version of our multimodal anomaly detection system outperformed prior versions.Comment: This short 4-page paper was accepted and presented as a poster on May. 16, 2016 in ICRA 2016 workshop on 'Human-Robot Interfaces for Enhanced Physical Interactions' organized by Arash Ajoudani, Barkan Ugurlu, Panagiotis Artemiadis, Jun Morimoto. It was peer reviewed by one reviewe

Intuitive human interactive with an arm robot for severely handicapped people - A one click approach.

International audienceAssistance to disabled people is still a domain in which a lot of progress needs to be done. The more severe the handicap is, more complex are the devices, implying increased efforts to simplify the interactions between man and these devices. In this document we propose a solution to reduce the interaction between a user and a robotic arm. The system is equipped with two cameras. One is fixed on the top of the wheelchair (eye-to-hand) and the other one is mounted on the end effector of the robotic arm (eye-in-hand). The two cameras cooperate to reduce the grasping task to one click. The method is generic, it does not require marks on the object, geometrical model or the database. It thus provides a tool applicable to any kind of graspable object. The paper first gives an overview of the existing grasping tools for disabled people and proposes a novel approach toward an intuitive human machine interaction

Definition of problems of persons in sheltered care environments

Innovations in health care using aerospace technologies are described. Voice synthesizer and voice recognition technologies were used in developing voice controlled wheel chairs and optacons. Telephone interface modules are also described

Sensor-based navigating mobile robots for people with disabilities

People with severe physical disabilities need help with everyday tasks, such as getting dressed, eating, brushing their teeth, scratching themselves, drinking, etc. They also need support to be able to work. They are usually helped by one or more persona

Overcoming barriers and increasing independence: service robots for elderly and disabled people

This paper discusses the potential for service robots to overcome barriers and increase independence of elderly and disabled people. It includes a brief overview of the existing uses of service robots by disabled and elderly people and advances in technology which will make new uses possible and provides suggestions for some of these new applications. The paper also considers the design and other conditions to be met for user acceptance. It also discusses the complementarity of assistive service robots and personal assistance and considers the types of applications and users for which service robots are and are not suitable

Design of a Multiple-User Intelligent Feeding Robot for Elderly and Disabled

The number of elderly people around the world is growing rapidly. This has led to an increase in the number of people who are seeking assistance and adequate service either at home or in long-term- care institutions to successfully accomplish their daily activities. Responding to these needs has been a burden to the health care system in terms of labour and associated costs and has motivated research in developing alternative services using new technologies. Various intelligent, and non-intelligent, machines and robots have been developed to meet the needs of elderly and people with upper limb disabilities or dysfunctions in gaining independence in eating, which is one of the most frequent and time-consuming everyday tasks. However, in almost all cases, the proposed systems are designed only for the personal use of one individual and little effort to design a multiple-user feeding robot has been previously made. The feeding requirements of elderly in environments such as senior homes, where many elderly residents dine together at least three times per day, have not been extensively researched before. The aim of this research was to develop a machine to feed multiple elderly people based on their characteristics and feeding needs, as determined through observations at a nursing home. Observations of the elderly during meal times have revealed that almost 40% of the population was totally dependent on nurses or caregivers to be fed. Most of those remaining, suffered from hand tremors, joint pain or lack of hand muscle strength, which made utensil manipulation and coordination very difficult and the eating process both messy and lengthy. In addition, more than 43% of the elderly were very slow in eating because of chewing and swallowing problems and most of the rest were slow in scooping and directing utensils toward their mouths. Consequently, one nurse could only respond to a maximum of two diners simultaneously. In order to manage the needs of all elderly diners, they required the assistance of additional staff members. The limited time allocated for each meal and the daily progression of the seniors’ disabilities also made mealtime very challenging. Based on the caregivers’ opinion, many of the elderly in such environments can benefit from a machine capable of feeding multiple users simultaneously. Since eating is a slow procedure, the idle state of the robot during one user’s chewing and swallowing time can be allotted for feeding another person who is sitting at the same table. The observations and studies have resulted in the design of a food tray, and selection of an appropriate robot and applicable user interface. The proposed system uses a 6-DOF serial articulated robot in the center of a four-seat table along with a specifically designed food tray to feed one to four people. It employs a vision interface for food detection and recognition. Building the dynamic equations of the robotic system and simulation of the system were used to verify its dynamic behaviour before any prototyping and real-time testing

An algorithm for facial expression recognition to assist handicapped individuals with eating disabilities

The purpose of this thesis is to describe an algorithm and implement a software system based upon facial expression recognition that will accurately determine the specific need of a handicapped individual pertaining to the eating process. Then based upon that need, determine the appropriate action that should be executed. This thesis aims to present a solution to allow a special needs individual to eat more efficienty and foster independence, while providing a platform for further research in the area of feature detection to assist individuals with special needs

Ambient Assisted Living Technology

Ambient assisted living technology, known as ambient welfare technology in Denmark, promises to play a prominent role in the future of home health care. This project, sponsored by the Danish Association of the Blind, investigated the social and political context of ambient welfare technology and the primary concerns of stakeholder’s in its development. The results from our research were used to develop criteria for evaluating assistive devices and make recommendations for future development of these technologies