CORE
🇺🇦
make metadata, not war
Services
Services overview
Explore all CORE services
Access to raw data
API
Dataset
FastSync
Content discovery
Recommender
Discovery
OAI identifiers
OAI Resolver
Managing content
Dashboard
Bespoke contracts
Consultancy services
Support us
Support us
Membership
Sponsorship
Community governance
Advisory Board
Board of supporters
Research network
About
About us
Our mission
Team
Blog
FAQs
Contact us
Interactive Multi-Modal Robot Programming
Authors
Soshi Iba
Pradeep K. Khosla
Chris Paredis
Publication date
1 January 2002
Publisher
'Institute of Electrical and Electronics Engineers (IEEE)'
Abstract
This paper was presented at the 2002 IEEE International Conference on Robotics and Automation, Washington, DC. The definitive paper is located at http://ieeexplore.ieee.org (DOI: 10.1109/ROBOT.2002.1013355). © IEEE.As robots enter the human environment and come in contact with inexperienced users, they need to be able to interact with users in a multi-modal fashion—keyboard and mouse are no longer acceptable as the only input modalities. This paper introduces a novel approach to program a robot interactively through a multi-modal interface. The key characteristic of this approach is that the user can provide feedback interactively at any time—during both the programming and the execution phase. The framework takes a three-step approach to the problem: multi-modal recognition, intention interpretation, and prioritized task execution. The multi-modal recognition module translates hand gestures and spontaneous speech into a structured symbolic data stream without abstracting away the user's intent. The intention interpretation module selects the appropriate primitives to generate a task based on the user's input, the system's current state, and robot sensor data. Finally, the prioritized task execution module selects and executes skill primitives based on the system’s current state, sensor inputs, and prior tasks. The framework is demonstrated by interactively controlling and programming a vacuum-cleaning robot
Similar works
Full text
Open in the Core reader
Download PDF
Available Versions
CiteSeerX
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:CiteSeerX.psu:10.1.1.71.82...
Last time updated on 22/10/2014
CiteSeerX
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:CiteSeerX.psu:10.1.1.68.26...
Last time updated on 22/10/2014
Scholarly Materials And Research @ Georgia Tech
See this paper in CORE
Go to the repository landing page
Download from data provider
oai:smartech.gatech.edu:1853/3...
Last time updated on 21/06/2012