A Data-driven Approach Towards Human-robot Collaborative Problem Solving in a Shared Space

We are developing a system for human-robot communication that enables people to communicate with robots in a natural way and is focused on solving problems in a shared space. Our strategy for developing this system is fundamentally data-driven: we use data from multiple input sources and train key components with various machine learning techniques. We developed a web application that is collecting data on how two humans communicate to accomplish a task, as well as a mobile laboratory that is instrumented to collect data on how two humans communicate to accomplish a task in a physically shared space. The data from these systems will be used to train and fine-tune the second stage of our system, in which the robot will be simulated through software. A physical robot will be used in the final stage of our project. We describe these instruments, a test-suite and performance metrics designed to evaluate and automate the data gathering process as well as evaluate an initial data set.Comment: 2017 AAAI Fall Symposium on Natural Communication for Human-Robot Collaboratio

A novel haptic model and environment for maxillofacial surgical operation planning and manipulation

This paper presents a practical method and a new haptic model to support manipulations of bones and their segments during the planning of a surgical operation in a virtual environment using a haptic interface. To perform an effective dental surgery it is important to have all the operation related information of the patient available beforehand in order to plan the operation and avoid any complications. A haptic interface with a virtual and accurate patient model to support the planning of bone cuts is therefore critical, useful and necessary for the surgeons. The system proposed uses DICOM images taken from a digital tomography scanner and creates a mesh model of the filtered skull, from which the jaw bone can be isolated for further use. A novel solution for cutting the bones has been developed and it uses the haptic tool to determine and define the bone-cutting plane in the bone, and this new approach creates three new meshes of the original model. Using this approach the computational power is optimized and a real time feedback can be achieved during all bone manipulations. During the movement of the mesh cutting, a novel friction profile is predefined in the haptical system to simulate the force feedback feel of different densities in the bone

Geometrical Product Specification and Verification as toolbox to meet up-to-date technical requirements

The ISO standards for the Geometrical Product Specification and Verification (GPS) define an internationally uniform description language, that allows expressing unambiguously and completely all requirements for the geometry of a product with the corresponding requirements for the inspection process in technical drawings, taking into account current possibilities of measurement and testing technology. The practice shows that the university curricula of the mechanical engineering faculties often include only limited classes on the GPS, mostly as part of curriculum of subjects like Metrology or Fundamentals of Machine Design. This does not allow students to gain enough knowledge on the subject. Currently there is no coherent EU-wide provision for vocational training (VET) in this area. Consortium, members of which are the authors of this paper, is preparing a proposal of an EU project aiming to develop appropriate course

Virtual horizontal machining center LOLA HBG 80 for program verification and monitoring

Ovaj rad opisuje konfigurisanje virtuelnog horizontalnog obradnog centra LOLA HBG80 u okviru sistema za programiranje i verifikaciju, kao i u okviru sistema otvorene arhitekture upravljanja. Horizontalni obradni centar LOLA HBG 80 podržan je ekvivalentnom virtuelnom mašinom u CAD/CAM okruženju (PTC Creo i Catia), STEP-NC mašinskom okruženju, kao i u upravljačkom sistemu. Virtuelna simulacija je od suštinske važnosti za obradu, a razvijene virtuelne mašine koriste se za verifikaciju programa i monitoring procesa obrade. Virtuelna mašina u sistemu za programiranje omogućava verifikaciju programa pre slanja na stvarnu mašinu i može da uključuje verifikaciju putanje alata (CLF-Cutter Location File) i verifikaciju G-koda. U radu se takođe govori o mogućnosti primene novog metoda programiranja poznatog kao STEP-NC i pripremi odgovarajućeg okruženja koje uključuje virtuelnu mašinu. Virtuelna mašina u sistemu upravljanja predstavlja poslednji nivo za konačnu verifikaciju programa, kao i sistem za nadzor procesa.This paper describes configuring the virtual horizontal machining center LOLA HBG80 within the programming and verification system and the open architecture control system. The horizontal machining center LOLA HBG 80 is represented by an equivalent virtual machine in a CAD/CAM environment (PTC Creo and Catia), STEP-NC Machine environment, and the control system. Virtual simulation is essential for machining, and the developed virtual machines are used for program verification and monitoring of the machining process. The virtual machine in the programming system allows the verification of the program before sending it to the real machine and includes verification of the tool path (CLF-Cutter Location File) and G-code. The paper also discusses the possibility of applying a new programming method known as STEP-NC and preparing an adequate environment that includes a virtual machine. The virtual machine in the control system represents the last level for the final program verification and the process monitoring system

Virtual horizontal machining center LOLA HBG 80 for program verification and monitoring

Ovaj rad opisuje konfigurisanje virtuelnog horizontalnog obradnog centra LOLA HBG80 u okviru sistema za programiranje i verifikaciju, kao i u okviru sistema otvorene arhitekture upravljanja. Horizontalni obradni centar LOLA HBG 80 podržan je ekvivalentnom virtuelnom mašinom u CAD/CAM okruženju (PTC Creo i Catia), STEP-NC mašinskom okruženju, kao i u upravljačkom sistemu. Virtuelna simulacija je od suštinske važnosti za obradu, a razvijene virtuelne mašine koriste se za verifikaciju programa i monitoring procesa obrade. Virtuelna mašina u sistemu za programiranje omogućava verifikaciju programa pre slanja na stvarnu mašinu i može da uključuje verifikaciju putanje alata (CLF-Cutter Location File) i verifikaciju G-koda. U radu se takođe govori o mogućnosti primene novog metoda programiranja poznatog kao STEP-NC i pripremi odgovarajućeg okruženja koje uključuje virtuelnu mašinu. Virtuelna mašina u sistemu upravljanja predstavlja poslednji nivo za konačnu verifikaciju programa, kao i sistem za nadzor procesa.This paper describes configuring the virtual horizontal machining center LOLA HBG80 within the programming and verification system and the open architecture control system. The horizontal machining center LOLA HBG 80 is represented by an equivalent virtual machine in a CAD/CAM environment (PTC Creo and Catia), STEP-NC Machine environment, and the control system. Virtual simulation is essential for machining, and the developed virtual machines are used for program verification and monitoring of the machining process. The virtual machine in the programming system allows the verification of the program before sending it to the real machine and includes verification of the tool path (CLF-Cutter Location File) and G-code. The paper also discusses the possibility of applying a new programming method known as STEP-NC and preparing an adequate environment that includes a virtual machine. The virtual machine in the control system represents the last level for the final program verification and the process monitoring system

Sharing Human-Generated Observations by Integrating HMI and the Semantic Sensor Web

Current “Internet of Things” concepts point to a future where connected objects gather meaningful information about their environment and share it with other objects and people. In particular, objects embedding Human Machine Interaction (HMI), such as mobile devices and, increasingly, connected vehicles, home appliances, urban interactive infrastructures, etc., may not only be conceived as sources of sensor information, but, through interaction with their users, they can also produce highly valuable context-aware human-generated observations. We believe that the great promise offered by combining and sharing all of the different sources of information available can be realized through the integration of HMI and Semantic Sensor Web technologies. This paper presents a technological framework that harmonizes two of the most influential HMI and Sensor Web initiatives: the W3C’s Multimodal Architecture and Interfaces (MMI) and the Open Geospatial Consortium (OGC) Sensor Web Enablement (SWE) with its semantic extension, respectively. Although the proposed framework is general enough to be applied in a variety of connected objects integrating HMI, a particular development is presented for a connected car scenario where drivers’ observations about the traffic or their environment are shared across the Semantic Sensor Web. For implementation and evaluation purposes an on-board OSGi (Open Services Gateway Initiative) architecture was built, integrating several available HMI, Sensor Web and Semantic Web technologies. A technical performance test and a conceptual validation of the scenario with potential users are reported, with results suggesting the approach is soun

IMPLEMENTATION OF A LOCALIZATION-ORIENTED HRI FOR WALKING ROBOTS IN THE ROBOCUP ENVIRONMENT

This paper presents the design and implementation of a human–robot interface capable of evaluating robot localization performance and maintaining full control of robot behaviors in the RoboCup domain. The system consists of legged robots, behavior modules, an overhead visual tracking system, and a graphic user interface. A human–robot communication framework is designed for executing cooperative and competitive processing tasks between users and robots by using object oriented and modularized software architecture, operability, and functionality. Some experimental results are presented to show the performance of the proposed system based on simulated and real-time information. </jats:p