Integrating Olfaction in a Robotic Telepresence Loop

In this work we propose enhancing a typical robotic telepresence architecture by considering olfactory and wind flow information in addition to the common audio and video channels. The objective is to expand the range of applications where robotics telepresence can be applied, including those related to the detection of volatile chemical substances (e.g. land-mine detection, explosive deactivation, operations in noxious environments, etc.). Concretely, we analyze how the sense of smell can be integrated in the telepresence loop, covering the digitization of the gases and wind flow present in the remote environment, the transmission through the communication network, and their display at the user location. Experiments under different environmental conditions are presented to validate the proposed telepresence system when localizing a gas emission leak at the remote environment.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Multi-destination beaming: apparently being in three places at once through robotic and virtual embodiment

It has been shown that an illusion of ownership over an artificial limb or even an entire body can be induced in people through multisensory stimulation, providing evidence that the surrogate body is the person’s actual body. Such body ownership illusions (BOIs) have been shown to occur with virtual bodies, mannequins, and humanoid robots. In this study, we show the possibility of eliciting a full-BOI over not one, but multiple artificial bodies concurrently. We demonstrate this by describing a system that allowed a participant to inhabit and fully control two different humanoid robots located in two distinct places and a virtual body in immersive virtual reality, using real-time full-body tracking and two-way audio communication, thereby giving them the illusion of ownership over each of them. We implemented this by allowing the participant be embodied in any one surrogate body at a given moment and letting them instantaneously switch between them. While the participant was embodied in one of the bodies, a proxy system would track the locations currently unoccupied and would control their remote representation in order to continue performing the tasks in those locations in a logical fashion. To test the efficacy of this system, an exploratory study was carried out with a fully functioning setup with three destinations and a simplified version of the proxy for use in a social interaction. The results indicate that the system was physically and psychologically comfortable and was rated highly by participants in terms of usability. Additionally, feelings of BOI and agency were reported, which were not influenced by the type of body representation. The results provide us with clues regarding BOI with humanoid robots of different dimensions, along with insight about self-localization and multilocation

Robots and Cultural Heritage: New Museum Experiences

The introduction of new technologies to enhance the visiting museum experience is not a novelty. A large variety of interactive systems are nowadays available, including virtual tours, which makes cultural heritage accessible remotely. The theme of increase in accessibility and attractiveness has lately been faced with the employment of the service robotics, covering various types of applications. Regrettably, many of robotics solutions appear less successful in terms of utility and usability. On the basis of this awareness, a design for a new robotic solution for cultural heritage has been proposed. The project, developed at the royal residence of Racconigi Castle, consists of a telepresence robot designed as a tool to explore inaccessible areas of the heritage. The employed robot, called Virgil, was expressly designed for the project. The control of the robot is entrusted to the museum guides in order to enhance their work and enrich the cultural storytelling

Robo-ethics design approach for cultural heritage: Case study - Robotics for museum purpose

The thesis shows the study behind the design process and the realization of the robotic solution for museum purposes called Virgil. The research started with the literature review on museums management and the critic analysis of signi cant digital experiences in the museum eld. Then, it continues analyzing the museum and its relation with the territory and the cultural heritage. From this preliminary analysis stage, signi cant issue related to museum management analysis comes out: nowadays many museum areas are not accessible to visitors because of issues related to security or architectural barriers. Make explorable these areas is one of the important topics in the cultural debate related to the visiting experience. This rst stage gave the knowledge to develop the outlines which brought to the realization of an ef cient service design then realized following robot ethical design values. One of the pillars of the robot ethical design is the necessity to involve all the stakeholders in the early project phases, for this reason, the second stage of the research was the study of the empathic relations between museum and visitors. In this phase, facilitator factors of this relation are de ned and transformed into guidelines for the product system performances. To perform this stage, it has been necessary create a relation between all the stakeholders of the project, which are: Politecnico di Torino, Tim (Telecom Italia Mobile) JOL CRAB research laboratory and Terre dei Savoia which is the association in charge of the Racconiggi’s Castle, the context scenario of the research. The third stage of the research, provided the realization of a prototype of the robot, in this stage telepresence robot piloted the Museum Guide it is used to show, in real time, the inaccessible areas of the museum enriched with multimedia contents. This stage concludes with the nal test user, from the test session feedback analysis, many of people want to drive themselves the robot. To give an answer to user feedback an interactive game has been developed. The game is based both on the robot ability to be driven by the visitors and also on the capacity of the robot to be used as a platform for the digital telling. To be effective, the whole experience it has been designed and tested with the support of high school students, which are one of the categories less interested in the traditional museum visit. This experience wants to demonstrate that the conscious and ethical use of the robotic device is effectively competitive, in term of performances, with the other solutions of digital visit: because it allows a more interactive digital experience in addition to the satisfaction of the physical visit at the museum

The computerization of archaeology: survey on AI techniques

This paper analyses the application of artificial intelligence techniques to various areas of archaeology and more specifically: a) The use of software tools as a creative stimulus for the organization of exhibitions; the use of humanoid robots and holographic displays as guides that interact and involve museum visitors; b) The analysis of methods for the classification of fragments found in archaeological excavations and for the reconstruction of ceramics, with the recomposition of the parts of text missing from historical documents and epigraphs; c) The cataloguing and study of human remains to understand the social and historical context of belonging with the demonstration of the effectiveness of the AI techniques used; d) The detection of particularly difficult terrestrial archaeological sites with the analysis of the architectures of the Artificial Neural Networks most suitable for solving the problems presented by the site; the design of a study for the exploration of marine archaeological sites, located at depths that cannot be reached by man, through the construction of a freely explorable 3D version

Videos in Context for Telecommunication and Spatial Browsing

The research presented in this thesis explores the use of videos embedded in panoramic imagery to transmit spatial and temporal information describing remote environments and their dynamics. Virtual environments (VEs) through which users can explore remote locations are rapidly emerging as a popular medium of presence and remote collaboration. However, capturing visual representation of locations to be used in VEs is usually a tedious process that requires either manual modelling of environments or the employment of specific hardware. Capturing environment dynamics is not straightforward either, and it is usually performed through specific tracking hardware. Similarly, browsing large unstructured video-collections with available tools is difficult, as the abundance of spatial and temporal information makes them hard to comprehend. At the same time, on a spectrum between 3D VEs and 2D images, panoramas lie in between, as they offer the same 2D images accessibility while preserving 3D virtual environments surrounding representation. For this reason, panoramas are an attractive basis for videoconferencing and browsing tools as they can relate several videos temporally and spatially. This research explores methods to acquire, fuse, render and stream data coming from heterogeneous cameras, with the help of panoramic imagery. Three distinct but interrelated questions are addressed. First, the thesis considers how spatially localised video can be used to increase the spatial information transmitted during video mediated communication, and if this improves quality of communication. Second, the research asks whether videos in panoramic context can be used to convey spatial and temporal information of a remote place and the dynamics within, and if this improves users' performance in tasks that require spatio-temporal thinking. Finally, the thesis considers whether there is an impact of display type on reasoning about events within videos in panoramic context. These research questions were investigated over three experiments, covering scenarios common to computer-supported cooperative work and video browsing. To support the investigation, two distinct video+context systems were developed. The first telecommunication experiment compared our videos in context interface with fully-panoramic video and conventional webcam video conferencing in an object placement scenario. The second experiment investigated the impact of videos in panoramic context on quality of spatio-temporal thinking during localization tasks. To support the experiment, a novel interface to video-collection in panoramic context was developed and compared with common video-browsing tools. The final experimental study investigated the impact of display type on reasoning about events. The study explored three adaptations of our video-collection interface to three display types. The overall conclusion is that videos in panoramic context offer a valid solution to spatio-temporal exploration of remote locations. Our approach presents a richer visual representation in terms of space and time than standard tools, showing that providing panoramic contexts to video collections makes spatio-temporal tasks easier. To this end, videos in context are suitable alternative to more difficult, and often expensive solutions. These findings are beneficial to many applications, including teleconferencing, virtual tourism and remote assistance