Integrating Olfaction in a Robotic Telepresence Loop

In this work we propose enhancing a typical robotic telepresence architecture by considering olfactory and wind flow information in addition to the common audio and video channels. The objective is to expand the range of applications where robotics telepresence can be applied, including those related to the detection of volatile chemical substances (e.g. land-mine detection, explosive deactivation, operations in noxious environments, etc.). Concretely, we analyze how the sense of smell can be integrated in the telepresence loop, covering the digitization of the gases and wind flow present in the remote environment, the transmission through the communication network, and their display at the user location. Experiments under different environmental conditions are presented to validate the proposed telepresence system when localizing a gas emission leak at the remote environment.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tech

Cooperative strategies for the detection and localization of odorants with robots and artificial noses

En este trabajo de investigación se aborda el diseño de una plataforma robótica orientada a la implementación de estrategias de búsqueda cooperativa bioinspiradas. En particular, tanto el proceso de diseño de la parte electrónica como hardware se han enfocado hacia la validación en entornos reales de algoritmos capaces de afrontar problemas de búsqueda con incertidumbre, como lo es la búsqueda de fuentes de olor que presentan variación espacial y temporal. Este tipo de problemas pueden ser resueltos de forma más eficiente con el empleo de enjambres con una cantidad razonable de robots, y por tanto la plataforma ha sido desarrollada utilizando componentes de bajo coste. Esto ha sido posible por la combinación de elementos estandarizados -como la placa controladora Arduino y otros sensores integrados- con piezas que pueden ser fabricadas mediante una impresora 3D atendiendo a la filosofía del hardware libre (open-source). Entre los requisitos de diseño se encuentran además la eficiencia energética -para maximizar el tiempo de funcionamiento de los robots-, su capacidad de posicionamiento en el entorno de búsqueda, y la integración multisensorial -con la inclusión de una nariz electrónica, sensores de luminosidad, distancia, humedad y temperatura, así como una brújula digital-. También se aborda el uso de una estrategia de comunicación adecuada basada en ZigBee. El sistema desarrollado, denominado GNBot, se ha validado tanto en los aspectos de eficiencia energética como en sus capacidades combinadas de posicionamiento espacial y de detección de fuentes de olor basadas en disoluciones de etanol. La plataforma presentada -formada por el GNBot, su placa electrónica GNBoard y la capa de abstracción software realizada en Python- simplificará por tanto el proceso de implementación y evaluación de diversas estrategias de detección, búsqueda y monitorización de odorantes, con la estandarización de enjambres de robots provistos de narices artificiales y otros sensores multimodales.This research work addresses the design of a robotic platform oriented towards the implementation of bio-inspired cooperative search strategies. In particular, the design processes of both the electronics and hardware have been focused towards the real-world validation of algorithms that are capable of tackling search problems that have uncertainty, such as the search of odor sources that have spatio-temporal variability. These kind of problems can be solved more efficiently with the use of swarms formed by a considerable amount of robots, and thus the proposed platform makes use of low cost components. This has been possible with the combination of standardized elements -as the Arduino controller board and other integrated sensors- with custom parts that can be manufactured with a 3D printer attending to the open-source hardware philosophy. Among the design requirements is the energy efficiency -in order to maximize the working range of the robots-, their positioning capability within the search environment, and multiple sensor integration -with the incorporation of an artificial nose, luminosity, distance, humidity and temperature sensors, as well as an electronic compass-. Another subject that is tackled is the use of an efficient wireless communication strategy based on ZigBee. The developed system, named GNBot, has also been validated in the aspects of energy efficiency and for its combined capabilities for autonomous spatial positioning and detection of ethanol-based odor sources. The presented platform -formed by the GNBot, the GNBoard electronics and the abstraction layer built in Python- will thus simplify the processes of implementation and evaluation of various strategies for the detection, search and monitoring of odorants with conveniently standardized robot swarms provided with artificial noses and other multimodal sensors

Spatial information from the odour environment in mammalian olfaction

The sense of smell is an essential modality for many species, in particular nocturnal and crepuscular mammals, to gather information about their environment. Olfactory cues provide information over a large range of distances, allowing behaviours ranging from simple detection and recognition of objects, to tracking trails and navigating using odour plumes from afar. In this review, we discuss the features of the natural olfactory environment and provide a brief overview of how odour information can be sampled and might be represented and processed by the mammalian olfactory system. Finally, we discuss recent behavioural approaches that address how mammals extract spatial information from the environment in three diferent contexts: odour trail tracking, odour plume tracking and, more general, olfactory-guided navigation. Recent technological developments have seen the spatiotemporal aspect of mammalian olfaction gain signifcant attention, and we discuss both the promising aspects of rapidly developing paradigms and stimulus control technologies as well as their limitations. We conclude that, while still in its beginnings, research on the odour environment ofers an entry point into understanding the mechanisms how mammals extract information about space

Design and Implement a Gas Pipeline Inspection System using Robotic Vehicle

Gas leak is an important safety issue in oil and gas production. During the past fifteen years, a considerable number of studies have been made into how to detect and localize gas leaks. Equipped with sensors measuring the point concentration of specific substances, a variety of mobile robots and technologies have been looking for gas sources. This paper presents a real-time system to detect abnormal events on gas pipes, by developing a data monitoring system to detect the gas levels and concentration using GAS leak detector system that is positioned on robotic vehicle (pioneer p3-dx) combined with modern communication technologies in terms of GPS to locate the robot in real-time accuracy of tracking process. Keywords: Gas Detection, Robotic (outdoor seeker), EASYPEE (zigbee) board, GP

Long-term robot motion planning for active sound source localization with Monte Carlo tree search

International audienceWe consider the problem of controlling a mobile robot in order to localize a sound source. A microphone array can provide the robot with information on source localization. By combining this information with the movements of the robot, the localization accuracy can be improved. However, random robot motion or short-term planning may not result in optimal localization. In this paper, we propose an optimal long-term robot motion planning algorithm for active source lo-calization. We introduce a Monte Carlo tree search (MCTS) method to find a sequence of robot actions that minimize the entropy of the belief on the source location. A tree of possible robot movements which balances between exploration and exploitation is first constructed. Then, the movement that leads to minimum uncertainty is selected and executed. Experiments and statistical results show the effectiveness of our proposed method on improving sound source localization in the long term compared to other motion planning methods

Earth as Interface: Exploring chemical senses with Multisensory HCI Design for Environmental Health Communication

As environmental problems intensify, the chemical senses -that is smell and taste, are the most relevantsenses to evidence them.As such, environmental exposure vectors that can reach human beings comprise air,food, soil and water[1].Within this context, understanding the link between environmental exposures andhealth[2]is crucial to make informed choices, protect the environment and adapt to new environmentalconditions[3].Smell and taste lead therefore to multi-sensorial experiences which convey multi-layered information aboutlocal and global events[4]. However, these senses are usually absent when those problems are represented indigital systems. The multisensory HCIdesign framework investigateschemical sense inclusion withdigital systems[5]. Ongoing efforts tackledigitalization of smell and taste for digital delivery, transmission or substitution [6]. Despite experimentsproved technological feasibility, its dissemination depends on relevant applicationdevelopment[7].This thesis aims to fillthose gaps by demonstratinghow chemical senses provide the means to link environment and health based on scientific andgeolocation narratives [8], [9],[10]. We present a Multisensory HCI design process which accomplished symbolicdisplaying smell and taste and led us to a new multi-sensorial interaction system presented herein. We describe the conceptualization, design and evaluation of Earthsensum, an exploratory case study project.Earthsensumoffered to 16 participants in the study, environmental smell and taste experiences about real geolocations to participants of the study. These experiences were represented digitally using mobilevirtual reality (MVR) and mobile augmented reality (MAR). Its technologies bridge the real and digital Worlds through digital representations where we can reproduce the multi-sensorial experiences. Our study findings showed that the purposed interaction system is intuitive and can lead not only to a betterunderstanding of smell and taste perception as also of environmental problems. Participants comprehensionabout the link between environmental exposures and health was successful and they would recommend thissystem as education tools. Our conceptual design approach was validated and further developments wereencouraged.In this thesis,we demonstratehow to applyMultisensory HCI methodology to design with chemical senses. Weconclude that the presented symbolic representation model of smell and taste allows communicatingtheseexperiences on digital platforms. Due to its context-dependency, MVR and MAR platforms are adequatetechnologies to be applied for this purpose.Future developments intend to explore further the conceptual approach. These developments are centredon the use of the system to induce hopefully behaviourchange. Thisthesisopens up new application possibilities of digital chemical sense communication,Multisensory HCI Design and environmental health communication.À medida que os problemas ambientais se intensificam, os sentidos químicos -isto é, o cheiroe sabor, são os sentidos mais relevantes para evidenciá-los. Como tais, os vetores de exposição ambiental que podem atingir os seres humanos compreendem o ar, alimentos, solo e água [1]. Neste contexto, compreender a ligação entre as exposições ambientais e a saúde [2] é crucial para exercerescolhas informadas, proteger o meio ambiente e adaptar a novas condições ambientais [3]. O cheiroe o saborconduzemassima experiências multissensoriais que transmitem informações de múltiplas camadas sobre eventos locais e globais [4]. No entanto, esses sentidos geralmente estão ausentes quando esses problemas são representados em sistemas digitais. A disciplina do design de Interação Humano-Computador(HCI)multissensorial investiga a inclusão dossentidos químicos em sistemas digitais [9]. O seu foco atual residena digitalização de cheirose sabores para o envio, transmissão ou substituiçãode sentidos[10]. Apesar dasexperimentaçõescomprovarem a viabilidade tecnológica, a sua disseminação está dependentedo desenvolvimento de aplicações relevantes [11]. Estatese pretendepreencher estas lacunas ao demonstrar como os sentidos químicos explicitama interconexãoentre o meio ambiente e a saúde, recorrendo a narrativas científicas econtextualizadasgeograficamente[12], [13], [14]. Apresentamos uma metodologiade design HCImultissensorial que concretizouum sistema de representação simbólica de cheiro e sabor e nos conduziu a um novo sistema de interação multissensorial, que aqui apresentamos. Descrevemos o nosso estudo exploratório Earthsensum, que integra aconceptualização, design e avaliação. Earthsensumofereceu a 16participantes do estudo experiências ambientais de cheiro e sabor relacionadas com localizações geográficasreais. Essas experiências foram representadas digitalmente através derealidade virtual(VR)e realidade aumentada(AR).Estas tecnologias conectamo mundo real e digital através de representações digitais onde podemos reproduzir as experiências multissensoriais. Os resultados do nosso estudo provaramque o sistema interativo proposto é intuitivo e pode levar não apenas a uma melhor compreensão da perceção do cheiroe sabor, como também dos problemas ambientais. O entendimentosobre a interdependência entre exposições ambientais e saúde teve êxitoe os participantes recomendariam este sistema como ferramenta para aeducação. A nossa abordagem conceptual foi positivamentevalidadae novos desenvolvimentos foram incentivados. Nesta tese, demonstramos como aplicar metodologiasde design HCImultissensorialpara projetar com ossentidos químicos. Comprovamosque o modelo apresentado de representação simbólica do cheiroe do saborpermite comunicar essas experiênciasem plataformas digitais. Por serem dependentesdocontexto, as plataformas de aplicações emVR e AR são tecnologias adequadaspara este fim.Desenvolvimentos futuros pretendem aprofundar a nossa abordagemconceptual. Em particular, aspiramos desenvolvera aplicaçãodo sistema para promover mudanças de comportamento. Esta tese propõenovas possibilidades de aplicação da comunicação dos sentidos químicos em plataformas digitais, dedesign multissensorial HCI e de comunicação de saúde ambiental

Towards disappearing user interfaces for ubiquitous computing: human enhancement from sixth sense to super senses

The enhancement of human senses electronically is possible when pervasive computers interact unnoticeably with humans in Ubiquitous Computing. The design of computer user interfaces towards “disappearing” forces the interaction with humans using a content rather than a menu driven approach, thus the emerging requirement for huge number of non-technical users interfacing intuitively with billions of computers in the Internet of Things is met. Learning to use particular applications in Ubiquitous Computing is either too slow or sometimes impossible so the design of user interfaces must be naturally enough to facilitate intuitive human behaviours. Although humans from different racial, cultural and ethnic backgrounds own the same physiological sensory system, the perception to the same stimuli outside the human bodies can be different. A novel taxonomy for Disappearing User Interfaces (DUIs) to stimulate human senses and to capture human responses is proposed. Furthermore, applications of DUIs are reviewed. DUIs with sensor and data fusion to simulate the Sixth Sense is explored. Enhancement of human senses through DUIs and Context Awareness is discussed as the groundwork enabling smarter wearable devices for interfacing with human emotional memories

Engineering derivatives from biological systems for advanced aerospace applications

The present study consisted of a literature survey, a survey of researchers, and a workshop on bionics. These tasks produced an extensive annotated bibliography of bionics research (282 citations), a directory of bionics researchers, and a workshop report on specific bionics research topics applicable to space technology. These deliverables are included as Appendix A, Appendix B, and Section 5.0, respectively. To provide organization to this highly interdisciplinary field and to serve as a guide for interested researchers, we have also prepared a taxonomy or classification of the various subelements of natural engineering systems. Finally, we have synthesized the results of the various components of this study into a discussion of the most promising opportunities for accelerated research, seeking solutions which apply engineering principles from natural systems to advanced aerospace problems. A discussion of opportunities within the areas of materials, structures, sensors, information processing, robotics, autonomous systems, life support systems, and aeronautics is given. Following the conclusions are six discipline summaries that highlight the potential benefits of research in these areas for NASA's space technology programs