Automatic Diary Generation System including Information on Joint Experiences between Humans and Robots

In this study, we propose an automatic diary generation system that uses information from past joint experiences with the aim of increasing the favorability for robots through shared experiences between humans and robots. For the verbalization of the robot's memory, the system applies a large-scale language model, which is a rapidly developing field. Since this model does not have memories of experiences, it generates a diary by receiving information from joint experiences. As an experiment, a robot and a human went for a walk and generated a diary with interaction and dialogue history. The proposed diary achieved high scores in comfort and performance in the evaluation of the robot's impression. In the survey of diaries giving more favorable impressions, diaries with information on joint experiences were selected higher than diaries without such information, because diaries with information on joint experiences showed more cooperation between the robot and the human and more intimacy from the robot.Comment: 12 pages, 5 figures, IAS-1

Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model

It is important for daily life support robots to detect changes in their environment and perform tasks. In the field of anomaly detection in computer vision, probabilistic and deep learning methods have been used to calculate the image distance. These methods calculate distances by focusing on image pixels. In contrast, this study aims to detect semantic changes in the daily life environment using the current development of large-scale vision-language models. Using its Visual Question Answering (VQA) model, we propose a method to detect semantic changes by applying multiple questions to a reference image and a current image and obtaining answers in the form of sentences. Unlike deep learning-based methods in anomaly detection, this method does not require any training or fine-tuning, is not affected by noise, and is sensitive to semantic state changes in the real world. In our experiments, we demonstrated the effectiveness of this method by applying it to a patrol task in a real-life environment using a mobile robot, Fetch Mobile Manipulator. In the future, it may be possible to add explanatory power to changes in the daily life environment through spoken language.Comment: Accepted to 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023

Microheater-integrated zinc oxide nanowire microfluidic device for hybridization-based detection of target single-stranded DNA

Detection of cell-free DNA (cfDNA) has an impact on DNA analysis in liquid biopsies. However, current strategies to detect cfDNA have limitations that should be overcome, such as having low sensitivity and requiring much time and a specialized instrument. Thus, non-invasive and rapid detection tools are needed for disease prevention and early-stage treatment. Here we developed a device having a microheater integrated with zinc oxide nanowires (microheater-ZnO-NWs) to detect target single-stranded DNAs (ssDNAs) based on DNA probe hybridization. We confirmed experimentally that our device realized in-situ annealed DNA probes by which we subsequently detected target ssDNAs. We envision that this device can be utilized for fundamental studies related to nanobiodevice-based DNA detection