4 research outputs found
Automatic Diary Generation System including Information on Joint Experiences between Humans and Robots
In this study, we propose an automatic diary generation system that uses
information from past joint experiences with the aim of increasing the
favorability for robots through shared experiences between humans and robots.
For the verbalization of the robot's memory, the system applies a large-scale
language model, which is a rapidly developing field. Since this model does not
have memories of experiences, it generates a diary by receiving information
from joint experiences. As an experiment, a robot and a human went for a walk
and generated a diary with interaction and dialogue history. The proposed diary
achieved high scores in comfort and performance in the evaluation of the
robot's impression. In the survey of diaries giving more favorable impressions,
diaries with information on joint experiences were selected higher than diaries
without such information, because diaries with information on joint experiences
showed more cooperation between the robot and the human and more intimacy from
the robot.Comment: 12 pages, 5 figures, IAS-1
Semantic Scene Difference Detection in Daily Life Patroling by Mobile Robots using Pre-Trained Large-Scale Vision-Language Model
It is important for daily life support robots to detect changes in their
environment and perform tasks. In the field of anomaly detection in computer
vision, probabilistic and deep learning methods have been used to calculate the
image distance. These methods calculate distances by focusing on image pixels.
In contrast, this study aims to detect semantic changes in the daily life
environment using the current development of large-scale vision-language
models. Using its Visual Question Answering (VQA) model, we propose a method to
detect semantic changes by applying multiple questions to a reference image and
a current image and obtaining answers in the form of sentences. Unlike deep
learning-based methods in anomaly detection, this method does not require any
training or fine-tuning, is not affected by noise, and is sensitive to semantic
state changes in the real world. In our experiments, we demonstrated the
effectiveness of this method by applying it to a patrol task in a real-life
environment using a mobile robot, Fetch Mobile Manipulator. In the future, it
may be possible to add explanatory power to changes in the daily life
environment through spoken language.Comment: Accepted to 2023 IEEE/RSJ International Conference on Intelligent
Robots and Systems (IROS 2023
Microheater-integrated zinc oxide nanowire microfluidic device for hybridization-based detection of target single-stranded DNA
Detection of cell-free DNA (cfDNA) has an impact on DNA analysis in liquid biopsies. However, current strategies to detect cfDNA have limitations that should be overcome, such as having low sensitivity and requiring much time and a specialized instrument. Thus, non-invasive and rapid detection tools are needed for disease prevention and early-stage treatment. Here we developed a device having a microheater integrated with zinc oxide nanowires (microheater-ZnO-NWs) to detect target single-stranded DNAs (ssDNAs) based on DNA probe hybridization. We confirmed experimentally that our device realized in-situ annealed DNA probes by which we subsequently detected target ssDNAs. We envision that this device can be utilized for fundamental studies related to nanobiodevice-based DNA detection