Context-Independent Task Knowledge for Neurosymbolic Reasoning in Cognitive Robotics

One of the current main goals of artificial intelligence and robotics research is the creation of an artificial assistant which can have flexible, human like behavior, in order to accomplish everyday tasks. A lot of what is context-independent task knowledge to the human is what enables this flexibility at multiple levels of cognition. In this scope the author analyzes how to acquire, represent and disambiguate symbolic knowledge representing context-independent task knowledge, abstracted from multiple instances: this thesis elaborates the incurred problems, implementation constraints, current state-of-the-art practices and ultimately the solutions newly introduced in this scope. The author specifically discusses acquisition of context-independent task knowledge from large amounts of human-written texts and their reusability in the robotics domain; the acquisition of knowledge on human musculoskeletal dependencies constraining motion which allows a better higher level representation of observed trajectories; the means of verbalization of partial contextual and instruction knowledge, increasing interaction possibilities with the human as well as contextual adaptation. All the aforementioned points are supported by evaluation in heterogeneous setups, to bring a view on how to make optimal use of statistical & symbolic applications (i.e. neurosymbolic reasoning) in cognitive robotics. This work has been performed to enable context-adaptable artificial assistants, by bringing together knowledge on what is usually regarded as context-independent task knowledge

Design and Development of the eBear: A Socially Assistive Robot for Elderly People with Depression

There has been tremendous progress in the field of robotics in the past decade and especially developing humanoid robots with social abilities that can assist human at a socio-emotional level. The objective of this thesis is to develop and study a perceptive and expressive animal-like robot equipped with artificial intelligence in assisting the elderly people with depression. We investigated how social robots can become companions of elderly individuals with depression and improve their mood and increase their happiness and well-being. The robotic platform built in this thesis is a bear-like robot called the eBear. The eBear can show facial expression and head gesture, can understand user\u27s emotion using audio-video sensory inputs and machine learning, can speak and show relatively accurate visual speech, and make dialog with users. the eBear can respond to their questions by querying the Internet, and even encourage them to physically be more active and even perform simple physical exercises. Besides building the robot, the eBear was used in running a pilot study in which seven elderly people with mild to severe depression interacted with the eBear for about 45 minutes three times a week over one month. The results of the study show that interacting with the eBear can increase happiness and mood of these human users as measured by Face Scale, and Geriatric Depression Scale (GDS) score systems. In addition, using Almere Model, it was concluded that the acceptance of the social agent increased over the study period. Videos of the users interaction with the eBear was analyzed and eye gaze, and facial expressions were manually annotated to better understand the behavior changes of users with the eBear. Results of these analyses as well as the exit surveys completed by the users at the end of the study demonstrate that a social robot such as the eBear can be an effective companion for the elderly people and can be a new approach for depression treatment

The Future of Humanoid Robots

This book provides state of the art scientific and engineering research findings and developments in the field of humanoid robotics and its applications. It is expected that humanoids will change the way we interact with machines, and will have the ability to blend perfectly into an environment already designed for humans. The book contains chapters that aim to discover the future abilities of humanoid robots by presenting a variety of integrated research in various scientific and engineering fields, such as locomotion, perception, adaptive behavior, human-robot interaction, neuroscience and machine learning. The book is designed to be accessible and practical, with an emphasis on useful information to those working in the fields of robotics, cognitive science, artificial intelligence, computational methods and other fields of science directly or indirectly related to the development and usage of future humanoid robots. The editor of the book has extensive R&D experience, patents, and publications in the area of humanoid robotics, and his experience is reflected in editing the content of the book

Real-Time Robot Motion Planning Algorithms and Applications Under Uncertainty

Robot motion planning is an important problem for real-world robot applications. Recently, the separation of workspaces between humans and robots has been gradually fading, and there is strong interest in developing solutions where collaborative robots (cobots) can interact or work safely with humans in a shared space or in close proximity. When working with humans in real-world environments, the robots need to plan safe motions under uncertainty stemming from many sources such as noise of visual sensors, ambiguity of verbal instruction, and variety of human motions. In this thesis, we propose novel optimization-based and learning-based robot motion planning algorithms to deal with the uncertainties in real-world environments. To handle the input noise of visual cameras and the uncertainty of shape and pose estimation of surrounding objects, we present efficient probabilistic collision detection algorithms for Gaussian and non-Gaussian error distributions. By efficiently computing upper bounds of collision probability between an object and a robot, we present novel trajectory planning algorithms that guarantee that the collision probability at any trajectory point is less than a user-specified threshold. To enable human-robot interaction using natural language instructions, we present a mapping function from grounded linguistic semantics to the coefficients of the motion planning optimization problem. The mapping function considers task descriptions and motion-related constraints. For collaborative robots working with a human in close proximity, we present human intention and motion prediction algorithms for efficient task ordering and safe motion planning. The robot observes the human poses in real-time and predicts the future human motion based on the history of human poses. We also present an occlusion-aware robot motion planning algorithm that accounts for occlusion in the visual sensor data and uses learning-based techniques for trajectory planning. We highlight the benefits of our collision detection and robot motion planning algorithms with a 7-DOF Fetch robot arm in simulated and real-world environments.Doctor of Philosoph

Learning of Generalized Manipulation Strategies in Service Robotics

This thesis makes a contribution to autonomous robotic manipulation. The core is a novel constraint-based representation of manipulation tasks suitable for flexible online motion planning. Interactive learning from natural human demonstrations is combined with parallelized optimization to enable efficient learning of complex manipulation tasks with limited training data. Prior planning results are encoded automatically into the model to reduce planning time and solve the correspondence problem

Gaze-Based Control of Robot Arm in Three-Dimensional Space

Eye tracking technology has opened up a new communication channel for people with very restricted body movements. These devices had already been successfully applied as a human computer interface, e.g. for writing a text, or to control different devices like a wheelchair. This thesis proposes a Human Robot Interface (HRI) that enables the user to control a robot arm in 3-Dimensional space using only 2-Dimensional gaze direction and the states of the eyes. The introduced interface provides all required commands to translate, rotate, open or close the gripper with the definition of different control modes. In each mode, different commands are provided and direct gaze direction of the user is applied to generate continuous robot commands. To distinguish between natural inspection eye movements and the eye movements that intent to control the robot arm, dynamic command areas are proposed. The dynamic command areas are defined around the robot gripper and are updated with its movements. To provide a direct interaction of the user, gaze gestures and states of the eyes are used to switch between different control modes. For the purpose of this thesis, two versions of the above-introduced HRI were developed. In the first version of the HRI, only two simple gaze gestures and two states of the eye (closed eyes and eye winking) are used for switching. In the second version, instead of the two simple gestures, four complex gaze gestures were applied and the positions of the dynamic command areas were optimized. The complex gaze gestures enable the user to switch directly from initial mode to the desired control mode. These gestures are flexible and can be generated directly in the robot environments. For the recognition of complex gaze gestures, a novel algorithm based on Dynamic Time Warping (DTW) is proposed. The results of the studies conducted with both HRIs confirmed their feasibility and showed the high potential of the proposed interfaces as hands-free interfaces. Furthermore, the results of subjective and objective measurements showed that the usability of the interface with simple gaze gestures had been improved with the integration of complex gaze gestures and the new positions of the dynamic command areas

Technology 2001: The Second National Technology Transfer Conference and Exposition, volume 2

Proceedings of the workshop are presented. The mission of the conference was to transfer advanced technologies developed by the Federal government, its contractors, and other high-tech organizations to U.S. industries for their use in developing new or improved products and processes. Volume two presents papers on the following topics: materials science, robotics, test and measurement, advanced manufacturing, artificial intelligence, biotechnology, electronics, and software engineering

Motion Planning for Manipulation With Heuristic Search

Heuristic searches such as A* search are a popular means of finding least-cost plans due to their generality, strong theoretical guarantees on completeness and optimality, simplicity in implementation, and consistent behavior. In planning for robotic manipulation, however, these techniques are commonly thought of as impractical due to the high-dimensionality of the planning problem. As part of this thesis work, we have developed a heuristic search-based approach to motion planning for manipulation that does deal effectively with the high-dimensionality of the problem. In this thesis, I will present the approach together with its theoretical properties and show how to apply it to single-arm and dual-arm motion planning with upright constraints on a PR2 robot operating in non-trivial cluttered spaces. Then I will explain how we extended our approach to manipulation planning for n-arms with regrasping. In this work, the planner itself makes all of the discrete decisions, including which arm to use for the pickup and putdown, whether handoffs are necessary and how the object should be grasped at each step along the way. An extensive experimental analysis in both simulation and on a physical PR2 shows that, in terms of runtime, our approach is on par with some of the most common sampling-based approaches. This includes benchmarking our planning framework on two domains that we constructed that are common to manufacturing: pick-and-place of fast moving objects and the autonomous assembly of small objects. Between these applications, the planner exhibited fast planning times and the ability to robustly plan paths into and out of tight working environments that are common to assembly. The closing work of this thesis includes an exhaustive study of the natural tradeoff that occurs between planning efficiency versus solution quality for different values of the heuristic inflation factor. A comparison of the solution quality of our planner to paths computed by an asymptotically optimal approach given a great deal of time for path optimization is included as well. Finally, a set of experimental results are included that show that due to our approach\u27s deterministic cost-minimization, similar input tends to lead to similarity in the output. This kind of local consistency is important to the predictability of the robot\u27s motions and contributes to human-robot safety

ISMCR 1994: Topical Workshop on Virtual Reality. Proceedings of the Fourth International Symposium on Measurement and Control in Robotics

This symposium on measurement and control in robotics included sessions on: (1) rendering, including tactile perception and applied virtual reality; (2) applications in simulated medical procedures and telerobotics; (3) tracking sensors in a virtual environment; (4) displays for virtual reality applications; (5) sensory feedback including a virtual environment application with partial gravity simulation; and (6) applications in education, entertainment, technical writing, and animation

Digital Interaction and Machine Intelligence

This book is open access, which means that you have free and unlimited access. This book presents the Proceedings of the 9th Machine Intelligence and Digital Interaction Conference. Significant progress in the development of artificial intelligence (AI) and its wider use in many interactive products are quickly transforming further areas of our life, which results in the emergence of various new social phenomena. Many countries have been making efforts to understand these phenomena and find answers on how to put the development of artificial intelligence on the right track to support the common good of people and societies. These attempts require interdisciplinary actions, covering not only science disciplines involved in the development of artificial intelligence and human-computer interaction but also close cooperation between researchers and practitioners. For this reason, the main goal of the MIDI conference held on 9-10.12.2021 as a virtual event is to integrate two, until recently, independent fields of research in computer science: broadly understood artificial intelligence and human-technology interaction