Object search and retrieval in indoor environment using a Mobile Manipulator

Robots are increasingly viewed as service agents in offices and homes. In many countries where the average population is aging, robots can be used for elderly care. This Thesis explores one such possibility using a mobile manipulator robot. Such robots have a mobile base to move from one place to another and an arm to pick and place objects. This Thesis considers a problem where the mobile manipulator needs to search for an object in an environment and bring it to some location. The optimal object search is formulated in terms of the popular traveling salesman problem (TSP) that computes the optimal sequence in which the Robot can visit all the possible locations where the object can possibly be. Prior information about the more likely locations is brought in by scaling the edge-weight of the TSP graph through the probabilities of the location. The Thesis can combine the output of TSP with navigation and manipulation planning built on top of Robot Operating Systems (ROS) to build the complete object search and retrieval pipeline. The results of the Thesis are validated both in simulation and actual hardware experiments

Autonomous task-based grasping for mobile manipulators

A fully integrated grasping system for a mobile manipulator to grasp an unknown object of interest (OI) in an unknown environment is presented. The system autonomously scans its environment, models the OI, plans and executes a grasp, while taking into account base pose uncertainty and obstacles in its way to reach the object. Due to inherent line of sight limitations in sensing, a single scan of the OI often does not reveal enough information to complete grasp analysis; as a result, our system autonomously builds a model of an object via multiple scans from different locations until a grasp can be performed. A volumetric next-best-view (NBV) algorithm is used to model an arbitrary object and terminates modelling when grasp poses are discovered on a partially observed object. Two key sets of experiments are presented: i) modelling and registration error in the OI point cloud model is reduced by selecting viewpoints with more scan overlap, and ii) model construction and grasps are successfully achieved while experiencing base pose uncertainty. A generalized algorithm is presented to discover grasp pose solutions for multiple grasp types for a multi-fingered mechanical gripper using sensed point clouds. The algorithm introduces two key ideas: 1) a histogram of finger contact normals is used to represent a grasp “shape” to guide a gripper orientation search in a histogram of object(s) surface normals, and 2) voxel grid representations of gripper and object(s) are cross-correlated to match finger contact points, i.e. grasp “size”, to discover a grasp pose. Constraints, such as collisions with neighbouring objects, are incorporated in the cross-correlation computation. Simulations and preliminary experiments show that 1) grasp poses for three grasp types are found in near real-time, 2) grasp pose solutions are consistent with respect to voxel resolution changes for both partial and complete point cloud scans, 3) a planned grasp pose is executed with a mechanical gripper, and 4) grasp overlap is presented as a feature to identify regions on a partial object model ideal for object transfer or securing an object