Automatic Romaine Heart Harvester

The Romaine Robotics Senior Design Team developed a romaine lettuce heart trimming system in partnership with a Salinas farm to address a growing labor shortage in the agricultural industry that is resulting in crops rotting in the field before they could be harvested. An automated trimmer can alleviate the most time consuming step in the cut-trim-bag harvesting process, increasing the yields of robotic cutters or the speed of existing laborer teams. Leveraging the Partner Farm’s existing trimmer architecture, which consists of a laborer loading lettuce into sprungloaded grippers that are rotated through vision and cutting systems by an indexer, the team redesigned geometry to improve the loading, gripping, and ejection stages of the system. Physical testing, hand calculations, and FEA were performed to understand acceptable grip strengths and cup design, and several wooden mockups were built to explore a new actuating linkage design for the indexer. The team manufactured, assembled, and performed verification testing on a full-size metal motorized prototype that can be incorporated with the Partner Farm’s existing cutting and vision systems. The prototype met all of the established requirements, and the farm has implemented the redesign onto their trimmer. Future work would include designing and implementing vision and cutting systems for the team’s metal prototype

Miniaturized modular manipulator design for high precision assembly and manipulation tasks

In this paper, design and control issues for the development of miniaturized manipulators which are aimed to be used in high precision assembly and manipulation tasks are presented. The developed manipulators are size adapted devices, miniaturized versions of conventional robots based on well-known kinematic structures. 3 degrees of freedom (DOF) delta robot and a 2 DOF pantograph mechanism enhanced with a rotational axis at the tip and a Z axis actuating the whole mechanism are given as examples of study. These parallel mechanisms are designed and developed to be used in modular assembly systems for the realization of high precision assembly and manipulation tasks. In that sense, modularity is addressed as an important design consideration. The design procedures are given in details in order to provide solutions for miniaturization and experimental results are given to show the achieved performances

On the Calibration of Active Binocular and RGBD Vision Systems for Dual-Arm Robots

This paper describes a camera and hand-eye calibration methodology for integrating an active binocular robot head within a dual-arm robot. For this purpose, we derive the forward kinematic model of our active robot head and describe our methodology for calibrating and integrating our robot head. This rigid calibration provides a closedform hand-to-eye solution. We then present an approach for updating dynamically camera external parameters for optimal 3D reconstruction that are the foundation for robotic tasks such as grasping and manipulating rigid and deformable objects. We show from experimental results that our robot head achieves an overall sub millimetre accuracy of less than 0.3 millimetres while recovering the 3D structure of a scene. In addition, we report a comparative study between current RGBD cameras and our active stereo head within two dual-arm robotic testbeds that demonstrates the accuracy and portability of our proposed methodology

Exploiting the robot kinematic redundancy for emotion conveyance to humans as a lower priority task

Current approaches do not allow robots to execute a task and simultaneously convey emotions to users using their body motions. This paper explores the capabilities of the Jacobian null space of a humanoid robot to convey emotions. A task priority formulation has been implemented in a Pepper robot which allows the specification of a primary task (waving gesture, transportation of an object, etc.) and exploits the kinematic redundancy of the robot to convey emotions to humans as a lower priority task. The emotions, defined by Mehrabian as points in the pleasure–arousal–dominance space, generate intermediate motion features (jerkiness, activity and gaze) that carry the emotional information. A map from this features to the joints of the robot is presented. A user study has been conducted in which emotional motions have been shown to 30 participants. The results show that happiness and sadness are very well conveyed to the user, calm is moderately well conveyed, and fear is not well conveyed. An analysis on the dependencies between the motion features and the emotions perceived by the participants shows that activity correlates positively with arousal, jerkiness is not perceived by the user, and gaze conveys dominance when activity is low. The results indicate a strong influence of the most energetic motions of the emotional task and point out new directions for further research. Overall, the results show that the null space approach can be regarded as a promising mean to convey emotions as a lower priority task.Postprint (author's final draft

Changes in motor synergies for tracking movement and responses to perturbations depend on task-irrelevant dimension constraints

We investigated the changes in the motor synergies of target-tracking movements of hands and the responses to perturbation when the dimensionalities of target positions were changed. We used uncontrolled manifold (UCM) analyses to quantify the motor synergies. The target was changed from one to two dimensions, and the direction orthogonal to the movement direction was switched from task-irrelevant directions to task-relevant directions. The movement direction was task-relevant in both task conditions. Hence, we evaluated the effects of constraints on the redundant dimensions on movement tracking. Moreover, we could compare the two types of responses to the same directional perturbations in one- and two-dimensional target tasks. In the one-dimensional target task, the perturbation along the movement direction and the orthogonal direction were task-relevant and -irrelevant perturbations, respectively. In the two-dimensional target task, the both perturbations were task-relevant perturbations. The results of the experiments showed that the variabilities of the hand positions in the two-dimensional target-tracking task decreased, but the variances of the joint angles did not significantly change. For the task-irrelevant perturbations, the variances of the joint angles within the UCM that did not affect hand position (UCM component) increased. For the task-relevant perturbations, the UCM component tended to increase when the available UCM was large. These results suggest that humans discriminate whether the perturbations were task-relevant or -irrelevant and then adjust the responses of the joints by utilizing the available UCM

Efficient Learning of Fast Inverse Kinematics with Collision Avoidance

Fast inverse kinematics (IK) is a central component in robotic motion planning. For complex robots, IK methods are often based on root search and non-linear optimization algorithms. These algorithms can be massively sped up using a neural network to predict a good initial guess, which can then be refined in a few numerical iterations. Besides previous work on learning-based IK, we present a learning approach for the fundamentally more complex problem of IK with collision avoidance. We do this in diverse and previously unseen environments. From a detailed analysis of the IK learning problem, we derive a network and unsupervised learning architecture that removes the need for a sample data generation step. Using the trained network's prediction as an initial guess for a two-stage Jacobian-based solver allows for fast and accurate computation of the collision-free IK. For the humanoid robot, Agile Justin (19 DoF), the collision-free IK is solved in less than 10 milliseconds (on a single CPU core) and with an accuracy of 10^-4 m and 10^-3 rad based on a high-resolution world model generated from the robot's integrated 3D sensor. Our method massively outperforms a random multi-start baseline in a benchmark with the 19 DoF humanoid and challenging 3D environments. It requires ten times less training time than a supervised training method while achieving comparable results.Comment: Presented at the 2023 IEEE-RAS International Conference on Humanoid Robot

A low cost cell calibration technique and its PC based control software

In this study, a technique will be presented to measure the absolute position of a robot and any other strategic positions within the workcell, and also its specially built control software. One of the most important factors affecting the absolute or world accuracy of robots is the variation in arm geometry from a perfect kinematics form. Since arm position is essentially controlled by means of joint angles, Cartesian co-ordinates of the tool centre point are derived from the forward kinematics transform equations assuming a perfect kinematics form. Any deviation from this perfect case will result in world positional errors and hence, for effective off-line programming it is important to calibrate the real robot hardware against the virtual model used by the robot simulation computer systems. This paper will report on work carried out in developing such low cost calibration technique, its PC Based control software and performance monitoring systems