Development of Multi-Robotic Arm System for Sorting System Using Computer Vision

This paper develops a multi-robotic arm system and a stereo vision system to sort objects in the right position according to size and shape attributes. The robotic arm system consists of one master and three slave robots associated with three conveyor belts. Each robotic arm is controlled by a robot controller based on a microcontroller. A master controller is used for the vision system and communicating with slave robotic arms using the Modbus RTU protocol through an RS485 serial interface. The stereo vision system is built to determine the 3D coordinates of the object. Instead of rebuilding the entire disparity map, which is computationally expensive, the centroids of the objects in the two images are calculated to determine the depth value. After that, we can calculate the 3D coordinates of the object by using the formula of the pinhole camera model. Objects are picked up and placed on a conveyor branch according to their shape. The conveyor transports the object to the location of the slave robot. Based on the size attribute that the slave robot receives from the master, the object is picked and placed in the right position. Experiment results reveal the effectiveness of the system. The system can be used in industrial processes to reduce the required time and improve the performance of the production line

Survey of Visual and Force/Tactile Control of Robots for Physical Interaction in Spain

Sensors provide robotic systems with the information required to perceive the changes that happen in unstructured environments and modify their actions accordingly. The robotic controllers which process and analyze this sensory information are usually based on three types of sensors (visual, force/torque and tactile) which identify the most widespread robotic control strategies: visual servoing control, force control and tactile control. This paper presents a detailed review on the sensor architectures, algorithmic techniques and applications which have been developed by Spanish researchers in order to implement these mono-sensor and multi-sensor controllers which combine several sensors

Kinematics modeling of six degrees of freedom humanoid robot arm using improved damped least squares for visual grasping

The robotic arm has functioned as an arm in the humanoid robot and is generally used to perform grasping tasks. Accordingly, kinematics modeling both forward and inverse kinematics is required to calculate the end-effector position in the cartesian space before performing grasping activities. This research presents the kinematics modeling of six degrees of freedom (6-DOF) robotic arm of the T-FLoW humanoid robot for the grasping mechanism of visual grasping systems on the robot operating system (ROS) platform and CoppeliaSim. Kinematic singularity is a common problem in the inverse kinematics model of robots, but. However, other problems are mechanical limitations and computational time. The work uses the homogeneous transformation matrix (HTM) based on the Euler system of the robot for the forward kinematics and demonstrates the capability of an improved damped least squares (I-DLS) method for the inverse kinematics. The I-DLS method was obtained by improving the original DLS method with the joint limits and clamping techniques. The I-DLS performs better than the original DLS during the experiments yet increases the calculation iteration by 10.95%, with a maximum error position between the end-effector and target positions in path planning of 0.1 cm

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available