Inverse Kinematics and Trajectory Planning Analysis of a Robotic Manipulator

In this work, we pretended to show and compare three methodologies used to solve the inverse kinematics of a 3 DOF robotic manipulator. The approaches are the algebraic method through Matlabreg; solve function, Genetic Algorithms (GAs), Artificial Neural Networks (ANNs). Another aspect considered is the trajectory planning of the manipulator, which allows the user to control the desired movement in the joint space. We compare polynomials of third, fourth and fifth orders for the solution of the chosen coordinates. The results show that the ANN method presented best results due to its configuration to show only feasible joint values, as also do the GA. In the trajectory planning the analysis lead to the fifth-order polynomial, which showed the smoothest solution

Trajectory Generation for a Multibody Robotic System: Modern Methods Based on Product of Exponentials

This work presents several trajectory generation algorithms for multibody robotic systems based on the Product of Exponentials (PoE) formulation, also known as screw theory. A PoE formulation is first developed to model the kinematics and dynamics of a multibody robotic manipulator (Sawyer Robot) with 7 revolute joints and an end-effector. In the first method, an Inverse Kinematics (IK) algorithm based on the Newton-Raphson iterative method is applied to generate constrained joint-space trajectories corresponding to straight-line and curvilinear motions of the end effector in Cartesian space with finite jerk. The second approach describes Constant Screw Axis (CSA) trajectories which are generated using Machine Learning (ML) and Artificial Neural Networks (ANNs) techniques. The CSA method smooths the trajectory in the Special Euclidean (SE(3)) space. In the third approach, a multi-objective Swarm Intelligence (SI) trajectory generation algorithm is developed, where the IK problem is tackled using a combined SI-PoE ML technique resulting in a joint trajectory that avoids obstacles in the workspace, and satisfies the finite jerk constraint on end-effector while minimizing the torque profiles. The final method is a different approach to solving the IK problem using the Deep Q-Learning (DQN) Reinforcement Learning (RL) algorithm which can generate different joint space trajectories given the Cartesian end-effector path. For all methods above, the Newton-Euler recursive algorithm is implemented to compute the inverse dynamics, which generates the joint torques profiles. The simulated torque profiles are experimentally validated by feeding the generated joint trajectories to the Sawyer robotic arm through the developed Robot Operating System (ROS) - Python environment in the Software Development Kit (SDK) mode. The developed algorithms can be used to generate various trajectories for robotic arms (e.g. spacecraft servicing missions)

A Model for Robot Arm Pattern Identification using K-Means Clustering and Multi-Layer Perceptron

Predictive maintenance of industrial machines is one of the challenging applications in Industry 4.0. This paper presents a comprehensive methodology to identify robot arm (SCARA) movement patterns to detect the mechanical aging of the robot, which is determined by the abnormal movement of the robot arm. The dataset used is two robot arm movements that go from point A to B and then back to point A. Accelerometer data is used to measure the signal of SCARA actions, mainly focus on the non-linear movement. The identification of the movement pattern of the robot arm is made by combining k-means and multilayer perceptron. The proposed approach first extracts valuable features as characteristics of the two datasets from the time domain statistical value parameters. K-means clustering technique is initiated to label the training dataset. In this phase, the elbow curve is used to determine the number of clusters in the dataset, which is 2 clusters. Moreover, the assumption is used to determine which cluster is labeled as a normal and abnormal movement.  Hence, a multilayer perceptron approach is proposed to predict the testing dataset. The proposed multilayer perceptron model yields an accuracy of 94.14%, whereas its cross-validation yields an accuracy of 96.12%

EEG-based brain-computer interfaces using motor-imagery: techniques and challenges.

Electroencephalography (EEG)-based brain-computer interfaces (BCIs), particularly those using motor-imagery (MI) data, have the potential to become groundbreaking technologies in both clinical and entertainment settings. MI data is generated when a subject imagines the movement of a limb. This paper reviews state-of-the-art signal processing techniques for MI EEG-based BCIs, with a particular focus on the feature extraction, feature selection and classification techniques used. It also summarizes the main applications of EEG-based BCIs, particularly those based on MI data, and finally presents a detailed discussion of the most prevalent challenges impeding the development and commercialization of EEG-based BCIs

Visual Servoing in Robotics

Visual servoing is a well-known approach to guide robots using visual information. Image processing, robotics, and control theory are combined in order to control the motion of a robot depending on the visual information extracted from the images captured by one or several cameras. With respect to vision issues, a number of issues are currently being addressed by ongoing research, such as the use of different types of image features (or different types of cameras such as RGBD cameras), image processing at high velocity, and convergence properties. As shown in this book, the use of new control schemes allows the system to behave more robustly, efficiently, or compliantly, with fewer delays. Related issues such as optimal and robust approaches, direct control, path tracking, or sensor fusion are also addressed. Additionally, we can currently find visual servoing systems being applied in a number of different domains. This book considers various aspects of visual servoing systems, such as the design of new strategies for their application to parallel robots, mobile manipulators, teleoperation, and the application of this type of control system in new areas

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field

Remote-controlled ambidextrous robot hand actuated by pneumatic muscles: from feasibility study to design and control algorithms

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University LondonThis thesis relates to the development of the Ambidextrous Robot Hand engineered in Brunel University. Assigned to a robotic hand, the ambidextrous feature means that two different behaviours are accessible from a single robot hand, because of its fingers architecture which permits them to bend in both ways. On one hand, the robotic device can therefore behave as a right hand whereas, on another hand, it can behave as a left hand. The main contribution of this project is its ambidextrous feature, totally unique in robotics area. Moreover, the Ambidextrous Robot Hand is actuated by pneumatic artificial muscles (PAMs), which are not commonly used to drive robot hands. The type of the actuators consequently adds more originality to the project. The primary challenge is to reach an ambidextrous behaviour using PAMs designed to actuate non-ambidextrous robot hands. Thus, a feasibility study is carried out for this purpose. Investigating a number of mechanical possibilities, an ambidextrous design is reached with features almost identical for its right and left sides. A testbench is thereafter designed to investigate this possibility even further to design ambidextrous fingers using 3D printing and an asymmetrical tendons routing engineered to reduce the number of actuators. The Ambidextrous Robot Hand is connected to a remote control interface accessible from its website, which provides video streaming as feedback, to be eventually used as an online rehabilitation device. The secondary main challenge is to implement control algorithms on a robot hand with a range twice larger than others, with an asymmetrical tendons routing and actuated by nonlinear actuators. A number of control algorithms are therefore investigated to interact with the angular displacement of the fingers and the grasping abilities of the hand. Several solutions are found out, notably the implementations of a phasing plane switch control and a sliding-mode control, both specific to the architecture of the Ambidextrous Robot Hand. The implementation of these two algorithms on a robotic hand actuated by PAMs is almost as innovative as the ambidextrous design of the mechanical structure itself

Design and Development of an Automated Mobile Manipulator for Industrial Applications

This thesis presents the modeling, control and coordination of an automated mobile manipulator. A mobile manipulator in this investigation consists of a robotic manipulator and a mobile platform resulting in a hybrid mechanism that includes a mobile platform for locomotion and a manipulator arm for manipulation. The structural complexity of a mobile manipulator is the main challenging issue because it includes several problems like adapting a manipulator and a redundancy mobile platform at non-holonomic constraints. The objective of the thesis is to fabricate an automated mobile manipulator and develop control algorithms that effectively coordinate the arm manipulation and mobility of mobile platform. The research work starts with deriving the motion equations of mobile manipulators. The derivation introduced here makes use of motion equations of robot manipulators and mobile platforms separately, and then integrated them as one entity. The kinematic analysis is performed in two ways namely forward & inverse kinematics. The motion analysis is performed for various WMPs such as, Omnidirectional WMP, Differential three WMP, Three wheeled omni-steer WMP, Tricycle WMP and Two steer WMP. From the obtained motion analysis results, Differential three WMP is chosen as the mobile platform for the developed mobile manipulator. Later motion analysis is carried out for 4-axis articulated arm. Danvit-Hartenberg representation is implemented to perform forward kinematic analysis. Because of this representation, one can easily understand the kinematic equation for a robotic arm. From the obtained arm equation, Inverse kinematic model for the 4-axis robotic manipulator is developed. Motion planning of an intelligent mobile robot is one of the most vital issues in the field of robotics, which includes the generation of optimal collision free trajectories within its work space and finally reaches its target position. For solving this problem, two evolutionary algorithms namely Particle Swarm Optimization (PSO) and Artificial Immune System (AIS) are introduced to move the mobile platform in intelligent manner. The developed algorithms are effective in avoiding obstacles, trap situations and generating optimal paths within its unknown environments. Once the robot reaches its goal (within the work space of the manipulator), the manipulator will generate its trajectories according to task assigned by the user. Simulation analyses are performed using MATLAB-2010 in order to validate the feasibility of the developed methodologies in various unknown environments. Additionally, experiments are carried out on an automated mobile manipulator. ATmega16 Microcontrollers are used to enable the entire robot system movement in desired trajectories by means of robot interface application program. The control program is developed in robot software (Keil) to control the mobile manipulator servomotors via a serial connection through a personal computer. To support the proposed control algorithms both simulation and experimental results are presented. Moreover, validation of the developed methodologies has been made with the ER-400 mobile platform

Process control for WAAM using computer vision

This study is mainly about the vision system and control algorithm programming for wire arc additive manufacturing (WAAM). Arc additive manufacturing technology is formed by the principle of heat source cladding produced by welders using molten inert gas shielded welding (MIG), tungsten inert gas shielded welding (TIG) and layered plasma welding power supply (PA). It has high deposition efficiency, short manufacturing cycle, low cost, and easy maintenance. Although WAAM has very good uses in various fields, the inability to control the adding process in real time has led to defects in the weld and reduced quality. Therefore, it is necessary to develop the real-time feedback through computer vision and algorithms for WAAM to ensure that the thickness and the width of each layer during the addition process are the same

Vision-Based Soft Mobile Robot Inspired by Silkworm Body and Movement Behavior

Designing an inexpensive, low-noise, safe for individual, mobile robot with an efficient vision system represents a challenge. This paper proposes a soft mobile robot inspired by the silkworm body structure and moving behavior. Two identical pneumatic artificial muscles (PAM) have been used to design the body of the robot by sewing the PAMs longitudinally. The proposed robot moves forward, left, and right in steps depending on the relative contraction ratio of the actuators. The connection between the two artificial muscles gives the steering performance at different air pressures of each PAM. A camera (eye) integrated into the proposed soft robot helps it to control its motion and direction. The silkworm soft robot detects a specific object and tracks it continuously. The proposed vision system is used to help with automatic tracking based on deep learning platforms with real-time live IR camera. The object detection platform, named, YOLOv3 is used effectively to solve the challenge of detecting high-speed tiny objects like Tennis balls. The model is trained with a dataset consisting of images of   Tennis balls. The work is simulated with Google Colab and then tested in real-time on an embedded device mated with a fast GPU called Jetson Nano development kit. The presented object follower robot is cheap, fast-tracking, and friendly to the environment. The system reaches a 99% accuracy rate during training and testing. Validation results are obtained and recorded to prove the effectiveness of this novel silkworm soft robot. The research contribution is designing and implementing a soft mobile robot with an effective vision system