Intelligent 3D seam tracking and adaptable weld process control for robotic TIG welding

Tungsten Inert Gas (TIG) welding is extensively used in aerospace applications, due to its unique ability to produce higher quality welds compared to other shielded arc welding types. However, most TIG welding is performed manually and has not achieved the levels of automation that other welding techniques have. This is mostly attributed to the lack of process knowledge and adaptability to complexities, such as mismatches due to part fit-up. Recent advances in automation have enabled the use of industrial robots for complex tasks that require intelligent decision making, predominantly through sensors. Applications such as TIG welding of aerospace components require tight tolerances and need intelligent decision making capability to accommodate any unexpected variation and to carry out welding of complex geometries. Such decision making procedures must be based on the feedback about the weld profile geometry. In this thesis, a real-time position based closed loop system was developed with a six axis industrial robot (KUKA KR 16) and a laser triangulation based sensor (Micro-Epsilon Scan control 2900-25). [Continues.

Development of a real-time ultrasonic sensing system for automated and robotic welding

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The implementation of robotic technology into welding processes is made difficult by the inherent process variables of part location, fit up, orientation and repeatability. Considering these aspects, to ensure weld reproducibility consistency and quality, advanced adaptive control techniques are essential. These involve not only the development of adequate sensors for seam tracking and joint recognition but also developments of overall machines with a level of artificial intelligence sufficient for automated welding. The development of such a prototype system which utilizes a manipulator arm, ultrasonic sensors and a transistorised welding power source is outlined. This system incorporates three essential aspects. It locates and tracks the welding seam ensuring correct positioning of the welding head relatively to the joint preparation. Additionally, it monitors the joint profile of the molten weld pool and modifies the relevant heat input parameters ensuring consistent penetration, joint filling and acceptable weld bead shape. Finally, it makes use of both the above information to reconstruct three-dimensional images of the weld pool silhouettes providing in-process inspection capabilities of the welded joints. Welding process control strategies have been incorporated into the system based on quantitative relationships between input parameters and weld bead shape configuration allowing real-time decisions to be made during the process of welding, without the need for operation intervention.British Technology Group (BTG

TOWARD INTELLIGENT WELDING BY BUILDING ITS DIGITAL TWIN

To meet the increasing requirements for production on individualization, efficiency and quality, traditional manufacturing processes are evolving to smart manufacturing with the support from the information technology advancements including cyber-physical systems (CPS), Internet of Things (IoT), big industrial data, and artificial intelligence (AI). The pre-requirement for integrating with these advanced information technologies is to digitalize manufacturing processes such that they can be analyzed, controlled, and interacted with other digitalized components. Digital twin is developed as a general framework to do that by building the digital replicas for the physical entities. This work takes welding manufacturing as the case study to accelerate its transition to intelligent welding by building its digital twin and contributes to digital twin in the following two aspects (1) increasing the information analysis and reasoning ability by integrating deep learning; (2) enhancing the human user operative ability to physical welding manufacturing via digital twins by integrating human-robot interaction (HRI). Firstly, a digital twin of pulsed gas tungsten arc welding (GTAW-P) is developed by integrating deep learning to offer the strong feature extraction and analysis ability. In such a system, the direct information including weld pool images, arc images, welding current and arc voltage is collected by cameras and arc sensors. The undirect information determining the welding quality, i.e., weld joint top-side bead width (TSBW) and back-side bead width (BSBW), is computed by a traditional image processing method and a deep convolutional neural network (CNN) respectively. Based on that, the weld joint geometrical size is controlled to meet the quality requirement in various welding conditions. In the meantime, this developed digital twin is visualized to offer a graphical user interface (GUI) to human users for their effective and intuitive perception to physical welding processes. Secondly, in order to enhance the human operative ability to the physical welding processes via digital twins, HRI is integrated taking virtual reality (VR) as the interface which could transmit the information bidirectionally i.e., transmitting the human commends to welding robots and visualizing the digital twin to human users. Six welders, skilled and unskilled, tested this system by completing the same welding job but demonstrate different patterns and resulted welding qualities. To differentiate their skill levels (skilled or unskilled) from their demonstrated operations, a data-driven approach, FFT-PCA-SVM as a combination of fast Fourier transform (FFT), principal component analysis (PCA), and support vector machine (SVM) is developed and demonstrates the 94.44% classification accuracy. The robots can also work as an assistant to help the human welders to complete the welding tasks by recognizing and executing the intended welding operations. This is done by a developed human intention recognition algorithm based on hidden Markov model (HMM) and the welding experiments show that developed robot-assisted welding can help to improve welding quality. To further take the advantages of the robots i.e., movement accuracy and stability, the role of the robot upgrades to be a collaborator from an assistant to complete a subtask independently i.e., torch weaving and automatic seam tracking in weaving GTAW. The other subtask i.e., welding torch moving along the weld seam is completed by the human users who can adjust the travel speed to control the heat input and ensure the good welding quality. By doing that, the advantages of humans (intelligence) and robots (accuracy and stability) are combined together under this human-robot collaboration framework. The developed digital twin for welding manufacturing helps to promote the next-generation intelligent welding and can be applied in other similar manufacturing processes easily after small modifications including painting, spraying and additive manufacturing

Neuro-fuzzy control modelling for gas metal arc welding process

Weld quality features are difficult or impossible to directly measure and control during welding, therefore indirect methods are necessary. Penetration is the most important geometric feature since in most applications it is the most significant factor affecting joint strength. Observation of penetration is only possible from the back face of the full penetration weld. In all other cases, since direct measurement of depth of penetration is not possible, real time control of penetration in the Gas Metal Arc Welding (GMAW) process by sensing conditions at the top surface of the joint is necessary. This continues to be a major area of interest for automation of the process. The objective of this research has been to develop an on-line intelligent process control model for GMAW, which can monitor and control the welding process. The model uses measurement of the temperature at a point on the surface of the workpiece to predict the depth of penetration being achieved, and to provide feedback for corrective adjustment of welding variables. Neural Network and Fuzzy Logic technologies have been used to achieve a reliable Neuro-Fuzzy control model for GMAW of a typical closed butt joint having 60° Vee edge preparation. The neural network model predicts the surface temperature expected for a set of fixed and adjustable welding variables when a prescribed level of penetration is achieved. This predicted temperature is compared with the actual surface temperature occurring during welding, as measured by an infrared sensor. If there is a difference between the measured temperature and the temperature predicted by the neural network, a fuzzy logic model will recommend changes to the adjustable welding variables necessary to achieve the desired weld penetration. Large scale experiments to obtain data for modelling and for model validation, and various other modelling studies are described. The results are used to establish the relationships between the output surface temperature measurement, welding variables and the corresponding achieved weld quality criteria. The effectiveness of the modelling methodology in dealing with fixed or variable root gap has also been tested. The result shows that the Neuro-fuzzy models are capable of providing control of penetration to an acceptable degree of accuracy, and a potential control response time, using modestly powerful computing hardware, of the order of one hundred milliseconds. This is more than adequate for real time control of GMAW. The application potential for control using these models is significant since, unlike many other top surface monitoring methods, it does not require sensing of the highly transient weld pool shape or surface

Real time defect detection in welds by ultrasonic means

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.A computer controlled weld quality assurance system has been developed to detect weld defects ultrasonically whilst welding is in progress. This system, including a flash analogue to digital converter and built-in memories to store sampled data, a peak characters extractor and a welding process controller, enabled welding processes to be controlled automatically and welding defects to be detected concurrently with welding. In this way, the weld quality could be satisfactorily assured if no defect was detected and the welding cost was minimised either through avoiding similar defects to occur or by stopping the welding process if repair was necessary. This work demonstrated that the high temperature field around the weld pool was the major source of difficulties and unreliabilities in defect detection during welding and, had to be taken into account in welding control by ultrasonic means. The high temperatures not only influence ultrasonic characteristic parameters which are the defect judgement and assessment criterion, but also introduce noise into signals. The signal averaging technique and statistical analysis based on B-scan data have proved their feasibility to increase 'signal to noise ratio' effectively and to judge or assess weld defects. The hardware and the software for the system is explained in this work. By using this system, real-time 'A-scan' signals on screen display, and, A-scan, B-scan or three dimensional results can be printed on paper, or stored on disks, and, as a result, weld quality could be fully computerized.Sino-British Friendship Scholarship Schem

ESTABLISHING THE FOUNDATION TO ROBOTIZE COMPLEX WELDING PROCESSES THROUGH LEARNING FROM HUMAN WELDERS BASED ON DEEP LEARNING TECHNIQUES

As the demand for customized, efficient, and high-quality production increases, traditional manufacturing processes are transforming into smart manufacturing with the aid of advancements in information technology, such as cyber-physical systems (CPS), the Internet of Things (IoT), big data, and artificial intelligence (AI). The key requirement for integration with these advanced information technologies is to digitize manufacturing processes to enable analysis, control, and interaction with other digitized components. The integration of deep learning algorithm and massive industrial data will be critical components in realizing this process, leading to enhanced manufacturing in the Future of Work at the Human-Technology Frontier (FW-HTF). This work takes welding manufacturing as the case study to accelerate its transition to intelligent welding by robotize a complex welding process. By integrate process sensing, data visualization, deep learning-based modeling and optimization, a complex welding system is established, with the systematic solution to generalize domain-specific knowledge from experienced human welder. Such system can automatically perform complex welding processes that can only be handled by human in the past. To enhance the system\u27s tracking capabilities, we trained an image segmentation network to offer precise position information. We incorporated a recurrent neural network structure to analyze dynamic variations during welding. Addressing the challenge of human heterogeneity in data collection, we conducted experiments illustrating that even inaccurate datasets can effectively train deep learning models with zero mean error. Fine-tuning the model with a small portion of accurate data further elevates its performance

Feasibility of remotely manipulated welding in space. A step in the development of novel joining technologies

In order to establish permanent human presence in space technologies of constructing and repairing space stations and other space structures must be developed. Most construction jobs are performed on earth and the fabricated modules will then be delivered to space by the Space Shuttle. Only limited final assembly jobs, which are primarily mechanical fastening, will be performed on site in space. Such fabrication plans, however, limit the designs of these structures, because each module must fit inside the transport vehicle and must withstand launching stresses which are considerably high. Large-scale utilization of space necessitates more extensive construction work on site. Furthermore, continuous operations of space stations and other structures require maintenance and repairs of structural components as well as of tools and equipment on these space structures. Metal joining technologies, and especially high-quality welding, in space need developing

The application of high power lasers to the welding of tee section joints in ship production

PhD ThesisThe use of computers by naval architects has revolutionised ship design and -construction management. The use of high power laser technology could similarly revolutionise production processes to produce a quantum leap in productivity. Facilitating low heat input materials processing, the laser is suited to various cutting, welding and heat treatment applications in shipbuilding to increase productivity through improved product accuracy. From these processes, the Author has concentrated on the application of high power lasers to the welding of tee section joints - the most common joint configuration in ship structures - by a single sided method (skid welding) to give both the lowest possible heat input and greatest flexibility. -Using a lOkW laser, single pass fully penetrating skid welds may be produced for joints in plate of up to 15mm thick, but using this size of laser, production parameter envelopes to produce visually and structurally sound joints reduce in size as plate thickness increases to greater than 10mm. It is shown that fully penetrating laser skid welds produced in steel conventionally used for surface vessel construction are of superior structural quality to fillet welds as required by classification society rules. The work has shown that achieving process consistency in an automated production based skid welding workstation operating with existing levels of joint tolerance will be dependent not only on well designed laser and beam delivery harware but also on suitable on-line adaptive control systems. It has been demonstrated that by employing laser skid welding for steelwork fabrication, an increase in productivity can be gained, principally through increased processing speed and improved product accuracy.British Shipbuilders: The Science and Engineering Research Council