Automatic Annotation of Subsea Pipelines using Deep Learning

Regulatory requirements for sub-sea oil and gas operators mandates the frequent inspection of pipeline assets to ensure that their degradation and damage are maintained at acceptable levels. The inspection process is usually sub-contracted to surveyors who utilize sub-sea Remotely Operated Vehicles (ROVs), launched from a surface vessel and piloted over the pipeline. ROVs capture data from various sensors/instruments which are subsequently reviewed and interpreted by human operators, creating a log of event annotations; a slow, labor-intensive and costly process. The paper presents an automatic image annotation framework that identifies/classifies key events of interest in the video footage viz. exposure, burial, field joints, anodes, and free spans. The reported methodology utilizes transfer learning with a Deep Convolutional Neural Network (ResNet-50), fine-tuned on real-life, representative data from challenging sub-sea environments with low lighting conditions, sand agitation, sea-life and vegetation. The network outputs are configured to perform multi-label image classifications for critical events. The annotation performance varies between 95.1 and 99.7 in terms of accuracy and 90.4 and 99.4 in terms of F1-Score depending on event type. The performance results are on a per-frame basis and corroborate the potential of the algorithm to be the foundation for an intelligent decision support framework that automates the annotation process. The solution can execute annotations in real-time and is significantly more cost-effective than human-only approaches

Data Analysis and Modeling Techniques of Welding Processes: The State-of-the-Art

Information contributes to the improvement of decision-making, process improvement, error detection, and prevention. The new requirements of the coming Industry 4.0 will make these new information technologies help in the improvement and decision-making of industrial processes. In case of the welding processes, several techniques have been used. Welding processes can be analyzed as a stochastic system with several inputs and outputs. This allows a study with a data analysis perspective. Data mining processes, machine learning, deep learning, and reinforcement learning techniques have had good results in the analysis and control of systems as complex as the welding process. The increase of information acquisition and information quality by sensors developed at present, allows a large volume of data that benefits the analysis of these techniques. This research aims to make a bibliographic analysis of the techniques used in the welding area, the advantages that these new techniques can provide, and how some researchers are already using them. The chapter is organized according to some stages of the data mining process. This was defined with the objective of highlighting evolution and potential for each stage for welding processes

Evaluating structural safety of trusses using Machine Learning

In this paper, a machine learning-based framework is developed to quickly evaluate the structural safety of trusses. Three numerical examples of a 10-bar truss, a 25-bar truss, and a 47-bar truss are used to illustrate the proposed framework. Firstly, several truss cases with different cross-sectional areas are generated by employing the Latin Hypercube Sampling method. Stresses inside truss members as well as displacements of nodes are determined through finite element analyses and obtained values are compared with design constraints. According to the constraint verification, the safety state is assigned as safe or unsafe. Members’ sectional areas and the safety state are stored as the inputs and outputs of the training dataset, respectively. Three popular machine learning classifiers including Support Vector Machine, Deep Neural Network, and Adaptive Boosting are used for evaluating the safety of structures. The comparison is conducted based on two metrics: the accuracy and the area under the ROC curve. For the two first examples, three classifiers get more than 90% of accuracy. For the 47-bar truss, the accuracies of the Support Vector Machine model and the Deep Neural Network model are lower than 70% but the Adaptive Boosting model still retains the high accuracy of approximately 98%. In terms of the area under the ROC curve, the comparative results are similar. Overall, the Adaptive Boosting model outperforms the remaining models. In addition, an investigation is carried out to show the influence of the parameters on the performance of the Adaptive Boosting model

A New Insight on Phased Array Ultrasound Inspection in MIG/MAG Welding

Weldment inspection is a critical process in the metal industry. It is first conducted visually, then manually and finally using instrumental techniques such as ultrasound. We made one hundred metal inert/active gas (MIG/MAG) weldments on plates of naval steel S275JR+N with no defects, and inducing pores, slag intrusion and cracks. With the objective of the three-dimensional reconstruction of the welding defects, phased array ultrasound inspections were carried out. Error-free weldment probes were used to provide the noise level. The results can be summarized as follows. (i) The top view obtained from the phased array provided no conclusive information about the welding defects. The values of the echo amplitudes were about 70 mV for pores and cracks, and greater than 150 mV for slag intrusion, all of which showed great variability. (ii) The sectional data did not lie at the same depths and they needed to be interpolated. (iii) The interpolated sectional views, or C-scans, allowed the computation of top views at any depth, as well as the three-dimensional reconstruction of the defects. (iv) The use of the simplest tool, consisting of the frequency histogram and its statistical moments, was sufficient to classify the defects. The mean echo amplitudes were 33 mV for pores, 72.16 mV for slag intrusion and 43.19 mV for cracks, with standard deviations of 8.84 mV, 24.64 mV and 12.39 mV, respectively. These findings represent the first step in the automatic classification of welding defects.This research was funded by CEI.MAR Cadiz, 2020-PR003

Detection of solidification crack formation in laser beam welding videos of sheet metal using neural networks

Laser beam welding has become widely applied in many industrial fields in recent years. Solidification cracks remain one of the most common welding faults that can prevent a safe welded joint. In civil engineering, convolutional neural networks (CNNs) have been successfully used to detect cracks in roads and buildings by analysing images of the constructed objects. These cracks are found in static objects, whereas the generation of a welding crack is a dynamic process. Detecting the formation of cracks as early as possible is greatly important to ensure high welding quality. In this study, two end-to-end models based on long short-term memory and three-dimensional convolutional networks (3D-CNN) are proposed for automatic crack formation detection. To achieve maximum accuracy with minimal computational complexity, we progressively modify the model to find the optimal structure. The controlled tensile weldability test is conducted to generate long videos used for training and testing. The performance of the proposed models is compared with the classical neural network ResNet-18, which has been proven to be a good transfer learning model for crack detection. The results show that our models can detect the start time of crack formation earlier, while ResNet-18 only detects cracks during the propagation stage