Deep CNN-Based Automated Optical Inspection for Aerospace Components

ABSTRACT The defect detection problem is of outmost importance in high-tech industries such as aerospace manufacturing and is widely employed using automated industrial quality control systems. In the aerospace manufacturing industry, composite materials are extensively applied as structural components in civilian and military aircraft. To ensure the quality of the product and high reliability, manual inspection and traditional automatic optical inspection have been employed to identify the defects throughout production and maintenance. These inspection techniques have several limitations such as tedious, time- consuming, inconsistent, subjective, labor intensive, expensive, etc. To make the operation effective and efficient, modern automated optical inspection needs to be preferred. In this dissertation work, automatic defect detection techniques are tested on three levels using a novel aerospace composite materials image dataset (ACMID). First, classical machine learning models, namely, Support Vector Machine and Random Forest, are employed for both datasets. Second, deep CNN-based models, such as improved ResNet50 and MobileNetV2 architectures are trained on ACMID datasets. Third, an efficient defect detection technique that combines the features of deep learning and classical machine learning model is proposed for ACMID dataset. To assess the aerospace composite components, all the models are trained and tested on ACMID datasets with distinct sizes. In addition, this work investigates the scenario when defective and non-defective samples are scarce and imbalanced. To overcome the problems of imbalanced and scarce datasets, oversampling techniques and data augmentation using improved deep convolutional generative adversarial networks (DCGAN) are considered. Furthermore, the proposed models are also validated using one of the benchmark steel surface defects (SSD) dataset

Texture and Colour in Image Analysis

Research in colour and texture has experienced major changes in the last few years. This book presents some recent advances in the field, specifically in the theory and applications of colour texture analysis. This volume also features benchmarks, comparative evaluations and reviews

A convolutional neural network (CNN) for defect detection of additively manufactured parts

“Additive manufacturing (AM) is a layer-by-layer deposition process to fabricate parts with complex geometries. The formation of defects within AM components is a major concern for critical structural and cyclic loading applications. Understanding the mechanisms of defect formation and identifying the defects play an important role in improving the product lifecycle. The convolutional neural network (CNN) has been demonstrated to be an effective deep learning tool for automated detection of defects for both conventional and AM processes. A network with optimized parameters including proper data processing and sampling can improve the performance of the architecture. In this study, for the detection of good deposition quality and defects such as lack of fusion, gas porosity, and cracks in a fusion-based AM process, a CNN architecture is presented comparing the classification report and evaluation of different architectural settings and obtaining the optimized result from them. Since data set preparation, visualization, and balancing are very important aspects in deep learning to improve the performance and accuracy of neural network architectures, exploratory data analysis was performed for data visualization and the up-sampling method was implemented to balance the data set for each class. By comparing the results for different architectures, the optimal CNN network was chosen for further investigation. To tune the hyperparameters and to achieve an optimized parameter set, a design of experiments was implemented to improve the performance of the network. The performance of the network with optimized parameters was compared with the results from the previous study. The overall accuracy ( \u3e 97%) for both training and testing the CNN network presented in this work transcends the current state of the art (92%) for AM defect detection”--Abstract, page iv

Gender Classification for Anime Character Face Image Using Random Forest Classifier Method and GLCM Feature Extraction

Japan has many entertaining and unique artworks, especially its signature animation, called anime. Anime is an animation art that is unique in that the characterizations, characters, and storylines are made to resemble human life. The characters have 2 genders called male and female with unique visuals and are the characteristics of each anime character to entertain the audience. Training large-scale data and complex textures because not all of the anime images owned are of high quality, making classification by Machine Learning Algorithms low in accuracy. This study will describe an experiment using an anime face image dataset to classify the gender, namely male or female. From this problem, this research implements feature extraction to produce unique features of anime images with Gray-Level Cooccurrence Matrix (GLCM) and uses the Random Forest Classifier which is a classification algorithm in Machine Learning to classify gender. The results of this study get a good accuracy value of 95%, using 3,612 images where the test data used is 723 images and Homogeneity5 feature being the most relevant feature in increasing the accuracy value with a value of 0.06378389

A Systematic Review of Convolutional Neural Network-Based Structural Condition Assessment Techniques

With recent advances in non-contact sensing technology such as cameras, unmanned aerial and ground vehicles, the structural health monitoring (SHM) community has witnessed a prominent growth in deep learning-based condition assessment techniques of structural systems. These deep learning methods rely primarily on convolutional neural networks (CNNs). The CNN networks are trained using a large number of datasets for various types of damage and anomaly detection and post-disaster reconnaissance. The trained networks are then utilized to analyze newer data to detect the type and severity of the damage, enhancing the capabilities of non-contact sensors in developing autonomous SHM systems. In recent years, a broad range of CNN architectures has been developed by researchers to accommodate the extent of lighting and weather conditions, the quality of images, the amount of background and foreground noise, and multiclass damage in the structures. This paper presents a detailed literature review of existing CNN-based techniques in the context of infrastructure monitoring and maintenance. The review is categorized into multiple classes depending on the specific application and development of CNNs applied to data obtained from a wide range of structures. The challenges and limitations of the existing literature are discussed in detail at the end, followed by a brief conclusion on potential future research directions of CNN in structural condition assessment

BagStack Classification for Data Imbalance Problems with Application to Defect Detection and Labeling in Semiconductor Units

abstract: Despite the fact that machine learning supports the development of computer vision applications by shortening the development cycle, finding a general learning algorithm that solves a wide range of applications is still bounded by the ”no free lunch theorem”. The search for the right algorithm to solve a specific problem is driven by the problem itself, the data availability and many other requirements. Automated visual inspection (AVI) systems represent a major part of these challenging computer vision applications. They are gaining growing interest in the manufacturing industry to detect defective products and keep these from reaching customers. The process of defect detection and classification in semiconductor units is challenging due to different acceptable variations that the manufacturing process introduces. Other variations are also typically introduced when using optical inspection systems due to changes in lighting conditions and misalignment of the imaged units, which makes the defect detection process more challenging. In this thesis, a BagStack classification framework is proposed, which makes use of stacking and bagging concepts to handle both variance and bias errors. The classifier is designed to handle the data imbalance and overfitting problems by adaptively transforming the multi-class classification problem into multiple binary classification problems, applying a bagging approach to train a set of base learners for each specific problem, adaptively specifying the number of base learners assigned to each problem, adaptively specifying the number of samples to use from each class, applying a novel data-imbalance aware cross-validation technique to generate the meta-data while taking into account the data imbalance problem at the meta-data level and, finally, using a multi-response random forest regression classifier as a meta-classifier. The BagStack classifier makes use of multiple features to solve the defect classification problem. In order to detect defects, a locally adaptive statistical background modeling is proposed. The proposed BagStack classifier outperforms state-of-the-art image classification techniques on our dataset in terms of overall classification accuracy and average per-class classification accuracy. The proposed detection method achieves high performance on the considered dataset in terms of recall and precision.Dissertation/ThesisDoctoral Dissertation Computer Engineering 201

Application of Artificial Intelligence for Surface Roughness Prediction of Additively Manufactured Components

Additive manufacturing has gained significant popularity from a manufacturing perspective due to its potential for improving production efficiency. However, ensuring consistent product quality within predetermined equipment, cost, and time constraints remains a persistent challenge. Surface roughness, a crucial quality parameter, presents difficulties in meeting the required standards, posing significant challenges in industries such as automotive, aerospace, medical devices, energy, optics, and electronics manufacturing, where surface quality directly impacts performance and functionality. As a result, researchers have given great attention to improving the quality of manufactured parts, particularly by predicting surface roughness using different parameters related to the manufactured parts. Artificial intelligence (AI) is one of the methods used by researchers to predict the surface quality of additively fabricated parts. Numerous research studies have developed models utilizing AI methods, including recent deep learning and machine learning approaches, which are effective in cost reduction and saving time, and are emerging as a promising technique. This paper presents the recent advancements in machine learning and AI deep learning techniques employed by researchers. Additionally, the paper discusses the limitations, challenges, and future directions for applying AI in surface roughness prediction for additively manufactured components. Through this review paper, it becomes evident that integrating AI methodologies holds great potential to improve the productivity and competitiveness of the additive manufacturing process. This integration minimizes the need for re-processing machined components and ensures compliance with technical specifications. By leveraging AI, the industry can enhance efficiency and overcome the challenges associated with achieving consistent product quality in additive manufacturing.publishedVersio

Artificial Intelligence in Civil Infrastructure Health Monitoring—historical Perspectives, Current Trends, and Future Visions

Over the past 2 decades, the use of artificial intelligence (AI) has exponentially increased toward complete automation of structural inspection and assessment tasks. This trend will continue to rise in image processing as unmanned aerial systems (UAS) and the internet of things (IoT) markets are expected to expand at a compound annual growth rate of 57.5% and 26%, respectively, from 2021 to 2028. This paper aims to catalog the milestone development work, summarize the current research trends, and envision a few future research directions in the innovative application of AI in civil infrastructure health monitoring. A blow-by-blow account of the major technology progression in this research field is provided in a chronological order. Detailed applications, key contributions, and performance measures of each milestone publication are presented. Representative technologies are detailed to demonstrate current research trends. A road map for future research is outlined to address contemporary issues such as explainable and physics-informed AI. This paper will provide readers with a lucid memoir of the historical progress, a good sense of the current trends, and a clear vision for future research

Artificial intelligence for advanced manufacturing quality

100 p.This Thesis addresses the challenge of AI-based image quality control systems applied to manufacturing industry, aiming to improve this field through the use of advanced techniques for data acquisition and processing, in order to obtain robust, reliable and optimal systems. This Thesis presents contributions onthe use of complex data acquisition techniques, the application and design of specialised neural networks for the defect detection, and the integration and validation of these systems in production processes. It has been developed in the context of several applied research projects that provided a practical feedback of the usefulness of the proposed computational advances as well as real life data for experimental validation

Recent Advances and Applications of Machine Learning in Metal Forming Processes

Machine learning (ML) technologies are emerging in Mechanical Engineering, driven by the increasing availability of datasets, coupled with the exponential growth in computer performance. In fact, there has been a growing interest in evaluating the capabilities of ML algorithms to approach topics related to metal forming processes, such as: Classification, detection and prediction of forming defects; Material parameters identification; Material modelling; Process classification and selection; Process design and optimization. The purpose of this Special Issue is to disseminate state-of-the-art ML applications in metal forming processes, covering 10 papers about the abovementioned and related topics