Design of automatic vision-based inspection system for solder joint segmentation

Purpose: Computer vision has been widely used in the inspection of electronic components. This paper proposes a computer vision system for the automatic detection, localisation, and segmentation of solder joints on Printed Circuit Boards (PCBs) under different illumination conditions. Design/methodology/approach: An illumination normalization approach is applied to an image, which can effectively and efficiently eliminate the effect of uneven illumination while keeping the properties of the processed image the same as in the corresponding image under normal lighting conditions. Consequently special lighting and instrumental setup can be reduced in order to detect solder joints. These normalised images are insensitive to illumination variations and are used for the subsequent solder joint detection stages. In the segmentation approach, the PCB image is transformed from an RGB color space to a YIQ color space for the effective detection of solder joints from the background. Findings: The segmentation results show that the proposed approach improves the performance significantly for images under varying illumination conditions. Research limitations/implications: This paper proposes a front-end system for the automatic detection, localisation, and segmentation of solder joint defects. Further research is required to complete the full system including the classification of solder joint defects. Practical implications: The methodology presented in this paper can be an effective method to reduce cost and improve quality in production of PCBs in the manufacturing industry. Originality/value: This research proposes the automatic location, identification and segmentation of solder joints under different illumination conditions

Inspection System And Method For Bond Detection And Validation Of Surface Mount Devices Using Sensor Fusion And Active Perception

A hybrid surface mount component inspection system which includes both vision and infrared inspection techniques to determine the presence of surface mount components on a printed wiring board, and the quality of solder joints of surface mount components on printed wiring boards by using data level sensor fusion to combine data from two infrared sensors to obtain emissivity independent thermal signatures of solder joints, and using feature level sensor fusion with active perception to assemble and process inspection information from any number of sensors to determine characteristic feature sets of different defect classes to classify solder defects.Georgia Tech Research Corporatio

Fine-grained Classification of Solder Joints with {\alpha}-skew Jensen-Shannon Divergence

Solder joint inspection (SJI) is a critical process in the production of printed circuit boards (PCB). Detection of solder errors during SJI is quite challenging as the solder joints have very small sizes and can take various shapes. In this study, we first show that solders have low feature diversity, and that the SJI can be carried out as a fine-grained image classification task which focuses on hard-to-distinguish object classes. To improve the fine-grained classification accuracy, penalizing confident model predictions by maximizing entropy was found useful in the literature. Inline with this information, we propose using the {\alpha}-skew Jensen-Shannon divergence ({\alpha}-JS) for penalizing the confidence in model predictions. We compare the {\alpha}-JS regularization with both existing entropyregularization based methods and the methods based on attention mechanism, segmentation techniques, transformer models, and specific loss functions for fine-grained image classification tasks. We show that the proposed approach achieves the highest F1-score and competitive accuracy for different models in the finegrained solder joint classification task. Finally, we visualize the activation maps and show that with entropy-regularization, more precise class-discriminative regions are localized, which are also more resilient to noise. Code will be made available here upon acceptance.Comment: Submitted to IEEE Transactions on Components, Packaging and Manufacturing Technolog

A Review and Analysis of Automatic Optical Inspection and Quality Monitoring Methods in Electronics Industry

Electronics industry is one of the fastest evolving, innovative, and most competitive industries. In order to meet the high consumption demands on electronics components, quality standards of the products must be well-maintained. Automatic optical inspection (AOI) is one of the non-destructive techniques used in quality inspection of various products. This technique is considered robust and can replace human inspectors who are subjected to dull and fatigue in performing inspection tasks. A fully automated optical inspection system consists of hardware and software setups. Hardware setup include image sensor and illumination settings and is responsible to acquire the digital image, while the software part implements an inspection algorithm to extract the features of the acquired images and classify them into defected and non-defected based on the user requirements. A sorting mechanism can be used to separate the defective products from the good ones. This article provides a comprehensive review of the various AOI systems used in electronics, micro-electronics, and opto-electronics industries. In this review the defects of the commonly inspected electronic components, such as semiconductor wafers, flat panel displays, printed circuit boards and light emitting diodes, are first explained. Hardware setups used in acquiring images are then discussed in terms of the camera and lighting source selection and configuration. The inspection algorithms used for detecting the defects in the electronic components are discussed in terms of the preprocessing, feature extraction and classification tools used for this purpose. Recent articles that used deep learning algorithms are also reviewed. The article concludes by highlighting the current trends and possible future research directions.Framework of the IQONIC Project; European Union’s Horizon 2020 Research and Innovation Program

Inspection of the integrity of surface mounted integrated circuits on a printed circuit board using vision

Machine vision technology has permeated many areas of industry, and automated inspection systems are playing increasingly important roles in many production processes. Electronic manufacturing is a good example of the integration of vision based feedback in manufacturing and the assembly of surface mount PCBs is typical of the technology involved. There are opportunities to use machine vision during different stages of the surface mount process. The problem in the inspection of solder joints on surface mount printed circuit board is much more difficult than many other inspection problems. In this thesis, an approach for inspecting surface mounted integrated circuits (SMICs) is presented. It is based on the variance of intensity values of pixels in an image. This method is able to cope with 4 kinds of soldering defects in SMICs. A set of modules for the system is proposed. The computer program which performs the image processing and analyzing has been written in C. It has been linked with a number of image processing routines from MAVIS1 to perform some image processing tasks, and the result is a compact executable module which works under MS-DOS2 3.30

On flexibly integrating machine vision inspection systems in PCB manufacture

The objective of this research is to advance computer vision techniques and their applications in the electronics manufacturing industry. The research has been carried out with specific reference to the design of automatic optical inspection (AOI) systems and their role in the manufacture of printed circuit boards (PCBs). To achieve this objective, application areas of AOI systems in PCB manufacture have been examined. As a result, a requirement for enhanced performance characteristics has been identified and novel approaches and image processing algorithms have been evolved which can be used within next generation of AOI systems. The approaches are based on gaining an understanding of ways in which manufacturing information can be used to support AOI operations. Through providing information support, an AOI system has access to product models and associated information which can be used to enhance the execution of visual inspection tasks. Manufacturing systems integration, or more accurately controlled access to electronic information, is the key to the approaches. Also in the thesis methods are proposed to achieve the flexible integration of AOI systems (and computer vision systems in general) within their host PCB manufacturing environment. Furthermore, potential applications of information supported AOI systems at various stages of PCB manufacturing have been studied. It is envisaged that more efficient and cost-effective applications of AOI can be attained through adopting the flexible integration methods proposed, since AOI-generated information can now be accessed and utilized by other processes

A STUDY OF THE THERMAL CYCLING PERFORMANCE OF SOLDER JOINTS IN AREA ARRAY PACKAGING

For both the electronics manufacturer and consumer, reliability is an essential characteristic defining the quality of the electronic component and system. Gradual degradation of the electronic components decreases efficiency of the system, and lack of reliability can lead to a significant loss. Efforts at achieving better quality and reliability of electronic components involve the inspection of solder joints in area array packaging. It is of note that solder interconnections are the vulnerable parts of circuit board assemblies (CBA), because they are mainly subjected to various assembly process during electronic manufacturing as well as environmental exposure failures during service. Therefore, the reliability of solder joints is a major concern during the entire life of an area array packaging in order to minimize the electronic failure rate that may lead to large losses. This thesis aims to provide a solution that helps to overcome some of the challenges that can occur during the reliability inspection of solder joints in area array packaging. Firstly, by successfully developing a non-destructive monitoring methodology to study the performance of solder joints under thermal cycling test. The quality of the solder joints in this research work from growth to failure was monitored by using a type of ultrasonic inspection called acoustic micro imaging (AMI). Results indicate that provided a suitable AMI parameters is applied, one can generate a 3D reconstruction of the solder joints images to allow and assess the solder joints’ behaviour in flip chip packages. AMI inspection of solder joints show good agreement with the results obtained that was used to examine how the reliability was affected by the geometry and position of the joints. An automatic segmentation technique was developed that allow to characterize and extract distinctive features of solder joints on different area array packages; such features include mean intensity, structural similarities model and histogram intensity of the region of interest of solder joints. The validation experimental results have been statistically implemented using novel geometrical and time domain features extraction methods like area, form factor and standard deviation. The result from these methods were used to extrapolate the solder joint’s fatigue life at normal operating conditions. Moreover, the analysis of variance (ANOVA) was employed to determine the percentage contribution of solder joints parameters on the acquired images. The results indicated that the thickness of the printed circuit board can affect solder joint reliability

An Automated rule based visual printed circuit board inspection system which uses mathematical morphological image processing algorithms

Ankara : The Department of Electrical and Electronics Engineering and the Institute of Engineering and Science of Bilkent Univ. , 1990.Thesis (Master's) -- Bilkent University, 1990.Includes bibliographical references leaves 122-125.In this thesis, the design and implementation of an automated rule based visual printed circuit board (PCB) inspection system are presented. The developed system makes use of mathematical morphology based image processing algorithms. This system is designed for the detection of the PCB defects related to the conducting structures on the PCBs. For this purpose, four new algorithms, three of which are defect detection algorithms, are designed, and an already existing algorithm is modified for its implementation in our system. The designed defect detection algorithms respectively verify the minimum conductor trace width, minimum land width, and the minimum conductor trace spacing requirements on digital binary PCB images. The implementation of a prototype system is made in our image processing laboratory and the necessary computer programs are developed. These programs control the image processor and apply the defect detection algorithms to discrete binary PCB test images.Oğuz, Seyfullah HalitM.S