Design of automatic vision-based inspection system for solder joint segmentation

Purpose: Computer vision has been widely used in the inspection of electronic components. This paper proposes a computer vision system for the automatic detection, localisation, and segmentation of solder joints on Printed Circuit Boards (PCBs) under different illumination conditions. Design/methodology/approach: An illumination normalization approach is applied to an image, which can effectively and efficiently eliminate the effect of uneven illumination while keeping the properties of the processed image the same as in the corresponding image under normal lighting conditions. Consequently special lighting and instrumental setup can be reduced in order to detect solder joints. These normalised images are insensitive to illumination variations and are used for the subsequent solder joint detection stages. In the segmentation approach, the PCB image is transformed from an RGB color space to a YIQ color space for the effective detection of solder joints from the background. Findings: The segmentation results show that the proposed approach improves the performance significantly for images under varying illumination conditions. Research limitations/implications: This paper proposes a front-end system for the automatic detection, localisation, and segmentation of solder joint defects. Further research is required to complete the full system including the classification of solder joint defects. Practical implications: The methodology presented in this paper can be an effective method to reduce cost and improve quality in production of PCBs in the manufacturing industry. Originality/value: This research proposes the automatic location, identification and segmentation of solder joints under different illumination conditions

Inspection System And Method For Bond Detection And Validation Of Surface Mount Devices Using Sensor Fusion And Active Perception

A hybrid surface mount component inspection system which includes both vision and infrared inspection techniques to determine the presence of surface mount components on a printed wiring board, and the quality of solder joints of surface mount components on printed wiring boards by using data level sensor fusion to combine data from two infrared sensors to obtain emissivity independent thermal signatures of solder joints, and using feature level sensor fusion with active perception to assemble and process inspection information from any number of sensors to determine characteristic feature sets of different defect classes to classify solder defects.Georgia Tech Research Corporatio

Electrical termination techniques

A technical review of high reliability electrical terminations for electronic equipment was made. Seven techniques were selected from this review for further investigation, experimental work, and preliminary testing. From the preliminary test results, four techniques were selected for final testing and evaluation. These four were: (1) induction soldering, (2) wire wrap, (3) percussive arc welding, and (4) resistance welding. Of these four, induction soldering was selected as the best technique in terms of minimizing operator errors, controlling temperature and time, minimizing joint contamination, and ultimately producing a reliable, uniform, and reusable electrical termination

Non-contact Microelectronic Device Inspection Systems And Methods

Non-contact microelectronic device inspection systems and methods are discussed and provided. Some embodiments include a method of generating a virtual reference device (or chip). This approach uses a statistics to find devices in a sample set that are most similar and then averages their time domain signals to generate the virtual reference. Signals associated with the virtual reference can then be correlated with time domain signals obtained from the packages under inspection to obtain a quality signature. Defective and non-defective devices are separated by estimating a beta distribution that fits a quality signature histogram of inspected packages and determining a cutoff threshold for an acceptable quality signature. Other aspects, features, and embodiments are also claimed and described.Georgia Tech Research Corporatio

Automatic surface mount solder joints inspection

This thesis reports the research results on automatic inspection of solder joints on printed circuit boards. The previous work on this subject has been advanced significantly in the following three aspects. With the support of AT&T Bell Lab, the most updated surface mount solder joints are inspected in this work instead of larger simulation solder joints or traditional through hole solder joints in the previous work. A small set of features is extracted for surface mount solder joints in both infrared and visual light inspection. A new image processing software named Khoros has been applied to improve the quality of images. It has been demonstrated that infrared imaging technique can identify solder joints of surface mount printed circuit boards according to their solder volumn. The correct classification rate was found to be in the range of 89% to 100%. For the sample joints provided by AT&T Bell Laboratory, reasonably good inspection results have been obtained. The experimental results demonstrate that infrared imaging technique can be utilized to discriminate solder joints on surface mount printed circuit boards with different solder volumes quite reliably

Fine-grained Classification of Solder Joints with {\alpha}-skew Jensen-Shannon Divergence

Solder joint inspection (SJI) is a critical process in the production of printed circuit boards (PCB). Detection of solder errors during SJI is quite challenging as the solder joints have very small sizes and can take various shapes. In this study, we first show that solders have low feature diversity, and that the SJI can be carried out as a fine-grained image classification task which focuses on hard-to-distinguish object classes. To improve the fine-grained classification accuracy, penalizing confident model predictions by maximizing entropy was found useful in the literature. Inline with this information, we propose using the {\alpha}-skew Jensen-Shannon divergence ({\alpha}-JS) for penalizing the confidence in model predictions. We compare the {\alpha}-JS regularization with both existing entropyregularization based methods and the methods based on attention mechanism, segmentation techniques, transformer models, and specific loss functions for fine-grained image classification tasks. We show that the proposed approach achieves the highest F1-score and competitive accuracy for different models in the finegrained solder joint classification task. Finally, we visualize the activation maps and show that with entropy-regularization, more precise class-discriminative regions are localized, which are also more resilient to noise. Code will be made available here upon acceptance.Comment: Submitted to IEEE Transactions on Components, Packaging and Manufacturing Technolog

Visual Inspection System To Detect Connector Tilts In PCBAs [TS156. V844 2005 f rb] [Microfiche 7845].

Sistem pemeriksaan visual automatic memainkan peranan penting dalam bahagian tapisan kualiti di industri eletronik. AVI’s are playing important roles in quality inspection in the electronic industry

Industry 4.0: Mining Physical Defects in Production of Surface-Mount Devices

With the advent of Industry 4.0, production processes have been endowed with intelligent cyber-physical systems generating massive amounts of streaming sensor data. Internet of Things technologies have enabled capturing, managing, and processing production data at a large scale in order to utilize this data as an asset for the optimization of production processes. In this work, we focus on the automatic detection of physical defects in the production of surfacemount devices. We show how to build a classification model based on random forests that efficiently detects defect products with a high degree of precision. In fact, the results of our preliminary experimental analysis indicate that our approach is able to correctly determine defects in a simulated production environment of surface-mount devices with a MCC score of 0.96. We investigate the feasibility of utilizing this approach in realistic settings. We believe that our approach will help to advance the production of surface-mount devices

Automated robotic inspection system for electronic manufacturing

An automated robotic inspection system for electronic manufacturing has been developed to identify pin defects of IC packages mounted on printed circuit boards using surface mount technology. The automated robotic inspection system consists of two robots, a computer, a CCD camera with frame gabber for image acquisition, and a customized windows program using neural network for on-line defect identification. Gray scale images of the pins on IC packages are acquired using ambient light. The images are filtered and formatted to appropriate size, so that Matlab neural network tool could be used. The images are used to train neural networks using Matlab\u27s Bayesian Regularization module. Optimal network was found to be a single-layer network with three outputs for each IC investigated. The weights and biases of each of the ICs investigated and the matrices of gray scale values for the IC images are saved as text files. A customized windows program uses these text files for on-line defect identification. The defect identification for the networks was found to be 100 percent for the two ICs investigated. The analysis and integration of an automated robotic inspection system for on-line monitoring of electronic manufacturing using neural networks is presented in this work