Efficient completeness inspection using real-time 3D color reconstruction with a dual-laser triangulation system

In this chapter, we present the final system resulting from the European Project \u201d3DComplete\u201d aimed at creating a low-cost and flexible quality inspection system capable of capturing 2.5D color data for completeness inspection. The system uses a single color camera to capture at the same time 3D data with laser triangulation and color texture with a special projector of a narrow line of white light, which are then combined into a color 2.5D model in real-time. Many examples of completeness inspection tasks are reported which are extremely difficult to analyze with state-of-the-art 2D-based methods. Our system has been integrated into a real production environment, showing that completeness inspection incorporating 3D technology can be readily achieved in a short time at low costs

Autonomous Mechanical Assembly on the Space Shuttle: An Overview

The space shuttle will be equipped with a pair of 50 ft. manipulators used to handle payloads and to perform mechanical assembly operations. Although current plans call for these manipulators to be operated by a human teleoperator. The possibility of using results from robotics and machine intelligence to automate this shuttle assembly system was investigated. The major components of an autonomous mechanical assembly system are examined, along with the technology base upon which they depend. The state of the art in advanced automation is also assessed

An illumination-invariant phase-shifting algorithm for three-dimensional profilometry

Image Processing: Machine Vision Applications V, Burlingame, California, USA, 22 January, 2012Uneven illumination is a common problem in real optical systems for machine vision applications, and it contributes significant errors when using phase-shifting algorithms (PSA) to reconstruct the surface of a moving object. Here, we propose an illumination-reflectivity-focus (IRF) model to characterize this uneven illumination effect on phase-measuring profilometry. With this model, we separate the illumination factor effectively, and then formulate the phase reconstruction as an optimization problem. To simplify the optimization process, we calibrate the uneven illumination distribution beforehand, and then use the calibrated illumination information during surface profilometry. After calibration, the degrees of freedom are reduced. Accordingly, we develop a novel illumination-invariant phase-shifting algorithm (II-PSA) to reconstruct the surface of a moving object under an uneven illumination environment. Experimental results show that the proposed algorithm can improve the reconstruction quality both visually and numerically. Therefore, using this IRF model and the corresponding II-PSA, not only can we handle uneven illumination in a real optical system with a large field of view (FOV), but we also develop a robust and efficient method for reconstructing the surface of a moving object. © 2012 Copyright Society of Photo-Optical Instrumentation Engineers (SPIE).link_to_subscribed_fulltextpublished_or_final_versio

Multi-scale metrology for automated non-destructive testing systems

This thesis was previously held under moratorium from 5/05/2020 to 5/05/2022The use of lightweight composite structures in the aerospace industry is now commonplace. Unlike conventional materials, these parts can be moulded into complex aerodynamic shapes, which are diffcult to inspect rapidly using conventional Non-Destructive Testing (NDT) techniques. Industrial robots provide a means of automating the inspection process due to their high dexterity and improved path planning methods. This thesis concerns using industrial robots as a method for assessing the quality of components with complex geometries. The focus of the investigations in this thesis is on improving the overall system performance through the use of concepts from the field of metrology, specifically calibration and traceability. The use of computer vision is investigated as a way to increase automation levels by identifying a component's type and approximate position through comparison with CAD models. The challenges identified through this research include developing novel calibration techniques for optimising sensor integration, verifying system performance using laser trackers, and improving automation levels through optical sensing. The developed calibration techniques are evaluated experimentally using standard reference samples. A 70% increase in absolute accuracy was achieved in comparison to manual calibration techniques. Inspections were improved as verified by a 30% improvement in ultrasonic signal response. A new approach to automatically identify and estimate the pose of a component was developed specifically for automated NDT applications. The method uses 2D and 3D camera measurements along with CAD models to extract and match shape information. It was found that optical large volume measurements could provide suffciently high accuracy measurements to allow ultrasonic alignment methods to work, establishing a multi-scale metrology approach to increasing automation levels. A classification framework based on shape outlines extracted from images was shown to provide over 88% accuracy on a limited number of samples.The use of lightweight composite structures in the aerospace industry is now commonplace. Unlike conventional materials, these parts can be moulded into complex aerodynamic shapes, which are diffcult to inspect rapidly using conventional Non-Destructive Testing (NDT) techniques. Industrial robots provide a means of automating the inspection process due to their high dexterity and improved path planning methods. This thesis concerns using industrial robots as a method for assessing the quality of components with complex geometries. The focus of the investigations in this thesis is on improving the overall system performance through the use of concepts from the field of metrology, specifically calibration and traceability. The use of computer vision is investigated as a way to increase automation levels by identifying a component's type and approximate position through comparison with CAD models. The challenges identified through this research include developing novel calibration techniques for optimising sensor integration, verifying system performance using laser trackers, and improving automation levels through optical sensing. The developed calibration techniques are evaluated experimentally using standard reference samples. A 70% increase in absolute accuracy was achieved in comparison to manual calibration techniques. Inspections were improved as verified by a 30% improvement in ultrasonic signal response. A new approach to automatically identify and estimate the pose of a component was developed specifically for automated NDT applications. The method uses 2D and 3D camera measurements along with CAD models to extract and match shape information. It was found that optical large volume measurements could provide suffciently high accuracy measurements to allow ultrasonic alignment methods to work, establishing a multi-scale metrology approach to increasing automation levels. A classification framework based on shape outlines extracted from images was shown to provide over 88% accuracy on a limited number of samples

Effect of imperfections on and modelling of conductivity and hardness of high-Zn X7xxx cast al-alloys produced from recycled beverage can

In this paper, the effect of imperfections as a result of formation of new phases on electrical and macro hardness property of a novel experimental high-Zn Al-Zn-Mg-Cu alloys produced from recycled beverage can was investigated with the aim of correlating hardness with conductivity using ANOVA. Alloys were observed in the As Cast (AC), annealed (O), natural aged (T4) and artificial aged (T6) conditions. Heat treatments supported the formation of hardening precipitates like the Al2.06Fe4, α-AlFeSi, Al7Cu2Fe, θ(Al2Cu), β-AlFeSi and MgZn2 phases. Imperfections inform of voids and contaminants are by-products of recycled aluminium and casting route. Peak obtainable hardness of 122.94 HV in the T6 condition was observed in an alloy of Al-5.0 Zn-1.5 Mg- 0.35 Cu. The same alloy’s conductivity is 3.676 107 S/m. The least hardness of 38.16 HV and conductivity of 3.533 107 S/m is credited to an alloy of Al- 5.0 Zn-1.00 Mg-0.35 Cu in the O condition. The relationship between hardness and conductivity is nonlinear. Models developed to predict the hardness of this experimental alloys fits all the variables and covers the AC, O, T4 and T6 respectively. The need for further investigation on the imperfections, optimization of mechanical properties and additional mechanical properties investigation is required

Towards an automated polishing system: capturing manual polishing operations

Advancements in robotic and automation industries have influenced many manual manufacturing operations. With a great level of success, robots have taken over from man in many processes such as part manufacturing, transfer and assembly. However, in other traditionally manual operations such as polishing, automation has only partially been successful, typically limited to parts with simple geometry and low accuracy. Automated polishing systems using robots have been attempted already by a number of industrial and research groups; however, there are few examples of deploying such a system as a part of a routine production process in high-technology industries, such as aerospace. This is due to limitations in flexibility, speed of operation, and inspection processes, when compared with manual polishing processes. The need for automated polishing processes is discussed in this article and the problem with the existing system was explained to be a lack of understanding and the disconnect from manual operations. In collaboration with industrial partners, a mechatronic based data capturing device was developed to accurately capture and analyze operational variables such as force, torque, vibration, polishing pattern, and feed rates. Also reported in this article is a set of experiments carried out to identify the polishing parameters that a manual operator controls through tactile and visual sensing. The captured data is interpreted to the operators’ preferences and polishing methods and should then be included in the design of an automated polishing system. The research results reported in this article are fed back to an ongoing research project on developing an integrated robotic polishing system