An intelligent real time 3D vision system for robotic welding tasks

MARWIN is a top-level robot control system that has been designed for automatic robot welding tasks. It extracts welding parameters and calculates robot trajectories directly from CAD models which are then verified by real-time 3D scanning and registration. MARWIN's 3D computer vision provides a user-centred robot environment in which a task is specified by the user by simply confirming and/or adjusting suggested parameters and welding sequences. The focus of this paper is on describing a mathematical formulation for fast 3D reconstruction using structured light together with the mechanical design and testing of the 3D vision system and show how such technologies can be exploited in robot welding tasks

Vision-aided Monitoring and Control of Thermal Spray, Spray Forming, and Welding Processes

Vision is one of the most powerful forms of non-contact sensing for monitoring and control of manufacturing processes. However, processes involving an arc plasma or flame such as welding or thermal spraying pose particularly challenging problems to conventional vision sensing and processing techniques. The arc or plasma is not typically limited to a single spectral region and thus cannot be easily filtered out optically. This paper presents an innovative vision sensing system that uses intense stroboscopic illumination to overpower the arc light and produce a video image that is free of arc light or glare and dedicated image processing and analysis schemes that can enhance the video images or extract features of interest and produce quantitative process measures which can be used for process monitoring and control. Results of two SBIR programs sponsored by NASA and DOE and focusing on the application of this innovative vision sensing and processing technology to thermal spraying and welding process monitoring and control are discussed

A path to in-space welding and to other in-space metal processing technologies using Space Shuttle small payloads

As we venture into space, it becomes necessary to assemble, expand, and repair space-based structures for our housing, research, and manufacturing. The zero gravity-vacuum of space challenges us to employ construction options which are commonplace on Earth. Rockwell International (RI) has begun to undertake the challenge of space-based construction via numerous options, of which one is welding. As of today, RI divisions have developed appropriate resources and technologies to bring space-based welding within our grasp. Further work, specifically in the area of developing space experiments to test RI technology, is required. RI Space Welding Project's achievements to date, from research and development (R&E) efforts in the areas of microgravity, vacuum, intra- / extra- vehicular activity and spinoff technologies, are reviewed. Special emphasis is given to results for G-169's (Get Away Special) microgravity flights aboard a NASA KC-135. Based on these achievements, a path to actual development of a space welding system is proposed with options to explore spinoff in-space metal processing technologies. This path is constructed by following a series of milestone experiments, of which several are to utilize NASA's Shuttle Small Payload Programs. Conceptual designs of the proposed shuttle payload experiments are discussed with application of lessons learned from G-169's design, development, integration, testing, safety approval process, and KC-135 flights

Vision-assisted robotic finishing of friction stir-welded corner joints

One required process in the fabrication of large components is welding, after which there may be a need for machining to achieve final dimensions and uniform surfaces. Friction stir-welding (FSW) is a typical example after which a series of deburring and grinding operations are carried out. Currently, the majority of these operations are carried out either manually, by human workers, or on machine tools which results in bottlenecks in the process flows. This paper presents a robotic finishing system to automate the finishing of friction stir-welded parts with minimum human involvement. In a sequence, the system can scan and reconstruct the 3D model of the part, localise it in the robot frame and generate a suitable machining path accordingly, to remove the excess material from FSW without violating process constraints. Results of the cutting trials carried out for demonstration have shown that the developed system can consistently machine the corner joints of an industrial scale part to desired surface quality which is around 1.25 μm in, Ra, the arithmetic average of the surface roughness

Online programming system for robotic fillet welding in Industry 4.0

Purpose Fillet welding is one of the most widespread types of welding in the industry, which is still carried out manually or automated by contact. This paper aims to describe an online programming system for noncontact fillet welding robots with "U"- and "L"-shaped structures, which responds to the needs of the Fourth Industrial Revolution. Design/methodology/approach In this paper, the authors propose an online robot programming methodology that eliminates unnecessary steps traditionally performed in robotic welding, so that the operator only performs three steps to complete the welding task. First, choose the piece to weld. Then, enter the welding parameters. Finally, it sends the automatically generated program to the robot. Findings The system finally managed to perform the fillet welding task with the proposed method in a more efficient preparation time than the compared methods. For this, a reduced number of components was used compared to other systems: a structured light 3 D camera, two computers and a concentrator, in addition to the six-axis industrial robotic arm. The operating complexity of the system has been reduced as much as possible. Practical implications To the best of the authors' knowledge, there is no scientific or commercial evidence of an online robot programming system capable of performing a fillet welding process, simplifying the process so that it is completely transparent for the operator and framed in the Industry 4.0 paradigm. Its commercial potential lies mainly in its simple and low-cost implementation in a flexible system capable of adapting to any industrial fillet welding job and to any support that can accommodate it. Originality/value In this study, a robotic robust system is achieved, aligned to Industry 4.0, with a friendly, intuitive and simple interface for an operator who does not need to have knowledge of industrial robotics, allowing him to perform a fillet welding saving time and increasing productivity

A Review of Welding in Space and Related Technologies

Deployment of welding and additive manufacturing (AM) technologies in the space environment has the potential to revolutionize how orbiting platforms are designed, manufactured, and assembled. These technologies offer the option for repair of sustained damage to habitat structures on space missions, as astronauts would be able to manufacture new parts (using welding-derived AM processes suitable for use in the external space environment) and weld cracks. An added benefit is that required repairs can be achieved more economically, as new parts need not be shipped from Earth. With further maturation of in-space welding capabilities, astronauts could operate under given standards and weld damaged structures rather than rely on cargo resupply. This Technical Memorandum (TM) begins by reviewing the available literature relevant to welding in space, focusing on solidification, heat and mass transfer, and fluid flows in microgravity. This survey considers research on the effects of welding in microgravity on a material system. The various in-space welding devices that have been previously designed and tested are examined to determine their capabilities and shortcomings, with a focus on the results of their individual welding experiments. Safety measures are discussed to protect the orbiting International Space Station (ISS) and crew during welding operations. Finally, the state of the art is examined by focusing on current approaches to AM and on-orbit welding that are being developed by several companies in conjunction with NASA

Recent Advancements in Augmented Reality for Robotic Applications: A Survey

Robots are expanding from industrial applications to daily life, in areas such as medical robotics, rehabilitative robotics, social robotics, and mobile/aerial robotics systems. In recent years, augmented reality (AR) has been integrated into many robotic applications, including medical, industrial, human–robot interactions, and collaboration scenarios. In this work, AR for both medical and industrial robot applications is reviewed and summarized. For medical robot applications, we investigated the integration of AR in (1) preoperative and surgical task planning; (2) image-guided robotic surgery; (3) surgical training and simulation; and (4) telesurgery. AR for industrial scenarios is reviewed in (1) human–robot interactions and collaborations; (2) path planning and task allocation; (3) training and simulation; and (4) teleoperation control/assistance. In addition, the limitations and challenges are discussed. Overall, this article serves as a valuable resource for working in the field of AR and robotic research, offering insights into the recent state of the art and prospects for improvement