A STUDY OF MACHINE VISION IN THE AUTOMOTIVE INDUSTRY

With the growth of industrial automation, it has become increasingly important to validate the quality of every manufactured part during production. Until now, human visual inspection aided with hard tooling or machines have been the primary means to this end, but the speed of today's production lines, the complexity of production equipment and the highest standards of quality to which parts must adhere frequently, make the traditional methods of industrial inspection and control impractical, if not impossible. Subsequently, new solutions have been developed for the monitoring and control of industrial processes, in real­time. One such technology is the area of machine vision. After many years of research and development, computerised vision systems are now leaving the laboratory and are being used successfully in the factory environment. They are both robust and competitively priced as a sensing technique which has now opened up a whole new sector for automation. Machine vision systems are becoming an important integral part of the automotive manufacturing process, with applications ranging from inspection, classification, robot guidance, assembly verification through to process monitoring and control. Although the number of systems in current use is still relatively small, there can be no doubt, given the issues at stake, that the automotive industry will once again lead the way with the implementation of machine vision just as it has done robotic technology. The thesis considered the issue of machine vision and in particular, its deployment within the automotive industry. The thesis has presented work on machine vision for the prospective end-user and not the designer of such systems. It will provide sufficient background about the subject, to separate machine vision promises from reality and permit intelligent decisions regarding machine vision applications to be made. The initial part of the dissertation focussed on the strategic issues affecting the selection of machine vision at the planning stage, such as a listing of the factors to justify investment, the capability of the technology and type of problems that are associated with this relatively new but complex science. Though it is widely accepted that no two industrial machine vision systems are identical, knowledge of the basic fundamentals which underpin the structure of the technology in its application is presented. This work covered a structured description detailing typical hardware components such as camera technology, lighting systems, etc... which form an integral part of an industrial system and discussions regarding the criteria for selection are presented. To complement this work, a further section is specifically devoted to the bewildering array of vision software analysis techniques which are currently available today. A detailed description of the various techniques that are applied to images in order to make use of and understand the data contained within them are discussed and explored. Applications for machine vision fall into two main categories namely robotic guidance and inspection. Obviously within each category there are many further sub­groups. Within this context the latter part of the thesis reviews with a well structured description of several industrial case studies derived from the automotive industry, which illustrate that machine vision is capable of providing real time solutions to manufacturing based problems. In conclusion, despite the limited availability of industrially based machine vision systems, the success of implementation is not always guaranteed, as the technology imposes both technical limitations and introduce new human engineering considerations. By understanding the application and the implications of the technical requirements on both the "staging" and the "image-processing" power required of the machine vision system. The thesis has shown that the most significant elements of a successful application are indeed the lighting, optics, component design, etc... - the "Staging". From the case studies investigated, optimised "staging" has resulted in the need for less computing power in the machine vision system. Inevitably, greater computing power not only requires more time but is generally more expensive. The experience gained from the this project, has demonstrated that machine vision technology is a realistic alternative means of capturing data in real-time. Since the current limitations of the technology are well suited to the delivery process of the quality function within the manufacturing process

Three-dimensional geometry characterization using structured light fields

Tese de doutoramento. Engenharia Mecânica. Faculdade de Engenharia. Universidade do Porto. 200

Offshore stereo measurements of gravity waves

Stereo video techniques are effective for estimating the space-time wave dynamics over an area of the ocean. Indeed, a stereo camera view allows retrieval of both spatial and temporal data whose statistical content is richer than that of time series data retrieved from point wave probes. To prove this, we consider an application of the Wave Acquisition Stereo System (WASS) for the analysis of offshore video measurements of gravity waves in the Northern Adriatic Sea. In particular, we deployed WASS at the oceanographic platform Acqua Alta, off the Venice coast, Italy. Three experimental studies were performed, and the overlapping field of view of the acquired stereo images covered an area of approximately 1100 m2. Analysis of the WASS measurements show that the sea surface can be accurately estimated in space and time together, yielding associated directional spectra and wave statistics that agree well with theoretical models. From the observed wavenumber-frequency spectrum one can also predict the vertical profile of the current flow underneath the wave surface. Finally, future improvements of WASS and applications are discussed

Depth Map Improvement by Combining Passive and Active Scanning Methods

The paper presents a new method of more precise estimation of the depth map in 3D videos. The novelty of the proposed approach lies in sophisticated combination of partial results obtained by selected existing passive and active 3D scanning methods. The aim of the combination is to overcome drawbacks of individual methods and this way to improve the accessible precision of the final depth map. The active method used is incoherent profilometry scanning which fails on surface discontinuities. As a passive method, a stereo pair matching is used. This method is currently the most widely applied method of depth map estimation in the field of 3D capturing and is available in various implementations. Unfortunately, it fails if there is a lack of identifiable corresponding points in the scanned scene. The paper provides a specific way of combining these methods to improve the accuracy and usability. The proposed innovative technique exploits the advantages of both approaches. Specifically, the more accurate depth profiles of individual discontinuous objects obtained from the active method, and information about mean depths of the objects from the stereo pair are combined. Two implementations of the passive method have been tested for combination with active scanning: matching from stereo pair, and SIFT. The paper includes a brief description of the active and passive methods used and a thorough explanation of their combination. As an example, the proposed method is tested on a simple scene whose nature enables straight assessment of the achieved accuracy. The choice of a suitable implementation of the passive component is also shown and discussed. The obtained results of individual existing methods used and of the proposed combined method are given and compared. To demonstrate the contribution of the proposed combined method, also a comparison with the results obtained with a commercial solution is presented with significantly good results

Long-Term Structural Movement, HR-275, 1986

This report describes the field application of the tilt sensing method for monitoring movement of the Black Hawk and Karl King Bridges. The study objectives were: to design a data acquisition system for tilt sensing equipment utilizing a telephone telemetry system; to monitor possible movement of the main span pier, Pier No. 2, on the Black Hawk Bridge in Lansing and the possible long-term movement of Pier No. 4 on the Karl King Bridge in Fort Dodge; and to assess the feasibility, reliability, and accuracy of the instrumentation system used in this study

MONITORING DAIRY COW FEED INTAKE USING MACHINE VISION

The health and productive output of dairy cows can be closely correlated to individual cow feed intake. Being able to monitor feed intake on a daily basis is beneficial dairy farm management. Each cow can be addressed individually with minimal time required from those working with the animals. This is essential as time management is closely tied to resource management in a dairy operation. Anything that can save time and resources and increase profitability and herd health is a paramount advantage in dairy farming. This study examined the use of machine vision structured light illumination three-dimensional scanning of cow feed to determine the volume and weight of feed in a bin before and after feeding dairy cow. Calibration and control tests were conducted to determine the effectiveness and capability of implementing such a machine vision feed scanning system. Such a system is ideal as it does not obstruct workflow or cow feeding behavior. This is an improvement over existing systems as the system in this research study can be implemented into existing farm operations with minimal effort and costs

The development of a non-contact co-ordinate measurement machine

Bibliography: pages 113-117.The Department of Surveying and Geodetic Engineering at the University of Cape Town, in conjunction with the Department of Mechanical Engineering at the University of Cape Town have developed a non-contact co-ordinate measurement machine in a project called MILIMAP. The project had the following objectives : 1. To determine unique surface co-ordinates for continuous, complex objects with submillimetre accuracy. 2. The representation of the co-ordinates was to be in a format that could be utilised by a computer numerically controlled (CNC) milling machine in a computer aided design/ computer aided manufacture (CADCAM) environment. 3. The device had to use a non-contact method for data capture. The MILIMAP project was undertaken because there is a demand for co-ordinate measurement machines in industry for the inspection of objects for quality control purposes. Conventional Co-ordinate Measurement Machines (CMMs) are expensive and use a contact probe to measure the object. The contact probe measurement technique is unsuitable for the measurement of non-rigid objects such as shoes and automobile seat padding. The MILIMAP system provides a noncontact measurement technique that can be applied to non-rigid as well as rigid objects. Additional applications in the archaeological field exist for the non-contact measurement of sensitive, historical artefacts. A digital photogrammetric system was developed to measure the position of a laser dot projected onto the surface of the measurement object. This measurement system satisfied the criteria of a non-contact measurement method required for the project. The system utilised three digital CCD cameras to capture images of the laser dot projected onto the object. Image processing software, developed from existing software within the Department of Surveying and Geodetic Engineering, was used to photogrammetrically determine the co-ordinates of the laser dot to sub-millimetre accuracy on the surface of the object. A mechanical device was designed and constructed by the Department of Mechanical Engineering in order to move the laser over the surface of the object, and to rotate the object. The entire surface of the object could be measured by the system using these operations

On the popularization of digital close-range photogrammetry: a handbook for new users.

Εθνικό Μετσόβιο Πολυτεχνείο--Μεταπτυχιακή Εργασία. Διεπιστημονικό-Διατμηματικό Πρόγραμμα Μεταπτυχιακών Σπουδών (Δ.Π.Μ.Σ.) “Γεωπληροφορική

Electronic Imaging & the Visual Arts. EVA 2015 Florence

Information Technologies of interest for Culture Heritage are presented: multimedia systems, data-bases, data protection, access to digital content, Virtual Galleries. Particular reference is reserved to digital images (Electronic Imaging & the Visual Arts), regarding Cultural Institutions (Museums, Libraries, Palace – Monuments, Archaeological Sites). The International Conference includes the following Sessions: Strategic Issues; New Technologies & Applications; New 2D-3D Technical Developments & Applications; Virtual Galleries – Museums and Related Initiatives; Access to the Culture Information. Two Workshops regard: International Cooperation; Innovation and Enterprise