Image Contour Extraction and Analysis Based on Edge Detection Algorithm

With the development of science and technology, the requirements for the measurement accuracy of various workpiece parts are getting higher and higher. In this article, we combine the traditional edge detection algorithm and subpixel edge detection algorithm to analyze the three workpiece parts pictures  extracts the edge contour, and combines the sobel and canny algorithm to detect the edge contour. For the third photo taken under complex light, we constructed different series filters and parallel filters for filtering and denoising, and then extracted and analyzed the slices. The results show that our method achieves good results in contour extraction

Image understanding and feature extraction for applications in industry and mapping

Bibliography: p. 212-220.The aim of digital photogrammetry is the automated extraction and classification of the three dimensional information of a scene from a number of images. Existing photogrammetric systems are semi-automatic requiring manual editing and control, and have very limited domains of application so that image understanding capabilities are left to the user. Among the most important steps in a fully integrated system are the extraction of features suitable for matching, the establishment of the correspondence between matching points and object classification. The following study attempts to explore the applicability of pattern recognition concepts in conjunction with existing area-based methods, feature-based techniques and other approaches used in computer vision in order to increase the level of automation and as a general alternative and addition to existing methods. As an illustration of the pattern recognition approach examples of industrial applications are given. The underlying method is then extended to the identification of objects in aerial images of urban scenes and to the location of targets in close-range photogrammetric applications. Various moment-based techniques are considered as pattern classifiers including geometric invariant moments, Legendre moments, Zernike moments and pseudo-Zernike moments. Two-dimensional Fourier transforms are also considered as pattern classifiers. The suitability of these techniques is assessed. These are then applied as object locators and as feature extractors or interest operators. Additionally the use of fractal dimension to segment natural scenes for regional classification in order to limit the search space for particular objects is considered. The pattern recognition techniques require considerable preprocessing of images. The various image processing techniques required are explained where needed. Extracted feature points are matched using relaxation based techniques in conjunction with area-based methods to 'obtain subpixel accuracy. A subpixel pattern recognition based method is also proposed and an investigation into improved area-based subpixel matching methods is undertaken. An algorithm for determining relative orientation parameters incorporating the epipolar line constraint is investigated and compared with a standard relative orientation algorithm. In conclusion a basic system that can be automated based on some novel techniques in conjunction with existing methods is described and implemented in a mapping application. This system could be largely automated with suitably powerful computers

Research on railway track edge detection based on BM3D and Zernike moments

With the rapid development of intelligent rail transportation, the realization of intelligent detection of railroad foreign body intrusion has become an important topic of current research. Accurate detection of rail edge location, and then delineate the danger area is the premise and basis for railroad track foreign object intrusion detection. The application of a single edge detection algorithm in the process of rail identification is likely to cause the problem of missing important edges and weak gradient change edges of railroad tracks. It will affect the subsequent detection of track foreign objects. A combined global and local edge detection method is proposed to detect the edges of railroad tracks. In the global pixel-level edge detection, an improved blok-matching and 3D filtering (BM3D) algorithm combined with bilateral filtering is used for denoising to eliminate the interference information in the complex environment. Then the gradient direction is added to the Canny operator, the computational template is increased to achieve non-extreme value suppression, and the Otsu thresholding segmentation algorithm is used for thresholding improvement. It can effectively suppress noise while preserving image details, and improve the accuracy and efficiency of detection at the pixel level. For local subpixel-level edge detection, the improved Zernike moment algorithm is used to extract the edges of the obtained pixel-level images and obtain the corresponding subpixel-level images. It can enhance the extraction of tiny feature edges, effectively reduce the computational effort and obtain the subpixel edges of the orbit images. The experimental results show that compared with other improved algorithms, the method proposed in this paper can effectively extract the track edges of the detected images with higher accuracy, better preserve the track edge features, reduce the appearance of pseudo-edges, and shorten the edge detection time with certain noise immunity, which provides a reliable basis for subsequent track detection and analysis

A non-contact vision-based system for multi-point displacement monitoring in a cable-stayed footbridge

This is the author accepted manuscript. The final version is available from Wiley via the DOI in this record.Vision-based monitoring receives increased attention for measuring displacements of civil infrastructure such as towers and bridges. Currently, most field applications rely on artificial targets for video processing convenience, leading to high installation effort and focus on only single-point displacement measurement e.g. at mid-span of a bridge. This study proposes a low-cost and non-contact vision-based system for multi-point displacement measurement based on a consumer-grade camera for video acquisition and a custom-developed package for video processing. The system has been validated on a cable-stayed footbridge for deck deformation and cable vibration measurement under pedestrian loading. The analysis results indicate that the system provides valuable information about bridge deformation of the order of a few cm induced, in this application, by pedestrian passing. The measured data enables accurate estimation of modal frequencies of either the bridge deck or the bridge cables and could be used to investigate variations of modal frequencies under varying pedestrian loads

Robust Textural Features for Real Time Face Recognition

Automatic face recognition in real life environment is challenged by various issues such as the object motion, lighting conditions, poses and expressions. In this paper, we present the development of a system based on a refined Enhanced Local Binary Pattern (ELBP) feature set and a Support Vector Machine (SVM) classifier to perform face recognition in a real life environment. Instead of counting the number of 1\u27s in ELBP, we use the 8-bit code of the thresholded data as per the ELBP rule, and then binarize the image with a predefined threshold value, removing the small connections on the binarized image. The proposed system is currently trained with several people\u27s face images obtained from video sequences captured by a surveillance camera. One test set contains the disjoint images of the trained people\u27s faces to test the accuracy and the second test set contains the images of non-trained people\u27s faces to test the percentage of the false positives. The recognition rate among 570 images of 9 trained faces is around 94%, and the false positive rate with 2600 images of 34 non-trained faces is around 1%. Research work is progressing for the recognition of partially occluded faces as well. An appropriate weighting strategy will be applied to the different parts of the face area to achieve a better performance

Non-contact vision-based deformation monitoring on bridge structures

Information on deformation is an important metric for bridge condition and performance assessment, e.g. identifying abnormal events, calibrating bridge models and estimating load carrying capacities, etc. However, accurate measurement of bridge deformation, especially for long-span bridges remains as a challenging task. The major aim of this research is to develop practical and cost-effective techniques for accurate deformation monitoring on bridge structures. Vision-based systems are taken as the study focus due to a few reasons: low cost, easy installation, desired sample rates, remote and distributed sensing, etc. This research proposes an custom-developed vision-based system for bridge deformation monitoring. The system supports either consumer-grade or professional cameras and incorporates four advanced video tracking methods to adapt to different test situations. The sensing accuracy is firstly quantified in laboratory conditions. The working performance in field testing is evaluated on one short-span and one long-span bridge examples considering several influential factors i.e. long-range sensing, low-contrast target patterns, pattern changes and lighting changes. Through case studies, some suggestions about tracking method selection are summarised for field testing. Possible limitations of vision-based systems are illustrated as well. To overcome observed limitations of vision-based systems, this research further proposes a mixed system combining cameras with accelerometers for accurate deformation measurement. To integrate displacement with acceleration data autonomously, a novel data fusion method based on Kalman filter and maximum likelihood estimation is proposed. Through field test validation, the method is effective for improving displacement accuracy and widening frequency bandwidth. The mixed system based on data fusion is implemented on field testing of a railway bridge considering undesired test conditions (e.g. low-contrast target patterns and camera shake). Analysis results indicate that the system offers higher accuracy than using a camera alone and is viable for bridge influence line estimation. With considerable accuracy and resolution in time and frequency domains, the potential of vision-based measurement for vibration monitoring is investigated. The proposed vision-based system is applied on a cable-stayed footbridge for deck deformation and cable vibration measurement under pedestrian loading. Analysis results indicate that the measured data enables accurate estimation of modal frequencies and could be used to investigate variations of modal frequencies under varying pedestrian loads. The vision-based system in this application is used for multi-point vibration measurement and provides results comparable to those obtained using an array of accelerometers

Vision-Based Bridge Deformation Monitoring

This is the final version of the article. Available from Frontiers Media via the DOI in this record.Optics-based tracking of civil structures is not new, due to historical application in surveying, but automated applications capable of tracking at rates that capture dynamic effects are now a hot research topic in structural health monitoring. Recent innovations show promise of true non-contacting monitoring capability avoiding the need for physically attached sensor arrays. The paper reviews recent experience using the Imetrum Dynamic Monitoring Station (DMS) commercial optics-based tracking system on Humber Bridge and Tamar Bridge, aiming to show both the potential and limitations. In particular, the paper focuses on the challenges to field application of such a system resulting from camera instability, nature of the target (artificial or structural feature), and illumination. The paper ends with evaluation of a non-proprietary system using a consumer-grade camera for cable vibration monitoring to emphasize the potential for lower cost systems where if performance specifications can be relaxed.The GPS system at Humber was created by Dr. Ki Koo with support from EPSRC grant EP/F035403/1. DH was supported via the Marie Curie Fellowship programme and as such the research leading to these results has received funding from the People Programme (Marie Curie Actions) of the European Union’s Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 330195

Design and Development of Robotic Part Assembly System under Vision Guidance

Robots are widely used for part assembly across manufacturing industries to attain high productivity through automation. The automated mechanical part assembly system contributes a major share in production process. An appropriate vision guided robotic assembly system further minimizes the lead time and improve quality of the end product by suitable object detection methods and robot control strategies. An approach is made for the development of robotic part assembly system with the aid of industrial vision system. This approach is accomplished mainly in three phases. The first phase of research is mainly focused on feature extraction and object detection techniques. A hybrid edge detection method is developed by combining both fuzzy inference rule and wavelet transformation. The performance of this edge detector is quantitatively analysed and compared with widely used edge detectors like Canny, Sobel, Prewitt, mathematical morphology based, Robert, Laplacian of Gaussian and wavelet transformation based. A comparative study is performed for choosing a suitable corner detection method. The corner detection technique used in the study are curvature scale space, Wang-Brady and Harris method. The successful implementation of vision guided robotic system is dependent on the system configuration like eye-in-hand or eye-to-hand. In this configuration, there may be a case that the captured images of the parts is corrupted by geometric transformation such as scaling, rotation, translation and blurring due to camera or robot motion. Considering such issue, an image reconstruction method is proposed by using orthogonal Zernike moment invariants. The suggested method uses a selection process of moment order to reconstruct the affected image. This enables the object detection method efficient. In the second phase, the proposed system is developed by integrating the vision system and robot system. The proposed feature extraction and object detection methods are tested and found efficient for the purpose. In the third stage, robot navigation based on visual feedback are proposed. In the control scheme, general moment invariants, Legendre moment and Zernike moment invariants are used. The selection of best combination of visual features are performed by measuring the hamming distance between all possible combinations of visual features. This results in finding the best combination that makes the image based visual servoing control efficient. An indirect method is employed in determining the moment invariants for Legendre moment and Zernike moment. These moments are used as they are robust to noise. The control laws, based on these three global feature of image, perform efficiently to navigate the robot in the desire environment