A high speed Tri-Vision system for automotive applications

Purpose: Cameras are excellent ways of non-invasively monitoring the interior and exterior of vehicles. In particular, high speed stereovision and multivision systems are important for transport applications such as driver eye tracking or collision avoidance. This paper addresses the synchronisation problem which arises when multivision camera systems are used to capture the high speed motion common in such applications. Methods: An experimental, high-speed tri-vision camera system intended for real-time driver eye-blink and saccade measurement was designed, developed, implemented and tested using prototype, ultra-high dynamic range, automotive-grade image sensors specifically developed by E2V (formerly Atmel) Grenoble SA as part of the European FP6 project – sensation (advanced sensor development for attention stress, vigilance and sleep/wakefulness monitoring). Results : The developed system can sustain frame rates of 59.8 Hz at the full stereovision resolution of 1280 × 480 but this can reach 750 Hz when a 10 k pixel Region of Interest (ROI) is used, with a maximum global shutter speed of 1/48000 s and a shutter efficiency of 99.7%. The data can be reliably transmitted uncompressed over standard copper Camera-Link® cables over 5 metres. The synchronisation error between the left and right stereo images is less than 100 ps and this has been verified both electrically and optically. Synchronisation is automatically established at boot-up and maintained during resolution changes. A third camera in the set can be configured independently. The dynamic range of the 10bit sensors exceeds 123 dB with a spectral sensitivity extending well into the infra-red range. Conclusion: The system was subjected to a comprehensive testing protocol, which confirms that the salient requirements for the driver monitoring application are adequately met and in some respects, exceeded. The synchronisation technique presented may also benefit several other automotive stereovision applications including near and far-field obstacle detection and collision avoidance, road condition monitoring and others.Partially funded by the EU FP6 through the IST-507231 SENSATION project.peer-reviewe

Handheld 3D scanning system for in-vivo imaging of skin cancer

Postprint (published version

A novel ultrasonic strain gauge for single-sided measurement of a local 3D strain field

A novel method is introduced for the measurement of a 3D strain field by exploiting the interaction between ultrasound waves and geometrical characteristics of the insonified specimen. First, the response of obliquely incident harmonic waves to a deterministic surface roughness is utilized. Analysis of backscattered amplitudes in Bragg diffraction geometry then yields a measure for the in-plane strain field by mapping any shift in angular dependency. Secondly, the analysis of the reflection characteristics of normal incident pulsed waves in frequency domain provides a measure of the out-of-plane normal strain field component, simply by tracking any change in the stimulation condition for a thickness resonance. As such, the developed ultrasonic strain gauge yields an absolute, contactless and single-sided mapping of a local 3D strain field, in which both sample preparation and alignment procedure are needless. Results are presented for cold-rolled DC06 steel samples onto which skin passing of the work rolls is applied. The samples have been mechanically loaded, introducing plastic strain levels ranging from 2% up to 35%. The ultrasonically measured strains have been validated with various other strain measurement techniques, including manual micrometer, longitudinal and transverse mechanical extensometer and optical mono- and stereovision digital image correlation. Good agreement has been obtained between the ultrasonically determined strain values and the results of the conventional methods. As the ultrasonic strain gauge provides all three normal strain field components, it has been employed for the extraction of Lankford ratios at different applied longitudinal plastic strain levels, revealing a strain dependent plastic anisotropy of the investigated DC06 steel sheet

Accurate Feature Extraction and Control Point Correction for Camera Calibration with a Mono-Plane Target

The paper addresses two problems related to 3D camera calibration using a single mono-plane calibration target with circular control marks. The first problem is how to compute accurately the locations of the features (ellipses) in images of the target. Since the structure of the control marks is known beforehand, we propose to use a shape-specific searching technique to find the optimal locations of the features. Our experiments have shown this technique generates more accurate feature locations than the state-of-the-art ellipse extraction methods. The second problem is how to refine the control mark locations with unknown manufacturing errors. We demonstrate in a case study, where the control marks are laser printed on a A4 paper, that the manufacturing errors of the control marks can be compensated to a good extent so that the remaining calibration errors are reduced significantly. 1

Development of a stereovision-based technique to measure the spread patterns of granular fertilizer spreaders

Centrifugal fertilizer spreaders are by far the most commonly used granular fertilizer spreader type in Europe. Their spread pattern however is error-prone, potentially leading to an undesired distribution of particles in the field and losses out of the field, which is often caused by poor calibration of the spreader for the specific fertilizer used. Due to the large environmental impact of fertilizer use, it is important to optimize the spreading process and minimize these errors. Spreader calibrations can be performed by using collection trays to determine the (field) spread pattern, but this is very time-consuming and expensive for the farmer and hence not common practice. Therefore, we developed an innovative multi-camera system to predict the spread pattern in a fast and accurate way, independent of the spreader configuration. Using high-speed stereovision, ejection parameters of particles leaving the spreader vanes were determined relative to a coordinate system associated with the spreader. The landing positions and subsequent spread patterns were determined using a ballistic model incorporating the effect of tractor motion and wind. Experiments were conducted with a commercial spreader and showed a high repeatability. The results were transformed to one spatial dimension to enable comparison with transverse spread patterns determined in the field and showed similar results

Three-dimensional contact patch strain measurement inside rolling off-Road tyres

The forces generated in the tyre contact-patch are important for vehicle dynamics analysis. The tyre contact patch is not directly visible due to the terrain. Measuring the strain in the contact patch region may give insight into the forces generated by the tyre as it deforms. Strain measurement in the contact patch is often limited to discrete points, using strain gauges or other techniques which limits data capture to once per revolution. In this study stereovision cameras are used to capture unique features in the pattern painted on the tyres inner surface. An in-tyre mechanically stabilized camera system allows the contact patch to be captured continuously and the stereovision cameras allow for full field measurement of the tyre inner surface. In post processing the features are tracked and triangulated to form point-clouds for each time step. Point-clouds are compared to determine the strain of common points in two directions. The system is applied to an agricultural tyre with large tread-blocks. The wheel is instrumented to measure pressure and forces. The tyre is tested statically in a series of tyre tests where the lateral, longitudinal and vertical displacement is controlled. The strain measured in the tyre contact patch region is compared to the forces measured at the wheel centre. It is noticed that as the measured forces increases so too does the magnitudes of the strains. Unique patterns are found in the contact patch strain for each test type. These patterns could be used to identify the type of forces experienced by the wheel while the strain magnitude could give an indication of the magnitude of the forces. Future work could allow for strain measurement in the contact patch as the tyre rolls over deformable terrain where displacement is not easily controlled.Dissertation (MEng)--University of Pretoria, 2019.Mechanical and Aeronautical EngineeringMEngUnrestricte

Panoramic Stereovision and Scene Reconstruction

With advancement of research in robotics and computer vision, an increasingly high number of applications require the understanding of a scene in three dimensions. A variety of systems are deployed to do the same. This thesis explores a novel 3D imaging technique. This involves the use of catadioptric cameras in a stereoscopic arrangement. A secondary system aims to stabilize the system in the event that the cameras are misaligned during operation. The system provides a stark advantage due to it being a cost effective alternative to present day standard state-of-the-art systems that achieve the same goal of 3D imaging. The compromise lies in the quality of depth estimation, which can be overcome with a different imager and calibration. The result was a panoramic disparity map generated by the system

A proposal for automatic fruit harvesting by combining a low cost stereovision camera and a robotic arm

This paper proposes the development of an automatic fruit harvesting system by combining a low cost stereovision camera and a robotic arm placed in the gripper tool. The stereovision camera is used to estimate the size, distance and position of the fruits whereas the robotic arm is used to mechanically pickup the fruits. The low cost stereovision system has been tested in laboratory conditions with a reference small object, an apple and a pear at 10 different intermediate distances from the camera. The average distance error was from 4% to 5%, and the average diameter error was up to 30% in the case of a small object and in a range from 2% to 6% in the case of a pear and an apple. The stereovision system has been attached to the gripper tool in order to obtain relative distance, orientation and size of the fruit. The harvesting stage requires the initial fruit location, the computation of the inverse kinematics of the robotic arm in order to place the gripper tool in front of the fruit, and a final pickup approach by iteratively adjusting the vertical and horizontal position of the gripper tool in a closed visual loop. The complete system has been tested in controlled laboratory conditions with uniform illumination applied to the fruits. As a future work, this system will be tested and improved in conventional outdoor farming conditions

Calibration and Sensitivity Analysis of a Stereo Vision-Based Driver Assistance System

Az http://intechweb.org/ alatti "Books" fül alatt kell rákeresni a "Stereo Vision" címre és az 1. fejezetre