A video-based framework for automatic 3d localization of multiple basketball players : a combinatorial optimization approach

Sports complexity must be investigated at competitions; therefore, non-invasive methods are essential. In this context, computer vision, image processing, and machine learning techniques can be useful in designing a non-invasive system for data acquisition that identifies players’ positions in official basketball matches. Here, we propose and evaluate a novel video-based framework to perform automatic 3D localization of multiple basketball players. The introduced framework comprises two parts. The first stage is player detection, which aims to identify players’ heads at the camera image level. This stage is based on background segmentation and on classification performed by an artificial neural network. The second stage is related to 3D reconstruction of the player positions from the images provided by the different cameras used in the acquisition. This task is tackled by formulating a constrained combinatorial optimization problem that minimizes the re-projection error while maximizing the number of detections in the formulated 3D localization problem8286CONSELHO NACIONAL DE DESENVOLVIMENTO CIENTÍFICO E TECNOLÓGICO - CNPQCOORDENAÇÃO DE APERFEIÇOAMENTO DE PESSOAL DE NÍVEL SUPERIOR - CAPESFUNDAÇÃO DE AMPARO À PESQUISA DO ESTADO DE SÃO PAULO - FAPESPNão temNão temNão temWe would like to thank the CAPES, FAEPEX, FAPESP, and CNPq for funding their research. This paper has content from master degree’s dissertation previously published (Monezi, 2016) and available onlin

A new machine for acquire pavement texture

This paper presents a prototype machine for the acquisition and characterization of the macrotexture and megatexture of road surfaces. The development stages of the prototype machine involved: 3D data acquisition system configuration and calibration - based on laser triangulation technique, 3D surface reconstruction of the road surface and texture characterization using appropriated indicators, such as the Mean Profile Depth (MPD) and the Texture Profile Level (L), by applying different and complementary mathematical techniques. The prototype machine created is able to work in laboratory and in field, allowing an acquisition accuracy of 0.5 mm. The contribution of this research is in developing a prototype machine capable of acquiring an extensive area road surface with high precision 3D data.(undefined

Development of a Fluoroscopic Radiostereometric Analysis System With an Application to Glenohumeral Joint Kinematics

Ideally, joint kinematics should be measured with high accuracy, void of skin motion artefact, in three dimensions, and under dynamic conditions. Radiostereometric analysis (RSA) has the potential to fulfill all of these requirements. The objectives of this thesis were (1) to implement and validate a fluoroscopy-based RSA system, (2) to determine the effect of varying the calibration frame, (3) to correct image distortion, (4) to investigate errors in coordinate system creation for glenohumeral (shoulder) joint kinematics, (5) to introduce a new coordinate system definition for the scapula with limited radiation exposure, and (6) to use RSA to examine glenohumeral joint motions in- vivo. An RSA system consisting of two portable C-arm fluoroscopy units and two personal computers was assembled. Calibration was performed using a custom-made calibration frame. Images were digitized and RSA reconstruction was performed using custom-written software. Images taken using fluoroscopy under ideal conditions can produce reconstructions that are as accurate as those taken with digital radiography, with standard errors of measurement of 43pm and 0.23° and 36pm and 0.12°, respectively. RSA is more accurate than optical tracking for rigid body motion. The fluoroscopes may be positioned at angles less than 135° without affecting the accuracy of reconstruction. A global polynomial approach to distortion correction is appropriate for use with RSA; however, the polynomial degree must be determined for each system with an independent accuracy measure. m An alternative scapular coordinate system was introduced to decrease the required radiation exposure for coordinate system creation by approximately half. The kinematic angles obtained using the alternative coordinate system were different from those obtained using the International Society of Biomechanics standard; however, the differences are not clinically significant. As a first clinical application, glenohumeral joint translation was examined. The preliminary data suggests that humeral head position does not differ in active and static joint positioning. Fluoroscopy allows subjects to be examined while in motion and should enable substantial improvements to the study of even subtle in-vivo kinematics. It is likely that the RSA system will lead to an increased understanding of the effects of disease progression, surgical techniques and rehabilitation protocols on joint motion

Joint 4-D variational stereo reconstruction and camera calibration refinement for oceanic sea state measurements

Validating modern oceanographic theories using models produced through stereo computer vision principles has recently emerged. Space-time (4-D) models of the ocean surface may be generated by stacking a series of 3-D reconstructions independently generated for each time instant or, in a more robust manner, by simultaneously processing several snapshots coherently in a true ?4-D reconstruction.? However, the accuracy of these computer-vision-generated models is subject to the estimations of camera parameters, which may be corrupted under the influence of natural factors such as wind and vibrations. Therefore, removing the unpredictable errors of the camera parameters is necessary for an accurate reconstruction. In this paper, we propose a novel algorithm that can jointly perform a 4-D reconstruction as well as correct the camera parameter errors introduced by external factors. The technique is founded upon variational optimization methods to benefit from their numerous advantages: continuity of the estimated surface in space and time, robustness, and accuracy. The performance of the proposed algorithm is tested using synthetic data produced through computer graphics techniques, based on which the errors of the camera parameters arising from natural factors can be simulated

Precision and accuracy of tridimensional localization in Statscan digital medical radiology

Includes bibliographical references (leaves 83-86).The emergence of computerized medical imaging in early 1970s, which merged with digital technology in the 1980s, was celebrated as a major breakthrough in three-dimensional (3D) medicine. However, a recent South African innovation, the high speed scanning Lodox Stat scanCritical Digital Radiology modality, has posed challenges in X-ray photogrammetry. This is due to the system's imaging geometry. This research investigates the applicability of Direct Linear Transformation (DLT) method in Lodox Statscan 3D point localization. Static modelsdesigned from metal frames bearing targets of different contrast have been imaged on the Statscan system to generate experimental data. These models were used to eliminate distortions that arise from involuntary human body movements. A control frame for the 3D models has been generated at an accuracy of ± 0.5mm. Point positioning accuracy has been computed by comparing the acquired Statscan 3D point positions to the established control. Two different reference frames were used, showing that point positions could be established with RMS values in the mm range in the middle axis of the Statscan X-ray patient platform. This range of acceptable mm accuracies extends about 15 to 20 cm sideways towards the edge of the table and to about 20 cm above the table surface. Beyond this range, accuracy deteriorated significantly. The experiments further showed that the inclusion of control points close to the table edges and more than 20cm above the table resulted in lower accuracies for the L - parameters ofthe DLT solution than those derived from points close to the center axis only. As the accuracy of the L - parameters propagates into accuracy of the final coordinates of newly determined points, it becomes essential to restrict the space of the control points to the above described limits

Calibration of an orientation sensor for freehand 3D ultrasound and its use in a hybrid acquisition system

BACKGROUND: Freehand 3D ultrasound is a powerful imaging modality with many potential applications. However, its reliance on add-on position sensors, which can be expensive, obtrusive and difficult to calibrate, is a major drawback. Alternatively, freehand 3D ultrasound can be acquired without a position sensor using image-based techniques. Sensorless reconstructions exhibit good fine scale detail but are prone to tracking drift, resulting in large scale geometrical distortions. METHOD: We investigate an alternative position sensor, the Xsens MT9-B, which is relatively unobtrusive but measures orientation only. We describe a straightforward approach to calibrating the sensor, and we measure the calibration precision (by repeated calibrations) and the orientation accuracy (using independent orientation measurements). We introduce algorithms that allow the MT9-B potentially to correct both linear and angular drift in sensorless reconstructions. RESULTS: The MT9-B can be calibrated to a precision of around 1 degrees . Reconstruction accuracy is also around 1 degrees . The MT9-B was able to eliminate angular drift in sensorless reconstructions, though it had little impact on linear drift. In comparison, six degree-of-freedom drift correction was shown to produce excellent reconstructions. CONCLUSION: Gold standard freehand 3D ultrasound acquisition requires the synthesis of image-based techniques, for good fine scale detail, and position sensors, for good large scale geometrical accuracy. A hybrid system incorporating the MT9-B offers an attractive compromise between quality and ease of use. The position sensor is unobtrusive and the system is capable of faithful acquisition, with the one exception of linear drift in the elevational direction

Compact handheld fringe projection based underwater 3D-scanner

A new, fringe projection based compact handheld 3D scanner for the surface reconstruction of measurement objects under water is introduced. The weight of the scanner is about 10 kg and can be used in a water depth of maximal 40 metres. A measurement field of about 250 mm x 200 mm is covered under water, and the lateral resolution of the measured object points is about 150 μm. Larger measurement objects can be digitized in a unique geometric model by merging subsequently recorded datasets. The recording time for one 3D scan is a third of a second. The projection unit for the structured illumination of the scene as well as the computer for device control and measurement data analysis are included into the scanners housing. A display on the backside of the device realizes the graphical presentation of the current measurement data. It allows the user to evaluate the quality of the measurement result in real-time already during the recording of the measurement under water. For the calibration of the underwater scanner a combined method of air- and water-calibration was developed which needs only a few recorded underwater images of a plane surface and an object with known lengths. First measurement results obtained with the new scanner are presented

A 3D Omnidirectional Sensor For Mobile Robot Applications

International audienc