Progress in industrial photogrammetry by means of markerless solutions

174 p.La siguiente tesis está enfocada al desarrollo y uso avanzado de metodologías fotogramétrica sin dianas en aplicaciones industriales. La fotogrametría es una técnica de medición óptica 3D que engloba múltiples configuraciones y aproximaciones. En este estudio se han desarrollado procedimientos de medición, modelos y estrategias de procesamiento de imagen que van más allá que la fotogrametría convencional y buscan el emplear soluciones de otros campos de la visión artificial en aplicaciones industriales. Mientras que la fotogrametría industrial requiere emplear dianas artificiales para definir los puntos o elementos de interés, esta tesis contempla la reducción e incluso la eliminación de las dianas tanto pasivas como activas como alternativas prácticas. La mayoría de los sistemas de medida utilizan las dianas tanto para definir los puntos de control, relacionar las distintas perspectivas, obtener precisión, así como para automatizar las medidas. Aunque en muchas situaciones el empleo de dianas no sea restrictivo existen aplicaciones industriales donde su empleo condiciona y restringe considerablemente los procedimientos de medida empleados en la inspección. Un claro ejemplo es la verificación y control de calidad de piezas seriadas, o la medición y seguimiento de elementos prismáticos relacionados con un sistema de referencia determinado. Es en este punto donde la fotogrametría sin dianas puede combinarse o complementarse con soluciones tradicionales para tratar de mejorar las prestaciones actuales

Analysis and Observations from the First Amazon Picking Challenge

This paper presents a overview of the inaugural Amazon Picking Challenge along with a summary of a survey conducted among the 26 participating teams. The challenge goal was to design an autonomous robot to pick items from a warehouse shelf. This task is currently performed by human workers, and there is hope that robots can someday help increase efficiency and throughput while lowering cost. We report on a 28-question survey posed to the teams to learn about each team's background, mechanism design, perception apparatus, planning and control approach. We identify trends in this data, correlate it with each team's success in the competition, and discuss observations and lessons learned based on survey results and the authors' personal experiences during the challenge

Automatic 3D human modeling: an initial stage towards 2-way inside interaction in mixed reality

3D human models play an important role in computer graphics applications from a wide range of domains, including education, entertainment, medical care simulation and military training. In many situations, we want the 3D model to have a visual appearance that matches that of a specific living person and to be able to be controlled by that person in a natural manner. Among other uses, this approach supports the notion of human surrogacy, where the virtual counterpart provides a remote presence for the human who controls the virtual character\u27s behavior. In this dissertation, a human modeling pipeline is proposed for the problem of creating a 3D digital model of a real person. Our solution involves reshaping a 3D human template with a 2D contour of the participant and then mapping the captured texture of that person to the generated mesh. Our method produces an initial contour of a participant by extracting the user image from a natural background. One particularly novel contribution in our approach is the manner in which we improve the initial vertex estimate. We do so through a variant of the ShortStraw corner-finding algorithm commonly used in sketch-based systems. Here, we develop improvements to ShortStraw, presenting an algorithm called IStraw, and then introduce adaptations of this improved version to create a corner-based contour segmentatiuon algorithm. This algorithm provides significant improvements on contour matching over previously developed systems, and does so with low computational complexity. The system presented here advances the state of the art in the following aspects. First, the human modeling process is triggered automatically by matching the participant\u27s pose with an initial pose through a tracking device and software. In our case, the pose capture and skeletal model are provided by the Microsoft Kinect and its associated SDK. Second, color image, depth data, and human tracking information from the Kinect and its SDK are used to automatically extract the contour of the participant and then generate a 3D human model with skeleton. Third, using the pose and the skeletal model, we segment the contour into eight parts and then match the contour points on each segment to a corresponding anchor set associated with a 3D human template. Finally, we map the color image of the person to the 3D model as its corresponding texture map. The whole modeling process only take several seconds and the resulting human model looks like the real person. The geometry of the 3D model matches the contour of the real person, and the model has a photorealistic texture. Furthermore, the mesh of the human model is attached to the skeleton provided in the template, so the model can support programmed animations or be controlled by real people. This human control is commonly done through a literal mapping (motion capture) or a gesture-based puppetry system. Our ultimate goal is to create a mixed reality (MR) system, in which the participants can manipulate virtual objects, and in which these virtual objects can affect the participant, e.g., by restricting their mobility. This MR system prototype design motivated the work of this dissertation, since a realistic 3D human model of the participant is an essential part of implementing this vision

Monitoring and Computation of the Volumes of Stockpiles of Bulk Material by Means of UAV Photogrammetric Surveying

The monitoring and metric assessment of piles of natural or man-made materials plays a fundamental role in the production and management processes of multiple activities. Over time, the monitoring techniques have undergone an evolution linked to the progress of measure and data processing techniques; starting from classic topography to global navigation satellite system (GNSS) technologies up to the current survey systems like laser scanner and close-range photogrammetry. Last-generation 3D data management software allow for the processing of increasingly truer high-resolution 3D models. This study shows the results of a test for the monitoring and computing of stockpile volumes of material coming from the differentiated waste collection inserted in the recycling chain, performed by means of an unmanned aerial vehicle (UAV) photogrammetric survey and the generation of 3D models starting from point clouds. The test was carried out with two UAV flight sessions, with vertical and oblique camera configurations, and using a terrestrial laser scanner for measuring the ground control points and as ground truth for testing the two survey configurations. The computations of the volumes were carried out using two software and comparisons were made both with reference to the different survey configurations and to the computation software

Remote Sensing

This dual conception of remote sensing brought us to the idea of preparing two different books; in addition to the first book which displays recent advances in remote sensing applications, this book is devoted to new techniques for data processing, sensors and platforms. We do not intend this book to cover all aspects of remote sensing techniques and platforms, since it would be an impossible task for a single volume. Instead, we have collected a number of high-quality, original and representative contributions in those areas

Automatic tree detection and attribute characterization using portable terrestrial lidar

Currently, the implementation of portable laser scanners (PLS) in forest inventories is being studied, since they allow for significantly reduced field-work time and costs when compared to the traditional inventory methods and other LiDAR systems. However, it has been shown that their operability and efficiency are dependent upon the species assessed, and therefore, there is a need for more research assessing different types of stands and species. Additionally, a few studies have been conducted in Eucalyptus stands, one of the tree genus that is most commonly planted around the world. In this study, a PLS system was tested in a Eucalyptus globulus stand to obtain different metrics of individual trees. An automatic methodology to obtain inventory data (individual tree positions, DBH, diameter at different heights, and height of individual trees) was developed using public domain software. The results were compared to results obtained with a static terrestrial laser scanner (TLS). The methodology was able to identify 100% of the trees present in the stand in both the PLS and TLS point clouds. For the PLS point cloud, the RMSE of the DBH obtained was 0.0716, and for the TLS point cloud, it was 0.176. The RMSE for height for the PLS point cloud was 3.415 m, while for the PLS point cloud, it was 10.712 m. This study demonstrates the applicability of PLS systems for the estimation of the metrics of individual trees in adult Eucalyptus globulus stands.Agencia Estatal de Investigación | Ref. PID2019-111581RB-I00Ministerio de Ciencia, Innovación y Universidades | Ref. FPU19/02054Universidade de Vigo/CISU

Comparing Mobile Laser Scanner and manual measurements for dendrometric variables estimation in a black pine (Pinus nigra Arn.) plantation

The growing demand of ecosystem services provided by forests increased the need for fast and accurate field survey. The recent technological innovations fostered the application of geomatic tools and processes to different fields of the forestry sector. In this study we compared the efficiency and the accuracy of Mobile Laser Scanner (MLS), combined with Simultaneous Localization and Mapping (SLAM) technology, and traditional field survey for the mensuration of main forest dendrometric variables like stem diameter at breast height (DBH), individual tree height (H), crown base height (CBH) and branch-free stem volume (VOL). With ground truth measurements taken from 50 felled trees, we tested the applicability of MLS technology for individual tree parameters esti-mation in a conifer plantation in central Italy. Our results showed no bias of DBH estimates and the corre-sponding RMSE was equal to 10.8% (2.7 cm). H and CBH measured with MLS were underestimated compared to the ground truth (bias of-8.6% for H and-13.3% for CBH). VOL values showed a bias and a RMSE of-4.1% (-0.01 m(3)) and 12.4% (0.04 m3) respectively. Tree height is not perfectly estimated due to laser obstruction by crowns layer, but the acquisition speed of this survey, joined with a suitable accuracy of parameters extraction, suggests sufficient suitability of the method for operational applications in simple forest structures (e.g. one-layered stands)

An Approach Of Automatic Reconstruction Of Building Models For Virtual Cities From Open Resources

Along with the ever-increasing popularity of virtual reality technology in recent years, 3D city models have been used in different applications, such as urban planning, disaster management, tourism, entertainment, and video games. Currently, those models are mainly reconstructed from access-restricted data sources such as LiDAR point clouds, airborne images, satellite images, and UAV (uncrewed air vehicle) images with a focus on structural illustration of buildings’ contours and layouts. To help make 3D models closer to their real-life counterparts, this thesis research proposes a new approach for the automatic reconstruction of building models from open resources. In this approach, first, building shapes are reconstructed by using the structural and geographic information retrievable from the open repository of OpenStreetMap (OSM). Later, images available from the street view of Google maps are used to extract information of the exterior appearance of buildings for texture mapping onto their boundaries. The constructed 3D environment is used as prior knowledge for the navigation purposes in a self-driving car. The static objects from the 3D model are compared with the real-time images of static objects to reduce the computation time by eliminating them from the detection proces