Progress in industrial photogrammetry by means of markerless solutions

174 p.La siguiente tesis está enfocada al desarrollo y uso avanzado de metodologías fotogramétrica sin dianas en aplicaciones industriales. La fotogrametría es una técnica de medición óptica 3D que engloba múltiples configuraciones y aproximaciones. En este estudio se han desarrollado procedimientos de medición, modelos y estrategias de procesamiento de imagen que van más allá que la fotogrametría convencional y buscan el emplear soluciones de otros campos de la visión artificial en aplicaciones industriales. Mientras que la fotogrametría industrial requiere emplear dianas artificiales para definir los puntos o elementos de interés, esta tesis contempla la reducción e incluso la eliminación de las dianas tanto pasivas como activas como alternativas prácticas. La mayoría de los sistemas de medida utilizan las dianas tanto para definir los puntos de control, relacionar las distintas perspectivas, obtener precisión, así como para automatizar las medidas. Aunque en muchas situaciones el empleo de dianas no sea restrictivo existen aplicaciones industriales donde su empleo condiciona y restringe considerablemente los procedimientos de medida empleados en la inspección. Un claro ejemplo es la verificación y control de calidad de piezas seriadas, o la medición y seguimiento de elementos prismáticos relacionados con un sistema de referencia determinado. Es en este punto donde la fotogrametría sin dianas puede combinarse o complementarse con soluciones tradicionales para tratar de mejorar las prestaciones actuales

Review of the Synergies Between Computational Modeling and Experimental Characterization of Materials Across Length Scales

With the increasing interplay between experimental and computational approaches at multiple length scales, new research directions are emerging in materials science and computational mechanics. Such cooperative interactions find many applications in the development, characterization and design of complex material systems. This manuscript provides a broad and comprehensive overview of recent trends where predictive modeling capabilities are developed in conjunction with experiments and advanced characterization to gain a greater insight into structure-properties relationships and study various physical phenomena and mechanisms. The focus of this review is on the intersections of multiscale materials experiments and modeling relevant to the materials mechanics community. After a general discussion on the perspective from various communities, the article focuses on the latest experimental and theoretical opportunities. Emphasis is given to the role of experiments in multiscale models, including insights into how computations can be used as discovery tools for materials engineering, rather than to "simply" support experimental work. This is illustrated by examples from several application areas on structural materials. This manuscript ends with a discussion on some problems and open scientific questions that are being explored in order to advance this relatively new field of research.Comment: 25 pages, 11 figures, review article accepted for publication in J. Mater. Sc

Aeronautical Engineering: A continuing bibliography, supplement 120

This bibliography contains abstracts for 297 reports, articles, and other documents introduced into the NASA scientific and technical information system in February 1980

A New Variant of the ICP Algorithm for Pairwise 3D Point Cloud Registration

Pairwise 3D point cloud registration derived from Terrestrial Laser Scanner (TLS) in static mode is an essential task to produce locally consistent 3D point clouds. In this work, the contributions are twofold. First, a non-iterative scheme by merging the SIFT (Scale Invariant Feature Transform) 3D algorithm and the PFH (Point Feature Histograms) algorithm to find initial approximation of the transformation parameters is proposed. Then, a correspondence model based on a new variant of the ICP (Iterative Closest Point) algorithm to refine the transformation parameters is also proposed. To evaluate the local consistency of the pairwise 3D point cloud registration is used a point-to-distance approach. Experiments were performed using seven pairs of 3D point clouds into an urban area. The results obtained showed that the method achieves point-to-plane RMSE (Root of the Mean Square Error) mean values in the order of 2 centimeters

ROTEX-TRIIFEX: Proposal for a joint FRG-USA telerobotic flight experiment

The concepts and main elements of a RObot Technology EXperiment (ROTEX) proposed to fly with the next German spacelab mission, D2, are presented. It provides a 1 meter size, six axis robot inside a spacelab rack, equipped with a multisensory gripper (force-torque sensors, an array of range finders, and mini stereo cameras). The robot will perform assembly and servicing tasks in a generic way, and will grasp a floating object. The man machine and supervisory control concepts for teleoperation from the spacelab and from ground are discussed. The predictive estimation schemes for an extensive use of time-delay compensating 3D computer graphics are explained

Feature-based hybrid inspection planning for complex mechanical parts

Globalization and emerging new powers in the manufacturing world are among many challenges, major manufacturing enterprises are facing. This resulted in increased alternatives to satisfy customers\u27 growing needs regarding products\u27 aesthetic and functional requirements. Complexity of part design and engineering specifications to satisfy such needs often require a better use of advanced and more accurate tools to achieve good quality. Inspection is a crucial manufacturing function that should be further improved to cope with such challenges. Intelligent planning for inspection of parts with complex geometric shapes and free form surfaces using contact or non-contact devices is still a major challenge. Research in segmentation and localization techniques should also enable inspection systems to utilize modern measurement technologies capable of collecting huge number of measured points. Advanced digitization tools can be classified as contact or non-contact sensors. The purpose of this thesis is to develop a hybrid inspection planning system that benefits from the advantages of both techniques. Moreover, the minimization of deviation of measured part from the original CAD model is not the only characteristic that should be considered when implementing the localization process in order to accept or reject the part; geometric tolerances must also be considered. A segmentation technique that deals directly with the individual points is a necessary step in the developed inspection system, where the output is the actual measured points, not a tessellated model as commonly implemented by current segmentation tools. The contribution of this work is three folds. First, a knowledge-based system was developed for selecting the most suitable sensor using an inspection-specific features taxonomy in form of a 3D Matrix where each cell includes the corresponding knowledge rules and generate inspection tasks. A Travel Salesperson Problem (TSP) has been applied for sequencing these hybrid inspection tasks. A novel region-based segmentation algorithm was developed which deals directly with the measured point cloud and generates sub-point clouds, each of which represents a feature to be inspected and includes the original measured points. Finally, a new tolerance-based localization algorithm was developed to verify the functional requirements and was applied and tested using form tolerance specifications. This research enhances the existing inspection planning systems for complex mechanical parts with a hybrid inspection planning model. The main benefits of the developed segmentation and tolerance-based localization algorithms are the improvement of inspection decisions in order not to reject good parts that would have otherwise been rejected due to misleading results from currently available localization techniques. The better and more accurate inspection decisions achieved will lead to less scrap, which, in turn, will reduce the product cost and improve the company potential in the market

Computational virtual measurement for trees

National forest inventory (NFI) is a systematic sampling method to collect forest information, including tree parameters, site conditions, and auxiliary data. The sample plot measurement is the key work in NFI. However, compared to the techniques 100 years ago, measuring methods and data-processing (modeling) approaches for NFI sample plots have been improved to a minor extent. The limit was that the newly-developed methods introduced additional validation workflows and would increase the workload in NFI. That was due to that these methods were usually developed based on species-specific and site-specific strategies. In order to overcome these obstacles, the integration of the novel measuring instruments is in urgent need, e.g., light detection and ranging (LiDAR) and the corresponding data processing methods with NFI. Given these situations, this thesis proposed a novel computational virtual measurement (CVM) method for the determination of tree parameters without the need for validation. Primarily, CVM is a physical simulation method and works as a virtual measuring instrument. CVM measures raw data, e.g., LiDAR point clouds and tree models, by the simulation of the physical mechanism of measuring instruments and natural phenomena. Based on the theory of CVM, this thesis is a systematic description of how to develop virtual measuring instruments. The first work is to introduce the CVM theory. CVM is a conceptual and general methodology, which is different from a specific measurement of tree parameters. Then, the feasibility of CVM was tested using a conceptual implementation, i.e., virtual ruler. The development of virtual ruler demonstrated the two key differences between CVM and conventional modeling methods. Firstly, the research focus of CVM is to build an appropriate physical scenario instead of finding a mathematical relationship between modeling results and true values. Secondly, the CVM outputs can approach true values, whereas the modeling results could not. Consequently, in a virtual space, tree parameters are determined by a measuring process without mathematical predictions. Accordingly, the result is free of validation and can be regarded as true values, at least in virtual spaces. With the knowledge from the virtual ruler development, two exceptional implementations are further developed. They are the virtual water displacement (VWD) method and sunlight analysis method. Both of them employ the same CVM workflow, which is firstly measured in reality and secondly measured in virtual space. The VWD aims to virtually measure the point clouds using the simulation of water displacement methods in reality. There are two stages in this method. The first stage is to apply the simulation of water displacement using massive virtual water molecules (VWMs). Some empirical regressions have to be employed in this stage, due to the limitation of computer performance. In the second stage, a single (or few) VWM (or VWMs) is developed to remove those empirical processes in VWD. Finally, VWD can function as a fully automatic method to measure point clouds.The sunlight analysis method aims to virtually measure the tree models using the simulation of solar illumination during daylight. There are also two stages in this method. The first stage is to develop sunlight analysis for a single tree. The second stage is to analyze the interference from neighboring trees. The results include default tree attributes, which can be collected in the future NFI. The successful developments of CVM, along with implementations of VWD and sunlight analysis methods, prove the initial assumptions in this thesis. It is the conversion of mathematical processing of data into virtual measurements. Accordingly, this is a different philosophy, i.e., the role of data is extended to the digital representative of trees. It opens an avenue of data processing using a more natural approach and is expected to be employed in the near future as a standard measuring instrument, such as a diameter tape, in NFI.Die Nationale Waldinventur (NFI) ist eine systematische Stichprobenmethode zur Erfassung von Waldinformationen, einschließlich Baumparameter, Standortbedingungen und Hilfsdaten. Die Messung von Stichprobenparzellen ist die Schlüsselarbeit der NFI. Im Vergleich zu den Techniken vor 100 Jahren wurden die Messmethoden und Datenverarbeitungsansätze (Modellierung) für NFI-Stichprobenparzellen jedoch in geringem Umfang verbessert. Die Grenze lag darin, dass die neu entwickelten Methoden zusätzliche Validierungsabläufe einführten und den Arbeitsaufwand in der NFI erhöhen würden. Dies war darauf zurückzuführen, dass diese Methoden in der Regel auf der Grundlage art- und standortspezifischer Strategien entwickelt wurden. Um diese Hindernisse zu überwinden, ist die Integration der neuartigen Messinstrumente dringend erforderlich, z.B. Light Detection and Ranging (LiDAR) und die entsprechenden Datenverarbeitungsmethoden mit NFI. Vor diesem Hintergrund wird in dieser Arbeit ein neuartiges rechnergestütztes virtuelles Messverfahren (CVM) zur Bestimmung von Baumparametern ohne Validierungsbedarf vorgeschlagen. CVM ist in erster Linie eine physikalische Simulationsmethode und arbeitet als virtuelles Messinstrument. CVM misst Rohdaten, z.B. LiDAR-Punktwolken und Baummodelle, durch die Simulation des physikalischen Mechanismus von Messinstrumenten und Naturphänomenen. Basierend auf der Theorie des CVM ist diese Arbeit eine systematische Beschreibung, wie virtuelle Messinstrumente entwickelt werden können. Die erste Arbeit dient der Einführung in die Theorie des CVM. CVM ist eine konzeptuelle und allgemeine Methodik, die sich von einer spezifischen Messung von Baumparametern unterscheidet. Anschliessend wird die Durchführbarkeit des CVM anhand einer konzeptuellen Implementierung, d.h. eines virtuellen Lineals, getestet. Die Entwicklung des virtuellen Lineals zeigte die beiden Hauptunterschiede zwischen CVM und konventionellen Modellierungsmethoden auf. Erstens besteht der Forschungsschwerpunkt von CVM darin, ein geeignetes physisches Szenario zu erstellen, anstatt eine mathematische Beziehung zwischen Modellierungsergebnissen und wahren Werten zu finden. Zweitens können sich die Ergebnisse des CVM den wahren Werten annähern, während die Modellierungsergebnisse dies nicht konnten. Folglich werden in einem virtuellen Raum die Baumparameter durch einen Messprozess ohne mathematische Vorhersagen bestimmt. Dementsprechend ist das Ergebnis frei von Validierung und kann, zumindest in virtuellen Räumen, als wahre Werte betrachtet werden. Mit dem Wissen aus der Entwicklung des virtuellen Lineals werden zwei aussergewöhnliche Implementierungen weiterentwickelt. Es handelt sich um die Methode der virtuellen Wasserverdrängung (VWD) und die Methode der Sonnenlichtanalyse. Beide verwenden den gleichen CVM-Workflow, der erstens in der Realität und zweitens im virtuellen Raum gemessen wird. Das VWD zielt darauf ab, die Punktwolken virtuell zu messen, wobei die Simulation von Wasserverdrängungsmethoden in der Realität verwendet wird. Diese Methode besteht aus zwei Stufen. Die erste Stufe besteht in der Anwendung der Simulation der Wasserverdrängung unter Verwendung massiver virtueller Wassermoleküle (VWMs). Aufgrund der begrenzten Computerleistung müssen in dieser Phase einige empirische Regressionen angewandt werden. In der zweiten Stufe wird ein einzelnes (oder wenige) VWM (oder VWMs) entwickelt, um diese empirischen Prozesse im VWD zu entfernen. Schließlich kann VWD als vollautomatische Methode zur Messung von Punktwolken fungieren. Die Methode der Sonnenlichtanalyse zielt darauf ab, die Baummodelle virtuell zu messen, indem die Simulation der Sonneneinstrahlung bei Tageslicht verwendet wird. Auch bei dieser Methode gibt es zwei Stufen. In der ersten Stufe wird die Sonnenlichtanalyse für einen einzelnen Baum entwickelt. Die zweite Stufe ist die Analyse der Interferenz von benachbarten Bäumen. Die Ergebnisse umfassen Standard-Baumattribute, die in der zukünftigen NFI gesammelt werden können. Die erfolgreichen Entwicklungen von CVM, zusammen mit Implementierungen von VWD- und Sonnenlichtanalysemethoden, beweisen die anfänglichen Annahmen in dieser Arbeit. Es handelt sich um die Umsetzung der mathematischen Verarbeitung von Daten in virtuelle Messungen. Dementsprechend handelt es sich um eine andere Philosophie, d.h. die Rolle der Daten wird auf die digitale Darstellung von Bäumen ausgedehnt. Sie eröffnet einen Weg der Datenverarbeitung unter Verwendung eines natürlicheren Ansatzes und wird voraussichtlich in naher Zukunft als Standard-Messinstrument, wie z.B. ein Durchmesser-Band, in der NFI eingesetzt werden