Optimization in 3D Scene Acquisition with Two Mobile Robots.

This article presents a method for cooperative reconstruction of three-dimensional scenes using multiple views. Although the use of multiple views is one of the most applied in the 3D scenes interpretation, its use with a single mobile robot does not guarantee the perfect localization of the environment, due to odometry errors. Also, the reconstruction of dynamic environments is not allowed for a single robot, which takes views in different instants. This work proposes a system formed by multiple robots to get a cooperative reconstruction of the scene. The robots decide the best strategy to acquire the image to get the best reconstruction using an objective function defined. In this function, mainly are considered uncertainty of the reconstruction and view points. The result of this optimization is the next position of the robots

Analysis of the inspection of mechanical parts using dense range data

More than ever, efficiency and quality are key words in modern industry. This situation enhances the importance of quality control and creates a great demand for cheap and reliable automatic inspection systems. Taking into account these facts and the demand for systems able to inspect the final shape of machined parts, we decided to investigate the viability of automatic model-based inspection of mechanical parts using the dense range data produced by laser stripers. Given a part to be inspected and a corresponding model of the part stored in the model data base, the first step of inspecting the part is the acquisition of data corresponding to the part, in our case this means the acquisition of a range image of it. In order to be able to compare the part image and its stored model, it is necessary to align the model with the range image of the part. This process, called registration, corresponds to finding the rigid transformation that superposes model and image. After the image and model are registered, the actual inspection uses the range image to verify if all the features predicted in the model are present and have the right pose and dimensions. Therefore, besides the acquisition of range images, the inspection of machined parts involves three main issues: modelling, registration and inspection diagnosis. The application, for inspection purposes, of the main representational schemes for modelling solid objects is discussed and it is suggested the use of EDT models (see [Zeid 91]). A particular implementation of EDT models is presented. A novel approach for the verification of tolerances during the inspection is proposed. The approach allows not only the inspection of the most common tolerances described in the tolerancing standards, but also the inspection of tolerances defined according to Requicha's theory of tolerancing (see [Requicha 83]). A model of the sensitivity and reliability of the inspection process based on the modelling of the errors during the inspection process is also proposed. The importance of the accuracy of the registration in different inspections tasks is discussed. A modified version of the ICP algorithm (see [Besl &; McKay 92]) for the registration of sculptured surfaces is proposed. The maximum accuracy of the ICP algorithm, as a function of the sensor errors and the number of matched points, is determined. A novel method for the measurement and reconstruction of waviness errors on sculp¬ tured surfaces is proposed. The method makes use of the 2D Discrete Fourier Transform for the detection and reconstruction of the waviness error. A model of the sensitivity and reliability of the method is proposed. The application of the methods proposed is illustrated using synthetic and real range image

Three-dimensional breast assessment by multiple stereophotogrammetry after breast reconstruction with latissimus dorsi flap

Introduction: Numerous methods exist for the assessment of the female breast. Traditionally, a subjective approach was taken for surgical planning and evaluation of the postoperative outcome. Several objective methods have been developed to support this procedure, among which are laser scanning, MRI, mammography, ultrasound and photography. Recently, 3D imaging technology has been developed. Material & Method: 3D breast assessment by multiple stereophotogrammetry was examined. A custom-made imaging system with eight digital cameras arranged in four camera pods was utilised. This system was used for breast capture, resulting in eight images obtained by the cameras. The merging of these images and 3D image construction was carried out by C3D software and the volume assessment of the 3D images was made using breast analysis tool (BAT) software, developed by Glasgow University. A validation study was conducted. Nine plaster models were investigated and their volume determined by 3D stereophotogrammetry and water displacement method. Water displacement was considered to be the gold standard for comparison. The plaster models were specially made in order to represent a variety of shapes and sizes of the female breast. Each plaster model was examined 10 times by each method. Further, the volumes of the breasts of six female volunteer live models were investigated by the same two methods and the results compared. A special focus was placed on the reproducibility of the assessment. Each live model was captured with the 3D capture system three times at two different time points after retaking a special pose in a custom-made positioning frame. Altogether, each live model was captured six times, resulting in six 3D images, each of which was measured three times with BAT software. A patient study was conducted in 44 patients after unilateral immediate breast reconstruction with Latissimus dorsi flap and no contra-lateral surgery. Each patient underwent 3D imaging with the multiple stereophotogrammetry system. During capture, the special pose in the custom-made positioning frame was taken by the patient’s leaning forward almost horizontally with the upper body for the breasts to rise off the chest wall to enable full breast coverage by the cameras. 3D images were constructed with C3D software and volumes measured with BAT. For each patient, one 3D image was constructed and measured four times with BAT software. In addition to the volume determination, a shape analysis was conducted. For this purpose, 10 landmarks were determined according to recommendations in the literature. Two landmarks, sternal notch and xiphoid, were marked, forming an imaginary midline between each other and four landmarks on each breast, i.e. the medial and lateral ends of the infra-mammary fold, and the most prominent and most inferior breast points were utilised for symmetry assessment between the right and left breasts. Each landmark was recorded four times by the operator on the 3D image and three-dimensional coordinates obtained. By assessment of the left and right breasts a breast asymmetry score was calculated. Firstly, breast asymmetry was assessed objectively on the 3D images through the centroid size, which was determined as the square root of the sum of squared Euclidian distances from each landmark to the centroid. The centroid was the geometric mean of the landmarks. Secondly, asymmetry was assessed through breast volume by application of BAT software. Thirdly, asymmetry was examined through the landmarks themselves by investigation of the mismatch of the landmark configuration of one breast and its relabelled and matched reflection. The non-operated and reconstructed sides were compared and landmarks were recorded by the operator in three dimensions in four repeated tests. A decomposition of the total landmark asymmetry into its factors was conducted by fixation of the surface of the non-operated side and translation, rotation and scaling of the surface of the reconstructed side. For comparison, a subjective breast assessment was conducted by six expert observers who rated the results after breast reconstruction by subjective qualitative assessment of the symmetry in 2D images of the same 44 patients in six poses. For this purpose the Harris scale was utilised, providing a score of 1 to 4 for poor to excellent symmetry. Results: The results revealed that differences in the obtained volumes in the plaster models were not significant. In contrast, differences in the breast volumes measured in the live models were significant. The examination of the reproducibility revealed that overall reproducibility obtained by stereophotogrammetry was better than that obtained by water displacement. No correlation between breast size and reproducibility of the measurements was found. The results of the patient study demonstrated that the reproducibility of the landmarks was within 5 mm. There was a non-significant difference of the centroid sizes between both breasts. There was a significant difference of the volumes between the two breasts, with the non-operated side being larger than the reconstructed side. Volume was considered to be a more accurate measure for comparison of both breasts than centroid size as it was based on thousands of data points for the calculation as opposed to only four points of the centroid size. The statistical analysis of the landmark data provided a mathematical formula for determination of the breast asymmetry score. The average asymmetry score, derived by landmark assessment as the degree of mismatch between both sides, was 0.052 with scores ranging from 0.019 (lowest score) to 0.136 (highest score). The decomposition of the landmark-based asymmetry revealed that location was the most important factor contributing to breast asymmetry, ahead of intrinsic breast asymmetry, orientation and scale. When investigating the subjective assessment, the inter-observer agreement was good or substantial. There was moderate agreement on the controls and fair to substantial intra-observer agreement. When comparing the objective and subjective assessments, it was found that the relationship between the two scores was highly significant. Conclusion: We concluded that 3D breast assessment by multiple stereophotogrammetry was reliable for a comparative analysis and provided objective data to breast volume, shape and symmetry. A breast asymmetry score was developed, enabling an objective measurement of breast asymmetry after breast reconstruction. 3D breast assessment served as an objective method for comparison to subjective breast assessment

Establishing a Quantifiable Model of Whale Shark Avoidance Behaviours to Anthropogenic Impacts in Tourism Encounters to Inform Management Actions

As the world's largest living fish, the whale shark has received much scientific attention in recent years, although despite this a great deal is still unknown on the life history and behavioural ecology of these majestic sharks. Whale shark related tourism has exploded in the last two decades from only a few sites in the 1990s to more than 12 sites internationally, allowing it to become a highly lucrative industry based upon this Vulnerable species. This study assesses the effects of anthropogenic impact on the sharks’ avoidance behaviours within modern day tourism encounters, and provides recommendations on how to control and reduce unnecessary disturbance to the species. By means of stereo-photogrammetry, continuous high definition videos of human-animal interactions were recorded and analyzed for behavioural changes against pre-selected independant variables. The use of Stereo-photogrammetry imagery also allowed for the accumulation of repeatable, proximity measurements of swimmer distance to the shark, permitting more precise and accurate results. Avoidance behaviours of 33 individual whale sharks were monitored during typical tourism encounters (n=75). A total of 192 search hours were documented over the collection periods, which incorporated three-aggregation sites spanning the Indian Ocean (the Seychelles, the Philipines & Mozambique). A generalized linear model demonstrated that proximity of swimmers to the shark was found to be significant (p=0.0295) in explaining the probability of the whale sharks showing disturbed behaviour. A proportional odds plot for proximity was developed to give an indication of the animals disturbance level in tourism interactions. At recommended distances of three metres from the sides of the shark, there is on average a 42% chance of disturbance, while at the distance of four metres from the tail area results showed a 31% chance of overall disturbance. The true estimate for either distance is likely to lie between 22-53% respectively with regards to the uncertainty around the mean predictions. Whale shark tourism is viewed as a potential means of protecting this threatened species, while also providing a sustainable livelihood for local communities and tourism providers. Management recommendations presented offer suggestions on how to tackle concerns over proximity distances and links to disturbance. Additionally judgments for future research endeavors into assessing both the impacts of uncontrolled tourism and participants behaviour

View generated database

This document represents the final report for the View Generated Database (VGD) project, NAS7-1066. It documents the work done on the project up to the point at which all project work was terminated due to lack of project funds. The VGD was to provide the capability to accurately represent any real-world object or scene as a computer model. Such models include both an accurate spatial/geometric representation of surfaces of the object or scene, as well as any surface detail present on the object. Applications of such models are numerous, including acquisition and maintenance of work models for tele-autonomous systems, generation of accurate 3-D geometric/photometric models for various 3-D vision systems, and graphical models for realistic rendering of 3-D scenes via computer graphics

Fault-tolerant feature-based estimation of space debris motion and inertial properties

The exponential increase of the needs of people in the modern society and the contextual development of the space technologies have led to a significant use of the lower Earth’s orbits for placing artificial satellites. The current overpopulation of these orbits also increased the interest of the major space agencies in technologies for the removal of at least the biggest spacecraft that have reached their end-life or have failed their mission. One of the key functionalities required in a mission for removing a non-cooperative spacecraft is the assessment of its kinematics and inertial properties. In a few cases, this information can be approximated by ground observations. However, a re-assessment after the rendezvous phase is of critical importance for refining the capture strategies preventing accidents. The CADET program (CApture and DE-orbiting Technologies), funded by Regione Piemonte and led by Aviospace s.r.l., involved Politecnico di Torino in the research for solutions to the above issue. This dissertation proposes methods and algorithms for estimating the location of the center of mass, the angular rate, and the moments of inertia of a passive object. These methods require that the chaser spacecraft be capable of tracking several features of the target through passive vision sensors. Because of harsh lighting conditions in the space environment, feature-based methods should tolerate temporary failures in detecting features. The principal works on this topic do not consider this important aspect, making it a characteristic trait of the proposed methods. Compared to typical v treatments of the estimation problem, the proposed techniques do not depend solely on state observers. However, methods for recovering missing information, like compressive sampling techniques, are used for preprocessing input data to support the efficient usage of state observers. Simulation results showed accuracy properties that are comparable to those of the best-known methods already proposed in the literature. The developed algorithms were tested in the laboratory staged by Aviospace s.r.l., whose name is CADETLab. The results of the experimental tests suggested the practical applicability of such algorithms for supporting a real active removal mission

Computational intelligence approaches to robotics, automation, and control [Volume guest editors]

No abstract available

Augmented Reality Based Surgical Navigation of Complex Pelvic Osteotomies

first_page loading... settings Open AccessArticle Augmented Reality Based Surgical Navigation of Complex Pelvic Osteotomies—A Feasibility Study on Cadavers by Joëlle Ackermann 1,2,† [ORCID] , Florentin Liebmann 1,2,*,† [ORCID] , Armando Hoch 3 [ORCID] , Jess G. Snedeker 2,3, Mazda Farshad 3, Stefan Rahm 3, Patrick O. Zingg 3 and Philipp Fürnstahl 1 1 Research in Orthopedic Computer Science, Balgrist University Hospital, University of Zurich, 8008 Zurich, Switzerland 2 Laboratory for Orthopaedic Biomechanics, ETH Zurich, 8093 Zurich, Switzerland 3 Department of Orthopedics, Balgrist University Hospital, University of Zurich, 8008 Zurich, Switzerland * Author to whom correspondence should be addressed. † These authors contributed equally to this work. Academic Editor: Jiro Tanaka Appl. Sci. 2021, 11(3), 1228; https://doi.org/10.3390/app11031228 Received: 20 December 2020 / Revised: 13 January 2021 / Accepted: 25 January 2021 / Published: 29 January 2021 (This article belongs to the Special Issue Artificial Intelligence (AI) and Virtual Reality (VR) in Biomechanics) Download PDF Browse Figures Citation Export Abstract Augmented reality (AR)-based surgical navigation may offer new possibilities for safe and accurate surgical execution of complex osteotomies. In this study we investigated the feasibility of navigating the periacetabular osteotomy of Ganz (PAO), known as one of the most complex orthopedic interventions, on two cadaveric pelves under realistic operating room conditions. Preoperative planning was conducted on computed tomography (CT)-reconstructed 3D models using an in-house developed software, which allowed creating cutting plane objects for planning of the osteotomies and reorientation of the acetabular fragment. An AR application was developed comprising point-based registration, motion compensation and guidance for osteotomies as well as fragment reorientation. Navigation accuracy was evaluated on CT-reconstructed 3D models, resulting in an error of 10.8 mm for osteotomy starting points and 5.4° for osteotomy directions. The reorientation errors were 6.7°, 7.0° and 0.9° for the x-, y- and z-axis, respectively. Average postoperative error of LCE angle was 4.5°. Our study demonstrated that the AR-based execution of complex osteotomies is feasible. Fragment realignment navigation needs further improvement, although it is more accurate than the state of the art in PAO surgery