109 research outputs found

    Autonomisten metsäkoneiden koneaistijärjestelmät

    Get PDF
    A prerequisite for increasing the autonomy of forest machinery is to provide robots with digital situational awareness, including a representation of the surrounding environment and the robot's own state in it. Therefore, this article-based dissertation proposes perception systems for autonomous or semi-autonomous forest machinery as a summary of seven publications. The work consists of several perception methods using machine vision, lidar, inertial sensors, and positioning sensors. The sensors are used together by means of probabilistic sensor fusion. Semi-autonomy is interpreted as a useful intermediary step, situated between current mechanized solutions and full autonomy, to assist the operator. In this work, the perception of the robot's self is achieved through estimation of its orientation and position in the world, the posture of its crane, and the pose of the attached tool. The view around the forest machine is produced with a rotating lidar, which provides approximately equal-density 3D measurements in all directions. Furthermore, a machine vision camera is used for detecting young trees among other vegetation, and sensor fusion of an actuated lidar and machine vision camera is utilized for detection and classification of tree species. In addition, in an operator-controlled semi-autonomous system, the operator requires a functional view of the data around the robot. To achieve this, the thesis proposes the use of an augmented reality interface, which requires measuring the pose of the operator's head-mounted display in the forest machine cabin. Here, this work adopts a sensor fusion solution for a head-mounted camera and inertial sensors. In order to increase the level of automation and productivity of forest machines, the work focuses on scientifically novel solutions that are also adaptable for industrial use in forest machinery. Therefore, all the proposed perception methods seek to address a real existing problem within current forest machinery. All the proposed solutions are implemented in a prototype forest machine and field tested in a forest. The proposed methods include posture measurement of a forestry crane, positioning of a freely hanging forestry crane attachment, attitude estimation of an all-terrain vehicle, positioning a head mounted camera in a forest machine cabin, detection of young trees for point cleaning, classification of tree species, and measurement of surrounding tree stems and the ground surface underneath.Metsäkoneiden autonomia-asteen kasvattaminen edellyttää, että robotilla on digitaalinen tilannetieto sekä ympäristöstä että robotin omasta toiminnasta. Tämän saavuttamiseksi työssä on kehitetty autonomisen tai puoliautonomisen metsäkoneen koneaistijärjestelmiä, jotka hyödyntävät konenäkö-, laserkeilaus- ja inertia-antureita sekä paikannusantureita. Työ liittää yhteen seitsemässä artikkelissa toteutetut havainnointimenetelmät, joissa useiden anturien mittauksia yhdistetään sensorifuusiomenetelmillä. Työssä puoliautonomialla tarkoitetaan hyödyllisiä kuljettajaa avustavia välivaiheita nykyisten mekanisoitujen ratkaisujen ja täyden autonomian välillä. Työssä esitettävissä autonomisen metsäkoneen koneaistijärjestelmissä koneen omaa toimintaa havainnoidaan estimoimalla koneen asentoa ja sijaintia, nosturin asentoa sekä siihen liitetyn työkalun asentoa suhteessa ympäristöön. Yleisnäkymä metsäkoneen ympärille toteutetaan pyörivällä laserkeilaimella, joka tuottaa lähes vakiotiheyksisiä 3D-mittauksia jokasuuntaisesti koneen ympäristöstä. Nuoret puut tunnistetaan muun kasvillisuuden joukosta käyttäen konenäkökameraa. Lisäksi puiden tunnistamisessa ja puulajien luokittelussa käytetään konenäkökameraa ja laserkeilainta yhdessä sensorifuusioratkaisun avulla. Lisäksi kuljettajan ohjaamassa puoliautonomisessa järjestelmässä kuljettaja tarvitsee toimivan tavan ymmärtää koneen tuottaman mallin ympäristöstä. Työssä tämä ehdotetaan toteutettavaksi lisätyn todellisuuden käyttöliittymän avulla, joka edellyttää metsäkoneen ohjaamossa istuvan kuljettajan lisätyn todellisuuden lasien paikan ja asennon mittaamista. Työssä se toteutetaan kypärään asennetun kameran ja inertia-anturien sensorifuusiona. Jotta metsäkoneiden automatisaatiotasoa ja tuottavuutta voidaan lisätä, työssä keskitytään uusiin tieteellisiin ratkaisuihin, jotka soveltuvat teolliseen käyttöön metsäkoneissa. Kaikki esitetyt koneaistijärjestelmät pyrkivät vastaamaan todelliseen olemassa olevaan tarpeeseen nykyisten metsäkoneiden käytössä. Siksi kaikki menetelmät on implementoitu prototyyppimetsäkoneisiin ja tulokset on testattu metsäympäristössä. Työssä esitetyt menetelmät mahdollistavat metsäkoneen nosturin, vapaasti riippuvan työkalun ja ajoneuvon asennon estimoinnin, lisätyn todellisuuden lasien asennon mittaamisen metsäkoneen ohjaamossa, nuorten puiden havaitsemisen reikäperkauksessa, ympäröivien puiden puulajien tunnistuksen, sekä puun runkojen ja maanpinnan mittauksen

    Human History and Digital Future

    Get PDF
    Korrigierter Nachdruck. Im Kapitel "Wallace/Moullou: Viability of Production and Implementation of Retrospective Photogrammetry in Archaeology" wurden die Acknowledgemens enfternt.The Proceedings of the 46th Annual Conference on Computer Applications and Quantitative Methods in Archaeology, held between March 19th and 23th, 2018 at the University of Tübingen, Germany, discuss the current questions concerning digital recording, computer analysis, graphic and 3D visualization, data management and communication in the field of archaeology. Through a selection of diverse case studies from all over the world, the proceedings give an overview on new technical approaches and best practice from various archaeological and computer-science disciplines

    PAN-SUNET: UTILITY CORRIDOR UNDERSTANDING USING SPATIAL LAYOUT CONSISTENCY

    Get PDF
    The article addresses the need for a dependable and efficient computer vision system to examine utility networks with minimal human intervention, given the deteriorating state of these networks. To classify the dense and irregular point clouds obtained from the airborne laser terrain mapping (ALTM) system, which is used for data collection, we suggest a deep learning network named Panoptic-Semantic Utility Network (Pan-SUNet). The proposed network incorporates three networks to achieve voxel-based semantic segmentation and 3D object detection of the point clouds at various resolutions, including object categories in three dimensions, and predicts two-dimensional regional labels to differentiate utility and corridor regions from non-corridor regions. The network also ensures spatial layout consistency in the prediction of the voxel-based 3D network using regional segmentation. By testing the proposed approach on 67 km2 of utility corridor data with an average density of 5 pts/m2, the paper demonstrates the effectiveness of the technique. The proposed network outperforms the state-of-the-art baseline network, achieving an F1 score of 94% for the pylon class, 99% for the ground class, 99% for the vegetation class, and 99% for the powerline class. It also shows high performance for 3D object detection for pylon and span achieving average precision of 99% and 92% respectively

    Measurement and Evaluation of Roadway Geometry for Safety Analyses and Pavement Material Volume Estimation for Resurfacing and Rehabilitation Using Mobile LiDAR and Imagery-based Point Clouds

    Get PDF
    Roadway safety is a multifaceted issue affected by several variables including geometric design features of the roadway, weather conditions, sight distance issues, user behavior, and pavement surface condition. In recent years, transportation agencies have demonstrated a growing interest in utilizing Light Detecting and Ranging (LiDAR) and other remote sensing technologies to enhance data collection productivity, safety, and facilitate the development of strategies to maintain and improve existing roadway infrastructure. Studies have shown that three-dimensional (3D) point clouds acquired using mobile LiDAR systems are highly accurate, dense, and have numerous applications in transportation. Point cloud data applications include extraction of roadway geometry features, asset management, as-built documentation, and maintenance operations. Another source of highly accurate 3D data in the form of point clouds is close-range aerial photogrammetry using unmanned aerial vehicle (UAV) systems. One of the main advantages of these systems over conventional surveying methods is the ability to obtain accurate continuous data in a timely manner. Traditional surveying techniques allow for the collection of road surface data only at specified intervals. Point clouds from LiDAR and imagery-based data can be imported into modeling and design software to create a virtual representation of constructed roadways using 3D models. From a roadway safety assessment standpoint, mobile LiDAR scanning (MLS) systems and UAV close-range photogrammetry (UAV-CRP) can be used as effective methods to produce accurate digital representations of existing roadways for various safety evaluations. This research used LiDAR data collected by five vendors and UAV imagery data collected by the research team to achieve the following objectives: a) evaluate the accuracy of point clouds from MLS and UAV imagery data for collection roadway cross slopes for system-wide cross slope verification; b) evaluate the accuracy of as-built geometry features extracted from MLS and UAV imagery-based point clouds for estimating design speeds on horizontal and vertical curves of existing roadways; c) Determine whether MLS and UAV imagery-based point clouds can be used to produce accurate road surface models for material volume estimation purposes. Ground truth data collected using manual field survey measurements were used to validate the results of this research. Cross slope measurements were extracted from ten randomly selected stations along a 4-lane roadway. This resulted in a total of 42 cross slope measurements per data set including measurements from left turn lanes. The roadway is an urban parkway classified as an urban principal arterial located in Anderson, South Carolina. A comparison of measurements from point clouds and measurements from field survey data using t-test statical analysis showed that deviations between field survey data and MLS and UAV imagery-based point clouds were within the acceptable range of ±0.2% specified by SHRP2 and the South Carolina Department of Transportation (SCDOT). A surface-to-surface method was used to compute and compare material volumes between terrain models from MLS and UAV imagery-based point clouds and a terrain model from field survey data. The field survey data consisted of 424 points collected manually at sixty-nine 100-ft stations over the 1.3-mile study area. The average difference in height for all MLS data was less than 1 inch except for one of the vendors which appeared to be due to a systematic error. The average height difference for the UAV imagery-based data was approximately 1.02 inches. The relatively small errors indicated that these data sets can be used to obtain reliable material volume estimates. Lastly, MLS and UAV imagery-based point clouds were used to obtain horizontal curve radii and superelevation data to estimate design speeds on horizontal curves. Results from paired t-test statistical analyses using a 95% confidence level showed that geometry data extracted from point clouds can be used to obtain realistic estimates of design speeds on horizontal curves. Similarly, road grade and sight distance were obtained from point clouds for design speed estimation on crest and sag vertical curves. A similar approach using a paired t-test statistical analysis at a 95% confidence level showed that point clouds can be used to obtain reliable design speed information on crest and sag vertical curves. The proposed approach offers advantages over extracting information from design drawings which may provide an inaccurate representation of the as-built roadway

    Innovative Methods and Materials in Structural Health Monitoring of Civil Infrastructures

    Get PDF
    In the past, when elements in sructures were composed of perishable materials, such as wood, the maintenance of houses, bridges, etc., was considered of vital importance for their safe use and to preserve their efficiency. With the advent of materials such as reinforced concrete and steel, given their relatively long useful life, periodic and constant maintenance has often been considered a secondary concern. When it was realized that even for structures fabricated with these materials that the useful life has an end and that it was being approached, planning maintenance became an important and non-negligible aspect. Thus, the concept of structural health monitoring (SHM) was introduced, designed, and implemented as a multidisciplinary method. Computational mechanics, static and dynamic analysis of structures, electronics, sensors, and, recently, the Internet of Things (IoT) and artificial intelligence (AI) are required, but it is also important to consider new materials, especially those with intrinsic self-diagnosis characteristics, and to use measurement and survey methods typical of modern geomatics, such as satellite surveys and highly sophisticated laser tools

    Development of a new non-invasive vineyard yield estimation method based on image analysis

    Get PDF
    Doutoramento em Engenharia Agronómica / Instituto Superior de Agronomia. Universidade de LisboaPredicting vineyard yield with accuracy can provide several advantages to the whole vine and wine industry. Today this is majorly done using manual and sometimes destructive methods, based on bunch samples. Yield estimation using computer vision and image analysis can potentially perform this task extensively, automatically, and non-invasively. In the present work this approach is explored in three main steps: image collection, occluded fruit estimation and image traits conversion to mass. On the first step, grapevine images were collected in field conditions along some of the main grapevine phenological stages. Visible yield components were identified in the image and compared to ground truth. When analyzing inflorescences and bunches, more than 50% were occluded by leaves or other plant organs, on three cultivars. No significant differences were observed on bunch visibility after fruit set. Visible bunch projected area explained an average of 49% of vine yield variation, between veraison and harvest. On the second step, vine images were collected, in field conditions, with different levels of defoliation intensity at bunch zone. A regression model was computed combining canopy porosity and visible bunch area, obtained via image analysis, which explained 70-84% of bunch exposure variation. This approach allowed for an estimation of the occluded fraction of bunches with average errors below |10|%. No significant differences were found between the model’s output at veraison and harvest. On the last step, the conversion of bunch image traits into mass was explored in laboratory and field conditions. In both cases, cultivar differences related to bunch architecture were found to affect weight estimation. A combination of derived variables which included visible bunch area, estimated total bunch area, visible bunch perimeter, visible berry number and bunch compactness was used to estimate yield on undisturbed grapevines. The final model achieved a R2 = 0.86 between actual and estimated yield (n = 213). If performed automatically, the final approach suggested in this work has the potential to provide a non-invasive method that can be performed accurately across whole vineyards.N/

    Multi-Robot Systems: Challenges, Trends and Applications

    Get PDF
    This book is a printed edition of the Special Issue entitled “Multi-Robot Systems: Challenges, Trends, and Applications” that was published in Applied Sciences. This Special Issue collected seventeen high-quality papers that discuss the main challenges of multi-robot systems, present the trends to address these issues, and report various relevant applications. Some of the topics addressed by these papers are robot swarms, mission planning, robot teaming, machine learning, immersive technologies, search and rescue, and social robotics

    EG-ICE 2021 Workshop on Intelligent Computing in Engineering

    Get PDF
    The 28th EG-ICE International Workshop 2021 brings together international experts working at the interface between advanced computing and modern engineering challenges. Many engineering tasks require open-world resolutions to support multi-actor collaboration, coping with approximate models, providing effective engineer-computer interaction, search in multi-dimensional solution spaces, accommodating uncertainty, including specialist domain knowledge, performing sensor-data interpretation and dealing with incomplete knowledge. While results from computer science provide much initial support for resolution, adaptation is unavoidable and most importantly, feedback from addressing engineering challenges drives fundamental computer-science research. Competence and knowledge transfer goes both ways

    Urban Ecosystem Services

    Get PDF
    The school of thought surrounding the urban ecosystem has increasingly become in vogue among researchers worldwide. Since half of the world’s population lives in cities, urban ecosystem services have become essential to human health and wellbeing. Rapid urban growth has forced sustainable urban developers to rethink important steps by updating and, to some degree, recreating the human–ecosystem service linkage. Assessing, as well as estimating the losses of ecosystem services can denote the essential effects of urbanization and increasingly indicate where cities fall short. This book contains 13 thoroughly refereed contributions published within the Special Issue “Urban Ecosystem Services”. The book addresses topics such as nature-based solutions, green space planning, green infrastructure, rain gardens, climate change, and more. The contributions highlight new findings for landscape architects, urban planners, and policymakers. Important future cities research is considered by looking at the system connectivity between the social and ecological sphere—via varying forms of urban planning, management, and governance. The book is supported by methods and models that utilize an urban sustainability and ecosystem service-centric focus by adding knowledge-base and real-world solutions into the urbanization phenomenon
    corecore