35 research outputs found
Autonomous UAS-Based Agriculture Applications: General Overview and Relevant European Case Studies
Emerging precision agriculture techniques rely on the frequent collection of high-quality data which can be acquired efficiently by unmanned aerial systems (UAS). The main obstacle for wider adoption of this technology is related to UAS operational costs. The path forward requires a high degree of autonomy and integration of the UAS and other cyber physical systems on the farm into a common Farm Management System (FMS) to facilitate the use of big data and artificial intelligence (AI) techniques for decision support. Such a solution has been implemented in the EU project AFarCloud (Aggregated Farming in the Cloud). The regulation of UAS operations is another important factor that impacts the adoption rate of agricultural UAS. An analysis of the new European UAS regulations relevant for autonomous operation is included. Autonomous UAS operation through the AFarCloud FMS solution has been demonstrated at several test farms in multiple European countries. Novel applications have been developed, such as the retrieval of data from remote field sensors using UAS and in situ measurements using dedicated UAS payloads designed for physical contact with the environment. The main findings include that (1) autonomous UAS operation in the agricultural sector is feasible once the regulations allow this; (2) the UAS should be integrated with the FMS and include autonomous data processing and charging functionality to offer a practical solution; and (3) several applications beyond just asset monitoring are relevant for the UAS and will help to justify the cost of this equipment.publishedVersio
Soft-tissue evidence for homeothermy and crypsis in a Jurassic ichthyosaur
Ichthyosaurs are extinct marine reptiles that display a notable external similarity to modern toothed whales. Here we show that this resemblance is more than skin deep. We apply a multidisciplinary experimental approach to characterize the cellular and molecular composition of integumental tissues in an exceptionally preserved specimen of the Early Jurassic ichthyosaur Stenopterygius. Our analyses recovered still-flexible remnants of the original scaleless skin, which comprises morphologically distinct epidermal and dermal layers. These are underlain by insulating blubber that would have augmented streamlining, buoyancy and homeothermy. Additionally, we identify endogenous proteinaceous and lipid constituents, together with keratinocytes and branched melanophores that contain eumelanin pigment. Distributional variation of melanophores across the body suggests countershading, possibly enhanced by physiological adjustments of colour to enable photoprotection, concealment and/or thermoregulation. Convergence of ichthyosaurs with extant marine amniotes thus extends to the ultrastructural and molecular levels, reflecting the omnipresent constraints of their shared adaptation to pelagic life
Embedded high-resolution stereo-vision of high frame-rate and low latency through FPGA-acceleration
Autonomous agents rely on information from the surrounding environment to act upon. In the array of sensors available, the image sensor is perhaps the most versatile, allowing for detection of colour, size, shape, and depth. For the latter, in a dynamic environment, assuming no a priori knowledge, stereo vision is a commonly adopted technique. How to interpret images, and extract relevant information, is referred to as computer vision. Computer vision, and specifically stereo-vision algorithms, are complex and computationally expensive, already considering a single stereo pair, with results that are, in terms of accuracy, qualitatively difficult to compare. Adding to the challenge is a continuous stream of images, of a high frame rate, and the race of ever increasing image resolutions. In the context of autonomous agents, considerations regarding real-time requirements, embedded/resource limited processing platforms, power consumption, and physical size, further add up to an unarguably challenging problem. This thesis aims to achieve embedded high-resolution stereo-vision of high frame-rate and low latency, by approaching the problem from two different angles, hardware and algorithmic development, in a symbiotic relationship. The first contributions of the thesis are the GIMME and GIMME2 embedded vision platforms, which offer hardware accelerated processing through FGPAs, specifically targeting stereo vision, contrary to available COTS systems at the time. The second contribution, toward stereo vision algorithms, is twofold. Firstly, the problem of scalability and the associated disparity range is addressed by proposing a segment-based stereo algorithm. In segment space, matching is independent of image scale, and similarly, disparity range is measured in terms of segments, indicating relatively few hypotheses to cover the entire range of the scene. Secondly, more in line with the conventional stereo correspondence for FPGAs, the Census Transform (CT) has been identified as a recurring cost metric. This thesis proposes an optimisation of the CT through a Genetic Algorithm (GA) - the Genetic Algorithm Census Transform (GACT). The GACT shows promising results for benchmark datasets, compared to established CT methods, while being resource efficient.Autonoma agenter Àr beroende av information frÄn den omgivande miljön för att agera. I en mÀngd av tillgÀngliga sensorer Àr troligtvis bildsensorn den mest mÄngsidiga, dÄ den möjliggör sÀrskillnad av fÀrg, storlek, form och djup. För det sistnÀmnda Àr, i en dynamisk miljö utan krav pÄ förkunskaper, stereovision en vanligt tillÀmpad teknik. Tolkning av bildinnehÄll och extrahering av relevant information gÄr under benÀmningen datorseende. Datorseende, och specifikt stereoalgoritmer, Àr redan för ett enskilt bildpar komplexa och berÀkningsmÀssigt kostsamma, och ger resultat som, i termer av noggrannhet, Àr kvalitativt svÄra att jÀmföra. Problematiken utökas vidare av kontinuerlig ström av bilder, med allt högre bildfrekvens och upplösning. För autonoma agenter krÀvs dessutom övervÀganden vad gÀller realtidskrav, inbyggda system/resursbegrÀnsade berÀkningsplattformar, strömförbrukning och fysisk storlek, vilket summerar till ett otvetydigt utmanande problem. Den hÀr avhandlingen syftar till att Ästadkomma högupplöst stereovision med hög uppdateringsfrekvens och lÄg latens pÄ inbyggda system. Genom att nÀrma sig problemet frÄn tvÄ olika vinklar, hÄrdvaru- och algoritmmÀssigt, kan ett symbiotiskt förhÄllande dÀremellan sÀkerstÀllas.Avhandlingens första bidrag Àr GIMME och GIMME2 inbyggda visionsplattformar, som erbjuder FPGA-baserad hÄrdvaruaccelerering, med sÀrskilt fokus pÄ stereoseende, i kontrast till för tidpunkten kommersiellt tillgÀngliga system.Det andra bidraget, hÀrrörande stereoalgoritmer, Àr tudelat.Först hanteras skalbarhetproblemet, sammankopplat med disparitetsomfÄnget, genom att föreslÄ en segmentbaserad stereoalgoritm.I segmentrymden Àr matchningen oberoende av bildupplösningen, samt att disparitetsomfÄnget definieras i termer av segment, vilket antyder att relativt fÄ hypoteser behövs för att omfatta hela scenen.I det andra bidraget pÄ algoritmnivÄ, mer i linje med konventionella stereoalgoritmer för FPGAer, har Censustransformen (CT) identifierats som ett Äterkommande kostnadsmÄtt för likhet. HÀr föreslÄs en optimering av CT genom att tillÀmpa genetisk algoritm (GA) - Genetisk Algoritm Census Transform (GACT). GACT visar lovande resultat för referensdataset jÀmfört med etablerade CT-metoder, men Àr samtidigt resurseffektiv
Optisk detektion och höjdestimering av kraftledningar relativt till en UAV
Inspection of power lines is a crucial activity to locate the source of power outages or to preemptively stop them. Visual inspection methods using optical cameras attached to Unmanned Aerial Vehicles (UAV) have become increasingly popular due to cheap operating costs, large areal coverage and the wide availability of these platforms. The efficiency of power line inspection can further be improved using an automated UAV system, though the UAV must maintain a safe distance from the power lines to reduce the risk of collision. This thesis proposes a method of detecting visually straight power line cables and estimating the position of a UAV with respect to the detections in real time. Two power line detection strategies are investigated; a Canny and a Laplacian edge detection based approach. The algorithms are evaluated on power lines images in a range of lighting conditions, backgrounds and transmission cables. The Canny approach is chosen as the line detection method due to a superior performance when evaluated with a recall and precision line detection metric. Using this approach, UAV translational information with respect to the power lines is calculated by using the distance between the outermost power line cables and UAV odometry measurements. A complete evaluation of the algorithm is performed in both a simulated environment and on recordings of real power lines. The UAV translational error relative to the power lines was found to be below 0.1 m in general when using a simulated environment. Using real data, where only the altitude could be evaluated, the proposed method achieved an error of 1.6 m. The greater error was caused by inaccurate power line detections in conditions with poor cable visibility and uncertain ground truth values due to terrain approximations. Overall, the proposed algorithm provides a UAV translation estimate with respect to transmission lines in real time when individual cables are easily distinguishable from the background, thus improving the capabilities of automated power line inspection. Kraftledningsinspektioner Ă€r ett nödvĂ€ndigt arbete för att hitta kĂ€llan till strömavbrott eller för att kunna motverka dem i förebyggande syfte. Inspektionsmetoder som anvĂ€nder optiska kameror monterade pĂ„ obemannade luftfarkoster (UAV) har blivit allt mer vanliga pĂ„ grund av utbudet och billiga operationskostnader. Inspektionen kan ytterligare förbĂ€ttras genom autonoma UAV- system, dock krĂ€vs det att en UAV hĂ„ller ett sĂ€kert avstĂ„nd till kraftledningarna för att minska kollisionsrisken. Det hĂ€r examensarbetet föreslĂ„r en metod avsett för detektion av raka kraftledningar och en positionsuppskattning av en UAV relativt detektionerna i realtid. TvĂ„ metoder för kraftledningsdetektion undersöks: en Canny och en Laplaciansk metod för kantdetektion. Algoritmerna utvĂ€rderas pĂ„ bilder innehĂ„llande kraftledningar i olika belysningar, bakgrunder och typer av kraftledningar. Metoden baserat pĂ„ Canny- algoritmen vĂ€ljs för kraftledningsdektetion dĂ„ metoden har överlĂ€gsen prestanda nĂ€r precision och sensitivitet anvĂ€nds som prestandamĂ€tvĂ€rden. Med denna metod berĂ€knades UAV-positionen med anseende till kraftledningar genom anvĂ€ndningen av avstĂ„ndet mellan de yttersta kraftledningarna och UAV- odometrin. En omfattande utvĂ€rdering av hela algoritmen utförs i bĂ„de en simulerad miljö och pĂ„ inspelningar av verkliga kraftledningar. Felet för positionsuppskattningen i den simulerade miljön Ă€r generellt under 0.1 m, men ökade vid utvĂ€rderingen pĂ„ verklig data. Specifikt för den uppskattade höjden Ă€r felet 1.6 m pĂ„ verkliga kraftledningar. Det större felet orsakas av felaktiga kraftledningsdetektioner i förhĂ„llanden med undermĂ„lig belysning och osĂ€kra referensvĂ€rden. Ăverlag kan den föreslagna algoritmen skapa en UAV- positionsestimering med avseende pĂ„ kraftledningar i realtid nĂ€r enskilda kraftledningar Ă€r urskiljbara frĂ„n bakgrunden. DĂ€rav har förmĂ„gan att utföra autonoma kraftledningsinspektioner under dessa förhĂ„llanden utökats
Optisk detektion och höjdestimering av kraftledningar relativt till en UAV
Inspection of power lines is a crucial activity to locate the source of power outages or to preemptively stop them. Visual inspection methods using optical cameras attached to Unmanned Aerial Vehicles (UAV) have become increasingly popular due to cheap operating costs, large areal coverage and the wide availability of these platforms. The efficiency of power line inspection can further be improved using an automated UAV system, though the UAV must maintain a safe distance from the power lines to reduce the risk of collision. This thesis proposes a method of detecting visually straight power line cables and estimating the position of a UAV with respect to the detections in real time. Two power line detection strategies are investigated; a Canny and a Laplacian edge detection based approach. The algorithms are evaluated on power lines images in a range of lighting conditions, backgrounds and transmission cables. The Canny approach is chosen as the line detection method due to a superior performance when evaluated with a recall and precision line detection metric. Using this approach, UAV translational information with respect to the power lines is calculated by using the distance between the outermost power line cables and UAV odometry measurements. A complete evaluation of the algorithm is performed in both a simulated environment and on recordings of real power lines. The UAV translational error relative to the power lines was found to be below 0.1 m in general when using a simulated environment. Using real data, where only the altitude could be evaluated, the proposed method achieved an error of 1.6 m. The greater error was caused by inaccurate power line detections in conditions with poor cable visibility and uncertain ground truth values due to terrain approximations. Overall, the proposed algorithm provides a UAV translation estimate with respect to transmission lines in real time when individual cables are easily distinguishable from the background, thus improving the capabilities of automated power line inspection. Kraftledningsinspektioner Ă€r ett nödvĂ€ndigt arbete för att hitta kĂ€llan till strömavbrott eller för att kunna motverka dem i förebyggande syfte. Inspektionsmetoder som anvĂ€nder optiska kameror monterade pĂ„ obemannade luftfarkoster (UAV) har blivit allt mer vanliga pĂ„ grund av utbudet och billiga operationskostnader. Inspektionen kan ytterligare förbĂ€ttras genom autonoma UAV- system, dock krĂ€vs det att en UAV hĂ„ller ett sĂ€kert avstĂ„nd till kraftledningarna för att minska kollisionsrisken. Det hĂ€r examensarbetet föreslĂ„r en metod avsett för detektion av raka kraftledningar och en positionsuppskattning av en UAV relativt detektionerna i realtid. TvĂ„ metoder för kraftledningsdetektion undersöks: en Canny och en Laplaciansk metod för kantdetektion. Algoritmerna utvĂ€rderas pĂ„ bilder innehĂ„llande kraftledningar i olika belysningar, bakgrunder och typer av kraftledningar. Metoden baserat pĂ„ Canny- algoritmen vĂ€ljs för kraftledningsdektetion dĂ„ metoden har överlĂ€gsen prestanda nĂ€r precision och sensitivitet anvĂ€nds som prestandamĂ€tvĂ€rden. Med denna metod berĂ€knades UAV-positionen med anseende till kraftledningar genom anvĂ€ndningen av avstĂ„ndet mellan de yttersta kraftledningarna och UAV- odometrin. En omfattande utvĂ€rdering av hela algoritmen utförs i bĂ„de en simulerad miljö och pĂ„ inspelningar av verkliga kraftledningar. Felet för positionsuppskattningen i den simulerade miljön Ă€r generellt under 0.1 m, men ökade vid utvĂ€rderingen pĂ„ verklig data. Specifikt för den uppskattade höjden Ă€r felet 1.6 m pĂ„ verkliga kraftledningar. Det större felet orsakas av felaktiga kraftledningsdetektioner i förhĂ„llanden med undermĂ„lig belysning och osĂ€kra referensvĂ€rden. Ăverlag kan den föreslagna algoritmen skapa en UAV- positionsestimering med avseende pĂ„ kraftledningar i realtid nĂ€r enskilda kraftledningar Ă€r urskiljbara frĂ„n bakgrunden. DĂ€rav har förmĂ„gan att utföra autonoma kraftledningsinspektioner under dessa förhĂ„llanden utökats
Modeling Far Ultraviolet Auroral Ovals at Ganymede
Ganymede, one of Jupiters moons, differs from other moons in the Solar System as it has its own magnetic field. This rare property shapes the morphology on the existing far ultraviolet oxygen auroral ovals on the celestial body in the northern and southern hemisphere created by high energy electrons colliding into the atmosphere.With the help of the Hubble Space Telescope (HST) this phenomenon has been captured and analyzed multiple times during the past 20 years using the on-board Space Telescope Imaging Spectrograph (STIS). The ultimate goal of this project is recreating the far ultraviolet oxygen auroral emissions on Ganymede as a 3D computer model in MATLAB by using the data recovered from HST.The method used to reach this goal was to implement a model with main characteristics of the auroral ovals, project it onto a plane and then use a Cauchy distribution to filter the model. To compare the model with images from HST, a Ï2-value was calculated for every pixel in each image. To further improvethe model the Nelder-Mead Simplex optimization method was applied.The project succeeded in such a way that the final model created views of the locations and the appearance of the bright spots that represent the auroral ovals around Ganymede with an accurate result in relation to the given data
Modeling Far Ultraviolet Auroral Ovals at Ganymede
Ganymede, one of Jupiters moons, differs from other moons in the Solar System as it has its own magnetic field. This rare property shapes the morphology on the existing far ultraviolet oxygen auroral ovals on the celestial body in the northern and southern hemisphere created by high energy electrons colliding into the atmosphere.With the help of the Hubble Space Telescope (HST) this phenomenon has been captured and analyzed multiple times during the past 20 years using the on-board Space Telescope Imaging Spectrograph (STIS). The ultimate goal of this project is recreating the far ultraviolet oxygen auroral emissions on Ganymede as a 3D computer model in MATLAB by using the data recovered from HST.The method used to reach this goal was to implement a model with main characteristics of the auroral ovals, project it onto a plane and then use a Cauchy distribution to filter the model. To compare the model with images from HST, a Ï2-value was calculated for every pixel in each image. To further improvethe model the Nelder-Mead Simplex optimization method was applied.The project succeeded in such a way that the final model created views of the locations and the appearance of the bright spots that represent the auroral ovals around Ganymede with an accurate result in relation to the given data
Modeling Far Ultraviolet Auroral Ovals at Ganymede
Ganymede, one of Jupiters moons, differs from other moons in the Solar System as it has its own magnetic field. This rare property shapes the morphology on the existing far ultraviolet oxygen auroral ovals on the celestial body in the northern and southern hemisphere created by high energy electrons colliding into the atmosphere.With the help of the Hubble Space Telescope (HST) this phenomenon has been captured and analyzed multiple times during the past 20 years using the on-board Space Telescope Imaging Spectrograph (STIS). The ultimate goal of this project is recreating the far ultraviolet oxygen auroral emissions on Ganymede as a 3D computer model in MATLAB by using the data recovered from HST.The method used to reach this goal was to implement a model with main characteristics of the auroral ovals, project it onto a plane and then use a Cauchy distribution to filter the model. To compare the model with images from HST, a Ï2-value was calculated for every pixel in each image. To further improvethe model the Nelder-Mead Simplex optimization method was applied.The project succeeded in such a way that the final model created views of the locations and the appearance of the bright spots that represent the auroral ovals around Ganymede with an accurate result in relation to the given data