A Comprehensive Review of AI-enabled Unmanned Aerial Vehicle: Trends, Vision , and Challenges

In recent years, the combination of artificial intelligence (AI) and unmanned aerial vehicles (UAVs) has brought about advancements in various areas. This comprehensive analysis explores the changing landscape of AI-powered UAVs and friendly computing in their applications. It covers emerging trends, futuristic visions, and the inherent challenges that come with this relationship. The study examines how AI plays a role in enabling navigation, detecting and tracking objects, monitoring wildlife, enhancing precision agriculture, facilitating rescue operations, conducting surveillance activities, and establishing communication among UAVs using environmentally conscious computing techniques. By delving into the interaction between AI and UAVs, this analysis highlights the potential for these technologies to revolutionise industries such as agriculture, surveillance practices, disaster management strategies, and more. While envisioning possibilities, it also takes a look at ethical considerations, safety concerns, regulatory frameworks to be established, and the responsible deployment of AI-enhanced UAV systems. By consolidating insights from research endeavours in this field, this review provides an understanding of the evolving landscape of AI-powered UAVs while setting the stage for further exploration in this transformative domain

Principal variable selection to explain grain yield variation in winter wheat from features extracted from UAV imagery

Background: Automated phenotyping technologies are continually advancing the breeding process. However, collecting various secondary traits throughout the growing season and processing massive amounts of data still take great efforts and time. Selecting a minimum number of secondary traits that have the maximum predictive power has the potential to reduce phenotyping efforts. The objective of this study was to select principal features extracted from UAV imagery and critical growth stages that contributed the most in explaining winter wheat grain yield. Five dates of multispectral images and seven dates of RGB images were collected by a UAV system during the spring growing season in 2018. Two classes of features (variables), totaling to 172 variables, were extracted for each plot from the vegetation index and plant height maps, including pixel statistics and dynamic growth rates. A parametric algorithm, LASSO regression (the least angle and shrinkage selection operator), and a non-parametric algorithm, random forest, were applied for variable selection. The regression coefficients estimated by LASSO and the permutation importance scores provided by random forest were used to determine the ten most important variables influencing grain yield from each algorithm. Results: Both selection algorithms assigned the highest importance score to the variables related with plant height around the grain filling stage. Some vegetation indices related variables were also selected by the algorithms mainly at earlier to mid growth stages and during the senescence. Compared with the yield prediction using all 172 variables derived from measured phenotypes, using the selected variables performed comparable or even better. We also noticed that the prediction accuracy on the adapted NE lines (r = 0.58–0.81) was higher than the other lines (r = 0.21–0.59) included in this study with different genetic backgrounds. Conclusions: With the ultra-high resolution plot imagery obtained by the UAS-based phenotyping we are now able to derive more features, such as the variation of plant height or vegetation indices within a plot other than just an averaged number, that are potentially very useful for the breeding purpose. However, too many features or variables can be derived in this way. The promising results from this study suggests that the selected set from those variables can have comparable prediction accuracies on the grain yield prediction than the full set of them but possibly resulting in a better allocation of efforts and resources on phenotypic data collection and processing

UAV-Multispectral Sensed Data Band Co-Registration Framework

Precision farming has greatly benefited from new technologies over the years. The use of multispectral and hyperspectral sensors coupled to Unmanned Aerial Vehicles (UAV) has enabled farms to monitor crops, improve the use of resources and reduce costs. Despite being widely used, multispectral images present a natural misalignment among the various spectra due to the use of different sensors. The variation of the analyzed spectrum also leads to a loss of characteristics among the bands which hinders the feature detection process among the bands, which makes the alignment process complex. In this work, we propose a new framework for the band co-registration process based on two premises: i) the natural misalignment is an attribute of the camera, so it does not change during the acquisition process; ii) the speed of displacement of the UAV when compared to the speed between the acquisition of the first to the last band, is not sufficient to create significant distortions. We compared our results with the ground-truth generated by a specialist and with other methods present in the literature. The proposed framework had an average back-projection (BP) error of 0.425 pixels, this result being 335% better than the evaluated frameworks.CAPES - Coordenação de Aperfeiçoamento de Pessoal de Nível SuperiorDissertação (Mestrado)A agricultura de precisão se beneficiou muito das novas tecnologias ao longo dos anos. O uso de sensores multiespectrais e hiperespectrais acoplados aos Veículos Aéreos Não Tripulados (VANT) permitiu que as fazendas monitorassem as lavouras, melhorassem o uso de recursos e reduzissem os custos. Apesar de amplamente utilizadas, as imagens multiespectrais apresentam um desalinhamento natural entre os vários espectros devido ao uso de diferentes sensores. A variação do espectro analisado também leva à perda de características entre as bandas, o que dificulta o processo de detecção de atributos entre as bandas, o que torna complexo o processo de alinhamento. Neste trabalho, propomos um novo framework para o processo de alinhamento entre as bandas com base em duas premissas: i) o desalinhamento natural é um atributo da câmera, e por esse motivo ele não é alterado durante o processo de aquisição; ii) a velocidade de deslocamento do VANT, quando comparada à velocidade entre a aquisição da primeira e a última banda, não é suficiente para criar distorções significativas. Os resultados obtidos foram comparados com o padrão ouro gerado por um especialista e com outros métodos presentes na literatura. O framework proposto teve um back-projection error (BP) de 0, 425 pixels, sendo este resultado 335% melhor aos frameworks avaliados

Machine Learning-Aided Operations and Communications of Unmanned Aerial Vehicles: A Contemporary Survey

The ongoing amalgamation of UAV and ML techniques is creating a significant synergy and empowering UAVs with unprecedented intelligence and autonomy. This survey aims to provide a timely and comprehensive overview of ML techniques used in UAV operations and communications and identify the potential growth areas and research gaps. We emphasise the four key components of UAV operations and communications to which ML can significantly contribute, namely, perception and feature extraction, feature interpretation and regeneration, trajectory and mission planning, and aerodynamic control and operation. We classify the latest popular ML tools based on their applications to the four components and conduct gap analyses. This survey also takes a step forward by pointing out significant challenges in the upcoming realm of ML-aided automated UAV operations and communications. It is revealed that different ML techniques dominate the applications to the four key modules of UAV operations and communications. While there is an increasing trend of cross-module designs, little effort has been devoted to an end-to-end ML framework, from perception and feature extraction to aerodynamic control and operation. It is also unveiled that the reliability and trust of ML in UAV operations and applications require significant attention before full automation of UAVs and potential cooperation between UAVs and humans come to fruition.Comment: 36 pages, 304 references, 19 Figure

Application of UAV based high-resolution remote sensing for crop monitoring

Advances in technologies could offer enormous potential for crop monitoring applications, allowing the real-time acquisition of various environmental data. Technology such as high spatio-temporal imagery of unmanned aerial vehicles (UAV’s) can be widely used in crop monitoring applications. These technologies are expected to revolutionize the global agriculture practices, by enabling decision-making during the crop cycle days. Such results allow the effective practice of agricultural inputs, aiding precision agriculture pillars, i.e., applying the right practice in the right place, with the right amount and time. However, the actual exploitation of UAV’s has not been much strong in smart farming, mainly due to the challenges faced during selecting and deploying relevant technologies, including data acquisition and processing methods. The major problem is that there is still no consistent workflow for the use of UAV’s in such areas, as this mechanization is relatively new. In this article, the latest applications of UAV’s for crop monitoring are reviewed. It covers the most common applications, the types of UAV’s used and then we focused on data acquisition methods and technologies, employing the benefit and drawbacks of each. It also indicates the most popular image processing methods and summarizes the potential application in agricultural operations. 

Autonomous Vehicles

This edited volume, Autonomous Vehicles, is a collection of reviewed and relevant research chapters, offering a comprehensive overview of recent developments in the field of vehicle autonomy. The book comprises nine chapters authored by various researchers and edited by an expert active in the field of study. All chapters are complete in itself but united under a common research study topic. This publication aims to provide a thorough overview of the latest research efforts by international authors, open new possible research paths for further novel developments, and to inspire the younger generations into pursuing relevant academic studies and professional careers within the autonomous vehicle field

Uumanned Aerial Vehicle Data Analysis For High-throughput Plant Phenotyping

The continuing population is placing unprecedented demands on worldwide crop yield production and quality. Improving genomic selection for breeding process is one essential aspect for solving this dilemma. Benefitted from the advances in high-throughput genotyping, researchers already gained better understanding of genetic traits. However, given the comparatively lower efficiency in current phenotyping technique, the significance of phenotypic traits has still not fully exploited in genomic selection. Therefore, improving HTPP efficiency has become an urgent task for researchers. As one of the platforms utilized for collecting HTPP data, unmanned aerial vehicle (UAV) allows high quality data to be collected within short time and by less labor. There are currently many options for customized UAV system on market; however, data analysis efficiency is still one limitation for the fully implementation of HTPP. To this end, the focus of this program was data analysis of UAV acquired data. The specific objectives were two-fold, one was to investigate statistical correlations between UAV derived phenotypic traits and manually measured sorghum biomass, nitrogen and chlorophyll content. Another was to conduct variable selection on the phenotypic parameters calculated from UAV derived vegetation index (VI) and plant height maps, aiming to find out the principal parameters that contribute most in explaining winter wheat grain yield. Corresponding, two studies were carried out. Good correlations between UAV-derived VI/plant height and sorghum biomass/nitrogen/chlorophyll in the first study suggested that UAV-based HTPP has great potential in facilitating genetic improvement. For the second study, variable selection results from the single-year data showed that plant height related parameters, especially from later season, contributed more in explaining grain yield. Advisor: Yeyin Sh

New strategies for row-crop management based on cost-effective remote sensors

Agricultural technology can be an excellent antidote to resource scarcity. Its growth has led to the extensive study of spatial and temporal in-field variability. The challenge of accurate management has been addressed in recent years through the use of accurate high-cost measurement instruments by researchers. However, low rates of technological adoption by farmers motivate the development of alternative technologies based on affordable sensors, in order to improve the sustainability of agricultural biosystems. This doctoral thesis has as main objective the development and evaluation of systems based on affordable sensors, in order to address two of the main aspects affecting the producers: the need of an accurate plant water status characterization to perform a proper irrigation management and the precise weed control. To address the first objective, two data acquisition methodologies based on aerial platforms have been developed, seeking to compare the use of infrared thermometry and thermal imaging to determine the water status of two most relevant row-crops in the region, sugar beet and super high-density olive orchards. From the data obtained, the use of an airborne low-cost infrared sensor to determine the canopy temperature has been validated. Also the reliability of sugar beet canopy temperature as an indicator its of water status has been confirmed. The empirical development of the Crop Water Stress Index (CWSI) has also been carried out from aerial thermal imaging combined with infrared temperature sensors and ground measurements of factors such as water potential or stomatal conductance, validating its usefulness as an indicator of water status in super high-density olive orchards. To contribute to the development of precise weed control systems, a system for detecting tomato plants and measuring the space between them has been developed, aiming to perform intra-row treatments in a localized and precise way. To this end, low cost optical sensors have been used and compared with a commercial LiDAR laser scanner. Correct detection results close to 95% show that the implementation of these sensors can lead to promising advances in the automation of weed control. The micro-level field data collected from the evaluated affordable sensors can help farmers to target operations precisely before plant stress sets in or weeds infestation occurs, paving the path to increase the adoption of Precision Agriculture techniques

Using multi-spectral UAV imagery to extract tree crop structural properties and assess pruning effects

Unmanned aerial vehicles (UAV) provide an unprecedented capacity to monitor the development and dynamics of tree growth and structure through time. It is generally thought that the pruning of tree crops encourages new growth, has a positive effect on fruiting, makes fruit-picking easier, and may increase yield, as it increases light interception and tree crown surface area. To establish the response of pruning in an orchard of lychee trees, an assessment of changes in tree structure, i.e., tree crown perimeter, width, height, area and Plant Projective Cover (PPC), was undertaken using multi-spectral UAV imagery collected before and after a pruning event. While tree crown perimeter, width and area could be derived directly from the delineated tree crowns, height was estimated from a produced canopy height model and PPC was most accurately predicted based on the NIR band. Pre- and post-pruning results showed significant differences in all measured tree structural parameters, including an average decrease in tree crown perimeter of 1.94 m, tree crown width of 0.57 m, tree crown height of 0.62 m, tree crown area of 3.5 m(2), and PPC of 14.8%. In order to provide guidance on data collection protocols for orchard management, the impact of flying height variations was also examined, offering some insight into the influence of scale and the scalability of this UAV-based approach for larger orchards. The different flying heights (i.e., 30, 50 and 70 m) produced similar measurements of tree crown width and PPC, while tree crown perimeter, area and height measurements decreased with increasing flying height. Overall, these results illustrate that routine collection of multi-spectral UAV imagery can provide a means of assessing pruning effects on changes in tree structure in commercial orchards, and highlight the importance of collecting imagery with consistent flight configurations, as varying flying heights may cause changes to tree structural measurements