181 research outputs found

    A robotic platform for precision agriculture and applications

    Get PDF
    Agricultural techniques have been improved over the centuries to match with the growing demand of an increase in global population. Farming applications are facing new challenges to satisfy global needs and the recent technology advancements in terms of robotic platforms can be exploited. As the orchard management is one of the most challenging applications because of its tree structure and the required interaction with the environment, it was targeted also by the University of Bologna research group to provide a customized solution addressing new concept for agricultural vehicles. The result of this research has blossomed into a new lightweight tracked vehicle capable of performing autonomous navigation both in the open-filed scenario and while travelling inside orchards for what has been called in-row navigation. The mechanical design concept, together with customized software implementation has been detailed to highlight the strengths of the platform and some further improvements envisioned to improve the overall performances. Static stability testing has proved that the vehicle can withstand steep slopes scenarios. Some improvements have also been investigated to refine the estimation of the slippage that occurs during turning maneuvers and that is typical of skid-steering tracked vehicles. The software architecture has been implemented using the Robot Operating System (ROS) framework, so to exploit community available packages related to common and basic functions, such as sensor interfaces, while allowing dedicated custom implementation of the navigation algorithm developed. Real-world testing inside the university’s experimental orchards have proven the robustness and stability of the solution with more than 800 hours of fieldwork. The vehicle has also enabled a wide range of autonomous tasks such as spraying, mowing, and on-the-field data collection capabilities. The latter can be exploited to automatically estimate relevant orchard properties such as fruit counting and sizing, canopy properties estimation, and autonomous fruit harvesting with post-harvesting estimations.Le tecniche agricole sono state migliorate nel corso dei secoli per soddisfare la crescente domanda di aumento della popolazione mondiale. I recenti progressi tecnologici in termini di piattaforme robotiche possono essere sfruttati in questo contesto. Poiché la gestione del frutteto è una delle applicazioni più impegnative, a causa della sua struttura arborea e della necessaria interazione con l'ambiente, è stata oggetto di ricerca per fornire una soluzione personalizzata che sviluppi un nuovo concetto di veicolo agricolo. Il risultato si è concretizzato in un veicolo cingolato leggero, capace di effettuare una navigazione autonoma sia nello scenario di pieno campo che all'interno dei frutteti (navigazione interfilare). La progettazione meccanica, insieme all'implementazione del software, sono stati dettagliati per evidenziarne i punti di forza, accanto ad alcuni ulteriori miglioramenti previsti per incrementarne le prestazioni complessive. I test di stabilità statica hanno dimostrato che il veicolo può resistere a ripidi pendii. Sono stati inoltre studiati miglioramenti per affinare la stima dello slittamento che si verifica durante le manovre di svolta, tipico dei veicoli cingolati. L'architettura software è stata implementata utilizzando il framework Robot Operating System (ROS), in modo da sfruttare i pacchetti disponibili relativi a componenti base, come le interfacce dei sensori, e consentendo al contempo un'implementazione personalizzata degli algoritmi di navigazione sviluppati. I test in condizioni reali all'interno dei frutteti sperimentali dell'università hanno dimostrato la robustezza e la stabilità della soluzione con oltre 800 ore di lavoro sul campo. Il veicolo ha permesso di attivare e svolgere un'ampia gamma di attività agricole in maniera autonoma, come l'irrorazione, la falciatura e la raccolta di dati sul campo. Questi ultimi possono essere sfruttati per stimare automaticamente le proprietà più rilevanti del frutteto, come il conteggio e la calibratura dei frutti, la stima delle proprietà della chioma e la raccolta autonoma dei frutti con stime post-raccolta

    S5^{5}Mars: Semi-Supervised Learning for Mars Semantic Segmentation

    Full text link
    Deep learning has become a powerful tool for Mars exploration. Mars terrain semantic segmentation is an important Martian vision task, which is the base of rover autonomous planning and safe driving. However, there is a lack of sufficient detailed and high-confidence data annotations, which are exactly required by most deep learning methods to obtain a good model. To address this problem, we propose our solution from the perspective of joint data and method design. We first present a newdataset S5Mars for Semi-SuperviSed learning on Mars Semantic Segmentation, which contains 6K high-resolution images and is sparsely annotated based on confidence, ensuring the high quality of labels. Then to learn from this sparse data, we propose a semi-supervised learning (SSL) framework for Mars image semantic segmentation, to learn representations from limited labeled data. Different from the existing SSL methods which are mostly targeted at the Earth image data, our method takes into account Mars data characteristics. Specifically, we first investigate the impact of current widely used natural image augmentations on Mars images. Based on the analysis, we then proposed two novel and effective augmentations for SSL of Mars segmentation, AugIN and SAM-Mix, which serve as strong augmentations to boost the model performance. Meanwhile, to fully leverage the unlabeled data, we introduce a soft-to-hard consistency learning strategy, learning from different targets based on prediction confidence. Experimental results show that our method can outperform state-of-the-art SSL approaches remarkably. Our proposed dataset is available at https://jhang2020.github.io/S5Mars.github.io/

    Track-index-guided sustainable off-road operations using visual analytics, image intelligence and optimal delineation of track features

    Get PDF
    Visual-analytics-guided systems are replacing human efforts today. In many applications, movement in off-road terrain is required. Considering the need to negotiate various soft ground and desertic conditions, the beaten tracks of leading vehicles considered to be safe and suitable for guiding are used in such operations. During night, often, these tracks pass through low-contrast conditions posing difficulty in their identification. The maximization of track contrast is therefore desired. Many contrast enhancement techniques exist but their effectiveness varies as per the surrounding. Other than conventional techniques, the role of texture too becomes important for enhancing the differentiable track contrast. Gray-level co-occurrence matrix (GLCM)-based statistic measures are used here to evaluate the track texture. These measures are seen to improve the contrast of vehicle tracks significantly. A track-index-based technique is proposed to sort various images as per their effectiveness in increasing the track contrast. Different forms of track indices are proposed and compared. The proposed track index is seen as effective in sorting 88.8% of contrast images correctly. The proposed technique of creating and sorting images based on the contrast level is seen as a useful tool for improved fidelity in many difficult situations for making the off-road operations sustainable

    Adaptive Technique for Contrast Enhancement of Leading Vehicle Tracks

    Get PDF
    During movement in various unpaved terrain conditions, the track impressions left over by the leading vehicles provide guiding and safe routes in the area. The delineation of these tracks captured by the images can extend immense support for guidance in real time. These tracks that look like edges in coarse-resolution images take the shape of elongated areas in fine-resolution images. In such a scenario, the high pass and edge detection filters give limited information to delineate these tracks passing through different surroundings. However, the distinct texture of these tracks assists in the delineation of these tracks from their surroundings. Gray level co-occurrence matrix (GLCM) representing the spatial relation of pixels is employed here to define the texture. The authors investigated the influence of different resolutions on the distinguishability of these tracks. The study revealed that texture plays an increasing role in distinguishing objects as the image resolution improves. The texture analysis extended to investigate the track impressions left over by the leading vehicle brings out an ample scope in delineating these tracks. The measures could improve the track contrast even better than conventional techniques. To select the most optimal contrast enhancement measure in a given scenario, authors proposed a quantified measure of track index. An investigation is made on the difference-based track index (TI) representing the mean contrast value of the track vis-à-vis off-track areas. The results show an increase in the quantified contrast from 7.83 per cent to 29.06 per cent. The proposed technique highlights the image with the highest track contrast in a given scenario. The study can lead to onboard decision-making for the rut following vehicles moving in low-contrast terrain

    Tapered whisker reservoir computing for real-time terrain identification-based navigation

    Get PDF
    This paper proposes a new method for real-time terrain recognition-based navigation for mobile robots. Mobile robots performing tasks in unstructured environments need to adapt their trajectories in real-time to achieve safe and efficient navigation in complex terrains. However, current methods largely depend on visual and IMU (inertial measurement units) that demand high computational resources for real-time applications. In this paper, a real-time terrain identification-based navigation method is proposed using an on-board tapered whisker-based reservoir computing system. The nonlinear dynamic response of the tapered whisker was investigated in various analytical and Finite Element Analysis frameworks to demonstrate its reservoir computing capabilities. Numerical simulations and experiments were cross-checked with each other to verify that whisker sensors can separate different frequency signals directly in the time domain and demonstrate the computational superiority of the proposed system, and that different whisker axis locations and motion velocities provide variable dynamical response information. Terrain surface-following experiments demonstrated that our system could accurately identify changes in the terrain in real-time and adjust its trajectory to stay on specific terrain

    A Closed-Loop Shared Control Framework for Legged Robots

    Get PDF
    Shared control, as a combination of human and robot intelligence, has been deemed as a promising direction toward complementing the perception and learning capabilities of legged robots. However, previous works on human–robot control for legged robots are often limited to simple tasks, such as controlling movement direction, posture, or single-leg motion, yet extensive training of the operator is required. To facilitate the transfer of human intelligence to legged robots in unstructured environments, this article presents a user-friendly closed-loop shared control framework. The main novelty is that the operator only needs to make decisions based on the recommendations of the autonomous algorithm, without having to worry about operations or consider contact planning issues. Specifically, a rough navigation path from the operator is smoothed and optimized to generate a path with reduced traversing cost. The traversability of the generated path is assessed using fast Monte Carlo tree search, which is subsequently fed back through an intuitive image interface and force feedback to help the operator make decisions quickly, forming a closed-loop shared control. The simulation and hardware experiments on a hexapod robot show that the proposed framework gives full play to the advantages of human–machine collaboration and improves the performance in terms of learning time from the operator, mission completion time, and success rate than comparison methods

    Testing for the MMX Rover Autonomous Navigation Experiment on Phobos

    Get PDF
    The MMX rover will explore the surface of Phobos, Mars´ bigger moon. It will use its stereo cameras for perceiving the environment, enabling the use of vision based autonomous navigation algorithms. The German Aerospace Center (DLR) is currently developing the corresponding autonomous navigation experiment that will allow the rover to efficiently explore the surface of Phobos, despite limited communication with Earth and long turn-around times for operations. This paper discusses our testing strategy regarding the autonomous navigation solution. We present our general testing strategy for the software considering a development approach with agile aspects. We detail, how we ensure successful integration with the rover system despite having limited access to the flight hardware. We furthermore discuss, what environmental conditions on Phobos pose a potential risk for the navigation algorithms and how we test for these accordingly. Our testing is mostly data set-based and we describe our approaches for recording navigation data that is representative both for the rover system and also for the Phobos environment. Finally, we make the corresponding data set publicly available and provide an overview on its content

    A comprehensive survey of unmanned ground vehicle terrain traversability for unstructured environments and sensor technology insights

    Get PDF
    This article provides a detailed analysis of the assessment of unmanned ground vehicle terrain traversability. The analysis is categorized into terrain classification, terrain mapping, and cost-based traversability, with subcategories of appearance-based, geometry-based, and mixed-based methods. The article also explores the use of machine learning (ML), deep learning (DL) and reinforcement learning (RL) and other based end-to-end methods as crucial components for advanced terrain traversability analysis. The investigation indicates that a mixed approach, incorporating both exteroceptive and proprioceptive sensors, is more effective, optimized, and reliable for traversability analysis. Additionally, the article discusses the vehicle platforms and sensor technologies used in traversability analysis, making it a valuable resource for researchers in the field. Overall, this paper contributes significantly to the current understanding of traversability analysis in unstructured environments and provides insights for future sensor-based research on advanced traversability analysis

    Using Machine Learning to Reduce Observational Biases When Detecting New Impacts on Mars

    Full text link
    The current inventory of recent (fresh) impacts on Mars shows a strong bias towards areas of low thermal inertia. These areas are generally visually bright, and impacts create dark scours and rays that make them easier to detect. It is expected that impacts occur at a similar rate in areas of higher thermal inertia, but those impacts are under-detected. This study investigates the use of a trained machine learning classifier to increase the detection of fresh impacts on Mars using CTX data. This approach discovered 69 new fresh impacts that have been confirmed with follow-up HiRISE images. We found that examining candidates partitioned by thermal inertia (TI) values, which is only possible due to the large number of machine learning candidates, helps reduce the observational bias and increase the number of known high-TI impacts.Comment: 17 pages, 10 figures, 2 tables (Author's preprint, accepted version
    • …
    corecore