63 research outputs found
Real-time Strawberry Detection Based on Improved YOLOv5s Architecture for Robotic Harvesting in open-field environment
This study proposed a YOLOv5-based custom object detection model to detect
strawberries in an outdoor environment. The original architecture of the
YOLOv5s was modified by replacing the C3 module with the C2f module in the
backbone network, which provided a better feature gradient flow. Secondly, the
Spatial Pyramid Pooling Fast in the final layer of the backbone network of
YOLOv5s was combined with Cross Stage Partial Net to improve the generalization
ability over the strawberry dataset in this study. The proposed architecture
was named YOLOv5s-Straw. The RGB images dataset of the strawberry canopy with
three maturity classes (immature, nearly mature, and mature) was collected in
open-field environment and augmented through a series of operations including
brightness reduction, brightness increase, and noise adding. To verify the
superiority of the proposed method for strawberry detection in open-field
environment, four competitive detection models (YOLOv3-tiny, YOLOv5s,
YOLOv5s-C2f, and YOLOv8s) were trained, and tested under the same computational
environment and compared with YOLOv5s-Straw. The results showed that the
highest mean average precision of 80.3% was achieved using the proposed
architecture whereas the same was achieved with YOLOv3-tiny, YOLOv5s,
YOLOv5s-C2f, and YOLOv8s were 73.4%, 77.8%, 79.8%, 79.3%, respectively.
Specifically, the average precision of YOLOv5s-Straw was 82.1% in the immature
class, 73.5% in the nearly mature class, and 86.6% in the mature class, which
were 2.3% and 3.7%, respectively, higher than that of the latest YOLOv8s. The
model included 8.6*10^6 network parameters with an inference speed of 18ms per
image while the inference speed of YOLOv8s had a slower inference speed of
21.0ms and heavy parameters of 11.1*10^6, which indicates that the proposed
model is fast enough for real time strawberry detection and localization for
the robotic picking.Comment: 20 pages; 15 figure
Towards Autonomous Selective Harvesting: A Review of Robot Perception, Robot Design, Motion Planning and Control
This paper provides an overview of the current state-of-the-art in selective
harvesting robots (SHRs) and their potential for addressing the challenges of
global food production. SHRs have the potential to increase productivity,
reduce labour costs, and minimise food waste by selectively harvesting only
ripe fruits and vegetables. The paper discusses the main components of SHRs,
including perception, grasping, cutting, motion planning, and control. It also
highlights the challenges in developing SHR technologies, particularly in the
areas of robot design, motion planning and control. The paper also discusses
the potential benefits of integrating AI and soft robots and data-driven
methods to enhance the performance and robustness of SHR systems. Finally, the
paper identifies several open research questions in the field and highlights
the need for further research and development efforts to advance SHR
technologies to meet the challenges of global food production. Overall, this
paper provides a starting point for researchers and practitioners interested in
developing SHRs and highlights the need for more research in this field.Comment: Preprint: to be appeared in Journal of Field Robotic
Static and dynamic evaluations of acoustic positioning system using TDMA and FDMA for robots operating in a greenhouse
Acoustic positioning system has great potential to be applied in a greenhouse due to its centimeter-level accuracy, low cost, and ability of extensive greenhouse coverage. Spread Spectrum Sound-based local positioning system (SSSLPS) was proposed to be a navigation tool for multiple agricultural robots by the authors' research team. However, to increase the system capacity for positioning multiple robots in a greenhouse, the near-far problem caused by the interference between speakers needs to be overcome. The use of different access methods, Time Division Multiple Access (TDMA) or Frequency Division Multiple Access (FDMA), is essential in the SSSLPS system for solving the near-far problem. The static positioning in a greenhouse was first evaluated by setting different parameters to determine the optimal signal setting for a dynamic experiment. From that, the moving robot tests were added with a motion capture system and tested the performance of TDMA and FDMA. The results demonstrated that TDMA can be used in a stationary sound-based positioning system with 12.2 mm accuracy, but it has a time delay problem in dynamic positioning. A simulation was designed to mimic the position error increases with different moving speeds. Although FDMA has the sound damping problem in high-frequency regions creating a peak detection issue, it achieved a higher accuracy with an average position error of 62.1 mm compared to 180.3 mm of TDMA. This study shows that the TDMA method is suitable for static measurements, while the FDMA method is suitable for measuring dynamic objects and controlling mobile robots
Strawberry Cultivation Techniques
Among the berries, strawberries are the most commercially produced and consumed and their production and consumption are increasing in the world due to their enthusiastic aroma, taste, and biochemical properties. Strawberry is belonging to the genus Fragaria, from the family Rosaceae. It is indicated that the homeland of the strawberry is South America (Chile). It is well-known that people living in Asia, Europe, and America commonly use the wild F. vesca. In other regions such as Japan, North China and Manchuria, Europe-Siberia, and America there are different ecogeographic zones where alternative species are clustered. Despite its origins in the Pacific Northwest region of North America, F. ananassa is now grown all over the world. Strawberry is one of the most widespread berry species grown in almost every country including high altitudes of tropical regions, and subtropical and temperate areas. In this chapter, we aimed to offer new perspectives on the future of strawberry cultivation techniques by analyzing recent academic studies on strawberry production
Robotic Picking of Tangle-prone Materials (with Applications to Agriculture).
The picking of one or more objects from an unsorted pile continues to be non-trivial for robotic systems. This is especially so when the pile consists of individual items that tangle with one another, causing more to be picked out than desired. One of the key features of such tangling-prone materials (e.g., herbs, salads) is the presence of protrusions (e.g., leaves) extending out from the main body of items in the pile.This thesis explores the issue of picking excess mass due to entanglement such as occurs in bins composed of tangling-prone materials (TPs), especially in the context of a one-shot mass-constrained robotic bin-picking task. Specifically, it proposes a human-inspired entanglement reduction method for making the picking of TPs more predictable. The primary approach is to directly counter entanglement through pile interaction with an aim of reducing it to a level where the picked mass is predictable, instead of avoiding entanglement by picking from collision or entanglement-free points or regions. Taking this perspective, several contributions are presented that (i) improve the understanding of the phenomenon of entanglement and (ii) reduce the picking error (PE) by effectively countering entanglement in a TP pile.First, it studies the mechanics of a variety of TPs improving the understanding of the phenomenon of entanglement as observed in TP bins. It reports experiments with a real robot in which picking TPs with different protrusion lengths (PLs) results in up to a 76% increase in picked mass variance, suggesting PL be an informative feature in the design of picking strategies. Moreover, to counter the inherent entanglement in a TP pile, it proposes a new Spread-and-Pick (SnP) approach that significantly reduces entanglement, making picking more consistent. Compared to prior approaches that seek to pick from a tangle-free point in the pile, the proposed method results in a decrease in PE of up to 51% and shows good generalisation to previously unseen TPs
Review on human‐like robot manipulation using dexterous hands
In recent years, human hand‐based robotic hands or dexterous hands have gained attention due to their enormous capabilities of handling soft materials compared to traditional grippers. Back in the earlier days, the development of a hand model close to that of a human was an impossible task but with the advancements made in technology, dexterous hands with three, four or five‐fingered robotic hands have been developed to mimic human hand nature. However, human‐like manipulation of dexterous hands to this date remains a challenge. Thus, this review focuses on (a) the history and motivation behind the development of dexterous hands, (b) a brief overview of the available multi‐fingered hands, and (c) learning‐based methods such as traditional and data‐driven learning methods for manipulating dexterous hands. Additionally, it discusses the challenges faced in terms of the manipulation of multi‐fingered or dexterous hands
Agricultural Structures and Mechanization
In our globalized world, the need to produce quality and safe food has increased exponentially in recent decades to meet the growing demands of the world population. This expectation is being met by acting at multiple levels, but mainly through the introduction of new technologies in the agricultural and agri-food sectors. In this context, agricultural, livestock, agro-industrial buildings, and agrarian infrastructure are being built on the basis of a sophisticated design that integrates environmental, landscape, and occupational safety, new construction materials, new facilities, and mechanization with state-of-the-art automatic systems, using calculation models and computer programs. It is necessary to promote research and dissemination of results in the field of mechanization and agricultural structures, specifically with regard to farm building and rural landscape, land and water use and environment, power and machinery, information systems and precision farming, processing and post-harvest technology and logistics, energy and non-food production technology, systems engineering and management, and fruit and vegetable cultivation systems. This Special Issue focuses on the role that mechanization and agricultural structures play in the production of high-quality food and continuously over time. For this reason, it publishes highly interdisciplinary quality studies from disparate research fields including agriculture, engineering design, calculation and modeling, landscaping, environmentalism, and even ergonomics and occupational risk prevention
Proceedings of the European Conference on Agricultural Engineering AgEng2021
This proceedings book results from the AgEng2021 Agricultural Engineering Conference under auspices of the European Society of Agricultural Engineers, held in an online format based on the University of Évora,
Portugal, from 4 to 8 July 2021.
This book contains the full papers of a selection of abstracts that were the base for the oral presentations and posters presented at the conference.
Presentations were distributed in eleven thematic areas: Artificial Intelligence, data processing and
management; Automation, robotics and sensor technology; Circular Economy; Education and Rural development; Energy and bioenergy; Integrated and sustainable Farming systems; New application
technologies and mechanisation; Post-harvest technologies; Smart farming / Precision agriculture; Soil, land and water engineering; Sustainable production in Farm buildings
- …