Stereovision-Based Ego-Motion Estimation for Combine Harvesters

Ego-motion estimation is a foundational capability for autonomous combine harvesters, supporting high-level functions such as navigation and harvesting. This paper presents a novel approach for estimating the motion of a combine harvester from a sequence of stereo images. The proposed method starts with tracking a set of 3D landmarks which are triangulated from stereo-matched features. Six Degree of Freedom (DoF) ego motion is obtained by minimizing the reprojection error of those landmarks on the current frame. Then, local bundle adjustment is performed to refine structure (i.e., landmark positions) and motion (i.e., keyframe poses) jointly in a sliding window. Both processes are encapsulated into a two-threaded architecture to achieve real-time performance. Our method utilizes a stereo camera, which enables estimation at true scale and easy startup of the system. Quantitative tests were performed on real agricultural scene data, comprising several different working paths, in terms of estimating accuracy and real-time performance. The experimental results demonstrated that our proposed perception system achieved favorable accuracy, outputting the pose at 10 Hz, which is sufficient for online ego-motion estimation for combine harvesters

Development of Centrifugal Disc Spreader on Tracked Combine Harvester for Rape Undersowing Rice Based on DEM

Rape undersowing rice is an effective method to solve the problem of short crop rotation in rice-rape rotation. Applying of ground fertilizer to rape is one of the most critical aspects in this planting pattern. However, a special fertilizer spreading is required after the rice is harvested, which increases the labor intensity and the compaction of rape and soil and is also hindered by a lack of equipment to complete the harvesting and fertilizer spreading simultaneously. In response to the above issues, a centrifugal disc spreader on a tracked combine harvester for rape undersowing rice was developed. The basic parameters of the spreader were designed based on the agronomic requirements for fertilization and tracked combine harvester. Kinematic and kinetic models of fertilizer particles were developed to determine the key parameters that affect fertilizer spreading. Based on discrete element simulations, the effects of single structure and interaction of centrifugal disc spreader on fertilizer distribution pattern were investigated. The spreading range and coefficient of variation of fertilizer lateral distribution regression models were constructed, and the spreader parameters were optimized based on the regression models. The simulation results and fertilizer spreading performance were verified by bench tests. The results show that the distribution of fertilizer from simulation tests and bench tests was consistent. The coefficient of variation of fertilizer lateral distribution was 13.1% for the simulation test and 14.6% for the bench test. The error of simulation test was 10.3%, which indicates that the simulation result was reliable. The developed centrifugal disc spreader can meet the needs of fertilizer spreading for rape undersowing rice. The results serve as a theoretical basis for the design of a fertilizer spreader and provide new ways to promote accurate and efficient spreading of fertilizer

Development of Impurity-Detection System for Tracked Rice Combine Harvester Based on DEM and Mask R-CNN

Impurity rate is one of the key performance indicators of the rice combine harvester and is also the main basis for parameter regulation. At present, the tracked rice combine harvester impurity rates cannot be monitored in real time. Due to the lack of parameter regulation basis, the harvest working parameters are set according to the operator’s experience and not adjusted during the operation, which leads to the harvest quality fluctuating greatly in a complex environment. In this paper, an impurity-detection system, including a grain-sampling device and machine vision system, was developed. Sampling device structure and impurity extraction algorithm were studied to enhance the impurity identification accuracy. To reduce the effect of impurity occlusion on visual recognition, an infusion-type sampling device was designed. The sampling device light source form was determined based on the brightness histogram analysis of a captured image under different light irradiations. The effect of sampling device structures on impurity visualization, grain distribution, and mass flow rate was investigated by the discrete element method (DEM). The impurity recognition algorithm was proposed based on Mask R-CNN, which mainly includes an impurity feature extraction network, an ROI generation network, and a target segmentation network. The test set experiment showed that the precision rate, recall rate, average precision, and comprehensive evaluation indicator of the impurity recognition model were 92.49%, 88.63%, 81.47%, and 90.52%, respectively. The conversion between impurity pixel number and its actual mass was realized according to the pixel density calibration test and impurity rate correction factor. The bench test result showed that the designed system has a good detection accuracy of 91.15~97.26% for the five varieties. The result relative error was in a range of 5.71~11.72% between the impurity-detection system and manual method in field conditions. The impurity-detection system could be applied to tracked rice combine harvesters to provide a reference for the adjustment of operating parameters

Development of Centrifugal Disc Spreader on Tracked Combine Harvester for Rape Undersowing Rice Based on DEM

Rape undersowing rice is an effective method to solve the problem of short crop rotation in rice-rape rotation. Applying of ground fertilizer to rape is one of the most critical aspects in this planting pattern. However, a special fertilizer spreading is required after the rice is harvested, which increases the labor intensity and the compaction of rape and soil and is also hindered by a lack of equipment to complete the harvesting and fertilizer spreading simultaneously. In response to the above issues, a centrifugal disc spreader on a tracked combine harvester for rape undersowing rice was developed. The basic parameters of the spreader were designed based on the agronomic requirements for fertilization and tracked combine harvester. Kinematic and kinetic models of fertilizer particles were developed to determine the key parameters that affect fertilizer spreading. Based on discrete element simulations, the effects of single structure and interaction of centrifugal disc spreader on fertilizer distribution pattern were investigated. The spreading range and coefficient of variation of fertilizer lateral distribution regression models were constructed, and the spreader parameters were optimized based on the regression models. The simulation results and fertilizer spreading performance were verified by bench tests. The results show that the distribution of fertilizer from simulation tests and bench tests was consistent. The coefficient of variation of fertilizer lateral distribution was 13.1% for the simulation test and 14.6% for the bench test. The error of simulation test was 10.3%, which indicates that the simulation result was reliable. The developed centrifugal disc spreader can meet the needs of fertilizer spreading for rape undersowing rice. The results serve as a theoretical basis for the design of a fertilizer spreader and provide new ways to promote accurate and efficient spreading of fertilizer

Experimental Study on the Soil Conditions for Rapeseed Transplanting for Blanket Seedling Combined Transplanter

To address the lack of available information on the soil physical conditions suitable for rapeseed blanket-shaped seedling transplanting, as well as the lack of protocols for the optimisation of soil tillage components in the utilisation of an integrated rapeseed blanket seedling combined transplanter, the physical parameters of different soil conditions and their impact on the growth of rapeseed after transplanting were investigated in this study. The aim was to determine the suitable soil physical parameters for rapeseed blanket-shaped seedling transplanting. First, the changes in soil firmness, soil bulk density, and soil moisture content during the installation of the rapeseed blanket seedling combined transplanter were tested and analysed, providing preliminary data for subsequent research. Using the variables of soil firmness and soil moisture content in the micro-environment around the roots and stems (30–50 mm) after rapeseed seedling transplantation and indicators such as the survival rate, root diameter, seedling height, and dry weight, an experiment on the growth of rapeseed blanket-shaped seedlings was conducted based on the furrow cutting transplanting principle. The results indicated that during the initial stage of rapeseed transplanting, the soil moisture content significantly influenced the vitality of the rapeseed plants. Under a high soil moisture content, the typically lengthy seedling period was shortened, and the effect on vitality was good, with minimal influence from the soil firmness. After seedling establishment, the rapeseed growth was significantly affected by the soil firmness. When the soil moisture content was less than 20%, increasing the soil firmness to 500 kPa was beneficial for moisture retention and rapeseed seedling growth. At a soil moisture content ranging from 20 to 25%, a soil firmness of 400 kPa was most suitable for both rapeseed vitality and late-stage growth. When the soil moisture content exceeded 25%, reducing the soil firmness to 300 kPa was beneficial for rapeseed growth, as an excessively high moisture content may lead to soil compaction, affecting seedling development. This study provides a theoretical basis for optimizing the design of soil tillage components in the application of an integrated rapeseed blanket seedling combined transplanter and for the high-yield management of rapeseed after transplanting

A Feeding Quantity Monitoring System for a Combine Harvester: Design and Experiment

Due to the commitment to the target of green mechanized production and precision agriculture, the operating parameters of the main functional components of a combine harvester need to be adjusted according to the feeding quantity. Therefore, feeding quantity monitoring is one of the key technologies of intelligent control for a combine harvester. In order to obtain the accurate information of feeding quantity in the harvesting operation process in real time, a monitoring system was set up to obtain the accurate information of feeding quantity in real time. The torque signal corresponding to different feeding quantity was obtained through bench calibration experiments. The signal was decomposed, noise reduced, and reconstructed through the analysis of the frequency range of the noise based on the wavelet transform. A fitting relationship between the torque and the feeding quantity was obtained. Field validation experiment results showed good consistency of the measured data and the actual quantity. This paper provides a theoretical basis and technical reference for subsequent research on intelligent control of combine harvesters