Stereo Vision 3D Tracking of Multiple Free-Swimming Fish for Low Frame Rate Video

Abstract

3D multiple fish tracking has gained a significant growing research interest to quantify fish behavior. However, most tracking techniques have used a high frame rate that is currently not viable for real-time tracking applications. This study discusses multiple fish tracking techniques using low frame rate sampling of stereo video clips. The fish are tagged and tracked based on the absolute error of predicted indices using past and present fish centroid locations and a deterministic frame index. In the predictor sub-system, the linear regression and machine learning algorithms intended for nonlinear systems, such as Adaptive Neuro-Fuzzy Inference System (ANFIS), symbolic regression, and Gaussian Process Regression (GPR), were investigated. Results have shown that in the context of tagging and tracking accuracy, the symbolic regression attained the best performance, followed by the GPR, i.e., 74% to 100% and 81% to 91%, respectively. Considering the computation time, symbolic regression resulted in the highest computing lag of approximately 946 ms per iteration, whereas GPR achieved the lowest computing time of 39 ms

    Similar works