Automated monitoring of dairy cow body condition, mobility and weight using a single 3D video capture device

© 2018 Here we propose a low-cost automated system for the unobtrusive and continuous welfare monitoring of dairy cattle on the farm. We argue that effective and regular monitoring of multiple condition traits is not currently practicable and go on to propose 3D imaging technology able to acquire differing forms of related animal condition data (body condition, lameness and weight), concurrently using a single device. Results obtained under farm conditions in continuous operation are shown to be comparable or better than manual scoring of the herd. We also consider inherent limitations of using scoring and argue that sensitivity to relative change over successive observations offers greater benefit than the use of what may be considered abstract and arbitrary scoring systems

Precision technologies to address dairy cattle welfare: focus on lameness, mastitis and body condition

Specific animal-based indicators that can be used to predict animal welfare have been the core of protocols for assessing the welfare of farm animals, such as those produced by the Welfare Quality project. At the same time, the contribution of technological tools for the accurate and realtime assessment of farm animal welfare is also evident. The solutions based on technological tools fit into the precision livestock farming (PLF) concept, which has improved productivity, economic sustainability, and animal welfare in dairy farms. PLF has been adopted recently; nevertheless, the need for technological support on farms is getting more and more attention and has translated into significant scientific contributions in various fields of the dairy industry, but with an emphasis on the health and welfare of the cows. This review aims to present the recent advances of PLF in dairy cow welfare, particularly in the assessment of lameness, mastitis, and body condition, which are among the most relevant animal-based indications for the welfare of cows. Finally, a discussion is presented on the possibility of integrating the information obtained by PLF into a welfare assessment framework.FE1B-06B2-126F | Jos? Pedro Pinto de Ara?joN/

3D video based detection of early lameness in dairy cattle

Lameness is a major issue in dairy cattle and its early and automated detection offers animal welfare benefits together with potentially high commercial savings for farmers. Current advancements in automated detection have not achieved a sensitive measure for classifying early lameness; it remains to be a key challenge to be solved. The state-of-the-art also lacks behind on other aspects e.g. robust feature detection from a cow's body and the identification of the lame leg/side. This multidisciplinary research addresses the above issues by proposing an overhead, non-intrusive and covert 3-Dimensional (3D) video setup. This facilitates an automated process in order to record freely walking Holstein dairy cows at a commercial farm scale, in an unconstrained environment.The 3D data of the cow's body have been used to automatically track key regions such as the hook bones and the spine using a curvedness feature descriptor which operates at a high detection accuracy (100% for the spine, >97% for the hooks). From these tracked regions, two locomotion traits have been developed. First, motivated by a novel biomechanical approach, a proxy for the animal's gait asymmetry is introduced. This dynamic proxy is derived from the height variations in the hip joint (hooks) during walking, and extrapolated into right/left vertical leg motion signals. This proxy is evidently affected by minor lameness and directly contributes in identifying the lame leg. Second, back posture, which is analysed using two cubic-fit curvatures (X-Z plane and X-Y plane) from the spine region. The X-Z plane curvature is used to assess the spine's arch as an early lameness trait, while the X-Y plane curvature provides a novel definition for localising the lame side. Objective variables were extracted from both traits to be trained using a linear Support Vector Machine (SVM) classifier. Validation is made against ground truth data manually scored using a 1–5 locomotion scoring (LS) system, which consist of two datasets, 23 sessions and 60 sessions of walking cows. A threshold has been identified between LS 1 and 2 (and above). This boundary is important as it represents the earliest point in time at which a cow is considered lame, and its early detection could improve intervention outcome, thereby minimising losses and reducing animal suffering. The threshold achieved an accuracy of 95.7% with a 100% sensitivity (detecting lame cows), and 75% specificity (detecting non-lame cows) on dataset 1 and an accuracy of 88.3% with an 88% sensitivity and 92% specificity on dataset 2. Thereby outperforming the state-of-the-art at a stricter lameness boundary. The 3D video based multi-trait detection strives towards providing a comprehensive locomotion assessment on dairy farms. This contributes to the detection of developing lameness trends using regular monitoring which will improve the lack of robustness of existing methods and reduce reliance on expensive equipment and/or expertise in the dairy industry

Depth video data-enabled predictions of longitudinal dairy cow body weight using thresholding and Mask R-CNN algorithms

Monitoring cow body weight is crucial to support farm management decisions due to its direct relationship with the growth, nutritional status, and health of dairy cows. Cow body weight is a repeated trait, however, the majority of previous body weight prediction research only used data collected at a single point in time. Furthermore, the utility of deep learning-based segmentation for body weight prediction using videos remains unanswered. Therefore, the objectives of this study were to predict cow body weight from repeatedly measured video data, to compare the performance of the thresholding and Mask R-CNN deep learning approaches, to evaluate the predictive ability of body weight regression models, and to promote open science in the animal science community by releasing the source code for video-based body weight prediction. A total of 40,405 depth images and depth map files were obtained from 10 lactating Holstein cows and 2 non-lactating Jersey cows. Three approaches were investigated to segment the cow's body from the background, including single thresholding, adaptive thresholding, and Mask R-CNN. Four image-derived biometric features, such as dorsal length, abdominal width, height, and volume, were estimated from the segmented images. On average, the Mask-RCNN approach combined with a linear mixed model resulted in the best prediction coefficient of determination and mean absolute percentage error of 0.98 and 2.03%, respectively, in the forecasting cross-validation. The Mask-RCNN approach was also the best in the leave-three-cows-out cross-validation. The prediction coefficients of determination and mean absolute percentage error of the Mask-RCNN coupled with the linear mixed model were 0.90 and 4.70%, respectively. Our results suggest that deep learning-based segmentation improves the prediction performance of cow body weight from longitudinal depth video data

Recording behaviour of indoor-housed farm animals automatically using machine vision technology: a systematic review

Large-scale phenotyping of animal behaviour traits is time consuming and has led to increased demand for technologies that can automate these procedures. Automated tracking of animals has been successful in controlled laboratory settings, but recording from animals in large groups in highly variable farm settings presents challenges. The aim of this review is to provide a systematic overview of the advances that have occurred in automated, high throughput image detection of farm animal behavioural traits with welfare and production implications. Peer-reviewed publications written in English were reviewed systematically following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. After identification, screening, and assessment for eligibility, 108 publications met these specifications and were included for qualitative synthesis. Data collected from the papers included camera specifications, housing conditions, group size, algorithm details, procedures, and results. Most studies utilized standard digital colour video cameras for data collection, with increasing use of 3D cameras in papers published after 2013. Papers including pigs (across production stages) were the most common (n = 63). The most common behaviours recorded included activity level, area occupancy, aggression, gait scores, resource use, and posture. Our review revealed many overlaps in methods applied to analysing behaviour, and most studies started from scratch instead of building upon previous work. Training and validation sample sizes were generally small (mean±s.d. groups = 3.8±5.8) and in data collection and testing took place in relatively controlled environments. To advance our ability to automatically phenotype behaviour, future research should build upon existing knowledge and validate technology under commercial settings and publications should explicitly describe recording conditions in detail to allow studies to be reproduced

Advances in Sensors, Big Data and Machine Learning in Intelligent Animal Farming

Animal production (e.g., milk, meat, and eggs) provides valuable protein production for human beings and animals. However, animal production is facing several challenges worldwide such as environmental impacts and animal welfare/health concerns. In animal farming operations, accurate and efficient monitoring of animal information and behavior can help analyze the health and welfare status of animals and identify sick or abnormal individuals at an early stage to reduce economic losses and protect animal welfare. In recent years, there has been growing interest in animal welfare. At present, sensors, big data, machine learning, and artificial intelligence are used to improve management efficiency, reduce production costs, and enhance animal welfare. Although these technologies still have challenges and limitations, the application and exploration of these technologies in animal farms will greatly promote the intelligent management of farms. Therefore, this Special Issue will collect original papers with novel contributions based on technologies such as sensors, big data, machine learning, and artificial intelligence to study animal behavior monitoring and recognition, environmental monitoring, health evaluation, etc., to promote intelligent and accurate animal farm management

AUTOMATED BODY CONDITION SCORING: PROGRESSION ACROSS LACTATION AND ITS ASSOCIATION WITH DISEASE AND REPRODUCTION IN DAIRY CATTLE

Body condition scoring is a technique used to noninvasively assess fat reserves. It provides an objective estimate to describe the current and past nutritional status of the dairy cow and has been associated with increased disease risk and breeding success. Traditionally body condition scores are taken manually by visual appraisal on a 1 to 5 scale, in one-quarter increments. However, recent studies have shown the potential of automating the body condition scoring of cows using images. The first objective was to estimate the likelihood of disease development and breeding success, using odds ratios, associated with body condition score scored automatically at various points in lactation. The second objective of our research was to use a commercially available automated body condition scoring camera system to monitor body condition across the lactation period to evaluate differences between stratified parameters and to develop an equation to predict the dynamics of the body condition score. We found that poor body condition score at different times during the transition period are associated with increased disease occurrence and lower reproductive success. Automated body condition scoring (ABCS) curve during lactation was influenced by many factors, such as parity, ABCS at time of calving, disease occurrence, and milk production

Visual identification of individual Holstein-Friesian cattle via deep metric learning

Holstein-Friesian cattle exhibit individually-characteristic black and white coat patterns visually akin to those arising from Turing's reaction-diffusion systems. This work takes advantage of these natural markings in order to automate visual detection and biometric identification of individual Holstein-Friesians via convolutional neural networks and deep metric learning techniques. Existing approaches rely on markings, tags or wearables with a variety of maintenance requirements, whereas we present a totally hands-off method for the automated detection, localisation, and identification of individual animals from overhead imaging in an open herd setting, i.e. where new additions to the herd are identified without re-training. We propose the use of SoftMax-based reciprocal triplet loss to address the identification problem and evaluate the techniques in detail against fixed herd paradigms. We find that deep metric learning systems show strong performance even when many cattle unseen during system training are to be identified and re-identified - achieving 98.2% accuracy when trained on just half of the population. This work paves the way for facilitating the non-intrusive monitoring of cattle applicable to precision farming and surveillance for automated productivity, health and welfare monitoring, and to veterinary research such as behavioural analysis, disease outbreak tracing, and more. Key parts of the source code, network weights and underpinning datasets are available publicly.Comment: 37 pages, 14 figures, 2 tables; Submitted to Computers and Electronics in Agriculture; Source code and network weights available at https://github.com/CWOA/MetricLearningIdentification; OpenCows2020 dataset available at https://doi.org/10.5523/bris.10m32xl88x2b61zlkkgz3fml1

Mobility classification of cattle with micro-Doppler radar

Lameness in dairy cattle is a welfare concern that negatively impacts animal productivity and farmer profitability. Micro-Doppler radar sensing has been previously suggested as a potential system for automating lameness detection in ruminants. This thesis investigates the refinement of the proposed automated system by analysing and enhancing the repeatability and accuracy of the existing scoring method in cattle mobility scoring, used to provide labels in machine learning. The main aims of the thesis were (1) to quantify the performance of the micro-Doppler radar sensing method for the assessment of mobility, (2) to characterise and validate micro-Doppler radar signatures of dairy cattle with varying degrees of gait impairment, and (3) to develop machine learning algorithms that can infer the mobility status of the animals under test from their radar signatures and support automatic contactless classification. The first study investigated inter-assessor agreement using a 4-level system and modifications to it, as well as the impact of factors such as mobility scoring experience, confidence in scoring decisions, and video characteristics. The results revealed low levels of agreement between assessors' scores, with kappa values ranging from 0.16 to 0.53. However, after transforming and reducing the mobility scoring system levels, an improvement was observed, with kappa values ranging from 0.2 to 0.67. Subsequently, a longitudinal study was conducted using good-agreement scores as ground truth labels in supervised machine-learning models. However, the accuracy of the algorithmic models was found to be insufficient, ranging from 0.57 to 0.63. To address this issue, different labelling systems and data pre-processing techniques were explored in a cross-sectional study. Nonetheless, the inter-assessor agreement remained challenging, with an average kappa value of 0.37 (SD = 0.16), and high-accuracy algorithmic predictions remained elusive, with an average accuracy of 56.1 (SD =16.58). Finally, the algorithms' performance was tested with high-confidence labels, which consisted of only scores 0 and 3 of the AHDB system. This testing resulted in good classification accuracy (0.82), specificity (0.79), and sensitivity (0.85). This led to the proposal of a new approach to producing labels, testing vantage point changes, and improving the performance of machine learning models (average accuracy = 0.7 & SD = 0.17, average sensitivity = 0.68 & SD = 0.27, average specificity = 0.75 & SD = 0.17). The research identified a challenge in creating high-confidence diagnostic labels for supervised machine learning-based algorithms to automate the detection and classification of lameness in dairy cows. As a result, the original goals were partially overridden, with the focus shifted to creating reliable labels that would perform well with radar data and machine learning. This point was considered necessary for smooth system development and process automation. Nevertheless, we managed to quantify the performance of the micro-Doppler radar system, partially develop the supervised machine learning algorithms, compare levels of agreement among multiple assessors, evaluate the assessment tools, assess the mobility evaluation process and gather a valuable data set which can be used as a foundation for subsequent studies. Finally, the thesis suggests changes in the assessment process to improve the prediction accuracy of algorithms based on supervised machine learning with radar data