The systematic development of a machine vision based milking robot

Agriculture involves unique interactions between man, machines, and various elements from nature. Therefore the implementation of advanced technology in agriculture holds different challenges than in other sectors of the economy. This dissertation stems from research into the application of advanced technology in dairying - focusing on the systematic analysis and synthesis of concepts for a robotic milking machine for cows. The main subsystems of the milking robot are identified as a machine perception subsystem and a mechanical manipulator subsystem. The machine perception subsystem consists of one or more sensors and a signal processor; while the manipulator subsystem typically consists of a robot arm; a robot hand; actuators; and a controller. After the evaluation of different sensor concepts in terms of a defined set of technical performance requirements, television cameras are chosen as a suitable sensor concept for a milking robot. Therefore the signal processor is only concerned with image processing techniques. The primary task of the milking robot's image processor is to derive a computerized description of the spatial positions of the endpoints of a cow's four teats, in terms of a pre-defined frame of reference (called the word coordinates ). This process is called scene description ; and based on extensive experimental results, three-dimensional scene description - making use of a stereo-vision set-up - is shown to be feasible for application as part of a milking robot. Different processes are involved in stereo machine vision - such as data reduction, with the minimum loss of Image information (for which the Sobel edge enhancement operator is used); the accurate localisation of target objects in the two stereo images (for which the parabolic Hough transform is used); and correlation of features in the two stereo images. These aspects are all addressed for the milking robot, by means of concept analysis, trade-oft, and experimental verification. From a trade-off, based on a set of performance requirements for the manipulator subsystem, a cartesian robot arm is chosen as a suitable configuration for the milking robot; while sealed direct current servo motors are chosen as a suitable actuator concept. A robot arm and its actuators are designed by means of computer-aided design techniques; and computer simulation results are presented for the dynamic response of the arm and its actuators. A suitable robot hand is also designed - based on systematic trade-oft for different parts of a robot hand. From an analysis of the desired controller functions, and of different control concepts, it is concluded that a positional controller, making use of on-line obstruction avoidance, is required for the milking robot. Because this research project involved systematic concept exploration, there are still some details to be sorted out in a follow-up development phase. The basic principles of a machine vision based milking robot are however established; and the work in this dissertation represents a suitable baseline for further development