Leaf segmentation in plant phenotyping: a collation study

Image-based plant phenotyping is a growing application area of computer vision in agriculture. A key task is the segmentation of all individual leaves in images. Here we focus on the most common rosette model plants, Arabidopsis and young tobacco. Although leaves do share appearance and shape characteristics, the presence of occlusions and variability in leaf shape and pose, as well as imaging conditions, render this problem challenging. The aim of this paper is to compare several leaf segmentation solutions on a unique and first-of-its-kind dataset containing images from typical phenotyping experiments. In particular, we report and discuss methods and findings of a collection of submissions for the first Leaf Segmentation Challenge of the Computer Vision Problems in Plant Phenotyping workshop in 2014. Four methods are presented: three segment leaves by processing the distance transform in an unsupervised fashion, and the other via optimal template selection and Chamfer matching. Overall, we find that although separating plant from background can be accomplished with satisfactory accuracy (>>90 % Dice score), individual leaf segmentation and counting remain challenging when leaves overlap. Additionally, accuracy is lower for younger leaves. We find also that variability in datasets does affect outcomes. Our findings motivate further investigations and development of specialized algorithms for this particular application, and that challenges of this form are ideally suited for advancing the state of the art. Data are publicly available (online at http://​www.​plant-phenotyping.​org/​datasets) to support future challenges beyond segmentation within this application domain

Low-cost and automated phenotyping system “Phenomenon” for multi-sensor in situ monitoring in plant in vitro culture

Background: The current development of sensor technologies towards ever more cost-effective and powerful systems is steadily increasing the application of low-cost sensors in different horticultural sectors. In plant in vitro culture, as a fundamental technique for plant breeding and plant propagation, the majority of evaluation methods to describe the performance of these cultures are based on destructive approaches, limiting data to unique endpoint measurements. Therefore, a non-destructive phenotyping system capable of automated, continuous and objective quantification of in vitro plant traits is desirable. Results: An automated low-cost multi-sensor system acquiring phenotypic data of plant in vitro cultures was developed and evaluated. Unique hardware and software components were selected to construct a xyz-scanning system with an adequate accuracy for consistent data acquisition. Relevant plant growth predictors, such as projected area of explants and average canopy height were determined employing multi-sensory imaging and various developmental processes could be monitored and documented. The validation of the RGB image segmentation pipeline using a random forest classifier revealed very strong correlation with manual pixel annotation. Depth imaging by a laser distance sensor of plant in vitro cultures enabled the description of the dynamic behavior of the average canopy height, the maximum plant height, but also the culture media height and volume. Projected plant area in depth data by RANSAC (random sample consensus) segmentation approach well matched the projected plant area by RGB image processing pipeline. In addition, a successful proof of concept for in situ spectral fluorescence monitoring was achieved and challenges of thermal imaging were documented. Potential use cases for the digital quantification of key performance parameters in research and commercial application are discussed. Conclusion: The technical realization of “Phenomenon” allows phenotyping of plant in vitro cultures under highly challenging conditions and enables multi-sensory monitoring through closed vessels, ensuring the aseptic status of the cultures. Automated sensor application in plant tissue culture promises great potential for a non-destructive growth analysis enhancing commercial propagation as well as enabling research with novel digital parameters recorded over time

Analysis of Argonaute-Small RNA-Transcription Factor Circuits Controlling Leaf Development

Experimental studies of plant development have yielded many insights into gene regulation, revealing interactions between core transcriptional and post-transcriptional regulatory pathways present in all land plants. This work describes a direct connection between the three main small RNA-transcription factor circuits controlling leaf shape dynamics in the reference plant Arabidopsis thaliana. We used a high-throughput yeast 1-hybrid platform to identify factors directly binding the promoter of the highly specialized ARGONAUTE7 silencing factor. Two groups of developmentally significant microRNA-targeted transcription factors were the clearest hits from these screens, but transgenic complementation analysis indicated that their binding sites make only a small contribution to ARGONAUTE7 function, possibly indicating a role in fine tuning. Timelapse imaging methodology developed to quantify these small differences may have broad utility for plant biologists. Our analysis also clarified requirements for polar transcription of ARGONAUTE7. This work has implications for our understanding of patterning in land plants

Citizen crowds and experts: observer variability in image-based plant phenotyping

Background:Image-based plant phenotyping has become a powerful tool in unravelling genotype–environment interactions. The utilization of image analysis and machine learning have become paramount in extracting data stemming from phenotyping experiments. Yet we rely on observer (a human expert) input to perform the phenotyping process. We assume such input to be a ‘gold-standard’ and use it to evaluate software and algorithms and to train learning-based algorithms. However, we should consider whether any variability among experienced and non-experienced (including plain citizens) observers exists. Here we design a study that measures such variability in an annotation task of an integer-quantifiable phenotype: the leaf count.Results:We compare several experienced and non-experienced observers in annotating leaf counts in images of Arabidopsis Thaliana to measure intra- and inter-observer variability in a controlled study using specially designed annotation tools but also citizens using a distributed citizen-powered web-based platform. In the controlled study observers counted leaves by looking at top-view images, which were taken with low and high resolution optics. We assessed whether the utilization of tools specifically designed for this task can help to reduce such variability. We found that the presence of tools helps to reduce intra-observer variability, and that although intra- and inter-observer variability is present it does not have any effect on longitudinal leaf count trend statistical assessments. We compared the variability of citizen provided annotations (from the web-based platform) and found that plain citizens can provide statistically accurate leaf counts. We also compared a recent machine-learning based leaf counting algorithm and found that while close in performance it is still not within inter-observer variability.Conclusions:While expertise of the observer plays a role, if sufficient statistical power is present, a collection of non-experienced users and even citizens can be included in image-based phenotyping annotation tasks as long they are suitably designed. We hope with these findings that we can re-evaluate the expectations that we have from automated algorithms: as long as they perform within observer variability they can be considered a suitable alternative. In addition, we hope to invigorate an interest in introducing suitably designed tasks on citizen powered platforms not only to obtain useful information (for research) but to help engage the public in this societal important problem

Imaging as a tool to study leaf development in Arabidopsis thaliana

In contrast to humans and animals, the body plan of a plant is not completely defined within the embryonic stages. Organ formation continues throughout plant development and this iterative and modular process is continuously controlled by environmental cues such as light, gravity, temperature, humidity and chemicals. In most plant species, the above-ground plant body is dominated by leaves, the organs specialized in photosynthesis. This process converts carbon dioxide into organic components utilizing energy from sunlight; making leaves the energy production site and the growth engine of plants. In addition, in many cases the majority of a plant’s biomass consists of leaves, also making them important organs for the production of food, feed and bio-energy. The final leaf size is determined by the total number of cells and the average cell size that result from cell division and cell expansion, respectively. During leaf development of dicotyledonous species, a cell proliferation phase, characterized by actively dividing cells, is followed by a cell expansion phase, characterized by cell growth and differentiation. After expansion, cells mature and the final leaf size is reached. At the proliferation-to-expansion phase transition, cell division ceases along a longitudinal gradient from leaf tip to base. In this thesis, we set out to gain further insight in these developmental processes affecting leaf size, assisted by the use of imaging technology and automated image analysis. For these studies we used the model species Arabidopsis thaliana, focusing primarily on the epidermis of the developing leaves as divisions there are strictly anticlinal. Moreover this layer is thought to be the main tissue layer controlling leaf growth. As a first step, we developed different image analysis tools to allow for a better and more efficient analysis of the leaf developmental process. In the first place we developed an online framework, designated Leaf Image Analysis Interface (LIMANI), in which venation patterns are automatically segmented and measured on dark-field images. Image segmentation may be manually corrected through use of an interactive interface, allowing supervision and rectification steps in the automated image analysis pipeline and ensuring high-fidelity analysis. We subsequently used this framework to study vascular differentiation during leaf development and to analyze the venation pattern in transgenic lines with contrasting cellular and leaf size traits. A major conclusion from this work was that, as vascular differentiation occurs relatively late in development, the influence of a fully functional and differentiated venation pattern on final leaf size is rather limited. Furthermore, we describe a proof-of-concept to automate the kinematic analysis of leaf growth based on DIC pictures, by a sophisticated image processing chain and a data analysis pipeline. Next, we also developed imaging scripts to extract complete seedlings grown on soil and on Petri dishes and integrated those into three phenotyping platforms which monitor plant growth. Finally, we investigated the potential of emerging imaging technologies, particularly X-ray computed tomography, for future applications in plant growth analysis. The newly developed kinematic analysis tools allowed us to show that the transcription factors, SHORT-ROOT (SHR) and SCARECROW (SCR), next to their specific roles in cortex/endodermis differentiation and stem cell maintenance in the root, primarily function as general regulators of cell proliferation in leaves. The analysis of leaf growth revealed how these proteins affect the cellular growth dynamics and formed the basis to unravel the molecular mechanism controlling this. It turned out that they promote leaf growth mainly by the down-regulation of cell cycle inhibitors, known to restrain the activity of the transcription factor, E2Fa, stimulating S-phase progression. Although the dynamics of cell division and cell expansion processes can be analyzed rigorously by the leaf growth kinematics, knowledge of cell cycle duration, cell expansion, and their interaction at the individual cell level is still poorly understood, not only because of technical obstacles to study these phenomena, but also because the processes are intimately intertwined, shown by the fact that a reduced cell proliferation is often compensated by an increase in cell size and vice versa. A mathematical model fitted to detailed cellular measurements retrieved by automated image analysis of microscopic drawings of the leaf epidermis, revealed that average cell cycle duration remains constant throughout leaf development. Surprisingly, no evidence for a maximum cell size threshold for cell division of pavement cells was found in this analysis. We could estimate the division and expansion parameters of pavement and guard cell populations within the growing leaf separately and the model predicted that neighboring cells of different sizes within the epidermis expand at distinctly different relative rates. We could finally verify this by direct observations using live imaging. The mathematical model helped us to gain a better and more detailed insight into the processes that define leaf growth. But the transition from cell proliferation to cell expansion was a developmental time point that was still not characterized in detail. Differences in the timing of this transition strongly affects the number of cells formed and therefore potentially also serves as a control point determining mature leaf size. Several genes have been identified that alter leaf size by affecting the transition from primary to secondary morphogenesis. We characterized the progression of the transition on the morphological and molecular level using transcriptome analysis and imaging algorithms to visualize and quantify the size and shape of pavement cells along the proximal-distal axis of the leaf during transition. Both analyses showed that the transition from cell proliferation to expansion was established and abolished abruptly. Furthermore, the establishment of the cell cycle arrest front occurs simultaneously with the onset of photomorphogenesis. We provide evidence that retrograde signaling from chloroplasts can affect the onset of transition, revealing a previously unknown level of regulatory complexity during the transition from primary to secondary morphogenesis

Dissecting the rules underlying de novo centrosome biogenesis

"The centrosome is the main microtubule organising centre (MTOC) in animal cells, regulating cell motility and polarity during interphase and organising the mitotic spindle in mitosis. Each centrosome has two centrioles, a mother and a daughter, which are surrounded by a multi-layered protein network called pericentriolar material (PCM) (Loncarek and Bettencourt-Dias, 2018; Nigg and Holland, 2018). The PCM contains critical components that anchor and nucleate microtubules (MTs). Centriole biogenesis is a highly regulated process that occurs only once per cell-cycle in proliferating cells (Breslow and Holland, 2019).(...)