A photometric stereo-based 3D imaging system using computer vision and deep learning for tracking plant growth

© The Author(s) 2019. Published by Oxford University Press. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. Background: Tracking and predicting the growth performance of plants in different environments is critical for predicting the impact of global climate change. Automated approaches for image capture and analysis have allowed for substantial increases in the throughput of quantitative growth trait measurements compared with manual assessments. Recent work has focused on adopting computer vision and machine learning approaches to improve the accuracy of automated plant phenotyping. Here we present PS-Plant, a low-cost and portable 3D plant phenotyping platform based on an imaging technique novel to plant phenotyping called photometric stereo (PS). Results: We calibrated PS-Plant to track the model plant Arabidopsis thaliana throughout the day-night (diel) cycle and investigated growth architecture under a variety of conditions to illustrate the dramatic effect of the environment on plant phenotype. We developed bespoke computer vision algorithms and assessed available deep neural network architectures to automate the segmentation of rosettes and individual leaves, and extract basic and more advanced traits from PS-derived data, including the tracking of 3D plant growth and diel leaf hyponastic movement. Furthermore, we have produced the first PS training data set, which includes 221 manually annotated Arabidopsis rosettes that were used for training and data analysis (1,768 images in total). A full protocol is provided, including all software components and an additional test data set. Conclusions: PS-Plant is a powerful new phenotyping tool for plant research that provides robust data at high temporal and spatial resolutions. The system is well-suited for small- and large-scale research and will help to accelerate bridging of the phenotype-to-genotype gap

Unmanned Aerial Vehicles (UAVs) in environmental biology: A Review

Acquiring information about the environment is a key step during each study in the field of environmental biology at different levels, from an individual species to community and biome. However, obtaining information about the environment is frequently difficult because of, for example, the phenological timing, spatial distribution of a species or limited accessibility of a particular area for the field survey. Moreover, remote sensing technology, which enables the observation of the Earth’s surface and is currently very common in environmental research, has many limitations such as insufficient spatial, spectral and temporal resolution and a high cost of data acquisition. Since the 1990s, researchers have been exploring the potential of different types of unmanned aerial vehicles (UAVs) for monitoring Earth’s surface. The present study reviews recent scientific literature dealing with the use of UAV in environmental biology. Amongst numerous papers, short communications and conference abstracts, we selected 110 original studies of how UAVs can be used in environmental biology and which organisms can be studied in this manner. Most of these studies concerned the use of UAV to measure the vegetation parameters such as crown height, volume, number of individuals (14 studies) and quantification of the spatio-temporal dynamics of vegetation changes (12 studies). UAVs were also frequently applied to count birds and mammals, especially those living in the water. Generally, the analytical part of the present study was divided into following sections: (1) detecting, assessing and predicting threats on vegetation, (2) measuring the biophysical parameters of vegetation, (3) quantifying the dynamics of changes in plants and habitats and (4) population and behaviour studies of animals. At the end, we also synthesised all the information showing, amongst others, the advances in environmental biology because of UAV application. Considering that 33% of studies found and included in this review were published in 2017 and 2018, it is expected that the number and variety of applications of UAVs in environmental biology will increase in the future

Estimation of Vegetative Growth in Strawberry Plants Using Mobile LiDAR Laser Scanner

Monitoring of plant vegetative growth can provide the basis for precise crop management. In this study, a 2D light detection and ranging (LiDAR) laser scanner, mounted on a linear conveyor, was used to acquire multi-temporal three-dimensional (3D) data from strawberry plants (‘Honeoye’ and ‘Malling Centenary’) 14–77 days after planting (DAP). Canopy geometrical variables, i.e., points per plant, height, ground projected area, and canopy volume profile, were extracted from 3D point cloud. The manually measured leaf area exhibited a linear relationship with LiDAR-derived parameters (R2 = 0.98, 0.90, 0.93, and 0.96 with number of points per plant, volume, height, and projected canopy area, respectively). However, the measuring uncertainty was high in the dense canopies. Particularly, the canopy volume estimation was adapted to the plant habitus to remove gaps and empty spaces in the canopy point cloud. The parametric values for maximum point to point distance (Dmax) = 0.15 cm and slice height (S) = 0.10 cm resulted in R² = 0.80 and RMSPE = 26.93% for strawberry plant volume estimation considering actual volume measured by water displacement. The vertical volume profiling provided growth data for cultivars ‘Honeoye’ and ‘Malling Centenary’ being 51.36 cm³ at 77 DAP and 42.18 cm3 at 70 DAP, respectively. The results contribute an approach for estimating plant geometrical features and particularly strawberry canopy volume profile based on LiDAR point cloud for tracking plant growth

Towards a methodical framework for comprehensively assessing forest multifunctionality

Funded by Deutsche Forschungsgemeinschaft. Grant Number: DFG FOR 891/1-3 National Natural Science Foundation of China. Grant Numbers: 30710103907, 30930005, 31170457, 31210103910 Swiss National Science Foundation (SNSF) Sino-German Centre for Research Promotion in Beijing. Grant Number: GZ 986Peer reviewedPublisher PD

Stromule extension along microtubules coordinated with actin-mediated anchoring guides perinuclear chloroplast movement during innate immunity.

Dynamic tubular extensions from chloroplasts called stromules have recently been shown to connect with nuclei and function during innate immunity. We demonstrate that stromules extend along microtubules (MTs) and MT organization directly affects stromule dynamics since stabilization of MTs chemically or genetically increases stromule numbers and length. Although actin filaments (AFs) are not required for stromule extension, they provide anchor points for stromules. Interestingly, there is a strong correlation between the direction of stromules from chloroplasts and the direction of chloroplast movement. Stromule-directed chloroplast movement was observed in steady-state conditions without immune induction, suggesting it is a general function of stromules in epidermal cells. Our results show that MTs and AFs may facilitate perinuclear clustering of chloroplasts during an innate immune response. We propose a model in which stromules extend along MTs and connect to AF anchor points surrounding nuclei, facilitating stromule-directed movement of chloroplasts to nuclei during innate immunity

Constructing living buildings: a review of relevant technologies for a novel application of biohybrid robotics

Biohybrid robotics takes an engineering approach to the expansion and exploitation of biological behaviours for application to automated tasks. Here, we identify the construction of living buildings and infrastructure as a high-potential application domain for biohybrid robotics, and review technological advances relevant to its future development. Construction, civil infrastructure maintenance and building occupancy in the last decades have comprised a major portion of economic production, energy consumption and carbon emissions. Integrating biological organisms into automated construction tasks and permanent building components therefore has high potential for impact. Live materials can provide several advantages over standard synthetic construction materials, including self-repair of damage, increase rather than degradation of structural performance over time, resilience to corrosive environments, support of biodiversity, and mitigation of urban heat islands. Here, we review relevant technologies, which are currently disparate. They span robotics, self-organizing systems, artificial life, construction automation, structural engineering, architecture, bioengineering, biomaterials, and molecular and cellular biology. In these disciplines, developments relevant to biohybrid construction and living buildings are in the early stages, and typically are not exchanged between disciplines. We, therefore, consider this review useful to the future development of biohybrid engineering for this highly interdisciplinary application.publishe

Leveraging Image Analysis for High-Throughput Plant Phenotyping

The complex interaction between a genotype and its environment controls the biophysical properties of a plant, manifested in observable traits, i.e., plant’s phenome, which influences resources acquisition, performance, and yield. High-throughput automated image-based plant phenotyping refers to the sensing and quantifying plant traits non-destructively by analyzing images captured at regular intervals and with precision. While phenomic research has drawn significant attention in the last decade, extracting meaningful and reliable numerical phenotypes from plant images especially by considering its individual components, e.g., leaves, stem, fruit, and flower, remains a critical bottleneck to the translation of advances of phenotyping technology into genetic insights due to various challenges including lighting variations, plant rotations, and self-occlusions. The paper provides (1) a framework for plant phenotyping in a multimodal, multi-view, time-lapsed, high-throughput imaging system; (2) a taxonomy of phenotypes that may be derived by image analysis for better understanding of morphological structure and functional processes in plants; (3) a brief discussion on publicly available datasets to encourage algorithm development and uniform comparison with the state-of-the-art methods; (4) an overview of the state-of-the-art image-based high-throughput plant phenotyping methods; and (5) open problems for the advancement of this research field