Article thumbnail

Categorizing plant images at the variety level: Did you say fine-grained?

By Julien Champ, Titouan Lorieul, Pierre Bonnet, Najate Maghnaoui, Christophe Sereno, Thierry Dessup, Jean-Michel Boursiquot, Laurent AUDEGUIN, Thierry Lacombe and Alexis Joly


UMR AGAP - équipe DAAV - Diversité, adaptation et amélioration de la vigneInternational audienceThis paper addresses the problem of categorizing plant images at the variety level, i.e. at a finer taxonomic grain than state-of-the-art studies usually working at the species level. It therefore introduces two new evaluation datasets of agro-biodiversity interest, each being related to concrete scenarios on large-scale plant resources. They have been chosen so as to involve very different acquisition protocols and visual patterns in order to evaluate if state-of-the-art image classification techniques can generalize to such specific contexts and avoid the cost of building specific ad-hoc solutions. The first one is a collection of 2071 pictures of loose rice seeds built from 95 accessions kept in a bank of seeds. The second one is a collection of 2037 pictures of grape leaves taken in the fields and belonging to 34 varieties among the most commonly ones used in viticulture. Both datasets exhibit a very low inter-class variability resulting in two challenging fine-grained classification tasks, even for expert human operators. A baseline experimental study was conducted on the two datasets using the two most effective families of classification techniques in the state-of-the-art, i.e. convolutional neural networks on one side and fisher vectors-based discriminant models on the other side. It shows that the achieved classification performance is very different between the two problems. It is actually pretty bad for the grape leaves collection but much better in the case of the rice seeds collection for which the acquisition protocol was much more constrained and the morphological variability more visible. The conclusion is that automatically identifying plant varieties might already be feasible for some specific scenarios and in controlled environments but that it is still an open problem in the general case

Topics: Leaf classification, Convolutional neural networks, Seed analysis, Fine grained classification, Fisher vectors-based, Plant variety classification, Agro-biodiversity, [INFO]Computer Science [cs], [SDV.BID.SPT]Life Sciences [q-bio]/Biodiversity/Systematics, Phylogenetics and taxonomy, [SDV.EE.ECO]Life Sciences [q-bio]/Ecology, environment/Ecosystems, [SDV.BV.BOT]Life Sciences [q-bio]/Vegetal Biology/Botanics, [SDE.BE]Environmental Sciences/Biodiversity and Ecology
Publisher: 'Elsevier BV'
Year: 2016
DOI identifier: 10.1016/j.patrec.2016.05.022
OAI identifier: oai:HAL:lirmm-01348914v1
Provided by: HAL-CIRAD
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • (external link)
  • (external link)
  • (external link)
  • (external link)
  • (external link)
  • Suggested articles

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.