Semi-local extraction of ring structures in images of biological hard tissues: application to the Bayesian interpretation of fish otoliths for age and growth estimation

International audienceThis paper deals with the analysis of images of biological tissue that involves ring structures, such as tree trunks, bivalve seashells or fish otoliths, with a view to automating the acquisition of age and growth data. A bottom-up template-based scheme extracts meaningfulridge and valley curve data using growth-adapted time-frequency filtering. Age and growth estimation is then stated as the Bayesian selection of a subset of ring curves, combining ameasure of curve significativity and ana prioristatistical growth model. Experiments on realsamples demonstrate the efficiency of the proposed extraction stage. Our Bayesian frameworkis shown to significantly outperform previous methods for the interpretation of a dataset of200 plaice otoliths and compares favorably to inter-expert agreement rates (88% of agreement to expert interpretations)

Digital imaging techniques in otolith data capture, analysis and interpretation

Otoliths or ear-stones are hard, calcium carbonate structures located within the inner ear of bony fishes. Counts of rings and measurements of seasonal growth increments from otoliths are important metrics for assessment and management of fish stocks, and the preparation and microscopic analysis of otoliths forms an essential part of the routine work undertaken by fisheries scientists worldwide. Otolith analysis is a skilled task requiring accuracy and precision, but it is laborious, time-consuming to perform, and represents a significant cost to fisheries management. In the last 2 decades, several attempts to apply ‘computer vision’ (systems that perform high-level tasks and exhibit intelligent behaviour) in otolith analysis have been reported. Although considerable progress has been made and several prototype systems developed, laboratories have been reluctant to adopt image-based computer-assisted age and growth estimation (CAAGE) systems. This paper surveys applications of CAAGE, focusing on their utility for automated ageing using images of otolith macrostructure. A cost-benefit analysis of CAAGE of cod, plaice and anchovy shows that computer vision performs relatively poorly compared with morphometric techniques. However, there is evidence that information from visual features can boost the performance of morphometric CAAGE, and further work is needed to develop effective frameworks for this integrated approach. The cost benefit of these systems might be attractive to smaller laboratories that are already using age-length keys derived from otolith morphometrics for management of smaller artisanal fisheries

Automated fish age estimation from otolith images using statistical learning

International audienceThe acquisition of age and growth data is of key importance for fisheries research (assessment, marine ecology issues, etc.). Consequently, automating this task is of great interest. In this paper, we investigate the use of statistical learning techniques for fish age estimation. The core of this study lies in the definition of relevant image-related features. We rely on the computation of a 1D representation summing up the content of otolith images within a predefined area of interest. Features are then extracted from this non-stationary representation depicting the alternation of seasonal growth rings. Thus, fish age estimation can be viewed as a multi-class classification issue using statistical learning strategies. In particular, a procedure based on demodulation and remodulation of fish growth patterns is used to improve the generalization properties of the trained classifiers. The experimental evaluation is carried out over a dataset of 320 plaice otolith images from age groups 1–6. We analyze both, the performances of several statistical classifiers, namely SVMs (support vector machines) and neural networks, and the relevance of the proposed image-based feature sets. In addition, the combination of additional biological and shape features to the image-related ones is considered. We reach a rate of correct age estimation of 88% w.r.t. the expert ground truth. This demonstrates the relevance of the proposed approach for the automation of routine aging and for computer-assisted aging

Automatic fish ageing from otolith images using statistical learning.

International audienceWe investigate the use of statistical learning techniques for fish age estimation from otolith images. The core of this study lies in the definition of relevant image-related features. We rely on the characterization of a 1D signal summing up the image content within a predefined area of interest. Fish age estimation is then viewed as a multi-class classification issue using neural networks and SVMs. A procedure based on demodulation and remodulation of fish growth patterns is used to improve the generalization properties of the trained classifiers. We also investigate the combination of additional biological and shape features to the image-related ones. The performances are evaluated for a database of several hundred of plaice otoliths

On the automatic detection of otolith features for fish species identification and their age estimation

This thesis deals with the automatic detection of features in signals, either extracted from photographs or captured by means of electronic sensors, and its possible application in the detection of morphological structures in fish otoliths so as to identify species and estimate their age at death. From a more biological perspective, otoliths, which are calcified structures located in the auditory system of all teleostean fish, constitute one of the main elements employed in the study and management of marine ecology. In this sense, the application of Fourier descriptors to otolith images, combined with component analysis, is habitually a first and a key step towards characterizing their morphology and identifying fish species. However, some of the main limitations arise from the poor interpretation that can be obtained with this representation and the use that is made of the coefficients, as generally they are selected manually for classification purposes, both in quantity and representativity. The automatic detection of irregularities in signals, and their interpretation, was first addressed in the so-called Best-Basis paradigm. In this sense, Saito's Local discriminant Bases algorithm (LDB) uses the Discrete Wavelet Packet Transform (DWPT) as the main descriptive tool for positioning the irregularities in the time-frequency space, and an energy-based discriminant measure to guide the automatic search of relevant features in this domain. Current density-based proposals have tried to overcome the limitations of the energy-based functions with relatively little success. However, other measure strategies more consistent with the true classification capability, and which can provide generalization while reducing the dimensionality of features, are yet to be developed. The proposal of this work focuses on a new framework for one-dimensional signals. An important conclusion extracted therein is that such generalization involves a mesure system of bounded values representing the density where no class overlaps. This determines severely the selection of features and the vector size that is needed for proper class identification, which must be implemented not only based on global discriminant values but also on the complementary information regarding the provision of samples in the domain. The new tools have been used in the biological study of different hake species, yielding good classification results. However, a major contribution lies on the further interpretation of features the tool performs, including the structure of irregularities, time-frequency position, extension support and degree of importance, which is highlighted automatically on the same images or signals. As for aging applications, a new demodulation strategy for compensating the nonlinear growth effect on the intensity profile has been developed. Although the method is, in principle, able to adapt automatically to the specific growth of individual specimens, preliminary results with LDB-based techniques suggest to study the effect of lighting conditions on the otoliths in order to design more reliable techniques for reducing image contrast variation. In the meantime, a new theoretic framework for otolith-based fish age estimation has been presented. This theory suggests that if the true fish growth curve is known, the regular periodicity of age structures in the demodulated profile is related to the radial length the original intensity profile is extracted from. Therefore, if this periodicity can be measured, it is possible to infer the exact fish age omitting feature extractors and classifiers. This could have important implications in the use of computational resources anc current aging approaches.El eje principal de esta tesis trata sobre la detección automática de singularidades en señales, tanto si se extraen de imágenes fotográ cas como si se capturan de sensores electrónicos, así como su posible aplicación en la detección de estructuras morfológicas en otolitos de peces para identi car especies, y realizar una estimación de la edad en el momento de su muerte. Desde una vertiente más biológica, los otolitos, que son estructuras calcáreas alojadas en el sistema auditivo de todos los peces teleósteos, constituyen uno de los elementos principales en el estudio y la gestión de la ecología marina. En este sentido, el uso combinado de descriptores de Fourier y el análisis de componentes es el primer paso y la clave para caracterizar su morfología e identi car especies marinas. Sin embargo, una de las limitaciones principales de este sistema de representación subyace en la interpretación limitada que se puede obtener de las irregularidades, así como el uso que se hace de los coe cientes en tareas de clasi cación que, por lo general, acostumbra a seleccionarse manualmente tanto por lo que respecta a la cantidad y a su importancia. La detección automática de irregularidades en señales, y su interpretación, se abordó por primera bajo el marco del Best-Basis paradigm. En este sentido, el algoritmo Local Discriminant Bases (LDB) de N. Saito utiliza la Transformada Wavelet Discreta (DWT) para describir el posicionamiento de características en el espacio tiempo-frecuencia, y una medida discriminante basada en la energía para guiar la búsqueda automática de características en dicho dominio. Propuestas recientes basadas en funciones de densidad han tratado de superar las limitaciones que presentaban las medidas de energía con un éxito relativo. No obstante, todavía están por desarrollar nuevas estrategias más consistentes con la capacidad real de clasi cación y que ofrezcan mayor generalización al reducir la dimensión de los datos de entrada. La propuesta de este trabajo se centra en un nuevo marco para señales unidimensionales. Una conclusión principal que se extrae es que dicha generalización pasa por un marco de medidas de valores acotados que re ejen la densidad donde las clases no se solapan. Esto condiciona severamente el proceso de selección de características y el tamaño del vector necesario para identi car las clases correctamente, que se ha de establecer no sólo en base a valores discriminantes globales sino también en la información complementaria sobre la disposición de las muestras en el dominio. Las nuevas herramientas han sido utilizadas en el estudio biológico de diferentes especies de merluza, donde se han conseguido buenos resultados de identi cación. No obstante, la contribución principal subyace en la interpretación que dicha herramienta hace de las características seleccionadas, y que incluye la estructura de las irregularidades, su posición temporal-frecuencial, extensión en el eje y grado de relevancia, el cual, se resalta automáticamente sobre la misma imagen o señal. Por lo que respecta a la determinación de la edad, se ha planteado una nueva estrategia de demodulación para compensar el efecto del crecimiento no lineal en los per les de intensidad. Inicialmente, aunque el método implementa un proceso de optimización capaz de adaptarse al crecimiento individual de cada pez automáticamente, resultados preliminares obtenidos con técnicas basadas en el LDB sugieren estudiar el efecto de las condiciones lumínicas sobre los otolitos con el n de diseñar algoritmos que reduzcan la variación del contraste de la imagen más ablemente. Mientras tanto, se ha planteado una nueva teoría para estimar la edad de los peces en base a otolitos. Esta teoría sugiere que si la curva de crecimiento real del pez se conoce, el período regular de los anillos en el per l demodulado está relacionado con la longitud total del radio donde se extrae el per l original. Por tanto, si dicha periodicidad es medible, es posible determinar la edad exacta sin necesidad de utilizar extractores de características o clasi cadores, lo cual tendría implicaciones importantes en el uso de recursos computacionales y en las técnicas actuales de estimación de la edad.L'eix principal d'aquesta tesi tracta sobre la detecció automàtica d'irregularitats en senyals, tant si s'extreuen de les imatges fotogrà ques com si es capturen de sensors electrònics, així com la seva possible aplicació en la detecció d'estructures morfològiques en otòlits de peixos per identi car espècies, i realitzar una estimació de l'edat en el moment de la seva mort. Des de la vesant més biològica, els otòlits, que son estructures calcàries que es troben en el sistema auditiu de tots els peixos teleostis, constitueixen un dels elements principals en l'estudi i la gestió de l'ecologia marina. En aquest sentit, l'ús combinat de descriptors de Fourier i l'anàlisi de components es el primer pas i la clau per caracteritzar la seva morfologia i identi car espècies marines. No obstant, una de les limitacions principals d'aquest sistema de representació consisteix en la interpretació limitada de les irregularitats que pot desenvolupar, així com l'ús que es realitza dels coe cients en tasques de classi cació, els quals, acostumen a ser seleccionats manualment tant pel que respecta a la quantitat com la seva importància. La detecció automàtica d'irregularitats en senyals, així com la seva interpretació, es va tractar per primera vegada sota el marc del Best-Basis paradigm. En aquest sentit, l'algorisme Local Discriminant Bases (LDB) de N. Saito es basa en la Transformada Wavelet Discreta (DWT) per descriure el posicionament de característiques dintre de l'espai temporal-freqüencial, i en una mesura discriminant basada en l'energia per guiar la cerca automàtica de característiques dintre d'aquest domini. Propostes més recents basades en funcions de densitat han tractat de superar les limitacions de les mesures d'energia amb un èxit relatiu. No obstant, encara s'han de desenvolupar noves estratègies que siguin més consistents amb la capacitat real de classi cació i ofereixin més generalització al reduir la dimensió de les dades d'entrada. La proposta d'aquest treball es centra en un nou marc per senyals unidimensionals. Una de las conclusions principals que s'extreu es que aquesta generalització passa per establir un marc de mesures acotades on els valors re ecteixin la densitat on cap classe es solapa. Això condiciona bastant el procés de selecció de característiques i la mida del vector necessari per identi car les classes correctament, que s'han d'establir no només en base a valors discriminants globals si no també en informació complementària sobre la disposició de les mostres en el domini. Les noves eines s'han utilitzat en diferents estudis d'espècies de lluç, on s'han obtingut bons resultats d'identi cació. No obstant, l'aportació principal consisteix en la interpretació que l'eina extreu de les característiques seleccionades, i que inclou l'estructura de les irregularitats, la seva posició temporal-freqüencial, extensió en l'eix i grau de rellevància, el qual, es ressalta automàticament sobre les mateixa imatge o senyal. En quan a l'àmbit de determinació de l'edat, s'ha plantejat una nova estratègia de demodulació de senyals per compensar l'efecte del creixement no lineal en els per ls d'intensitat. Tot i que inicialment aquesta tècnica desenvolupa un procés d'optimització capaç d'adaptar-se automàticament al creixement individual de cada peix, els resultats amb el LDB suggereixen estudiar l'efecte de les condicions lumíniques sobre els otòlits amb la nalitat de dissenyar algorismes que redueixin la variació del contrast de les imatges més ablement. Mentrestant s'ha plantejat una nova teoria per realitzar estimacions d'edat en peixos en base als otòlits. Aquesta teoria suggereix que si la corba de creixement és coneguda, el període regular dels anells en el per l d'intensitat demodulat està relacionat amb la longitud total de radi d'on s'agafa el per l original. Per tant, si la periodicitat es pot mesurar, es possible conèixer l'edat exacta del peix sense usar extractors de característiques o classi cadors, la qual cosa tindria implicacions importants en l'ús de recursos computacionals i en les tècniques actuals d'estimació de l'edat.Postprint (published version

Mesopelagic fishes dominate otolith record of past two millennia in the Santa Barbara Basin.

The mesopelagic (200-1000 m) separates the productive upper ocean from the deep ocean, yet little is known of its long-term dynamics despite recent research that suggests fishes of this zone likely dominate global fish biomass and contribute to the downward flux of carbon. Here we show that mesopelagic fishes dominate the otolith (ear bone) record in anoxic sediment layers of the Santa Barbara Basin over the past two millennia. Among these mesopelagic fishes, otoliths from families Bathylagidae (deep-sea smelts) and Myctophidae (lanternfish) are most abundant. Otolith deposition rate fluctuates at decadal to centennial time scales and covaries with proxies for upper ocean temperature, consistent with climate forcing. Moreover, otolith deposition rate and proxies for temperature and primary productivity show contemporaneous discontinuities during the Medieval Climate Anomaly and Little Ice Age. Mesopelagic fishes may serve as proxies for future climatic influence at those depths including effects on the carbon cycle

Hake age estimation: state of the art and progress towards a solution

Since 1992, northern and southern hake (Merluccius merluccius) stock assessments have used age data based on otolith analysis. Age data for stock assessment is provided by different institutions, which implies a quantification of age‐reading precision to estimate assessment quality indicators. During this period, considerable effort has been made to improve the precision of age data by means of successive agereading calibration exercises, exchanges, and workshops in 1997, 1999, 2001, and 2004. This goal was partly achieved, and experts recently agreed on standard criteria (Piñeiro and Saínza, 2003) that allowed an acceptable precision to be reached for ages up to 3 years (Piñeiro et al., 2004). However, these criteria have never been validated, and recent mark ‒ recapture experiments are not in line with ageing results based on the standard criteria. Given the impact of bias in age estimation on stock assessment results, consequent management advice, and concern about the state of the hake stocks (ICES, 2007a, 2007b), a report on the current state of the art is needed. The main goal of this report is to present a synthesis of the work carried out over the years by researchers involved in providing age data for stock assessment, mainly on age‐reading calibration exercises, and current knowledge regarding the growth and ageing of this species. This report also includes recommendations for future work aimed at achieving validated age‐reading criteria

Age determination procedures for pelagic and benthic species from ICES area in Spanish Institute of Oceanography (IEO)

This handbook presents a summary of the age estimation procedures used in Spanish Institute of Oceanography (IEO) for some of the main commercial small and medium pelagic species and benthic species of the Spanish fleet. It provides information about the sampling program, otolith extraction and preparation, and the age estimation criteria. A summary of the information related to the age accuracy, validation and corroboration of each species is also presented, as well as that related to the age precision, quality control and verification

Extraction and interpretation of ring structures in images of biological hard tissues: application to fish age and growth estimation.

International audienceThis paper presents a general framework for the automated estimation of age and growth from images of biological materials depicting concentric ring-like structures such as tree trunks, corals, bivalve seashells, fish scales or otoliths. This interpretation task can be seen as a ring segmentation issue, where growth rings are associated to image ridge and valley structures. This is stated as the Bayesian selection of a subset of partial ring curves extracted using a semi-local template-based growth-adapted scheme. The application to fish otolith interpretation provides a consistent and convincing validation of the proposed framework

Unsupervised Bayesian reconstruction of individual life histories from otolith signatures : case study of Sr : Ca transects of eel (Anguilla anguilla) otoliths

International audienc