Automating three-dimensional osteoarthritis histopathological grading of human osteochondral tissue using machine learning on contrast-enhanced micro-computed tomography

Abstract. Osteoarthritis (OA) is a joint disease affecting hundreds of millions of people worldwide. In basic research, accurate ex vivo measures are needed for assessing OA severity. The standard method for this is the histopathological grading of stained thin tissue sections. However, the methods are destructive, time-consuming, do not describe the full sample volume and provide subjective results. Contrast-enhanced micro-computed tomography (CEμCT) -based grading with phosphotungstic acid -stain was previously developed to address some of these issues. Aim of this study was to investigate the possibility of automating this process. Osteochondral tissue cores were harvested from total knee arthroplasty patients (n = 34, N = 19, Ø = 2 mm, n = 15, N = 5, Ø = 4 mm) and asymptomatic cadavers (n = 30, N = 2, Ø = 4 mm). Samples were imaged with CEμCT, reconstructed and graded manually. Subsequently, the reconstructions were loaded into an ad hoc developed Python software, where volumes-of-interest (VOI) were extracted from different cartilage zones: surface zone (SZ), deep zone (DZ) and calcified zone (CZ) and collapsed into two-dimensional texture images. Normalized images underwent Median Robust Extended Local Binary Pattern (MRELBP) -algorithm to extract the features, with subsequent dimensionality reduction. Ridge and logistic regression models were trained with L2 regularization against the ground truth for the small samples (Ø = 2 mm) using leave-one-patient-out cross-validation. Trained models were then evaluated on the large samples (Ø = 4 mm). Performance of the models were assessed using Spearman’s correlation, Area under the Receiver Operating Characteristic Curve (AUC) and Average Precision (AP). Highest performance on both models was for the SZ. Strong correlation was observed on ridge regression (ρ = 0.68, p < 0.0001), as well as high AUC and AP values for the logistic regression (AUC = 0.92, AP = 0.89) for the small samples. Using the large samples, similar findings were observed with slightly reduced values (ρ = 0.55, p = 0.0001, AUC = 0.86, AP = 0.89). Moderate results were observed for CZ and DZ models (ρ = 0.54 and 0.38, AUC = 0.77 and 0.72, AP = 0.71 and 0.50, respectively). Evaluation on the large samples resulted in performance decrease on CZ models (ρ = 0.29, AUC = 0.63, AP = 0.62), while surprisingly performance increased on DZ logistic regression model (ρ = 0.34, AUC = 0.72, AP = 0.83). Obtained results indicate that automating the 3D CEμCT histopathological grading is feasible. However, with low number of samples, models are better suited for binary detection of sample degenerative features, rather than predicting a detailed grade. To facilitate model generalization on new data, similar data acquisition protocol should be used on all samples. The proposed methods have potential to aid OA researchers and pathologists in 3D histopathological grading, introducing more objectivity to the grading process. This thesis presents the conducted study in detail, and provides an extensive review related to the osteochondral unit, CEμCT imaging, as well as statistical learning machines

A Survey on Deep Learning in Medical Image Analysis

Deep learning algorithms, in particular convolutional networks, have rapidly become a methodology of choice for analyzing medical images. This paper reviews the major deep learning concepts pertinent to medical image analysis and summarizes over 300 contributions to the field, most of which appeared in the last year. We survey the use of deep learning for image classification, object detection, segmentation, registration, and other tasks and provide concise overviews of studies per application area. Open challenges and directions for future research are discussed.Comment: Revised survey includes expanded discussion section and reworked introductory section on common deep architectures. Added missed papers from before Feb 1st 201

Detection of osteoporosis in lumbar spine [L1-L4] trabecular bone: a review article

The human bones are categorized based on elemental micro architecture and porosity. The porosity of the inner trabecular bone is high that is 40-95% and the nature of the bone is soft and spongy where as the cortical bone is harder and is less porous that is 5 to 15%. Osteoporosis is a disease that normally affects women usually after their menopause. It largely causes mild bone fractures and further stages lead to the demise of an individual. This analysis is on the basis of bone mineral density (BMD) standards obtained through a variety of scientific methods experimented from different skeletal regions. The detection of osteoporosis in lumbar spine has been widely recognized as a promising way to frequent fractures. Therefore, premature analysis of osteoporosis will estimate the risk of the bone fracture which prevents life threats. This paper focuses on the advanced technology in imaging systems and fracture probability analysis of osteoporosis detection. The various segmentation techniques are explored to examine osteoporosis in particular region of the image and further significant attributes are extracted using different methods to classify normal and abnormal (osteoporotic) bones. The limitations of the reviewed papers are more in feature dimensions, lesser accuracy and expensive imaging modalities like computed tomography (CT), magnetic resonance imaging (MRI), and DEXA. To overcome these limitations it is suggested to have less feature dimensions, more accuracy and cost-effective imaging modality like X-ray. This is required to avoid bone fractures and to improve BMD with precision which further helps in the diagnosis of osteoporosis

Texture analysis and Its applications in biomedical imaging: a survey

Texture analysis describes a variety of image analysis techniques that quantify the variation in intensity and pattern. This paper provides an overview of several texture analysis approaches addressing the rationale supporting them, their advantages, drawbacks, and applications. This survey’s emphasis is in collecting and categorising over five decades of active research on texture analysis.Brief descriptions of different approaches are presented along with application examples. From a broad range of texture analysis applications, this survey’s final focus is on biomedical image analysis. An up-to-date list of biological tissues and organs in which disorders produce texture changes that may be used to spot disease onset and progression is provided. Finally, the role of texture analysis methods as biomarkers of disease is summarised.Manuscript received February 3, 2021; revised June 23, 2021; accepted September 21, 2021. Date of publication September 27, 2021; date of current version January 24, 2022. This work was supported in part by the Portuguese Foundation for Science and Technology (FCT) under Grants PTDC/EMD-EMD/28039/2017, UIDB/04950/2020, PestUID/NEU/04539/2019, and CENTRO-01-0145-FEDER-000016 and by FEDER-COMPETE under Grant POCI-01-0145-FEDER-028039. (Corresponding author: Rui Bernardes.)info:eu-repo/semantics/publishedVersio

Machine Learning/Deep Learning in Medical Image Processing

Many recent studies on medical image processing have involved the use of machine learning (ML) and deep learning (DL). This special issue, “Machine Learning/Deep Learning in Medical Image Processing”, has been launched to provide an opportunity for researchers in the area of medical image processing to highlight recent developments made in their fields with ML/DL. Seven excellent papers that cover a wide variety of medical/clinical aspects are selected in this special issue

Machine learning-based automated segmentation with a feedback loop for 3D synchrotron micro-CT

Die Entwicklung von Synchrotronlichtquellen der dritten Generation hat die Grundlage für die Untersuchung der 3D-Struktur opaker Proben mit einer Auflösung im Mikrometerbereich und höher geschaffen. Dies führte zur Entwicklung der Röntgen-Synchrotron-Mikro-Computertomographie, welche die Schaffung von Bildgebungseinrichtungen zur Untersuchung von Proben verschiedenster Art förderte, z.B. von Modellorganismen, um die Physiologie komplexer lebender Systeme besser zu verstehen. Die Entwicklung moderner Steuerungssysteme und Robotik ermöglichte die vollständige Automatisierung der Röntgenbildgebungsexperimente und die Kalibrierung der Parameter des Versuchsaufbaus während des Betriebs. Die Weiterentwicklung der digitalen Detektorsysteme führte zu Verbesserungen der Auflösung, des Dynamikbereichs, der Empfindlichkeit und anderer wesentlicher Eigenschaften. Diese Verbesserungen führten zu einer beträchtlichen Steigerung des Durchsatzes des Bildgebungsprozesses, aber auf der anderen Seite begannen die Experimente eine wesentlich größere Datenmenge von bis zu Dutzenden von Terabyte zu generieren, welche anschließend manuell verarbeitet wurden. Somit ebneten diese technischen Fortschritte den Weg für die Durchführung effizienterer Hochdurchsatzexperimente zur Untersuchung einer großen Anzahl von Proben, welche Datensätze von besserer Qualität produzierten. In der wissenschaftlichen Gemeinschaft besteht daher ein hoher Bedarf an einem effizienten, automatisierten Workflow für die Röntgendatenanalyse, welcher eine solche Datenlast bewältigen und wertvolle Erkenntnisse für die Fachexperten liefern kann. Die bestehenden Lösungen für einen solchen Workflow sind nicht direkt auf Hochdurchsatzexperimente anwendbar, da sie für Ad-hoc-Szenarien im Bereich der medizinischen Bildgebung entwickelt wurden. Daher sind sie nicht für Hochdurchsatzdatenströme optimiert und auch nicht in der Lage, die hierarchische Beschaffenheit von Proben zu nutzen. Die wichtigsten Beiträge der vorliegenden Arbeit sind ein neuer automatisierter Analyse-Workflow, der für die effiziente Verarbeitung heterogener Röntgendatensätze hierarchischer Natur geeignet ist. Der entwickelte Workflow basiert auf verbesserten Methoden zur Datenvorverarbeitung, Registrierung, Lokalisierung und Segmentierung. Jede Phase eines Arbeitsablaufs, die eine Trainingsphase beinhaltet, kann automatisch feinabgestimmt werden, um die besten Hyperparameter für den spezifischen Datensatz zu finden. Für die Analyse von Faserstrukturen in Proben wurde eine neue, hochgradig parallelisierbare 3D-Orientierungsanalysemethode entwickelt, die auf einem neuartigen Konzept der emittierenden Strahlen basiert und eine präzisere morphologische Analyse ermöglicht. Alle entwickelten Methoden wurden gründlich an synthetischen Datensätzen validiert, um ihre Anwendbarkeit unter verschiedenen Abbildungsbedingungen quantitativ zu bewerten. Es wurde gezeigt, dass der Workflow in der Lage ist, eine Reihe von Datensätzen ähnlicher Art zu verarbeiten. Darüber hinaus werden die effizienten CPU/GPU-Implementierungen des entwickelten Workflows und der Methoden vorgestellt und der Gemeinschaft als Module für die Sprache Python zur Verfügung gestellt. Der entwickelte automatisierte Analyse-Workflow wurde erfolgreich für Mikro-CT-Datensätze angewandt, die in Hochdurchsatzröntgenexperimenten im Bereich der Entwicklungsbiologie und Materialwissenschaft gewonnen wurden. Insbesondere wurde dieser Arbeitsablauf für die Analyse der Medaka-Fisch-Datensätze angewandt, was eine automatisierte Segmentierung und anschließende morphologische Analyse von Gehirn, Leber, Kopfnephronen und Herz ermöglichte. Darüber hinaus wurde die entwickelte Methode der 3D-Orientierungsanalyse bei der morphologischen Analyse von Polymergerüst-Datensätzen eingesetzt, um einen Herstellungsprozess in Richtung wünschenswerter Eigenschaften zu lenken