A review of arthritis diagnosis techniques in artificial intelligence era: Current trends and research challenges

Deep learning, a branch of artificial intelligence, has achieved unprecedented performance in several domains including medicine to assist with efficient diagnosis of diseases, prediction of disease progression and pre-screening step for physicians. Due to its significant breakthroughs, deep learning is now being used for the diagnosis of arthritis, which is a chronic disease affecting young to aged population. This paper provides a survey of recent and the most representative deep learning techniques (published between 2018 to 2020) for the diagnosis of osteoarthritis and rheumatoid arthritis. The paper also reviews traditional machine learning methods (published 2015 onward) and their application for the diagnosis of these diseases. The paper identifies open problems and research gaps. We believe that deep learning can assist general practitioners and consultants to predict the course of the disease, make treatment propositions and appraise their potential benefits

Early detection of knee osteoarthritis using deep learning on knee magnetic resonance images

The aim of this study was to investigate the influence of MRI and patient data on the prediction of knee osteoarthritis (OA) incidence using different deep learning architectures. Knee OA incidence within 24 months was predicted using the intermediate-weighted turbo spin-echo (IW-TSE) sequence of 593 patients from the Osteoarthritis Initiative. To extract a region of interest containing the knee joint from the IW-TSE sequence, a U-Net model was trained and used to segment bone on a dual echo steady state (DESS) sequence. Subsequently, IW-TSE and DESS sequences were registered and the DESS segmentations were transformed to the corresponding IW-TSE scans. The performance of MRI-based features in the prediction of knee OA incidence was tested using three different deep learning architectures: a residual network (ResNet), a densely connected convolutional network (DenseNet), and a convolutional variational autoencoder (CVAE). To evaluate the predictive performance of MRI-based features alone, the outputs of ResNet, DenseNet, and CVAE were coupled with patient data (i.e., age, gender, BMI) and used as input to a Logistic Regression (LR) Classifier. Knee OA was defined based on visual MRI and X-ray-based OA features. The ResNet and DenseNet showed similar results, with both methods having the area under the receiver operating characteristic curve (AUC) values up to 0.6269. The best performing OA detection model was CVAE with an AUC of 0.6699 when combined with patient data and an AUC of 0.6689 when used alone as input to the LR classifier. The results showed that three deep learning algorithms have similar metrics when using IW-TSE MRIs and their performance increased with the inclusion of patient data, which shows the strong influence of variables such as age, gender, and BMI on the detection of knee OA

Automatic radiographic quantification of hand osteoarthritis; accuracy and sensitivity to change in joint space width in a phantom and cadaver study

This is the final version of the article. Available from Springer Verlag via the DOI in this record.OBJECTIVE: To validate a newly developed quantification method that automatically detects and quantifies the joint space width (JSW) in hand radiographs. Repeatability, accuracy and sensitivity to changes in JSW were determined. The influence of joint location and joint shape on the measurements was tested. METHODS: A mechanical micrometer set-up was developed to define and adjust the true JSW in an acrylic phantom joint and in human cadaver-derived phalangeal joints. Radiographic measurements of the JSW were compared to the true JSW. Repeatability, systematic error (accuracy) and sensitivity (defined as the smallest detectable difference (SDD)) were determined. The influence of joint position on the JSW measurement was assessed by varying the location of the acrylic phantom on the X-ray detector with respect to the X-ray beam and the influence of joint shape was determined by using morphologically different human cadaver joints. RESULTS: The mean systematic error was 0.052 mm in the phantom joint and 0.210 mm in the cadaver experiment. In the phantom experiments, the repeatability was high (SDD = 0.028 mm), but differed slightly between joint locations (p = 0.046), and a change in JSW of 0.037 mm could be detected. Dependent of the joint shape in the cadaver hand, a change in JSW between 0.018 and 0.047 mm could be detected. CONCLUSIONS: The automatic quantification method is sensitive to small changes in JSW. Considering the published data of JSW decline in the normal and osteoarthritic population, the first signs of OA progression with this method can be detected within 1 or 2 years.This work was funded by the Dutch Arthritis Association (Reumafonds). The study sponsor had no involvement in study design, data collection, data analysis, or interpretation of the results

A multi-scale imaging approach to understand osteoarthritis development

X-ray phase-contrast imaging is an innovative and advanced imaging method. Contrary to conventional radiology, where the image contrast is primarily determined by X-ray attenuation, phase-contrast images contain additional information generated by the phase shifts or refraction of the X-rays passing through matter. The refractive effect on tissue samples is orders of magnitude higher than the absorption effect in the X-ray energy range used in biomedical imaging. This technique makes it possible to produce excellent and enhanced image contrast, particularly when examining soft biological tissues or features with similar X-ray attenuation properties. In combination with high spatial resolution detector technology and computer tomography, X-ray phase-contrast imaging has been proved to be a powerful method to examine tissue morphology and the evolution of pathologies three-dimensionally, with great detail and without the need of contrast agents. This Thesis work has focused on developing an accurate, multi-scale X-ray-based methodology for imaging and characterizing the early stages of osteoarthritis. X-ray phase-contrast images acquired at different spatial resolutions provide unprecedented insights into cartilage and the development of its degeneration, i.e., osteoarthritis. Other types of X-ray phase-contrast imaging techniques and setups using spatial resolutions ranging from micrometer down to nanometer were applied. Lower spatial resolutions allow large sample coverage and comprehensive representations, while the nanoscale analysis provides a precise depiction of anatomical details and pathological signs. X-ray phase-contrast results are correlated to data obtained, on the same specimens, by standard laboratory methods, such as histology and transmission electron microscopy. Furthermore, X-ray phase-contrast images of cartilage were acquired using different X-ray sources and results were compared in terms of image quality. It was shown that with the use of synchrotron radiation, more detailed images and much faster data acquisitions could be achieved. A second focus in this Thesis work has been the investigation of the reaction of healthy and degenerated cartilage under different physical pressures, simulating the different levels of stress to which the tissue is subject during daily movements. A specifically designed setup was used to dynamically study cartilage response to varying pressures with X-ray phase-contrast micro-computed tomography, and a fully volumetric and quantitative methodology to accurately describe the tissue morphological variations. This study revealed changes in the behavior of the cartilage cell structure, which differ between normal and osteoarthritic cartilage tissues. The third focus of this Thesis is the realization of an automated evaluation procedure for the discrimination of healthy and cartilage images with osteoarthritis. In recent years, developments in neural networks have shown that they are excellently suited for image classification tasks. The transfer learning method was applied, in which a pre-trained neural network with cartilage images is further trained and then used for classification. This enables a fast, robust and automated grouping of images with pathological findings. A neural network constructed in this way could be used as a supporting instrument in pathology. X-ray phase-contrast imaging computed tomography can provide a powerful tool for a fully 3D, highly accurate and quantitative depiction and characterization of healthy and early stage-osteoarthritic cartilage, supporting the understanding of the development of osteoarthritis.Röntgen-Phasenkontrast-Bildgebung ist eine innovative und weiterführende Bildgebungsmethode. Im Gegensatz zu herkömlichen Absorptions-Röntgenaufnahmen, wie sie in der Radiologie verwendet werden, wird der Kontrast bei dieser Methode aus dem Effekt der Phasenverschiebung oder auch Brechung der Röngtenstrahlen gebildet. Der Brechungseffekt bei Gewebeproben ist um ein Vielfaches höher als der Absorptionseffekt des elektromagnetischen Spektrums der Röntgenstrahlen. Diese Methode ermöglicht die Darstellung von großen Kontraste im Gewebe. Unter Verwendung eines hochauflösenden Detektors und in Kombination mit der Computer-Tomographie, ist Phasenkontrast-Bildgebung eine sehr gute Methode um Knorpelgewebe und Arthrose im Knorpel zu untersuchen. Diese Arbeit beschreibt primär ein Verfahren zur Darstellung arthrotischen Knorpels im Anfangsstadium. Die mit verschiedenen Auflösungen und 3D-Phasen-Kontrast-Methoden produzierten Aufnahmen ermöglichen einen noch nie dagewesenen Einblick in den Knorpel und die Entwicklung von Arthrose im Anfangsstadium. Hierbei kam die propagationsbasierte Phasenkontrastmethode mit einer Auflösung im mikrometer Bereich und die (Nano)-Holotomographie-Methode mit einer Auflösung im Submicrometer Bereich zum Einsatz. Durch Auflösung im mikrometer Bereich kann ein großes Volumen im Knorpel gescannt werden, während die Nano-Holotomographie Methode eine sehr große Detailauflösung aufweißt. Die Phasenkontrast-Aufnahmen werden mit zwei anderen wissenschaftlichen Methoden verglichen: mikroskopische Abbildungen histologisch aufgearbeiteter Knorpelproben und Aufnahmen eines Transmissionselektroskop zeigen sehr große Übereinstimmungen zur Röntgen-Phasenkontrast-Bildgebung. Desweiteren wurden Phasenkontrast-Aufnahmen von Knorpel aus unterschiedlichen Röntgenquellen verglichen. Hierbei zeigte sich, dass mit Hilfe des Teilchenbeschleunigers (Synchrotron) detailreichere und schnellere Aufnahmen erzielt werden können. Bilder aus Flüssig-Metall-Quellen zeigen sich durchaus von guter Qualität, erfordern jedoch sehr lange Aufnahmezeiten. In dieser Arbeit wird zudem das Verhalten von Knorpelgewebe, welches ein Anfangsstadium von Arthrose aufweist, unter physikalischem Druck untersucht. Hierfür wurden 3D-Computertomographie-Aufnahmen von komprimiertem Knorpelgewebe angefertig und mit Aufnahmen ohne Komprimierung verglichen. Ein quantitativer Vergleich machte Veränderungen des Verhaltens der Knorpelzellstruktur (Chondronen) sichtbar. Es konnte gezeigt werden, dass Chondrone bei arthrotischem Knorpel ein verändertes Kompressionsverhalten haben. Der dritte Fokus dieser Arbeit liegt auf der automatisierten Auswertung von Aufnahmen gesunden und arthrotischen Knorpelgewebes. Die Entwicklungen im Bereich der Neuronale Netze zeigten in den letzten Jahren, dass diese sich hervoragend für Bildklassifizierungsaufgaben eignen. Es wurde die Methode des transferierenden Lernens angewandt, bei der ein vortrainiertes Neuronales Netz mit Knorpelbildern weitertrainiert und anschließend zur Klassifizierung eingesetzt wird. Dadurch ist eine schnelle, robuste und automatisierte Gruppierung von Bildern mit pathologischen Befunden möglich. Ein derart konstruiertes Neuronales Netz könnte als unterstützendes Instrument in der Pathologie angewandt werden. Röntgen-Phasenkontrast-CT kann ein leistungsstarkes Werkzeug für eine umfassende, hochpräzise und quantitative 3D-Darstellung und Charakterisierung von gesundem Knorpel und athrotischem Knorpel im Frühstadium bieten, um das Verständnis der Entwicklung von Osteoarthritis zu erweitern

Design of an Implant for First Metatarsophalangeal Joint Hemiarthroplasty

Osteoarthritis (OA) is the most common form of arthritis and it affects 27 million US adults. OA disease involves all of the tissues of the diarthrodial joint and ultimately, may lead to softening, ulceration, loss of articular cartilage, sclerosis and polished appearance of the subchondral bone, osteophytes, and subchondral cysts. The first metatarsophalangeal joint (MTPJ1) is affected in up to 42 cases of OA. Besides osteoarthritis, other conditions such as rheumatoid arthritis and gout also affect the MTPJ1. Involvement of MTPJ1 with these conditions invariably leads to deformed toe such as hallux valgus and hallux rigidus. Over 150 surgical techniques exist for treatment of hallux deformity, which includes cheilectomy, arthrodesis, osteotomy, resection arthroplasty, and replacement of part or the entire articular surface with an implant. A hemi-implant, which partially replaces the 1st metatarsal head with minimal bone resection and without altering the sesamoid articulation has shown promising results and gives superior postoperative range of motion and pain reductions. But the geometry of such implants has not been explained in any literature and there are no details of the data used for designing such implants. An anatomically based approach to design the geometry of an MTPJ1 implant is needed in order to best fit the articulating surface of the adjacent phalanx. In the current study, a method was developed for designing a hemiarthroplasty implant for MTPJ1 based upon the morphology of metatarsal. Ninety-seven metatarsal osteological specimens were scanned using a laser scanner to obtain 3D surface data. After aligning the surface data, the articular surface of each metatarsal head (MTH1) superior to the inter-condylar ridge were characterized by a section of an ellipsoid using non-linear unconstrained optimization (NLUO) and the section of the ellipsoid forms the surface of the implant. The implants based upon osteological specimens had a very good fit to metatarsal articulating surface with root mean

Role of high tibial osteotomy in chronic injuries of posterior cruciate ligament and posterolateral corner

High tibial osteotomy (HTO) is a surgical procedure used to change the mechanical weight-bearing axis and alter the loads carried through the knee. Conventional indications for HTO are medial compartment osteoarthritis and varus malalignment of the knee causing pain and dysfunction. Traditionally, knee instability associated with varus thrust has been considered a contraindication. However, today the indications include patients with chronic ligament deficiencies and malalignment, because an HTO procedure can change not only the coronal but also the sagittal plane of the knee. The sagittal plane has generally been ignored in HTO literature, but its modification has a significant impact on biomechanics and joint stability. Indeed, decreased posterior tibial slope causes posterior tibia translation and helps the anterior cruciate ligament (ACL)-deficient knee. Vice versa, increased tibial slope causes anterior tibia translation and helps the posterior cruciate ligament (PCL)-deficient knee. A review of literature shows that soft tissue procedures alone are often unsatisfactory for chronic posterior instability if alignment is not corrected. Since limb alignment is the most important factor to consider in lower limb reconstructive surgery, diagnosis and treatment of limb malalignment should not be ignored in management of chronic ligamentous instabilities. This paper reviews the effects of chronic posterior instability and tibial slope alteration on knee and soft tissues, in addition to planning and surgical technique for chronic posterior and posterolateral instability with HTO

Applied AI/ML for automatic customisation of medical implants

Most knee replacement surgeries are performed using ‘off-the-shelf’ implants, supplied with a set number of standardised sizes. X-rays are taken during pre-operative assessment and used by clinicians to estimate the best options for patients. Manual templating and implant size selection have, however, been shown to be inaccurate, and frequently the generically shaped products do not adequately fit patients’ unique anatomies. Furthermore, off-the-shelf implants are typically made from solid metal and do not exhibit mechanical properties like the native bone. Consequently, the combination of these factors often leads to poor outcomes for patients. Various solutions have been outlined in the literature for customising the size, shape, and stiffness of implants for the specific needs of individuals. Such designs can be fabricated via additive manufacturing which enables bespoke and intricate geometries to be produced in biocompatible materials. Despite this, all customisation solutions identified required some level of manual input to segment image files, identify anatomical features, and/or drive design software. These tasks are time consuming, expensive, and require trained resource. Almost all currently available solutions also require CT imaging, which adds further expense, incurs high levels of potentially harmful radiation, and is not as commonly accessible as X-ray imaging. This thesis explores how various levels of knee replacement customisation can be completed automatically by applying artificial intelligence, machine learning and statistical methods. The principal output is a software application, believed to be the first true ‘mass-customisation’ solution. The software is compatible with both 2D X-ray and 3D CT data and enables fully automatic and accurate implant size prediction, shape customisation and stiffness matching. It is therefore seen to address the key limitations associated with current implant customisation solutions and will hopefully enable the benefits of customisation to be more widely accessible.Open Acces