PadChest: A large chest x-ray image dataset with multi-label annotated reports

We present a labeled large-scale, high resolution chest x-ray dataset for the automated exploration of medical images along with their associated reports. This dataset includes more than 160,000 images obtained from 67,000 patients that were interpreted and reported by radiologists at Hospital San Juan Hospital (Spain) from 2009 to 2017, covering six different position views and additional information on image acquisition and patient demography. The reports were labeled with 174 different radiographic findings, 19 differential diagnoses and 104 anatomic locations organized as a hierarchical taxonomy and mapped onto standard Unified Medical Language System (UMLS) terminology. Of these reports, 27% were manually annotated by trained physicians and the remaining set was labeled using a supervised method based on a recurrent neural network with attention mechanisms. The labels generated were then validated in an independent test set achieving a 0.93 Micro-F1 score. To the best of our knowledge, this is one of the largest public chest x-ray database suitable for training supervised models concerning radiographs, and the first to contain radiographic reports in Spanish. The PadChest dataset can be downloaded from http://bimcv.cipf.es/bimcv-projects/padchest/

A Novel Method for the 3-D Reconstruction of Scoliotic Ribs From Frontal and Lateral Radiographs

Among the external manifestations of scoliosis, the rib hump, which is associated with the ribs' deformities and rotations, constitutes the most disturbing aspect of the scoliotic deformity for patients. A personalized 3-D model of the rib cage is important for a better evaluation of the deformity, and hence, a better treatment planning. A novel method for the 3-D reconstruction of the rib cage, based only on two standard radiographs, is proposed in this paper. For each rib, two points are extrapolated from the reconstructed spine, and three points are reconstructed by stereo radiography. The reconstruction is then refined using a surface approximation. The method was evaluated using clinical data of 13 patients with scoliosis. A comparison was conducted between the reconstructions obtained with the proposed method and those obtained by using a previous reconstruction method based on two frontal radiographs. A first comparison criterion was the distances between the reconstructed ribs and the surface topography of the trunk, considered as the reference modality. The correlation between ribs axial rotation and back surface rotation was also evaluated. The proposed method successfully reconstructed the ribs of the 6th-12th thoracic levels. The evaluation results showed that the 3-D configuration of the new rib reconstructions is more consistent with the surface topography and provides more accurate measurements of ribs axial rotation.Natural Sciences and Engineering Research Council of Canada and MENTOR, a strategic training program of the Canadian Institutes of Health Research

XNet: A convolutional neural network (CNN) implementation for medical X-Ray image segmentation suitable for small datasets

X-Ray image enhancement, along with many other medical image processing applications, requires the segmentation of images into bone, soft tissue, and open beam regions. We apply a machine learning approach to this problem, presenting an end-to-end solution which results in robust and efficient inference. Since medical institutions frequently do not have the resources to process and label the large quantity of X-Ray images usually needed for neural network training, we design an end-to-end solution for small datasets, while achieving state-of-the-art results. Our implementation produces an overall accuracy of 92%, F1 score of 0.92, and an AUC of 0.98, surpassing classical image processing techniques, such as clustering and entropy based methods, while improving upon the output of existing neural networks used for segmentation in non-medical contexts. The code used for this project is available online.Comment: 11 pages, 5 figures, 2 table

Reconstruction 3D personnalisée de la colonne vertébrale à partir d'images radiographiques non-calibrées

Les systèmes de reconstruction stéréo-radiographique 3D -- La colonne vertébrale -- La scoliose idiopathique adolescente -- Évolution des systèmes de reconstruction 3D -- Filtres de rehaussement d'images -- Techniques de segmentation -- Les méthodes de calibrage -- Les méthodes de reconstruction 3D -- Problématique, hypothèses, objectifs et méthode générale -- Three-dimensional reconstruction of the scoliotic spine and pelvis from uncalibrated biplanar X-ray images -- A versatile 3D reconstruction system of the spine and pelvis for clinical assessment of spinal deformities -- Simulation experiments -- Clinical validation -- A three-dimensional retrospective analysis of the evolution of spinal instrumentation for the correction of adolescent idiopathic scoliosis -- Auto-calibrage d'un système à rayons-X à partir de primitives de haut niveau -- Segmentation de la colonne vertébrale -- Approche hiérarchique d'auto-calibrage d'un système d'acquisition à rayons-X -- Personalized 3D reconstruction of the scoliotic spine from hybrid statistical and X-ray image-based models -- Validation protocol

Augmented Image-Guidance for Transcatheter Aortic Valve Implantation

The introduction of transcatheter aortic valve implantation (TAVI), an innovative stent-based technique for delivery of a bioprosthetic valve, has resulted in a paradigm shift in treatment options for elderly patients with aortic stenosis. While there have been major advancements in valve design and access routes, TAVI still relies largely on single-plane fluoroscopy for intraoperative navigation and guidance, which provides only gross imaging of anatomical structures. Inadequate imaging leading to suboptimal valve positioning contributes to many of the early complications experienced by TAVI patients, including valve embolism, coronary ostia obstruction, paravalvular leak, heart block, and secondary nephrotoxicity from contrast use. A potential method of providing improved image-guidance for TAVI is to combine the information derived from intra-operative fluoroscopy and TEE with pre-operative CT data. This would allow the 3D anatomy of the aortic root to be visualized along with real-time information about valve and prosthesis motion. The combined information can be visualized as a `merged\u27 image where the different imaging modalities are overlaid upon each other, or as an `augmented\u27 image, where the location of key target features identified on one image are displayed on a different imaging modality. This research develops image registration techniques to bring fluoroscopy, TEE, and CT models into a common coordinate frame with an image processing workflow that is compatible with the TAVI procedure. The techniques are designed to be fast enough to allow for real-time image fusion and visualization during the procedure, with an intra-procedural set-up requiring only a few minutes. TEE to fluoroscopy registration was achieved using a single-perspective TEE probe pose estimation technique. The alignment of CT and TEE images was achieved using custom-designed algorithms to extract aortic root contours from XPlane TEE images, and matching the shape of these contours to a CT-derived surface model. Registration accuracy was assessed on porcine and human images by identifying targets (such as guidewires or coronary ostia) on the different imaging modalities and measuring the correspondence of these targets after registration. The merged images demonstrated good visual alignment of aortic root structures, and quantitative assessment measured an accuracy of less than 1.5mm error for TEE-fluoroscopy registration and less than 6mm error for CT-TEE registration. These results suggest that the image processing techniques presented have potential for development into a clinical tool to guide TAVI. Such a tool could potentially reduce TAVI complications, reducing morbidity and mortality and allowing for a safer procedure

Detailed Annotations of Chest X-Rays via CT Projection for Report Understanding

In clinical radiology reports, doctors capture important information about the patient's health status. They convey their observations from raw medical imaging data about the inner structures of a patient. As such, formulating reports requires medical experts to possess wide-ranging knowledge about anatomical regions with their normal, healthy appearance as well as the ability to recognize abnormalities. This explicit grasp on both the patient's anatomy and their appearance is missing in current medical image-processing systems as annotations are especially difficult to gather. This renders the models to be narrow experts e.g. for identifying specific diseases. In this work, we recover this missing link by adding human anatomy into the mix and enable the association of content in medical reports to their occurrence in associated imagery (medical phrase grounding). To exploit anatomical structures in this scenario, we present a sophisticated automatic pipeline to gather and integrate human bodily structures from computed tomography datasets, which we incorporate in our PAXRay: A Projected dataset for the segmentation of Anatomical structures in X-Ray data. Our evaluation shows that methods that take advantage of anatomical information benefit heavily in visually grounding radiologists' findings, as our anatomical segmentations allow for up to absolute 50% better grounding results on the OpenI dataset as compared to commonly used region proposals. The PAXRay dataset is available at https://constantinseibold.github.io/paxray/.Comment: 33rd British Machine Vision Conference (BMVC 2022

Navigation accuracy and assessability of carbon fiber-reinforced PEEK instrumentation with multimodal intraoperative imaging in spinal oncology

Radiolucent carbon-fiber reinforced PEEK (CFRP) implants have helped improve oncological follow-up and radiation therapy. Here, we investigated the performance of 3D intraoperative imaging and navigation systems for instrumentation and precision assessment of CFRP pedicle screws across the thoraco-lumbar spine. Thirty-three patients with spinal tumors underwent navigated CFRP instrumentation with intraoperative CT (iCT), robotic cone-beam CT (rCBCT) or cone-beam CT (CBCT) imaging. Two different navigation systems were used for iCT-/rCBCT- and CBCT-based navigation. Demographic, clinical and outcome data was assessed. Four blinded observers rated image quality, assessability and accuracy of CFRP pedicle screws. Inter-observer reliability was determined with Fleiss` Kappa analysis. Between 2018 and 2021, 243 CFRP screws were implanted (iCT:93, rCBCT: 99, CBCT: 51), of which 13 were non-assessable (iCT: 1, rCBCT: 9, CBCT: 3; *p = 0.0475; iCT vs. rCBCT). Navigation accuracy was highest using iCT (74%), followed by rCBCT (69%) and CBCT (49%) (*p = 0.0064; iCT vs. CBCT and rCBCT vs. CBCT). All observers rated iCT image quality higher than rCBCT/CBCT image quality (*p < 0.01) but relevant pedicle breaches were reliably identified with substantial agreement between all observers regardless of the imaging modality. Navigation accuracy for CFRP pedicle screws was considerably lower than expected from reports on titanium implants and CT may be best for reliable assessment of CFRP materials

Depiction of pneumothoraces in a large animal model using x-ray dark-field radiography

The aim of this study was to assess the diagnostic value of x-ray dark-field radiography to detect pneumothoraces in a pig model. Eight pigs were imaged with an experimental grating-based large-animal dark-field scanner before and after induction of a unilateral pneumothorax. Image contrast-to-noise ratios between lung tissue and the air-filled pleural cavity were quantified for transmission and dark-field radiograms. The projected area in the object plane of the inflated lung was measured in dark-field images to quantify the collapse of lung parenchyma due to a pneumothorax. Means and standard deviations for lung sizes and signal intensities from dark-field and transmission images were tested for statistical significance using Student’s two-tailed t-test for paired samples. The contrast-to-noise ratio between the air-filled pleural space of lateral pneumothoraces and lung tissue was significantly higher in the dark-field (3.65 ± 0.9) than in the transmission images (1.13 ± 1.1; p = 0.002). In case of dorsally located pneumothoraces, a significant decrease (−20.5%; p > 0.0001) in the projected area of inflated lung parenchyma was found after a pneumothorax was induced. Therefore, the detection of pneumothoraces in x-ray dark-field radiography was facilitated compared to transmission imaging in a large animal model

Development and Validation of a Three-Dimensional Optical Imaging System for Chest Wall Deformity Measurement

Congenital chest wall deformities (CWD) are malformations of the thoracic cage that become more pronounced during early adolescence. Pectus excavatum (PE) is the most common CWD, characterized by an inward depression of the sternum and adjacent costal cartilage. A cross-sectional computed tomography (CT) image is mainly used to calculate the chest thoracic indices. Physicians use the indices to quantify PE deformity, prescribe surgical or non-surgical therapies, and evaluate treatment outcomes. However, the use of CT is increasingly causing physicians to be concerned about the radiation doses administered to young patients. Furthermore, radiographic indices are an unsafe and expensive method of evaluating non-surgical treatments involving gradual chest wall changes. Flexible tape or a dowel-shaped ruler can be used to measure changes on the anterior side of the thorax; however, these methods are subjective, prone to human error, and cannot accurately measure small changes. This study aims to fill this gap by exploring three-dimensional optical imaging techniques to capture patients’ chest surfaces. The dissertation describes the development and validation of a cost-effective and safe method for objectively evaluating treatment progress in children with chest deformities. First, a study was conducted to evaluate the performance of low-cost 3D scanning technologies in measuring the severity of CWD. Second, a multitemporal surface mesh registration pipeline was developed for aligning 3D torso scans taken at different clinical appointments. Surface deviations were assessed between closely aligned scans. Optical indices were calculated without exposing patients to ionizing radiation, and changes in chest shape were visualized on a color-coded heat map. Additionally, a statistical model of chest shape built from healthy subjects was proposed to assess progress toward normal chest and aesthetic outcomes. The system was validated with 3D and CT datasets from a multi-institutional cohort. The findings indicate that optical scans can detect differences on a millimeter scale, and optical indices can be applied to approximate radiographic indices. In addition to improving patient awareness, visual representations of changes during nonsurgical treatment can enhance patient compliance