OncoSpineSeg: A Software Tool for a Manual Segmentation of Computed Tomography of the Spine on Cancer Patients

The organ most commonly affected by metastatic cancer is the skeleton, and spine is the site where it causes the highest morbidity. Computer-aided diagnosis (CAD) for detecting and assessing metastatic disease in bone or other spine disorders can assist physicians to perform their decision-making tasks. A precise segmentation of the spine is important as a first stage in any automatic diagnosis task. However, it is a challenging problem to segment correctly an affected spine, and it is a crucial step to assess quantitatively the results of segmentation by comparing them with the results of a manual segmentation, reviewed by one experienced radiologist. This chapter presents the design of a MATLAB-based software for the manual segmentation of the spine. The software tool has a simple and easy to use interface, and it works with either computed tomography or magnetic resonance imaging (MRI). A typical workflow includes loading the image volume, creating multi-planar reconstructions, manually contouring the vertebrae, spinal lesions, intervertebral discs and spinal canal with availability of different segmentation tools, classification of the bone into healthy bone, osteolytic metastases, osteoblastic metastases or mixed lesions, being also possible to classify an object as a false-positive and a 3D reconstruction of the segmented objects

Automatic segmentation of the spine by means of a probabilistic atlas with a special focus on ribs suppression

[EN] Purpose: The development of automatic and reliable algorithms for the detection and segmentation of the vertebrae are of great importance prior to any diagnostic task. However, an important problem found to accurately segment the vertebrae is the presence of the ribs in the thoracic region. To overcome this problem, a probabilistic atlas of the spine has been developed dealing with the proximity of other structures, with a special focus on ribs suppression. Methods: The data sets used consist of Computed Tomography images corresponding to 21 patients suffering from spinal metastases. Two methods have been combined to obtain the final result: firstly, an initial segmentation is performed using a fully automatic level-set method; secondly, to refine the initial segmentation, a 3D volume indicating the probability of each voxel of belonging to the spine has been developed. In this way, a probability map is generated and deformed to be adapted to each testing case. Results: To validate the improvement obtained after applying the atlas, the Dice coefficient (DSC), the Hausdorff distance (HD), and the mean surface-to-surface distance (MSD) were used. The results showed up an average of 10 mm of improvement accuracy in terms of HD, obtaining an overall final average of 15.51 2.74 mm. Also, a global value of 91.01 3.18% in terms of DSC and a MSD of 0.66 0.25 mm were obtained. The major improvement using the atlas was achieved in the thoracic region, as ribs were almost perfectly suppressed. Conclusion: The study demonstrated that the atlas is able to detect and appropriately eliminate the ribs while improving the segmentation accuracy.The authors thank the financial support of the Spanish Ministerio de Economia y Competitividad (MINECO) and FEDER funds under Grants TEC2012-33778 and BFU2015-64380-C2-2-R (D.M.) and DPI2013-4572-R (J.D., E.D.)Ruiz-España, S.; Domingo, J.; Díaz-Parra, A.; Dura, E.; D'ocon-Alcaniz, V.; Arana, E.; Moratal, D. (2017). Automatic segmentation of the spine by means of a probabilistic atlas with a special focus on ribs suppression. Medical Physics. 44(9):4695-4707. https://doi.org/10.1002/mp.12431S46954707449Harris, R. I., & Macnab, I. (1954). STRUCTURAL CHANGES IN THE LUMBAR INTERVERTEBRAL DISCS. The Journal of Bone and Joint Surgery. British volume, 36-B(2), 304-322. doi:10.1302/0301-620x.36b2.304Oliveira, M. F. de, Rotta, J. M., & Botelho, R. V. (2015). Survival analysis in patients with metastatic spinal disease: the influence of surgery, histology, clinical and neurologic status. Arquivos de Neuro-Psiquiatria, 73(4), 330-335. doi:10.1590/0004-282x20150003Chou, R. (2011). Diagnostic Imaging for Low Back Pain: Advice for High-Value Health Care From the American College of Physicians. Annals of Internal Medicine, 154(3), 181. doi:10.7326/0003-4819-154-3-201102010-00008Brayda-Bruno, M., Tibiletti, M., Ito, K., Fairbank, J., Galbusera, F., Zerbi, A., … Sivan, S. S. (2013). Advances in the diagnosis of degenerated lumbar discs and their possible clinical application. European Spine Journal, 23(S3), 315-323. doi:10.1007/s00586-013-2960-9Quattrocchi, C. C., Santini, D., Dell’Aia, P., Piciucchi, S., Leoncini, E., Vincenzi, B., … Zobel, B. B. (2007). A prospective analysis of CT density measurements of bone metastases after treatment with zoledronic acid. Skeletal Radiology, 36(12), 1121-1127. doi:10.1007/s00256-007-0388-1Doi, K. (2007). Computer-aided diagnosis in medical imaging: Historical review, current status and future potential. Computerized Medical Imaging and Graphics, 31(4-5), 198-211. doi:10.1016/j.compmedimag.2007.02.002Ruiz-España, S., Arana, E., & Moratal, D. (2015). Semiautomatic computer-aided classification of degenerative lumbar spine disease in magnetic resonance imaging. Computers in Biology and Medicine, 62, 196-205. doi:10.1016/j.compbiomed.2015.04.028Alomari, R. S., Ghosh, S., Koh, J., & Chaudhary, V. (2014). Vertebral Column Localization, Labeling, and Segmentation. Lecture Notes in Computational Vision and Biomechanics, 193-229. doi:10.1007/978-3-319-12508-4_7Hamarneh, G., & Li, X. (2009). Watershed segmentation using prior shape and appearance knowledge. Image and Vision Computing, 27(1-2), 59-68. doi:10.1016/j.imavis.2006.10.009Ghebreab, S., & Smeulders, A. W. (2004). Combining Strings and Necklaces for Interactive Three-Dimensional Segmentation of Spinal Images Using an Integral Deformable Spine Model. IEEE Transactions on Biomedical Engineering, 51(10), 1821-1829. doi:10.1109/tbme.2004.831540Mastmeyer, A., Engelke, K., Fuchs, C., & Kalender, W. A. (2006). A hierarchical 3D segmentation method and the definition of vertebral body coordinate systems for QCT of the lumbar spine. Medical Image Analysis, 10(4), 560-577. doi:10.1016/j.media.2006.05.005Rasoulian, A., Rohling, R., & Abolmaesumi, P. (2013). Lumbar Spine Segmentation Using a Statistical Multi-Vertebrae Anatomical Shape+Pose Model. IEEE Transactions on Medical Imaging, 32(10), 1890-1900. doi:10.1109/tmi.2013.2268424Ma, J., & Lu, L. (2013). Hierarchical segmentation and identification of thoracic vertebra using learning-based edge detection and coarse-to-fine deformable model. Computer Vision and Image Understanding, 117(9), 1072-1083. doi:10.1016/j.cviu.2012.11.016Kim, Y., & Kim, D. (2009). A fully automatic vertebra segmentation method using 3D deformable fences. Computerized Medical Imaging and Graphics, 33(5), 343-352. doi:10.1016/j.compmedimag.2009.02.006Klinder, T., Ostermann, J., Ehm, M., Franz, A., Kneser, R., & Lorenz, C. (2009). Automated model-based vertebra detection, identification, and segmentation in CT images. Medical Image Analysis, 13(3), 471-482. doi:10.1016/j.media.2009.02.004Štern, D., Likar, B., Pernuš, F., & Vrtovec, T. (2011). Parametric modelling and segmentation of vertebral bodies in 3D CT and MR spine images. Physics in Medicine and Biology, 56(23), 7505-7522. doi:10.1088/0031-9155/56/23/011Korez, R., Ibragimov, B., Likar, B., Pernus, F., & Vrtovec, T. (2015). A Framework for Automated Spine and Vertebrae Interpolation-Based Detection and Model-Based Segmentation. IEEE Transactions on Medical Imaging, 34(8), 1649-1662. doi:10.1109/tmi.2015.2389334Castro-Mateos, I., Pozo, J. M., Pereanez, M., Lekadir, K., Lazary, A., & Frangi, A. F. (2015). Statistical Interspace Models (SIMs): Application to Robust 3D Spine Segmentation. IEEE Transactions on Medical Imaging, 34(8), 1663-1675. doi:10.1109/tmi.2015.2443912Pereanez, M., Lekadir, K., Castro-Mateos, I., Pozo, J. M., Lazary, A., & Frangi, A. F. (2015). Accurate Segmentation of Vertebral Bodies and Processes Using Statistical Shape Decomposition and Conditional Models. IEEE Transactions on Medical Imaging, 34(8), 1627-1639. doi:10.1109/tmi.2015.2396774Michael Kelm, B., Wels, M., Kevin Zhou, S., Seifert, S., Suehling, M., Zheng, Y., & Comaniciu, D. (2013). Spine detection in CT and MR using iterated marginal space learning. Medical Image Analysis, 17(8), 1283-1292. doi:10.1016/j.media.2012.09.007Yan Kang, Engelke, K., & Kalender, W. A. (2003). A new accurate and precise 3-D segmentation method for skeletal structures in volumetric CT data. IEEE Transactions on Medical Imaging, 22(5), 586-598. doi:10.1109/tmi.2003.812265Huang, J., Jian, F., Wu, H., & Li, H. (2013). An improved level set method for vertebra CT image segmentation. BioMedical Engineering OnLine, 12(1), 48. doi:10.1186/1475-925x-12-48Lim, P. H., Bagci, U., & Bai, L. (2013). Introducing Willmore Flow Into Level Set Segmentation of Spinal Vertebrae. IEEE Transactions on Biomedical Engineering, 60(1), 115-122. doi:10.1109/tbme.2012.2225833Forsberg, D., Lundström, C., Andersson, M., & Knutsson, H. (2013). Model-based registration for assessment of spinal deformities in idiopathic scoliosis. Physics in Medicine and Biology, 59(2), 311-326. doi:10.1088/0031-9155/59/2/311Yao, J., Burns, J. E., Forsberg, D., Seitel, A., Rasoulian, A., Abolmaesumi, P., … Li, S. (2016). A multi-center milestone study of clinical vertebral CT segmentation. Computerized Medical Imaging and Graphics, 49, 16-28. doi:10.1016/j.compmedimag.2015.12.006Shi, C., Wang, J., & Cheng, Y. (2015). Sparse Representation-Based Deformation Model for Atlas-Based Segmentation of Liver CT Images. Image and Graphics, 410-419. doi:10.1007/978-3-319-21969-1_36Domingo, J., Dura, E., Ayala, G., & Ruiz-España, S. (2015). Means of 2D and 3D Shapes and Their Application in Anatomical Atlas Building. Lecture Notes in Computer Science, 522-533. doi:10.1007/978-3-319-23192-1_44Hyunjin Park, Bland, P. H., & Meyer, C. R. (2003). Construction of an abdominal probabilistic atlas and its application in segmentation. IEEE Transactions on Medical Imaging, 22(4), 483-492. doi:10.1109/tmi.2003.809139Cabezas, M., Oliver, A., Lladó, X., Freixenet, J., & Bach Cuadra, M. (2011). A review of atlas-based segmentation for magnetic resonance brain images. Computer Methods and Programs in Biomedicine, 104(3), e158-e177. doi:10.1016/j.cmpb.2011.07.015Fortunati, V., Verhaart, R. F., van der Lijn, F., Niessen, W. J., Veenland, J. F., Paulides, M. M., & van Walsum, T. (2013). Tissue segmentation of head and neck CT images for treatment planning: A multiatlas approach combined with intensity modeling. Medical Physics, 40(7), 071905. doi:10.1118/1.4810971Zhuang, X., Bai, W., Song, J., Zhan, S., Qian, X., Shi, W., … Rueckert, D. (2015). Multiatlas whole heart segmentation of CT data using conditional entropy for atlas ranking and selection. Medical Physics, 42(7), 3822-3833. doi:10.1118/1.4921366Zhou, J., Yan, Z., Lasio, G., Huang, J., Zhang, B., Sharma, N., … D’Souza, W. (2015). Automated compromised right lung segmentation method using a robust atlas-based active volume model with sparse shape composition prior in CT. Computerized Medical Imaging and Graphics, 46, 47-55. doi:10.1016/j.compmedimag.2015.07.003Linguraru, M. G., Sandberg, J. K., Li, Z., Shah, F., & Summers, R. M. (2010). Automated segmentation and quantification of liver and spleen from CT images using normalized probabilistic atlases and enhancement estimation. Medical Physics, 37(2), 771-783. doi:10.1118/1.3284530Xu, Y., Xu, C., Kuang, X., Wang, H., Chang, E. I.-C., Huang, W., & Fan, Y. (2016). 3D-SIFT-Flow for atlas-based CT liver image segmentation. Medical Physics, 43(5), 2229-2241. doi:10.1118/1.4945021Michopoulou, S. K., Costaridou, L., Panagiotopoulos, E., Speller, R., Panayiotakis, G., & Todd-Pokropek, A. (2009). Atlas-Based Segmentation of Degenerated Lumbar Intervertebral Discs From MR Images of the Spine. IEEE Transactions on Biomedical Engineering, 56(9), 2225-2231. doi:10.1109/tbme.2009.2019765Taso, M., Le Troter, A., Sdika, M., Ranjeva, J.-P., Guye, M., Bernard, M., & Callot, V. (2013). Construction of an in vivo human spinal cord atlas based on high-resolution MR images at cervical and thoracic levels: preliminary results. Magnetic Resonance Materials in Physics, Biology and Medicine, 27(3), 257-267. doi:10.1007/s10334-013-0403-6Lévy, S., Benhamou, M., Naaman, C., Rainville, P., Callot, V., & Cohen-Adad, J. (2015). White matter atlas of the human spinal cord with estimation of partial volume effect. NeuroImage, 119, 262-271. doi:10.1016/j.neuroimage.2015.06.040Hardisty, M., Gordon, L., Agarwal, P., Skrinskas, T., & Whyne, C. (2007). Quantitative characterization of metastatic disease in the spine. Part I. Semiautomated segmentation using atlas-based deformable registration and the level set method. Medical Physics, 34(8), 3127-3134. doi:10.1118/1.2746498Forsberg, D. (2015). Atlas-Based Registration for Accurate Segmentation of Thoracic and Lumbar Vertebrae in CT Data. Lecture Notes in Computational Vision and Biomechanics, 49-59. doi:10.1007/978-3-319-14148-0_5Ibañez MV Schroeder W Cates L Insight software Consortium. The ITK Software Guide 2016 http://www.itk.org/ItkSoftwareGuide.pdfLoader C R package: Local regression, likelihood and density estimation. CRAN repository 2013 2016 http://cran.r-project.org/web/packages/locfitPARK, H., HERO, A., BLAND, P., KESSLER, M., SEO, J., & MEYER, C. (2010). Construction of Abdominal Probabilistic Atlases and Their Value in Segmentation of Normal Organs in Abdominal CT Scans. IEICE Transactions on Information and Systems, E93-D(8), 2291-2301. doi:10.1587/transinf.e93.d.2291Pohl, K. M., Fisher, J., Bouix, S., Shenton, M., McCarley, R. W., Grimson, W. E. L., … Wells, W. M. (2007). Using the logarithm of odds to define a vector space on probabilistic atlases. Medical Image Analysis, 11(5), 465-477. doi:10.1016/j.media.2007.06.003Baddeley, A., & Molchanov, I. (1998). Journal of Mathematical Imaging and Vision, 8(1), 79-92. doi:10.1023/a:1008214317492De Bruijne, M., van Ginneken, B., Viergever, M. A., & Niessen, W. J. (2003). Adapting Active Shape Models for 3D Segmentation of Tubular Structures in Medical Images. Information Processing in Medical Imaging, 136-147. doi:10.1007/978-3-540-45087-0_12Zhang, K., Zhang, L., Song, H., & Zhou, W. (2010). Active contours with selective local or global segmentation: A new formulation and level set method. Image and Vision Computing, 28(4), 668-676. doi:10.1016/j.imavis.2009.10.009Kalpathy-Cramer, J., Awan, M., Bedrick, S., Rasch, C. R. N., Rosenthal, D. I., & Fuller, C. D. (2013). Development of a Software for Quantitative Evaluation Radiotherapy Target and Organ-at-Risk Segmentation Comparison. Journal of Digital Imaging, 27(1), 108-119. doi:10.1007/s10278-013-9633-4Huttenlocher, D. P., Klanderman, G. A., & Rucklidge, W. J. (1993). Comparing images using the Hausdorff distance. IEEE Transactions on Pattern Analysis and Machine Intelligence, 15(9), 850-863. doi:10.1109/34.232073Aspert, N., Santa-Cruz, D., & Ebrahimi, T. (s. f.). MESH: measuring errors between surfaces using the Hausdorff distance. Proceedings. IEEE International Conference on Multimedia and Expo. doi:10.1109/icme.2002.103587

A multi-center milestone study of clinical vertebral CT segmentation

A multiple center milestone study of clinical vertebra segmentation is presented in this paper. Vertebra segmentation is a fundamental step for spinal image analysis and intervention. The first half of the study was conducted in the spine segmentation challenge in 2014 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) Workshop on Computational Spine Imaging (CSI 2014). The objective was to evaluate the performance of several state-of-the-art vertebra segmentation algorithms on computed tomography (CT) scans using ten training and five testing dataset, all healthy cases; the second half of the study was conducted after the challenge, where additional 5 abnormal cases are used for testing to evaluate the performance under abnormal cases. Dice coefficients and absolute surface distances were used as evaluation metrics. Segmentation of each vertebra as a single geometric unit, as well as separate segmentation of vertebra substructures, was evaluated. Five teams participated in the comparative study. The top performers in the study achieved Dice coefficient of 0.93 in the upper thoracic, 0.95 in the lower thoracic and 0.96 in the lumbar spine for healthy cases, and 0.88 in the upper thoracic, 0.89 in the lower thoracic and 0.92 in the lumbar spine for osteoporotic and fractured cases. The strengths and weaknesses of each method as well as future suggestion for improvement are discussed. This is the first multi-center comparative study for vertebra segmentation methods, which will provide an up-to-date performance milestone for the fast growing spinal image analysis and intervention

X23D-Intraoperative 3D Lumbar Spine Shape Reconstruction Based on Sparse Multi-View X-ray Data

Visual assessment based on intraoperative 2D X-rays remains the predominant aid for intraoperative decision-making, surgical guidance, and error prevention. However, correctly assessing the 3D shape of complex anatomies, such as the spine, based on planar fluoroscopic images remains a challenge even for experienced surgeons. This work proposes a novel deep learning-based method to intraoperatively estimate the 3D shape of patients' lumbar vertebrae directly from sparse, multi-view X-ray data. High-quality and accurate 3D reconstructions were achieved with a learned multi-view stereo machine approach capable of incorporating the X-ray calibration parameters in the neural network. This strategy allowed a priori knowledge of the spinal shape to be acquired while preserving patient specificity and achieving a higher accuracy compared to the state of the art. Our method was trained and evaluated on 17,420 fluoroscopy images that were digitally reconstructed from the public CTSpine1K dataset. As evaluated by unseen data, we achieved an 88% average F1 score and a 71% surface score. Furthermore, by utilizing the calibration parameters of the input X-rays, our method outperformed a counterpart method in the state of the art by 22% in terms of surface score. This increase in accuracy opens new possibilities for surgical navigation and intraoperative decision-making solely based on intraoperative data, especially in surgical applications where the acquisition of 3D image data is not part of the standard clinical workflow

Automatic Segmentation of Anatomical Structures from CT Scans of Thorax for RTP

Modern radiotherapy techniques are vulnerable to delineation inaccuracies owing to the steep dose gradient around the target. In this aspect, accurate contouring comprises an indispensable part of optimal radiation treatment planning (RTP). We suggest a fully automated method to segment the lungs, trachea/main bronchi, and spinal canal accurately from computed tomography (CT) scans of patients with lung cancer to use for RTP. For this purpose, we developed a new algorithm for inclusion of excluded pathological areas into the segmented lungs and a modified version of the fuzzy segmentation by morphological reconstruction for spinal canal segmentation and implemented some image processing algorithms along with them. To assess the accuracy, we performed two comparisons between the automatically obtained results and the results obtained manually by an expert. The average volume overlap ratio values range between 94.30 ± 3.93% and 99.11 ± 0.26% on the two different datasets. We obtained the average symmetric surface distance values between the ranges of 0.28 ± 0.21 mm and 0.89 ± 0.32 mm by using the same datasets. Our method provides favorable results in the segmentation of CT scans of patients with lung cancer and can avoid heavy computational load and might offer expedited segmentation that can be used in RTP

X-Ray Computed Tomography: Semiautomated Volumetric Analysis of Late-Stage Lung Tumors as a Basis for Response Assessments

Background. This study presents a semiautomated approach for volumetric analysis of lung tumors and evaluates the feasibility of using volumes as an alternative to line lengths as a basis for response evaluation criteria in solid tumors (RECIST). The overall goal for the implementation was to accurately, precisely, and efficiently enable the analyses of lesions in the lung under the guidance of an operator. Methods. An anthropomorphic phantom with embedded model masses and 71 time points in 10 clinical cases with advanced lung cancer was analyzed using a semi-automated workflow. The implementation was done using the Cognition Network Technology. Results. Analysis of the phantom showed an average accuracy of 97%. The analyses of the clinical cases showed both intra- and interreader variabilities of approximately 5% on average with an upper 95% confidence interval of 14% and 19%, respectively. Compared to line lengths, the use of volumes clearly shows enhanced sensitivity with respect to determining response to therapy. Conclusions. It is feasible to perform volumetric analysis efficiently with high accuracy and low variability, even in patients with late-stage cancer who have complex lesions

Square-Cut: A Segmentation Algorithm on the Basis of a Rectangle Shape

We present a rectangle-based segmentation algorithm that sets up a graph and performs a graph cut to separate an object from the background. However, graph-based algorithms distribute the graph's nodes uniformly and equidistantly on the image. Then, a smoothness term is added to force the cut to prefer a particular shape. This strategy does not allow the cut to prefer a certain structure, especially when areas of the object are indistinguishable from the background. We solve this problem by referring to a rectangle shape of the object when sampling the graph nodes, i.e., the nodes are distributed nonuniformly and non-equidistantly on the image. This strategy can be useful, when areas of the object are indistinguishable from the background. For evaluation, we focus on vertebrae images from Magnetic Resonance Imaging (MRI) datasets to support the time consuming manual slice-by-slice segmentation performed by physicians. The ground truth of the vertebrae boundaries were manually extracted by two clinical experts (neurological surgeons) with several years of experience in spine surgery and afterwards compared with the automatic segmentation results of the proposed scheme yielding an average Dice Similarity Coefficient (DSC) of 90.97\pm62.2%.Comment: 13 pages, 17 figures, 2 tables, 3 equations, 42 reference

Artificial Intelligence in Oral Health

This Special Issue is intended to lay the foundation of AI applications focusing on oral health, including general dentistry, periodontology, implantology, oral surgery, oral radiology, orthodontics, and prosthodontics, among others