4 research outputs found
Pose-Aware Instance Segmentation Framework from Cone Beam CT Images for Tooth Segmentation
Individual tooth segmentation from cone beam computed tomography (CBCT)
images is an essential prerequisite for an anatomical understanding of
orthodontic structures in several applications, such as tooth reformation
planning and implant guide simulations. However, the presence of severe metal
artifacts in CBCT images hinders the accurate segmentation of each individual
tooth. In this study, we propose a neural network for pixel-wise labeling to
exploit an instance segmentation framework that is robust to metal artifacts.
Our method comprises of three steps: 1) image cropping and realignment by pose
regressions, 2) metal-robust individual tooth detection, and 3) segmentation.
We first extract the alignment information of the patient by pose regression
neural networks to attain a volume-of-interest (VOI) region and realign the
input image, which reduces the inter-overlapping area between tooth bounding
boxes. Then, individual tooth regions are localized within a VOI realigned
image using a convolutional detector. We improved the accuracy of the detector
by employing non-maximum suppression and multiclass classification metrics in
the region proposal network. Finally, we apply a convolutional neural network
(CNN) to perform individual tooth segmentation by converting the pixel-wise
labeling task to a distance regression task. Metal-intensive image augmentation
is also employed for a robust segmentation of metal artifacts. The result shows
that our proposed method outperforms other state-of-the-art methods, especially
for teeth with metal artifacts. The primary significance of the proposed method
is two-fold: 1) an introduction of pose-aware VOI realignment followed by a
robust tooth detection and 2) a metal-robust CNN framework for accurate tooth
segmentation.Comment: 10 pages, 10 figure
Tooth Instance Segmentation from Cone-Beam CT Images through Point-based Detection and Gaussian Disentanglement
Individual tooth segmentation and identification from cone-beam computed
tomography images are preoperative prerequisites for orthodontic treatments.
Instance segmentation methods using convolutional neural networks have
demonstrated ground-breaking results on individual tooth segmentation tasks,
and are used in various medical imaging applications. While point-based
detection networks achieve superior results on dental images, it is still a
challenging task to distinguish adjacent teeth because of their similar
topologies and proximate nature. In this study, we propose a point-based tooth
localization network that effectively disentangles each individual tooth based
on a Gaussian disentanglement objective function. The proposed network first
performs heatmap regression accompanied by box regression for all the
anatomical teeth. A novel Gaussian disentanglement penalty is employed by
minimizing the sum of the pixel-wise multiplication of the heatmaps for all
adjacent teeth pairs. Subsequently, individual tooth segmentation is performed
by converting a pixel-wise labeling task to a distance map regression task to
minimize false positives in adjacent regions of the teeth. Experimental results
demonstrate that the proposed algorithm outperforms state-of-the-art approaches
by increasing the average precision of detection by 9.1%, which results in a
high performance in terms of individual tooth segmentation. The primary
significance of the proposed method is two-fold: 1) the introduction of a
point-based tooth detection framework that does not require additional
classification and 2) the design of a novel loss function that effectively
separates Gaussian distributions based on heatmap responses in the point-based
detection framework.Comment: 11 pages, 7 figure
KĂŒnstliche Intelligenz in der Zahnheilkunde: Scoping-Review und SchlieĂung beobachteter WissenslĂŒcken durch eine methodische und eine klinische Studie
Objectives: The aims of this dissertation were to (1) conduct a scoping review of stud-ies on machine learning (ML) in dentistry and appraise their robustness, (2) perform a benchmarking study to systematically compare various ML algorithms for a specific dental task, and (3) evaluate the influence of a ML-based caries detection software on diagnostic accuracy and decision-making in a randomized controlled trial.
Methods: The scoping review included studies using ML in dentistry published between 1st January 2015 and 31st May 2021 on MEDLINE, IEEE Xplore, and arXiv. The risk of bias and reporting quality were assessed with the QUADASâ2 and TRIPOD checklists, respectively. In the benchmarking study, 216 ML models were built using permutations of six ML model architectures (U-Net, U-Net++, Feature Pyramid Networks, LinkNet, Pyramid Scene Parsing Network, and Mask Attention Network), 12 model backbones of varying complexities (ResNet18, ResNet34, ResNet50, ResNet101, ResNet152, VGG13, VGG16, VGG19, DenseNet121, DenseNet161, DenseNet169, and Dense-Net201), and three initialization strategies (random, ImageNet, and CheXpert weights). 1,625 dental bitewing radiographs were used for training and testing. Five-fold cross-validation was carried out and model performance assessed using F1-score. In the clin-ical trial, each one of 22 dentists examined 20 randomly selected bitewing images for proximal caries; 10 images were evaluated with ML and 10 images without ML. Accura-cy in lesion detection and the suggested treatment were evaluated.
Results: The scoping review included 168 studies, describing different ML tasks, mod-els, input data, methods to generate reference tests, and performance metrics, imped-ing comparison across studies. The studies showed considerable risk of bias and mod-erate adherence to reporting standards. In the benchmarking study, more complex models only minimally outperformed their simpler counterparts, if at all. Models initial-ized by ImageNet or CheXpert weights outperformed those using random weights (p<0.05). The clinical trial demonstrated that dentists using ML showed increased accu-racy (area under the receiver operating characteristic [mean (95% confidence interval): 0.89 (0.87â0.90)]) compared with those not using ML [0.85 (0.83â0.86); p<0.05], pri-marily due to their higher sensitivity [0.81 (0.74â0.87) compared to 0.72 (0.64â0.79); p<0.05]. Notably, dentists using ML also showed a higher frequency of invasive treat-ment decisions than those not using it (p<0.05).
Conclusion: To facilitate comparisons across ML studies in dentistry, a minimum (core) set of outcomes and metrics should be developed, and researchers should strive to improve robustness and reporting quality of their studies. ML model choice should be performed on an informed basis, and simpler models may often be similarly capable as more complex ones. ML can increase dentistsâ diagnostic accuracy but also lead to more invasive treatment.Ziele: Die Ziele dieser Dissertation waren, (1) ein Scoping-Review von Studien ĂŒber maschinelles Lernen (ML) in der Zahnmedizin, (2) eine Benchmarking-Studie zum systematischen Vergleich verschiedener ML-Algorithmen fĂŒr eine bestimmte zahnmedizinische Aufgabe, und (3) eine randomisierte kontrollierte Studie zur Bewertung einer ML-basierten Karies-Erkennungssoftware bezĂŒglich diagnostischer Genauigkeit und Einfluss auf den Entscheidungsprozess durchzufĂŒhren.
Methoden: Das Scoping-Review umfasste Studien ĂŒber ML in der Zahnmedizin, veröffentlicht vom 1. Januar 2015 bis 31. Mai 2021 auf MEDLINE, IEEE Xplore und arXiv. Bias-Risiko und BerichtsqualitĂ€t wurden mit den Checklisten QUADAS-2 beziehungsweise TRIPOD bewertet. In der Benchmarking-Studie wurden 216 ML-Modelle durch Permutationen von sechs Architekturen (U-Net, U-Net++, Feature Pyramid Networks, LinkNet, Pyramid Scene Parsing Network und Mask Attention Network), 12 Backbones (Res-Net18, ResNet34, ResNet50, ResNet101, ResNet152, VGG13, VGG16, VGG19, DenseNet121, DenseNet161, DenseNet169 und DenseNet201) und drei Initialisierungsstrategien (zufĂ€llige-, ImageNet- und CheXpert-Gewichtungen) erstellt. Zum Training und Testen wurden 1.625 BissflĂŒgel-Röntgenaufnahmen genutzt. Es wurde eine fĂŒnffache Kreuzvalidierung durchgefĂŒhrt und die Modellleistung anhand des F1-Scores bewertet. In der klinischen Studie untersuchten 22 ZahnĂ€rzte jeweils 20 zufĂ€llig ausgewĂ€hlte BissflĂŒgelbilder auf Approximalkaries; 10 Bilder wurden mit und 10 Bilder ohne ML ausgewertet. Die Genauigkeit in der Erkennung von LĂ€sionen sowie die abgeleitete Therapieempfehlung wurden bewertet.
Ergebnisse: Das Scoping-Review schloss 168 Studien ein, in denen verschiedene ML-Aufgaben, Modelle, Eingabedaten, Methoden zur Generierung von Referenztests und Leistungsmetriken beschrieben wurden. Die Studien zeigten ein erhebliches Bias-Risiko und eine mĂ€Ăige Einhaltung der Berichtsstandards. In der Benchmarking-Studie hatten komplexere Modelle gegenĂŒber einfachen Modellen allenfalls geringe Vorteile. Mit ImageNet- oder CheXpert-Gewichtungen initialisierte Modelle ĂŒbertrafen solche mit Zufallsgewichtungen (p<0,05). In der klinischen Studie erreichten ZahnĂ€rzte mit ML eine höhere Genauigkeit bei der Kariesdetektion (Receiver-Operating-Charakteristik [Mittelwert (95 % Konfidenzintervall) 0,89 (0,87â0,90)]) als ohne ML [0,85 (0,83â0,86); p<0,05], hauptsĂ€chlich aufgrund höherer SensitivitĂ€t [0,81 (0,74â0,87) verglichen mit 0,72 (0,64â0,79); p<0,05]. ZahnĂ€rzte mit ML wĂ€hlten auffallend hĂ€ufiger invasive Behandlungen als ohne ML (p<0,05).
Schlussfolgerung: Zur besseren Vergleichbarkeit von ML-Studien in der Zahnmedizin, sollten Core Outcomes und Metriken definiert sowie Robustheit und BerichtsqualitĂ€t verbessert werden. Die Entwicklung von ML-Modellen sollte auf informierter Basis erfolgen, bei oft Ă€hnlicher Leistung von einfacheren und komplexeren Modellen. ML kann die diagnostische Genauigkeit erhöhen, aber auch zu mehr invasiven Behandlungen fĂŒhren