Derin öğrenme yöntemi ile panoramik radyografiden diş eksikliklerinin tespiti: Bir yapay zekâ pilot çalışması

Amaç: Bu çalışmanın amacı, panoramik radyografide diş eksikliklerinin değerlendirilmesi için tasarlanmış tanı amaçlı bilgisayar yazılımının işlevini geliştirmek ve değerlendirmektir.Gereç ve Yöntemler: Veri seti eksik diş tespiti için 99 tam diş ve 54 eksik diş olmak üzere 153 görüntüden oluşmaktadır. Tüm görüntüler Ağız, Diş ve Çene Radyolojisi uzmanları tarafından tekrar kontrol edilmiş ve doğrulanmıştır. Veri setindeki tüm görüntüler eğitim öncesinde 971 X 474 piksel olarak yeniden boyutlandırılmıştır. Açık kaynak kodlu python programlama dili ve OpenCV, NumPy, Pandas, ile Matplotlib kütüphaneleri etkin olarak kullanılarak bir rastgele dizilim oluşturulmuştur. Önceden eğitilmiş bir Google Net Inception v3 CNN ağı ön işleme için kullanılmış ve veri setleri transfer öğrenimi kullanılarak eğitilmiştir.Bulgular: Eğitim de kullanılan görüntülerin modeli tahminlendirmesi ile çıkan başarı oranı % 94.7’dir. Eğitimde kullanılmayan test için ayrılan görüntülerin tahminlemesindeki başarı oranı % 75’dir. Sonuç: Derin öğrenme tekniklerinde veri seti arttıkça başarı oranları da artmaktadır. Daha fazla görüntüyle oluşacak veri setininin eğitim modellerinde başarı oranları yükselecektir. Gelecek çalışmalar daha büyük veri setleriyle yapılmalıdır.ANAHTAR KELİMELER Panoramik radyografi, derin öğrenme, yapay zek

Artificial intelligence based on Convolutional Neural Network for detecting dental caries on bitewing and periapical radiographs

Objectives: This narrative review is written to describe the accuracy of caries detection and find out the clinical implications and future prospects of using Convolutional Neural Network (CNN) to determine radio-diagnosis of dental caries in bitewing and periapical radiographs. Review: The databases used for literature searching in this narrative review were PubMed, Google Scholar, and Science Direct. The inclusion criteria were original article, case report, and textbook written in English and Bahasa Indonesia, published within 2011-2021. The exclusion criteria were articles that the full text could not be accessed, research article that did not provide the methods used, and duplication articles. In this narrative review, a total of 33 literatures consisting of 30 articles and three textbooks reviewed, including four original articles on CNN for caries detection. Conclusion: Results of the review reveal that GoogLeNet produces the best detection compared to Fully Convolutional Network (FCN) and U-Net for caries detection in bitewing and periapical radiographs. Nonetheless, the positive predictive value (PPV), recall, negative predictive value (NPV), specificity, F1-score, and accuracy values in these architectures indicate good performance. The differences of each CNN’s performances to detect caries are determined by the number of trained datasets, the architecture’s layers, and the complexity of the CNN architectures. The conclusion of this review is CNN can be used as an alternative to detect caries, increasing the diagnostic accuracy and time efficiency as well as preventing errors due to dentist fatigue. Yet the CNN is not able to substitute the expertise of a radiologist. Therefore, it is need to be revalidated by the radiologist to avoid diagnostic errors

Automatic Classification of Oral Pathologies Using Orthopantomogram Radiography Images Based on Convolutional Neural Network

An attempt has been made to device a robust method to classify different oral pathologies using Orthopantomogram (OPG) images based on Convolutional Neural Network (CNN). This system will provide a novel approach for the classification of types of teeth (viz., incisors and molar teeth) and also some underlying oral anomalies such as fixed partial denture (cap) and impacted teeth. To this end, various image preprocessing techniques are performed. The input OPG images are resized, pixels are scaled and erroneous data are excluded. The proposed algorithm is implemented using CNN with Dropout and the fully connected layer has been trained using hybrid GA-BP learning. Using the Dropout regularization technique, over fitting has been avoided and thereby making the network to correctly classify the objects. The CNN has been implemented with different convolutional layers and the highest accuracy of 97.92% has been obtained with two convolutional layers

파노라마방사선영상에서 딥러닝 신경망을 이용한 치성 낭과 종양의 자동 진단 방법

학위논문 (박사) -- 서울대학교 대학원 : 치의학대학원 치의학과, 2021. 2. 이원진.Objective: The purpose of this study was to automatically diagnose odontogenic cysts and tumors of the jaw on panoramic radiographs using a deep convolutional neural network. A novel framework method of deep convolutional neural network was proposed with data augmentation for detection and classification of the multiple diseases. Methods: A deep convolutional neural network modified from YOLOv3 was developed for detecting and classifying odontogenic cysts and tumors of the jaw. Our dataset of 1,282 panoramic radiographs comprised 350 dentigerous cysts, 302 periapical cysts, 300 odontogenic keratocysts, 230 ameloblastomas, and 100 normal jaw with no disease. In addition, the number of radiographs was augmented 12-fold by flip, rotation, and intensity changes. The Intersection over union threshold value of 0.5 was used to obtain performance for detection and classification. The classification performance of the developed convolutional neural network was evaluated by calculating sensitivity, specificity, accuracy, and AUC (Area under the ROC curve) for diseases of the jaw. Results: The overall classification performance for the diseases improved from 78.2% sensitivity, 93.9% specificity, 91.3% accuracy, and 0.86 AUC using the convolutional neural network with unaugmented dataset to 88.9% sensitivity, 97.2% specificity, 95.6% accuracy, and 0.94 AUC using the convolutional neural network with augmented dataset. Convolutional neural network using augmented dataset had the following sensitivities, specificities, accuracies, and AUC: 91.4%, 99.2%, 97.8%, and 0.96 for dentigerous cysts, 82.8%, 99.2%, 96.2%, and 0.92 for periapical cysts, 98.4%, 92.3%, 94.0%, and 0.97 for odontogenic keratocysts, 71.7%, 100%, 94.3%, and 0.86 for ameloblastomas, and 100.0%, 95.1%, 96.0%, and 0.94 for normal jaw, respectively. Conclusion: The novel framework convolutional neural network method was developed for automatically diagnosing odontogenic cysts and tumors of the jaw on panoramic radiographs using data augmentation. The proposed convolutional neural network model showed high sensitivity, specificity, accuracy, and AUC despite the limited number of panoramic images involved.1. 목 적 구강악안면영역에서 발생하는 낭종 혹은 종양을 조기에 발견하지 못하여 적절한 치료가 이루어지지 못하고 지연되는 경우가 있다. 이러한 문제를 해결하기 위하여 인공신경망을 기반으로 하는 기계학습 기술인 딥러닝신경망(deep convolutional neural network)을 이용하는 컴퓨터 보조진단은 보다 정확하고 빠른 결과를 제공할 수 있다. 따라서 본 연구에서는 파노라마방사선영상에서 딥러닝신경망을 이용하여 구강악안면에서 자주 나타나는 4가지 질환(함치성낭, 치근단당, 치성각화낭, 법랑모세포종)을 자동으로 검출 및 진단하는 딥러닝신경망을 개발하고 그 정확성을 평가하였다. 2. 방 법 본 연구에서는 파노라마방사선영상에서 악골에 발생한 치성 낭과 종양을 검출하고 진단하기 위하여 YoLoV3를 기반으로 한 딥러닝신경망을 구축하였다. 1999년부터 2017년까지 서울대학교치과병원에서 조직병리학적으로 확진된 함치성낭 350례, 치근단낭 302례, 치성각화낭 300례, 법랑모세포종 230례의 환자로부터 획득한 총 1182매 파노라마방사선영상을 분석하였다. 또한 대조군으로 질환이 없는 정상 파노라마방사선영상 100매를 선택하였다. 파노라마방사선영상 데이터는 감마, 보정, 회전, 뒤집기 기법을 통하여 12배 증강되었다. 총 데이터의 60%는 훈련세트, 20%는 검증세트, 20%는 테스트세트로 사용하였다. 개발된 딥러닝신경망은 5배 교차검증(5-fold cross validation)기법을 이용하여 평가하였다. 본 연구에서 개발한 딥러닝신경망의 성능은 정확도(Accuracy), 민감도(sensitivity), 특이도(specificity) 및 ROC분석을 통한 AUC(area under the curve) 지표를 사용하여 측정하였다. 3. 결 과 본 연구에서 개발한 딥러닝신경망은 데이터 증강을 하지 않았을 때 78.2% 민감도, 93.9% 특이도, 91.3% 정확도 및 0.86의 AUC 값을 보였고 데이터 증강을 하였을 때에는 88.9% 민감도, 97.2% 특이도, 95.6% 정확도 및 0.94 AUC의 개선된 성능을 보여주었다. 함치성낭은 91.4% 민감도, 99.2% 특이도, 97.8% 정확도 및 0.96 AUC 값을 보였다. 치근단낭은 82.8% 민감도, 99.2% 특이도, 96.2% 정확도 및 0.92 AUC 값을 나타냈다. 치성각화낭은 98.4% 민감도, 92.3% 특이도, 94.0% 정확도 및 0.97 AUC 결과를 보였다. 법랑모세포종은 71.7% 민감도, 100% 특이도, 94.3% 정확도 및 0.86 AUC의 결과를 보였다. 그리고 정상적인 악골에서는 100% 민감도, 95.1% 특이도, 96.0% 정확도 및 0.97 AUC값을 각각 보였다. 4. 결 론 본 연구에서는 파노라마방사선영상에서 치성 낭과 종양을 자동으로 검출하고 진단하는 딥러닝신경망을 개발하였다. 본 연구는 파노라마방사선영상의 수가 충분하지 않았음에도 불구하고 데이터 증강 기법을 이용하여 우수한 민감도, 특이도 및 정확도 결과를 보였다. 본 연구결과를 통하여 개발된 시스템은 환자의 상기 질환을 조기에 진단하고 적절한 시기에 치료하는데 유용하다.Contents Abstract i Tables v Figure legends vi Introduction １ Materials and Methods ５ Data preparation and augmentation of panoramic radiographs ５ A deep convolutional neural network model for detection and classification of multiple diseases YOLOv3 ９ Evaluation of detection and classification performance of the deep convolutional neural network model １３ Results １５ Discussion ２８ Conclusion ３７ Acknowledgments ３８ References ３９ 요약(국문초록) ４８Docto

Deep learning for early dental caries detection in bitewing radiographs

The early detection of initial dental caries enables preventive treatment, and bitewing radiography is a good diagnostic tool for posterior initial caries. In medical imaging, the utilization of deep learning with convolutional neural networks (CNNs) to process various types of images has been actively researched, with promising performance. In this study, we developed a CNN model using a U-shaped deep CNN (U-Net) for caries detection on bitewing radiographs and investigated whether this model can improve clinicians' performance. The research complied with relevant ethical regulations. In total, 304 bitewing radiographs were used to train the CNN model and 50 radiographs for performance evaluation. The diagnostic performance of the CNN model on the total test dataset was as follows: precision, 63.29%; recall, 65.02%; and F1-score, 64.14%, showing quite accurate performance. When three dentists detected caries using the results of the CNN model as reference data, the overall diagnostic performance of all three clinicians significantly improved, as shown by an increased sensitivity ratio (D1, 85.34%; D1', 92.15%; D2, 85.86%; D2', 93.72%; D3, 69.11%; D3', 79.06%; p < 0.05). These increases were especially significant (p < 0.05) in the initial and moderate caries subgroups. The deep learning model may help clinicians to diagnose dental caries more accurately.ope