2 research outputs found

    Development and validation of a deep learning algorithm for longitudinal change detection in sequential chest X-ray images

    Get PDF
    ์ตœ๊ทผ ๊ทธ๋ž˜ํ”ฝ ์ฒ˜๋ฆฌ ์žฅ์น˜ ๋ฐ ๋น…๋ฐ์ดํ„ฐ๊ฐ€ ๋ฐœ์ „ํ•˜๋ฉด์„œ, ์˜๋ฃŒ ์˜์ƒ์ฒ˜๋ฆฌ ๋ถ„์•ผ์— ์ธ๊ณต์ง€๋Šฅ ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ์ ‘๋ชฉ์‹œ์ผœ ์ฃผ์š” ์งˆ๋ณ‘์„ ์ง„๋‹จ ๋ฐ ๊ฒ€์ถœํ•˜๋Š” ์—ฐ๊ตฌ๊ฐ€ ํ™œ๋ฐœํžˆ ์ง„ํ–‰๋˜๊ณ  ์žˆ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ํ˜„์žฌ๊นŒ์ง€ ์ œ์•ˆ๋œ ์ธ๊ณต์ง€๋Šฅ ๊ธฐ๋ฐ˜์˜ ๋ถ„๋ฅ˜ ๋ชจ๋ธ๋“ค์€ ์ฃผ์–ด์ง„ ๋‹จ์ผ ์˜์ƒ๋งŒ์„ ๋…๋ฆฝ์ ์œผ๋กœ ์ด์šฉํ•˜์—ฌ ๊ฒฐ๊ณผ๋ฅผ ๋„์ถœํ•œ๋‹ค. ์ฆ‰, ํ˜„์žฌ ์ดฌ์˜๋œ ์˜์ƒ์€ ์ด์ „ ๊ธฐ๋ก๊ณผ ์ž ์žฌ์ ์œผ๋กœ ๊ด€๋ จ์ด ์žˆ์Œ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ , ์‚ฌ์ „์— ์ •์˜๋œ ๋น„์ •์ƒ ๋ฒ”์ฃผ๋งŒ์„ ์˜ˆ์ธกํ•˜๋Š” ํšก๋‹จ๋ฉด์  ๋ถ„์„์„ ์‹œํ–‰ํ•˜๋Š” ๊ฒƒ์ด๋‹ค. ๋ถ„๋ฅ˜ ์„ฑ๋Šฅ์€ ์˜์ƒ์˜ํ•™ ์ž„์ƒ์˜์˜ ์ˆ˜์ค€์— ๊ทผ์ ‘ํ•˜์˜€์ง€๋งŒ, ๋ณ‘๋ณ€์˜ ๊ตฌ์ฒด์ ์ธ ๋ณ€ํ™”์— ๋Œ€์‘ํ•˜์ง€ ๋ชปํ•œ๋‹ค. ์ด๋Š” ํ™˜์ž๊ฐ€ ์ด์ „์— ์ดฌ์˜ํ•œ ์˜์ƒ์„ ๋ถ„๋ฅ˜ํ•˜๋”๋ผ๋„ ๋‹จ์ˆœ ์งˆ๋ณ‘์˜ ์ถœํ˜„ ์œ ๋ฌด๋กœ๋Š” ๋ณ‘๋ณ€์˜ ๋ณ€ํ™”๋ฅผ ํŒŒ์•…ํ•˜๊ธฐ๊ฐ€ ์–ด๋ ต๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค. ํŠนํžˆ ์ผ๋ถ€ ์ฃผ์š” ์งˆ๋ณ‘์˜ ๊ฒฝ์šฐ, ๋™์ผํ•œ ์งˆ๋ณ‘ ๋‚ด์—์„œ๋„ ๊ทธ ํŒจํ„ด์˜ ์ข…๋ฅ˜๊ฐ€ ๋‹ค์–‘ํ•  ๋ฟ ๋งŒ ์•„๋‹ˆ๋ผ, ์žฅ๊ธฐ๊ฐ„ ๋˜๋Š” ๊ธ‰์„ฑ ๋ณ€ํ™” ๋“ฑ ๋ณ€ํ™” ์–‘์ƒ์ด ํ™˜์ž์˜ ์ž„์ƒ๊ธฐ๋ก์— ๋”ฐ๋ผ ๋งค์šฐ ๋‹ค๋ฅด๋‹ค. ๋”ฐ๋ผ์„œ ํšก๋‹จ๋ฉด์  ๋ถ„์„๋งŒ์œผ๋กœ๋Š” ์‹œ๊ฐ„์— ๋”ฐ๋ฅธ ํŠน์ • ๋ณ€ํ™”๋ฅผ ๊ฒ€์ถœํ•˜๋Š” ๊ฒƒ์€ ๋ถˆ๊ฐ€๋Šฅํ•˜๊ธฐ ๋•Œ๋ฌธ์— ์ข…๋‹จ๋ฉด์  ๋ถ„์„์ด ํ•จ๊ป˜ ์š”๊ตฌ๋œ๋‹ค. ๋ณธ ์—ฐ๊ตฌ๋Š” ์ฃผ์–ด์ง„ ๋‘ ์˜์ƒ(์ „,ํ›„) ๊ฐ„์˜ ๋ณ‘๋ณ€์˜ ํŠน์ • ๋ณ€ํ™”๋ฅผ ๊ฐ์ง€ํ•˜๋Š” ์ƒˆ๋กœ์šด ์ธ๊ณต์ง€๋Šฅ ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ์ œ์•ˆํ•œ๋‹ค. ๋ณธ ์•Œ๊ณ ๋ฆฌ์ฆ˜์˜ ํ•ต์‹ฌ ๊ธฐ๋ฒ•์€ ์ •ํ•ฉ๋˜์ง€ ์•Š์€ ๋‘ ์˜์ƒ์˜ ๊ธฐํ•˜ ์ƒ๊ด€๊ด€๊ณ„๋„๋ฅผ ๊ตฌํ•˜์—ฌ ์˜์ƒ ๊ฐ„ ๋ณ€ํ™” ์œ ๋ฌด์— ๋”ฐ๋ฅธ ๊ธฐํ•˜ ์ƒ๊ด€๊ด€๊ณ„๋„ ๋ณ€ํ™” ํŒจํ„ด์„ ํŒŒ์•…ํ•˜๊ณ , ๋ณ€ํ™”์œ ๋ฌด๋ฅผ ์ด์ง„ ๋ถ„๋ฅ˜ํ•˜๋Š” ๊ฒƒ์ด๋‹ค. ํ˜„์žฌ๊นŒ์ง€ ์ข…๋‹จ๋ฉด์  ๋ถ„์„์„ ์œ„ํ•œ ๊ธฐ๊ณ„ํ•™์Šต์šฉ ์ฐธ์กฐํ‘œ์ค€ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๊ฐ€ ๊ณต๊ฐœ๋œ ๊ฒƒ์ด ์—†๊ธฐ ๋•Œ๋ฌธ์—, ๋ณธ ์—ฐ๊ตฌ์—์„œ๋Š” ์˜์ƒ ํŒ๋…๋ฌธ์„ ๋ถ„์„ํ•˜์—ฌ ๋ณ‘๋ณ€์˜ ๋ณ€ํ™”๊ธฐ์ค€์„ ํ™•๋ฆฝํ•˜๊ณ , ์งˆํ™˜์˜ ์ข…๋ฅ˜, ๊ฒฝ๊ณผ์‹œ๊ฐ„, ๋ณ€ํ™” ํ˜•ํƒœ ๋“ฑ์— ๋”ฐ๋ฅธ ๋ฐ์ดํ„ฐ ๋ถ„๋ฅ˜ ์ฒด๊ณ„๋ฅผ ๊ตฌ์ถ•ํ•˜์—ฌ ์ˆœ์ฐจ์  ํ‰๋ถ€ X-์„  ์˜์ƒ์— ๋Œ€ํ•œ ์ฐธ์กฐํ‘œ์ค€ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค๋ฅผ ์ž์ฒด์ ์œผ๋กœ ํ™•๋ณดํ•˜์˜€๋‹ค. ๋ณธ ์—ฐ๊ตฌ๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜ ์„ฑ๋Šฅ์„ ๊ฐ๊ด€์ ์œผ๋กœ ๋ถ„์„ํ•˜๊ธฐ ์œ„ํ•˜์—ฌ ์ˆ˜์‹ ์ž์กฐ์ž‘ํŠน์„ฑ(ROC)์˜ ํ•˜์˜ ๋ฉด์ (AUC)์„ ์‚ฐ์ถœํ•˜๊ณ , ๊ธฐ์กด ๊ฐœ๋ฐœ๋œ ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๋ฐ ์œ ์‚ฌ ์—ฐ๊ตฌ์™€ ์ •๋Ÿ‰์ ์œผ๋กœ ๋น„๊ตํ•˜์˜€๋‹ค. ๋ณธ ์—ฐ๊ตฌ์—์„œ ์ œ์•ˆํ•˜๋Š” ๊ธฐํ•˜ ์ƒ๊ด€๊ด€๊ณ„๋„๋ฅผ ์ด์šฉํ•œ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด AUC=0.89 (95% ์‹ ๋ขฐ๊ตฌ๊ฐ„, 0.86-0.92) ๋ฐ Youden's index์—์„œ์˜ ๋ฏผ๊ฐ๋„=0.83, ํŠน์ด๋„=0.82์œผ๋กœ ๊ฐ€์žฅ ๋›ฐ์–ด๋‚œ ์„ฑ๋Šฅ์„ ๋ณด์˜€๋‹ค. ๋˜ํ•œ ์ฃผ์–ด์ง„ ๋‘ ์˜์ƒ์—์„œ ํŠน์ • ๋ณ‘๋ณ€์˜ ๋ณ€ํ™”์— ๋”ฐ๋ฅธ ๊ธฐํ•˜ ์ƒ๊ด€๊ด€๊ณ„๋„๋ฅผ ์ •์„ฑ์ ์œผ๋กœ ๋ถ„์„ํ•จ์œผ๋กœ์จ ์‹ค์ œ๋กœ ํ•ด๋‹น ๋ณ€ํ™”๊ฐ€ ๋ฐœ์ƒํ•œ ์œ„์น˜๋ฅผ ์—ญ์ถ”์  ๋ฐ ์„ค๋ช…ํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐ€๋Šฅ์„ฑ์„ ์ œ์‹œํ•˜์˜€๋‹ค.The diagnostic decision for chest X-ray image generally considers a probable change in a lesion, compared to the previous examination. We propose a novel algorithm to detect the change in longitudinal chest X-ray images. We extract feature maps from a pair of input images through two streams of convolutional neural networks. Next, we generate the geometric correlation map computing matching scores for every possible match of local descriptors in two feature maps. This correlation map is fed into a binary classifier to detect specific patterns of the map representing the change in the lesion. Since no public dataset offers proper information to train the proposed network, we also build our own dataset by analyzing reports in examinations at a tertiary hospital. Experimental results show our approach outperforms previous methods in quantitative comparison. We also provide various case examples visualizing the effect of the proposed geometric correlation map.1. ์„œ๋ก  7 1.1. ๋ฐฐ๊ฒฝ 7 1.2. ์—ฐ๊ตฌ์˜ ๋ชฉ์  9 2. ๋ณธ๋ก  12 2.1. ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ตฌ์กฐ 12 2.2.1. ํŠน์ง• ์ถ”์ถœ 14 2.2.2. ๊ธฐํ•˜ ์ƒ๊ด€๊ด€๊ณ„๋„ 14 2.2.3. ์ด์ง„ ๋ถ„๋ฅ˜๊ธฐ 16 2.2. ์ฐธ์กฐํ‘œ์ค€ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค 17 3. ๊ฒฐ๊ณผ ๋ฐ ๋ถ„์„ 21 3.1. ํŒ๋…๋ฌธ ๊ฐ€๊ณต 21 3.2. ์•Œ๊ณ ๋ฆฌ์ฆ˜ ์„ฑ๋Šฅ 22 4. ๊ณ ์ฐฐ 28 4.1. ์‹คํ—˜ ๊ฒฐ๊ณผ ๊ณ ์ฐฐ 28 4.2. ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ณ ์ฐฐ 28 5. ๊ฒฐ๋ก  30 ์ฐธ๊ณ  ๋ฌธํ—Œ 31 Abstract 33์„
    corecore