Automatic intensity windowing of mammographic images based on a perceptual metric

[EN] Purpose: Initial auto-adjustment of the window level WL and width WW applied to mammographic images. The proposed intensity windowing (IW) method is based on the maximization of the mutual information (MI) between a perceptual decomposition of the original 12-bit sources and their screen displayed 8-bit version. Besides zoom, color inversion and panning operations, IW is the most commonly performed task in daily screening and has a direct impact on diagnosis and the time involved in the process. Methods: The authors present a human visual system and perception-based algorithm named GRAIL (Gabor-relying adjustment of image levels). GRAIL initially measures a mammogram's quality based on the MI between the original instance and its Gabor-filtered derivations. From this point on, the algorithm performs an automatic intensity windowing process that outputs the WL/WW that best displays each mammogram for screening. GRAIL starts with the default, high contrast, wide dynamic range 12-bit data, and then maximizes the graphical information presented in ordinary 8-bit displays. Tests have been carried out with several mammogram databases. They comprise correlations and an ANOVA analysis with the manual IW levels established by a group of radiologists. A complete MATLAB implementation of GRAIL is available at . Results: Auto-leveled images show superior quality both perceptually and objectively compared to their full intensity range and compared to the application of other common methods like global contrast stretching (GCS). The correlations between the human determined intensity values and the ones estimated by our method surpass that of GCS. The ANOVA analysis with the upper intensity thresholds also reveals a similar outcome. GRAIL has also proven to specially perform better with images that contain micro-calcifications and/or foreign X-ray-opaque elements and with healthy BI-RADS A-type mammograms. It can also speed up the initial screening time by a mean of 4.5 s per image. Conclusions: A novel methodology is introduced that enables a quality-driven balancing of the WL/WW of mammographic images. This correction seeks the representation that maximizes the amount of graphical information contained in each image. The presented technique can contribute to the diagnosis and the overall efficiency of the breast screening session by suggesting, at the beginning, an optimal and customized windowing setting for each mammogram. (C) 2017 American Association of Physicists in MedicineThis work has the support of IST S.L., University of Valencia (CPI15170), Consolider (CPAN13TR01), MINETUR (TSI1001012013019) and IFIC (Severo Ochoa Centre of Excellence SEV20140398). The authors would also like to thank C. Bellot M.D., M. Brouzet M.D., C. Calabuig M.D., J. Camps M.D., J. Coloma M.D., D. Erades M.D., Mr. V. Gutierrez, J. Herrero M.D., Dr. I. Maestre, Dr. A. Neco M.D., C. Ortola M.D., A. Rubio M.D., Dr. R. Sanchez, Dr. F. Sellers, A. Segura M.D., and the Spanish Cancer Association (AECC) for their effort, participation, counseling, and commitment in this research study. The authors report no conflicts of interest in conducting the research.Albiol Colomer, A.; Corbi, A.; Albiol Colomer, F. (2017). Automatic intensity windowing of mammographic images based on a perceptual metric. Medical Physics. 44(4):1369-1378. https://doi.org/10.1002/mp.12144S13691378444Maidment, A. D. A., Fahrig, R., & Yaffe, M. J. (1993). Dynamic range requirements in digital mammography. Medical Physics, 20(6), 1621-1633. doi:10.1118/1.596949Kimpe, T., & Tuytschaever, T. (2006). Increasing the Number of Gray Shades in Medical Display Systems—How Much is Enough? Journal of Digital Imaging, 20(4), 422-432. doi:10.1007/s10278-006-1052-3ACR, AAPM, and SIIM Practice parameter for determinants of image quality in digital mammography 2014Committee DS PS3.3 information object definitions 2015Pisano, E. D., Chandramouli, J., Hemminger, B. M., Glueck, D., Johnston, R. E., Muller, K., … Pizer, S. (1997). The effect of intensity windowing on the detection of simulated masses embedded in dense portions of digitized mammograms in a laboratory setting. Journal of Digital Imaging, 10(4), 174-182. doi:10.1007/bf03168840Börjesson, S., Håkansson, M., Båth, M., Kheddache, S., Svensson, S., Tingberg, A., … Månsson, L. G. (2005). A software tool for increased efficiency in observer performance studies in radiology. Radiation Protection Dosimetry, 114(1-3), 45-52. doi:10.1093/rpd/nch550Sahidan, S. I., Mashor, M. Y., Wahab, A. S. W., Salleh, Z., & Ja’afar, H. (s. f.). Local and Global Contrast Stretching For Color Contrast Enhancement on Ziehl-Neelsen Tissue Section Slide Images. 4th Kuala Lumpur International Conference on Biomedical Engineering 2008, 583-586. doi:10.1007/978-3-540-69139-6_146Ganesan, K., Acharya, U. R., Chua, C. K., Min, L. C., Abraham, K. T., & Ng, K.-H. (2013). Computer-Aided Breast Cancer Detection Using Mammograms: A Review. IEEE Reviews in Biomedical Engineering, 6, 77-98. doi:10.1109/rbme.2012.2232289Papadopoulos, A., Fotiadis, D. I., & Costaridou, L. (2008). Improvement of microcalcification cluster detection in mammography utilizing image enhancement techniques. Computers in Biology and Medicine, 38(10), 1045-1055. doi:10.1016/j.compbiomed.2008.07.006Panetta, K., Yicong Zhou, Agaian, S., & Hongwei Jia. (2011). Nonlinear Unsharp Masking for Mammogram Enhancement. IEEE Transactions on Information Technology in Biomedicine, 15(6), 918-928. doi:10.1109/titb.2011.2164259Rogowska, J., Preston, K., & Sashin, D. (1988). Evaluation of digital unsharp masking and local contrast stretching as applied to chest radiographs. IEEE Transactions on Biomedical Engineering, 35(10), 817-827. doi:10.1109/10.7288Ramponi, G. (1998). Rational unsharp masking technique. Journal of Electronic Imaging, 7(2), 333. doi:10.1117/1.482649Rangayyan, R. M., Liang Shen, Yiping Shen, Desautels, J. E. L., Bryant, H., Terry, T. J., … Rose, M. S. (1997). Improvement of sensitivity of breast cancer diagnosis with adaptive neighborhood contrast enhancement of mammograms. IEEE Transactions on Information Technology in Biomedicine, 1(3), 161-170. doi:10.1109/4233.654859Tang, J., Liu, X., & Sun, Q. (2009). A Direct Image Contrast Enhancement Algorithm in the Wavelet Domain for Screening Mammograms. IEEE Journal of Selected Topics in Signal Processing, 3(1), 74-80. doi:10.1109/jstsp.2008.2011108LINGURARU, M., MARIAS, K., ENGLISH, R., & BRADY, M. (2006). A biologically inspired algorithm for microcalcification cluster detection. Medical Image Analysis, 10(6), 850-862. doi:10.1016/j.media.2006.07.004Tsai, D.-Y., Lee, Y., & Matsuyama, E. (2007). Information Entropy Measure for Evaluation of Image Quality. Journal of Digital Imaging, 21(3), 338-347. doi:10.1007/s10278-007-9044-5Sheikh, H. R., & Bovik, A. C. (2006). Image information and visual quality. IEEE Transactions on Image Processing, 15(2), 430-444. doi:10.1109/tip.2005.859378Tourassi, G. D., Vargas-Voracek, R., Catarious, D. M., & Floyd, C. E. (2003). Computer-assisted detection of mammographic masses: A template matching scheme based on mutual information. Medical Physics, 30(8), 2123-2130. doi:10.1118/1.1589494Tourassi, G. D., Harrawood, B., Singh, S., Lo, J. Y., & Floyd, C. E. (2006). Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms. Medical Physics, 34(1), 140-150. doi:10.1118/1.2401667Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 13(4), 600-612. doi:10.1109/tip.2003.819861Choi LK Goodall T Bovik AC Perceptual Image Enhancement. Encyclopedia of Image ProcessingFogel, I., & Sagi, D. (1989). Gabor filters as texture discriminator. Biological Cybernetics, 61(2). doi:10.1007/bf00204594Jain, A. K., Ratha, N. K., & Lakshmanan, S. (1997). Object detection using gabor filters. Pattern Recognition, 30(2), 295-309. doi:10.1016/s0031-3203(96)00068-4Vazquez-Fernandez, E., Dacal-Nieto, A., Martin, F., & Torres-Guijarro, S. (2010). Entropy of Gabor Filtering for Image Quality Assessment. Image Analysis and Recognition, 52-61. doi:10.1007/978-3-642-13772-3_6Rangayyan, R. M., Ayres, F. J., & Leo Desautels, J. E. (2007). A review of computer-aided diagnosis of breast cancer: Toward the detection of subtle signs. Journal of the Franklin Institute, 344(3-4), 312-348. doi:10.1016/j.jfranklin.2006.09.003Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., … Prior, F. (2013). The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository. Journal of Digital Imaging, 26(6), 1045-1057. doi:10.1007/s10278-013-9622-7Task Group 18 Imaging Informatics Subcommittee Assessment of display performance for medical imaging systems 2005A. C. of Radiology Committee Bi-rads atlas 5th edition 2014Hochberg, Y., & Benjamini, Y. (1990). More powerful procedures for multiple significance testing. Statistics in Medicine, 9(7), 811-818. doi:10.1002/sim.4780090710Keselman, H. J., & Keselman, J. C. (1984). The analysis of repeated measures designs in medical research. Statistics in Medicine, 3(2), 185-195. doi:10.1002/sim.4780030211Mauchly, J. W. (1940). Significance Test for Sphericity of a Normal $n$-Variate Distribution. The Annals of Mathematical Statistics, 11(2), 204-209. doi:10.1214/aoms/1177731915Samei, E., Badano, A., Chakraborty, D., Compton, K., Cornelius, C., Corrigan, K., … Willis, C. E. (2005). Assessment of display performance for medical imaging systems: Executive summary of AAPM TG18 report. Medical Physics, 32(4), 1205-1225. doi:10.1118/1.1861159Haghighat, M., Zonouz, S., & Abdel-Mottaleb, M. (2015). CloudID: Trustworthy cloud-based and cross-enterprise biometric identification. Expert Systems with Applications, 42(21), 7905-7916. doi:10.1016/j.eswa.2015.06.02

Hopfield Networks in Relevance and Redundancy Feature Selection Applied to Classification of Biomedical High-Resolution Micro-CT Images

We study filter–based feature selection methods for classification of biomedical images. For feature selection, we use two filters — a relevance filter which measures usefulness of individual features for target prediction, and a redundancy filter, which measures similarity between features. As selection method that combines relevance and redundancy we try out a Hopfield network. We experimentally compare selection methods, running unitary redundancy and relevance filters, against a greedy algorithm with redundancy thresholds [9], the min-redundancy max-relevance integration [8,23,36], and our Hopfield network selection. We conclude that on the whole, Hopfield selection was one of the most successful methods, outperforming min-redundancy max-relevance when\ud more features are selected

DeepWSD: Projecting Degradations in Perceptual Space to Wasserstein Distance in Deep Feature Space

Existing deep learning-based full-reference IQA (FR-IQA) models usually predict the image quality in a deterministic way by explicitly comparing the features, gauging how severely distorted an image is by how far the corresponding feature lies from the space of the reference images. Herein, we look at this problem from a different viewpoint and propose to model the quality degradation in perceptual space from a statistical distribution perspective. As such, the quality is measured based upon the Wasserstein distance in the deep feature domain. More specifically, the 1DWasserstein distance at each stage of the pre-trained VGG network is measured, based on which the final quality score is performed. The deep Wasserstein distance (DeepWSD) performed on features from neural networks enjoys better interpretability of the quality contamination caused by various types of distortions and presents an advanced quality prediction capability. Extensive experiments and theoretical analysis show the superiority of the proposed DeepWSD in terms of both quality prediction and optimization.Comment: ACM Multimedia 2022 accepted thesi

Generalization of form in visual pattern classification.

Human observers were trained to criterion in classifying compound Gabor signals with sym- metry relationships, and were then tested with each of 18 blob-only versions of the learning set. General- ization to dark-only and light-only blob versions of the learning signals, as well as to dark-and-light blob versions was found to be excellent, thus implying virtually perfect generalization of the ability to classify mirror-image signals. The hypothesis that the learning signals are internally represented in terms of a 'blob code' with explicit labelling of contrast polarities was tested by predicting observed generalization behaviour in terms of various types of signal representations (pixelwise, Laplacian pyramid, curvature pyramid, ON/OFF, local maxima of Laplacian and curvature operators) and a minimum-distance rule. Most representations could explain generalization for dark-only and light-only blob patterns but not for the high-thresholded versions thereof. This led to the proposal of a structure-oriented blob-code. Whether such a code could be used in conjunction with simple classifiers or should be transformed into a propo- sitional scheme of representation operated upon by a rule-based classification process remains an open question

A Perceptually Based Comparison of Image Similarity Metrics

The assessment of how well one image matches another forms a critical component both of models of human visual processing and of many image analysis systems. Two of the most commonly used norms for quantifying image similarity are L1 and L2, which are specific instances of the Minkowski metric. However, there is often not a principled reason for selecting one norm over the other. One way to address this problem is by examining whether one metric, better than the other, captures the perceptual notion of image similarity. This can be used to derive inferences regarding similarity criteria the human visual system uses, as well as to evaluate and design metrics for use in image-analysis applications. With this goal, we examined perceptual preferences for images retrieved on the basis of the L1 versus the L2 norm. These images were either small fragments without recognizable content, or larger patterns with recognizable content created by vector quantization. In both conditions the participants showed a small but consistent preference for images matched with the L1 metric. These results suggest that, in the domain of natural images of the kind we have used, the L1 metric may better capture human notions of image similarity

Evaluation and Understandability of Face Image Quality Assessment

Face image quality assessment (FIQA) has been an area of interest to researchers as a way to improve the face recognition accuracy. By filtering out the low quality images we can reduce various difficulties faced in unconstrained face recognition, such as, failure in face or facial landmark detection or low presence of useful facial information. In last decade or so, researchers have proposed different methods to assess the face image quality, spanning from fusion of quality measures to using learning based methods. Different approaches have their own strength and weaknesses. But, it is hard to perform a comparative assessment of these methods without a database containing wide variety of face quality, a suitable training protocol that can efficiently utilize this large-scale dataset. In this thesis we focus on developing an evaluation platfrom using a large scale face database containing wide ranging face image quality and try to deconstruct the reason behind the predicted scores of learning based face image quality assessment methods. Contributions of this thesis is two-fold. Firstly, (i) a carefully crafted large scale database dedicated entirely to face image quality assessment has been proposed; (ii) a learning to rank based large-scale training protocol is devel- oped. Finally, (iii) a comprehensive study of 15 face image quality assessment methods using 12 different feature types, and relative ranking based label generation schemes, is performed. Evalua- tion results show various insights about the assessment methods which indicate the significance of the proposed database and the training protocol. Secondly, we have seen that in last few years, researchers have tried various learning based approaches to assess the face image quality. Most of these methods offer either a quality bin or a score summary as a measure of the biometric quality of the face image. But, to the best of our knowledge, so far there has not been any investigation on what are the explainable reasons behind the predicted scores. In this thesis, we propose a method to provide a clear and concise understanding of the predicted quality score of a learning based face image quality assessment. It is believed that this approach can be integrated into the FBI’s understandable template and can help in improving the image acquisition process by providing information on what quality factors need to be addressed

Perceptual Fidelity for Digital Color Imagery

The problem of measuring the fidelity of digital color images in a manner that corresponds to human perceptual assessments is addressed. Experiments are performed to validate human visual system (HVS) models, which provide access to a \u27perceptual space\u27 in which visual distortions may be measured, and then a model is proposed for assessing the perceptual fidelity of digital color image. Color Mach bands are produced in the first experiment, demonstrating that, as in the brightness channel, low spatial frequency attenuation occurs in the chromatic channels of the HVS. In the second experiment, a correlation between the chromatic channels of the HVS model and color discrimination axes of color blind observers is demonstrated. Removing variation from one of the chromatic channels of a natural image produces a color-distorted image which the color blind subjects cannot distinguish from the original. Removing variation from the other chromatic channel produces an image that appears colorful to normally-sighted observers, but monochrome to the color blind observers. The third experiment shows that a Gabor filter-based HVS model produces illusory contours in several illusory contour stimuli. These results provide a unique validation of multiple-channel HVS models which process the image in multiple spatial frequency bands that are tuned to match measured sensitivities of neurons in the primary visual cortex of cats and monkeys. Finally, the multiple-channel processing used in the illusory contour experiment is combined with the color vision model from the first two experiments to produce a multiple-channel, color HVS model for measuring perceptual fidelity of color images. A demonstration of the model shows that the structure of the new model is correct. However, inaccurate parameter values for the multiple-channel processing of the chromatic channels cause over-prediction of visible differences in these channels