[EN] This paper shows the progress in the development of two computer vision applications for measuring skin wounds. Both applications have been written in Python programming language and make use of OpenCV and Scipy open source libraries. Their objective is to be part of a software that calculates the dimensions of skin wounds in an objective and reliable way. This could be useful in the clinical follow-up, assessing the evolution of skin wounds, as well as in research, comparing the efficacy of different treatments. Merging these two applications into a single one would allow to generate two-dimensional results in real time, and three-dimensional results after a few hours of processingThis work is part of the Ph.D. research of D.S., which is supported by a grant from Generalitat Valenciana - Consellería de Educación, Investigación, Cultura y Deporte and the European Social Fund (ACIF/2018/160)Sánchez-Jiménez, D.; Buchón Moragues, FF.; Escutia-Muñoz, B.; Botella-Estrada, R. (2019). Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds. Proceedings. 19(18):1-4. https://doi.org/10.3390/proceedings2019019018S14191

Botella-Estrada, Rafael

Buchón Moragues, Fernando Francisco

Escutia-Muñoz, Begoña

Sánchez-Jiménez, David

English

Crossref

Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds

[EN] This paper shows the progress in the development of two computer vision applications for measuring skin wounds. Both applications have been written in Python programming language and make use of OpenCV and Scipy open source libraries. Their objective is to be part of a software that calculates the dimensions of skin wounds in an objective and reliable way. This could be useful in the clinical follow-up, assessing the evolution of skin wounds, as well as in research, comparing the efficacy of different treatments. Merging these two applications into a single one would allow to generate two-dimensional results in real time, and three-dimensional results after a few hours of processingThis work is part of the Ph.D. research of D.S., which is supported by a grant from Generalitat Valenciana - Consellería de Educación, Investigación, Cultura y Deporte and the European Social Fund (ACIF/2018/160)Sánchez-Jiménez, D.; Buchón Moragues, FF.; Escutia-Muñoz, B.; Botella-Estrada, R. (2019). Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds. Proceedings. 19(18):1-4. https://doi.org/10.3390/proceedings201901901814191

RiuNet

  Proceedings 2019, 19, 18; doi:10.3390/proceedings2019019018 www.mdpi.com/journal/proceedings Proceedings Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds † David Sánchez-Jiménez 1, Fernando Buchón-Moragues 1,*, Begoña Escutia-Muñoz 2  and Rafael Botella-Estrada 2 1 Departamento de Ingeniería Geodésica, Cartográfica y Topográfica, Universitat Politècnica de València, 46022 València, Spain 2 Servicio de Dermatología, Hospital Universitari i Politècnic La Fe de València, 46009 València, Spain * Correspondence: fbuchon@upvnet.upv.es † Presented at the II Congress in Geomatics Engineering, Madrid, Spain, 26–27 June 2019. Published: 16 July 2019 Abstract: This paper shows the progress in the development of two computer vision applications for measuring skin wounds. Both applications have been written in Python programming language and make use of OpenCV and Scipy open source libraries. Their objective is to be part of a software that calculates the dimensions of skin wounds in an objective and reliable way. This could be useful in the clinical follow-up, assessing the evolution of skin wounds, as well as in research, comparing the efficacy of different treatments. Merging these two applications into a single one would allow to generate two-dimensional results in real time, and three-dimensional results after a few hours of processing. Keywords: wounds; skin; ulcers; 3D modelling; geomatics; photogrammetry; OpenCV; Python  1. Introduction Biomedical applications have great potential in the field of geomatics, since techniques such as photogrammetry and remote sensing can be used as supplementary tests for various measurements, which are useful in the clinical follow-up of patients and in research [1–5]. Our line of research focuses on the area of dermatology, specifically on the measurement of the dimensions of skin wounds. The procedures include the following successive stages: taking photographs; reconstructing the 3D model from them; removing the noise in that model; defining the wound contour; interpolating the reference surface using the healthy skin; measuring the dimensions of the wound and presenting the results as a report for their interpretation as complementary tests by the medical specialist. In previous projects we developed the procedures for taking photographs and measuring the dimensions of skin wounds, using digital cameras and photogrammetric scanning software based on correlation. We tested our technique in a randomised clinical trial. We also created a system of applications to automate the presentation of results, including a website prototype to store them, testing it with data from 50 leg ulcers [6–11]. This project tries to go one step further, developing two computer vision applications in order to improve the automation of the definition of the wound contour, and to simplify the measurement of the dimensions of skin wounds and the presentation of results.   Proceedings 2019, 19, 18 2 of 4  2. Justification and Objectives The delimitation of the wound contour is a crucial aspect in the measurement of its dimensions. The manual definition of this contour is subjective, so it is an added source of imprecision to that of the measurement method itself. The measurement of this contour has an inter-observer variability, and even intra-observer variability, due to factors such as position and angle of the photograph, lighting and user’s ability to reproduce this measurement. Therefore, it would be useful to develop an application that could determine the contour of the wound in an objective and consistent way. In addition, it is necessary to automate the procedure for measuring the dimensions of the wounds and presenting results, in order to accelerate their evaluation by health personnel. 3. Method and Results 3.1. Application 1 This application (Figure 1) has a photograph of the skin wound as input data. It semi-automatically detects the contour and measures the following dimensions: circularity ratio, maximum length, perimeter and surface area. Its execution time is less than 5 min. The output is a report in PDF format with: photograph of the skin wound, its contour and dimensions.  Figure 1. Application 1 user interface overview. The application workflow includes the following sequential steps: 1. Select the photograph of the wound. JPG and PNG formats are supported. 2. Scale the image. It supports two options: the manual option, in which the user selects two points on the image and records the distance in mm between them, and the automatic option, in which the application automatically detects markers with certain characteristics of shape, color and size. 3. Determine the wound contour. It has two stages: in the first stage, the user manually sets a rectangle that completely encloses the wound, and the application makes a first approach to the wound contour. In the second stage, an iterative process of improvement in the definition of the wound contour is performed, in which the user draws a line where the wound or the healthy skin was wrongly classified. The application fits these requirements and delimits a new contour, using the color differences between the pixels classified as healthy skin and those classified as ulcer. 4. Calculate the dimensions: circularity ratio, maximum length, perimeter and surface area. 5. Save results: report in PDF format with the photograph of the skin wound, its contour and dimensions. Proceedings 2019, 19, 18 3 of 4  3.2. Application 2 This application (Figure 2) has a video of the skin wound as input data. It semi-automatically detects the contour and measures, in addition to the dimensions of Application 1, the roughness index, the excavated surface and the volume of the skin wound. Its execution time is less than 5 h. The outputs are a three-dimensional model of the skin wound, as well as a report in PDF format similar to the one obtained in Application 1.  Figure 2. Application 2 user interface overview. The application workflow includes the following sequential steps: 1. Select the video of the wound. AVI and MP4 formats are supported. 2. Upload the video to the server. Its frames are extracted, the best ones (based on the geometry and the sharpness of the photograph) are selected, the 3D model is reconstructed and the point cloud in TXT format is returned to the application. 3. Scale the 3D model. Markers with certain characteristics of shape, color and size are automatically detected. In the current version of the application, the markers are black circles placed on a grid of calibrated paper with a white background. The centroids are identified and the distance between them is scaled. 4. Create an orthophotograph. It has a pixel size of 100 microns and Z, R, G, B data. 5. Translate and rotate the 3D model. The user manually sets a rectangle that completely encloses the wound. The 3D model is translated so that the center of this rectangle matches the origin of the coordinate system. The 3D model is rotated, locating the wound at the top. 6. Determine the wound contour. The procedure is similar to the one in Application 1. 7. Determine the healthy skin contour. A 20 mm buffer is set with respect to the wound contour. This contour can be edited by the user. 8. Interpolate the reference surface, using the healthy skin contour. 9. Calculate the dimensions: circularity ratio, roughness index, maximum length, perimeter, surface area, excavated surface and volume. 10. Save results: 3D model in OBJ format and report in PDF format with: orthophotograph, wound contour and its dimensions. 4. Discussion The applications described here are in the alpha stage of development. Their functionalities must be improved and their results should be validated against other reference methods before becoming a stable release. Proceedings 2019, 19, 18 4 of 4  In future versions, both applications will be merged and coded for their use on a mobile phone with Android operating system. Merging these two applications into a single one would allow to obtain two-dimensional results in real time, and three-dimensional results after a few hours of processing. 5. Conclusions These unfinished applications have potential usefulness as objective tools: in the clinical follow-up, assessing the evolution of skin wounds, and in research, comparing the efficacy of different treatments. Author Contributions: Supervision, F.B.-M. and R.B.-E.; provision of patients, B.E.-M. and R.B.-E.; software development, D.S.-J.; writing of the published work, D.S.-J. and F.B.-M.; conceptualisation, D.S.-J., F.B.-M., B.E.-M. and R.B.-E. Funding: This work is part of the Ph.D. research of D.S., which is supported by a grant from Generalitat Valenciana—Consellería de Educación, Investigación, Cultura y Deporte and the European Social Fund (ACIF/2018/160). Conflicts of Interest: The authors declare no conflict of interest. References 1. Wannous, H.; Lucas, Y.; Treuillet, S. Enhanced Assessment of the Wound-Healing Process by Accurate Multiview Tissue Classification. IEEE Trans. Med. Imaging 2011, 30, 315–326, doi:10.1109/TMI.2010.2077739. 2. Mukherjee, R.; Tewary, S.; Routray, A. Diagnostic and Prognostic Utility of Non-Invasive Multimodal Imaging in Chronic Wound Monitoring: A Systematic Review. J. Med. Syst. 2017, 41, 46, doi:10.1007/s10916-016-0679-y. 3. Jorgensen, L.B.; Sorensen, J.A.; Jemec, G.B.E.; Yderstraede, K.B. Methods to assess area and volume of wounds—A systematic review. Int. Wound J. 2016, 13, 540–553, doi:10.1111/iwj.12472. 4. Pires, I.M.; Garcia, N. Wound Area Assessment using Mobile Application. In Proceedings of the HEALTHINF 2015—International Conference on Health Informatics, Lisbon, Portugal, 12–15 January 2015; pp. 271–282, doi:10.5220/0005236502710282. 5. Budman, J.; Keenahan, K.; Acharya, S.; Brat, G.A. Design of a Smartphone Application for Automated Wound Measurements in Home Care. Connect. Health Symp. 2015, 1, e16, doi:10.2196/iproc.4703. 6. Botella, R.; Palomar, J.M.; Escutia, M.B.; Buchón, F.F.; Sánchez-Jiménez, D.; García, A.; Escario, E.; Martínez, M.L. Modelado y medición de úlceras de la piel por técnicas fotogramétricas de objeto cercano (MEDULC). In Proyecto Coordinado UPV-La Fe; Editorial Universitat Politècnica De Valènci: Valènci, Spain, 2015. 7. Martínez, M.L.; Escario, E.; Poblet, E.; Sánchez-Jiménez, D.; Buchón, F.F.; Izeta, A.; Jiménez, F. Hair follicle-containing punch grafts accelerate chronic ulcer healing: A randomized controlled trial. J. Am. Acad. Dermatol. 2016, 75, 1007–1014, doi:10.1016/j.jaad.2016.02.1161. 8. Sánchez-Jiménez, D. Aplicaciones médicas de la fotogrametría a la medición de úlceras de la piel. In Proyecto Final de Carrera; Universitat Politècnica de València: Valencia, Spain, 2013. 9. Sánchez-Jiménez, D. Modelado de úlceras de la piel mediante fotogrametría: Escaneado basado en imágenes. In Proyecto Final de Grado; Universitat Politècnica de València: Valencia, Spain, 2014. 10. Buchón, F.F. Sistemas Fotogramétricos Submilimétricos de Adquisición de Datos Tridimensionales Aplicados a la Dermatología. Ph.D. Thesis, Universitat Politècnica de València, Valencia, Spain, 2015. 11. Sánchez-Jiménez, D.; Buchón, F.F.; Palomar, J.M.; Peris, G. Procesamiento automatizado de modelos tridimensionales de úlceras cutáneas. Primer Congr. En Ing. Geomática 2017, doi:10.4995/CIGeo2017.2017.6553.  © 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).  

This paper shows the progress in the development of two computer vision applications for measuring skin wounds. Both applications have been written in Python programming language and make use of OpenCV and Scipy open source libraries. Their objective is to be part of a software that calculates the dimensions of skin wounds in an objective and reliable way. This could be useful in the clinical follow-up, assessing the evolution of skin wounds, as well as in research, comparing the efficacy of different treatments. Merging these two applications into a single one would allow to generate two-dimensional results in real time, and three-dimensional results after a few hours of processing

David Sánchez-Jiménez

Multidisciplinary Digital Publishing Institute

https://riunet.upv.es/bitstream/10251/169341/1/Sanchez-JimenezBuchonEscutia-Munoz%20-%20Development%20of%20Computer%20Vision%20Applications%20to%20Automate%20the%20....pdf

Development of Computer Vision Applications to Automate the Measurement of the Dimensions of Skin Wounds

Abstract

Similar works

Full text

Available Versions

Crossref

RiuNet

Multidisciplinary Digital Publishing Institute