Photonics simulation and modelling of skin for design of spectrocutometer

fi=vertaisarvioitu|en=peerReviewed

Opto-physiological modeling applied to photoplethysmographic cardiovascular assessment

This paper presents opto-physiological (OP) modeling and its application in cardiovascular assessment techniques based on photoplethysmography (PPG). Existing contact point measurement techniques, i.e., pulse oximetry probes, are compared with the next generation noncontact and imaging implementations, i.e., non-contact reflection and camera-based PPG. The further development of effective physiological monitoring techniques relies on novel approaches to OP modeling that can better inform the design and development of sensing hardware and applicable signal processing procedures. With the help of finite-element optical simulation, fundamental research into OP modeling of photoplethysmography is being exploited towards the development of engineering solutions for practical biomedical systems. This paper reviews a body of research comprising two OP models that have led to significant progress in the design of transmission mode pulse oximetry probes, and approaches to 3D blood perfusion mapping for the interpretation of cardiovascular performance

Automated Remote Pulse Oximetry System (ARPOS)

Funding: This research is funded by the School of Computer Science and by St Leonard’s Postgraduate College Doctoral Scholarship, both at the University of St Andrews for Pireh Pirzada’s PhD. Early work was funded by the Digital Health & Care Innovation Centre (DHI).Current methods of measuring heart rate (HR) and oxygen levels (SPO2) require physical contact, are individualised, and for accurate oxygen levels may also require a blood test. No-touch or non-invasive technologies are not currently commercially available for use in healthcare settings. To date, there has been no assessment of a system that measures HR and SPO2 using commercial off-the-shelf camera technology that utilises R, G, B and IR data. Moreover, no formal remote photoplethysmography studies have been done in real life scenarios with participants at home with different demographic characteristics. This novel study addresses all these objectives by developing, optimising, and evaluating a system that measures the HR and SPO2 of 40 participants. HR and SPO2 are determined by measuring the frequencies from different wavelength band regions using FFT and radiometric measurements after pre-processing face regions of interest (forehead, lips, and cheeks) from Colour, IR and Depth data. Detrending, interpolating, hamming, and normalising the signal with FastICA produced the lowest RMSE of 7.8 for HR with the r-correlation value of 0.85 and RMSE 2.3 for SPO2. This novel system could be used in several critical care settings, including in care homes and in hospitals and prompt clinical intervention as required.Publisher PDFPeer reviewe

Skin image illumination modeling and chromophore identication for melanoma diagnosis

International audienceThe presence of illumination variation in dermatological images has a negative impact on the automatic detection and analysis of cutaneous lesions. This paper proposes a new illumination modeling and chromophore identication method to correct lighting variation in skin lesion images, as well as to extract melanin and hemoglobin concentrations of human skin, based on an adaptive bilateral decomposition and a weighted polynomial curve tting, with the knowledge of a multi-layered skin model. Different from state-of-the-art approaches based on the Lambert law, the proposed method, considering both specular reection and diffuse reection of the skin, enables us to address highlight and strong shading effects usually existing in skin color images captured in an uncontrolled environment. The derived melanin and hemoglobin indices, directly relating to the pathological tissue conditions, tend to be less inuenced by external imaging factors and are more efcient in describing pigmentation distributions. Experiments show that the proposed method gave better visual results and superior lesion segmentation, when compared to two other illumination correction algorithms, both designed specically for dermatological images. For computer-aided diagnosis of melanoma, sensitivity achieves 85.52% when using our chromophore descriptors, which is 8~20% higher than those derived from other color descriptors. This demonstrates the benet of the proposed method for automatic skin disease analysis

COLOR RESOLVED CHERENKOV IMAGING ALLOWS FOR DIFFERENTIAL SIGNAL DETECTION IN BLOOD AND MELANIN CONTENT

Cherenkov imaging in radiation therapy allows a video display of the irradiation beam on the patient’s tissue, for visualization of the treatment. High energy radiation from a linear accelerator (Linac) results in the production of spectrally-continuous broadband light inside tissue due to the Cherenkov effect; this light is then attenuated by tissue features from transport and exits from the delivery site. Progress with the development of color Cherenkov imaging has opened the possibility for some level of spectroscopic imaging of the light-tissue interaction and interpretation of the specific nature of the tissue being irradiated. Generally, there is a linear relationship between Cherenkov emission and dose in a homogenous medium; however human tissue has multiple factors of scatter and absorption that result in the distortion of this linear relationship. This project investigated what color Cherenkov imaging could be used for, in the situation of tissue with different levels of pigmentation present in skin and/or different levels of hemoglobin present inside the tissue. A custom-developed time-gated three-channel intensified camera was used to image the Red Green and Blue (RGB) Cherenkov emission from tissue phantoms that had synthetic epidermal layers and blood. The hypothesis was that RGB color Cherenkov imaging would allow for the detection of signals that varied uniquely in these channels in response to changes in blood content or melanin content, because of their different absorption spectra in the RGB channels. Oxy-hemoglobin in the blood is highly absorbing in the blue & green, but not as much in the red, whereas the melanin is highly absorbing across the channels, falling slightly from blue through green and red. The results showed that these spectral absorption differences did indeed lead to different amounts of exiting light, predominantly in the red wavelength band, where melanin has a higher relative absorption than blood. This observation leads to the provision for future color distortion corrections, and interpretation of more accurate Cherenkov imaging via color-based modeling or correction for dose quantification. Based on this work, it is possible to separate the effects of attenuation from skin color or blood volume based upon the colors seen in the Cherenkov images, as these are emissions that are specific to the patient

An Introduction to Light Interaction with Human Skin

Despite the notable progress in physically-based rendering, there is still a long way to go before one can automatically generate predictable images of organic materials such as human skin. In this tutorial, the main physical and biological aspects involved in the processes of propagation and absorption of light by skin tissues are examined. These processes affect not only skin appearance, but also its health. For this reason, they have also been the object of study in biomedical research. The models of light interaction with human skin developed by the biomedical community are mainly aimed at the simulation of skin spectral properties which are used to determine the concentration and distribution of various substances. In computer graphics, the focus has been on the simulation of light scattering properties that affect skin appearance. Computer models used to simulate these spectral and scattering properties are described in this tutorial, and their strengths and limitations discussed. Keywords: natural phenomena, biologically and physically-based rendering

Hyper-Skin: A Hyperspectral Dataset for Reconstructing Facial Skin-Spectra from RGB Images

We introduce Hyper-Skin, a hyperspectral dataset covering wide range of wavelengths from visible (VIS) spectrum (400nm - 700nm) to near-infrared (NIR) spectrum (700nm - 1000nm), uniquely designed to facilitate research on facial skin-spectra reconstruction. By reconstructing skin spectra from RGB images, our dataset enables the study of hyperspectral skin analysis, such as melanin and hemoglobin concentrations, directly on the consumer device. Overcoming limitations of existing datasets, Hyper-Skin consists of diverse facial skin data collected with a pushbroom hyperspectral camera. With 330 hyperspectral cubes from 51 subjects, the dataset covers the facial skin from different angles and facial poses. Each hyperspectral cube has dimensions of 1024$\times$1024$\times$448, resulting in millions of spectra vectors per image. The dataset, carefully curated in adherence to ethical guidelines, includes paired hyperspectral images and synthetic RGB images generated using real camera responses. We demonstrate the efficacy of our dataset by showcasing skin spectra reconstruction using state-of-the-art models on 31 bands of hyperspectral data resampled in the VIS and NIR spectrum. This Hyper-Skin dataset would be a valuable resource to NeurIPS community, encouraging the development of novel algorithms for skin spectral reconstruction while fostering interdisciplinary collaboration in hyperspectral skin analysis related to cosmetology and skin's well-being. Instructions to request the data and the related benchmarking codes are publicly available at: \url{https://github.com/hyperspectral-skin/Hyper-Skin-2023}.Comment: Skin spectral datase

Melanin and Hemoglobin Identification for Skin Disease Analysis

International audienceThis paper proposes a novel method to extract melanin and hemoglobin concentrations of human skin, using bilateral decomposition with the knowledge of a multiple layered skin model and absorbance characteristics of major chromophores. Different from state-of-art approaches, the proposed method enables to address highlight and strong shading usually existing in skin color images captured under uncontrolled environment. The derived melanin and hemoglobin indices, directly related to the pathological tissue conditions, tend to be less influenced by external imaging factors and are effective for describing pigmentation distributions. Experiments demonstrate the value of the proposed method for computer-aided diagnosis of different skin diseases. The diagnostic accuracy of melanoma increases by 9-15% for conventional RGB lesion images, compared to techniques using other color descriptors. The discrimination of inflammatory acne and hyperpigmentation reveals acne stage, which would be useful for acne severity evaluation. It is expected that this new method will prove useful for other skin disease analysis

Assessing skin lesion evolution from multispectral image sequences

During the evaluation of skin disease treatments, dermatologists have to clinically measure the evolution of the pathology severity of each patient during treatment periods. Such a process is sensitive to intra- and inter- dermatologist diagnosis. To make this severity measurement more objective we quantify the pathology severity using a new image processing based method. We focus on a hyperpigmentation disorder called melasma. During a treatment period, multispectral images are taken on patients receiving the same treatment. After co-registration and segmentation steps, we propose an algorithm to measure the intensity, the size and the homogeneity evolution of the pathological areas. Obtained results are compared with a dermatologist diagnosis using statistical tests on two clinical studies containing respectively 384 images from 16 patients and 352 images from 22 patients.This research report is an update of the report 8136. It describes methods and experiments in more details and provides more references.Lors de l'évaluation des traitements des maladies de peau, les dermatologues doivent mesurer la sévérité de la pathologie de chaque patient tout au long d'une période de traitement. Un tel procédé est sensible aux variations intra- et inter- dermatologues. Pour rendrecette mesure de sévérité plus robuste, nous proposons d'utiliser l'imagerie spectrale. Nous nous concentrons sur une pathologie d'hyperpigmentation cutanée appelée mélasma. Au cours d'une période de traitement, des images multispectrales sont acquises sur une population de patients sous traitement. Après des étapes de recalage des séries temporelles d'images et de classification des régions d'intérêt, nous proposons une méthodologie permettant de mesurer, dans le temps, la variation de contraste, de surface et d'homogénéité de la zone pathologique pour chaque patient. Les résultats obtenus sont comparés à un diagnostique clinique à l'aide de tests statistiques réalisés sur une étude clinique complète.Ce rapport de recherche est un complément du rapport de recherche 8136, afin de compléter la bibliographie, et de décrire plus en détail les méthodes et résultat

A Physical Model of Human Skin and Its Application for Search and Rescue

For this research we created a human skin reflectance model in the VIS and NIR. We then modeled sensor output for an RGB sensor based on output from the skin reflectance model. The model was also used to create a skin detection algorithm and a skin pigmentation level (skin reflectance at 685nm) estimation algorithm. The average root mean square error across the VIS and NIR between the skin reflectance model and measured data was 2%. The skin reflectance model then allowed us to generate qualitatively accurate responses for an RGB sensor for different biological and lighting conditions. To test the accuracy of the skin detection and skin color estimation algorithms, hyperspectral images of a suburban test scene containing people with various skin colors were collected. The skin detection algorithm had a probability of detection as high as 95% with a probability of false alarm of 0.6%. The skin pigmentation level estimation algorithm had a mean absolute error when compared with data measured by a reflectometer of 2.6% where the reflectance of the individuals at 685nm ranged from 14% to 64%