Micro Expression Classification Accuracy Assessment

The ability to identify and draw appropriate implications from non-verbal cues is a challenging task in facial expression recognition and has been investigated by various disciplines particularly social science, medical science, psychology and technological sciences beyond three decades. Non-verbal cues often last a few seconds and are obvious (macro) whereas others are very short and difficult to interpret (micro). This research is based on the area of micro expression recognition with the main focus laid on understanding and exploring the combined effect of various existing feature extraction techniques and one of the most renowned machine learning algorithms identified as Support Vector Machine (SVM). Experiments are conducted on spatiotemporal descriptors extracted from the CASME II dataset using LBP-TOP, LBP-SIP, LPQ-TOP, HOG-TOP, HIGO-TOP and STLBP-IP. We have considered two different cases for the CASME II dataset where the first case measures performance for five class i.e. happiness, disgust, surprise, repression and others and the second case considers three classes namely positive, negative and surprise. LPQ-TOP with SVM produced highest accuracy against rest of the approaches in this work

Melanoma Skin Cancer Identification with Explainability Utilizing Mask Guided Technique

Melanoma is a highly prevalent and lethal form of skin cancer, which has a significant impact globally. The chances of recovery for melanoma patients substantially improve with early detection. Currently, deep learning (DL) methods are gaining popularity in assisting with the identification of diseases using medical imaging. The paper introduces a computational model for classifying melanoma skin cancer images using convolutional neural networks (CNNs) and vision transformers (ViT) with the HAM10000 dataset. Both approaches utilize mask-guided techniques, employing a specialized U2-Net segmentation module to generate masks. The CNN-based approach utilizes ResNet50, VGG16, and Xception with transfer learning. The training process is enhanced using a Bayesian hyperparameter tuner. Moreover, this study applies gradient-weighted class activation mapping (Grad-CAM) and Grad-CAM++ to generate heatmaps to explain the classification models. These visual heatmaps elucidate the contribution of each input region to the classification outcome. The CNN-based model approach achieved the highest accuracy at 98.37% in the Xception model with a sensitivity and specificity of 95.92% and 99.01%, respectively. The ViT-based model approach achieved high values for accuracy, sensitivity, and specificity, such as 92.79%, 91.09%, and 93.54%, respectively. Furthermore, the performance of the model was assessed through intersection over union (IOU) and other qualitative evaluations. Finally, we developed the proposed model as a web application that can be used as a support tool for medical practitioners in real-time. The system usability study score of 86.87% is reported, which shows the usefulness of the proposed solution