8 research outputs found
Fusing deep learned and hand-crafted features of appearance, shape, and dynamics for automatic pain estimation
Automatic continuous time, continuous value assessment of a patient's pain from face video is highly sought after by the medical profession. Despite the recent advances in deep learning that attain impressive results in many domains, pain estimation risks not being able to benefit from this due to the difficulty in obtaining data sets of considerable size. In this work we propose a combination of hand-crafted and deep-learned features that makes the most of deep learning techniques in small sample settings. Encoding shape, appearance, and dynamics, our method significantly outperforms the current state of the art, attaining a RMSE error of less than 1 point on a 16-level pain scale, whilst simultaneously scoring a 67.3% Pearson correlation coefficient between our predicted pain level time series and the ground truth
Personalized Federated Deep Learning for Pain Estimation From Face Images
Standard machine learning approaches require centralizing the users' data in
one computer or a shared database, which raises data privacy and
confidentiality concerns. Therefore, limiting central access is important,
especially in healthcare settings, where data regulations are strict. A
potential approach to tackling this is Federated Learning (FL), which enables
multiple parties to collaboratively learn a shared prediction model by using
parameters of locally trained models while keeping raw training data locally.
In the context of AI-assisted pain-monitoring, we wish to enable
confidentiality-preserving and unobtrusive pain estimation for long-term
pain-monitoring and reduce the burden on the nursing staff who perform frequent
routine check-ups. To this end, we propose a novel Personalized Federated Deep
Learning (PFDL) approach for pain estimation from face images. PFDL performs
collaborative training of a deep model, implemented using a lightweight CNN
architecture, across different clients (i.e., subjects) without sharing their
face images. Instead of sharing all parameters of the model, as in standard FL,
PFDL retains the last layer locally (used to personalize the pain estimates).
This (i) adds another layer of data confidentiality, making it difficult for an
adversary to infer pain levels of the target subject, while (ii) personalizing
the pain estimation to each subject through local parameter tuning. We show
using a publicly available dataset of face videos of pain (UNBC-McMaster
Shoulder Pain Database), that PFDL performs comparably or better than the
standard centralized and FL algorithms, while further enhancing data privacy.
This, has the potential to improve traditional pain monitoring by making it
more secure, computationally efficient, and scalable to a large number of
individuals (e.g., for in-home pain monitoring), providing timely and
unobtrusive pain measurement.Comment: 12 pages, 6 figure
Fusing deep learned and hand-crafted features of appearance, shape, and dynamics for automatic pain estimation
Automatic continuous time, continuous value assessment of a patient's pain from face video is highly sought after by the medical profession. Despite the recent advances in deep learning that attain impressive results in many domains, pain estimation risks not being able to benefit from this due to the difficulty in obtaining data sets of considerable size. In this work we propose a combination of hand-crafted and deep-learned features that makes the most of deep learning techniques in small sample settings. Encoding shape, appearance, and dynamics, our method significantly outperforms the current state of the art, attaining a RMSE error of less than 1 point on a 16-level pain scale, whilst simultaneously scoring a 67.3% Pearson correlation coefficient between our predicted pain level time series and the ground truth