Comprehensive assessment of facial paralysis based on facial animation units.

Quantitative grading and classification of the severity of facial paralysis (FP) are important for selecting the treatment plan and detecting subtle improvement that cannot be detected clinically. To date, none of the available FP grading systems have gained widespread clinical acceptance. The work presented here describes the development and testing of a system for FP grading and assessment which is part of a comprehensive evaluation system for FP. The system is based on the Kinect v2 hardware and the accompanying software SDK 2.0 in extracting the real time facial landmarks and facial animation units (FAUs). The aim of this paper is to describe the development and testing of the FP assessment phase (first phase) of a larger comprehensive evaluation system of FP. The system includes two phases; FP assessment and FP classification. A dataset of 375 records from 13 unilateral FP patients was compiled for this study. The FP assessment includes three separate modules. One module is the symmetry assessment of both facial sides at rest and while performing five voluntary facial movements. Another module is responsible for recognizing the facial movements. The last module assesses the performance of each facial movement for both sides of the face depending on the involved FAUs. The study validates that the FAUs captured using the Kinect sensor can be processed and used to develop an effective tool for the automatic evaluation of FP. The developed FP grading system provides a detailed quantitative report and has significant advantages over the existing grading scales. It is fast, easy to use, user-independent, low cost, quantitative, and automated and hence it is suitable to be used as a clinical tool

FP assessment report.

FP assessment report.</p

Seventeen Facial Animation units (FAUs) Extracted using Kinect SDK 2.0 [26].

Seventeen Facial Animation units (FAUs) Extracted using Kinect SDK 2.0 [26].</p

S1 Dataset -

(XLSX)</p

Feature ranking applied on the 17 differences in FAUs in the 5 facial movements; smiling, eye closure, raising eyebrows, blowing cheeks, and whistling.

Feature ranking applied on the 17 differences in FAUs in the 5 facial movements; smiling, eye closure, raising eyebrows, blowing cheeks, and whistling.</p

Facial functions evaluation (9 FP patients).

Facial functions evaluation (9 FP patients).</p

The block diagram of facial paralysis evaluation.

The block diagram of facial paralysis evaluation.</p

The most affected FAUs in each facial movement.

The most affected FAUs in each facial movement.</p