Skip to main content
Article thumbnail
Location of Repository

Intensity Score for Facial Actions Detection in Near-Frontal-View Face Sequences

By R. Zwiggelaar, H. Ugail and M. H. Yap


Yap, M. H., Ugail, H., Zwiggelaar, R. (2012). Intensity Score for Facial Actions Detection in Near-Frontal-View Face Sequences, Computer and Communication Engineering (ICCCE) 2012 International Conference, Kuala Lumpur, Malaysia, 3-5 July 2012, p. 819-824 Computer and Communication Engineering (ICCCE) 2012 International Conference, Kuala Lumpur, Malaysia, 3-5 July 2012this paper proposes a method to detect the facial Action Units (AUs) and introduce an automatic measurement in predicting the intensity scores of each AU in near-to-frontal face image sequences. To our knowledge, this is the first attempt in computer vision to automate the intensity scores of facial expression research. First, the facial feature points are detected by using Gabor feature based boosted classifiers and the movement of each point is tracked by optical flow. Then, we introduce a set of distance measurement for the feature points and analyze the distances by using Sequence Analysis. Further, we exploit the sequence partition to predict the possible temporal segments in the sequence. We found there is a relationship between the intensity scores and the partition threshold, which we automated the process of threshold selection in our work. We tested the proposed prototype with our in-house dataset and MMI database. Finally, we discuss the result, the possibilities of further research, and the next challenges for computer vision scientist in facial actions detection.Non peer reviewe

Year: 2012
OAI identifier:

Suggested articles


  1. (2010). A Dynamic texture based approach to recognition of facial actions and their temporal models,” doi
  2. A Two-step Approach to Multiple Facial Feature Tracking: Temporal Particle Filter and Spatial Belief Propagation." doi
  3. (2003). Automatic facial expression analysis: a survey,” doi
  4. (2007). Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics,” doi
  5. Computer Vision and Face Processing," Final report to NSF of the planning workshop on facial expression understanding,,
  6. (1973). Darwin and facial expression - a century of research in review,” doi
  7. (2009). DataFace - Psychology, Appearance, and Behavior of Human Face,"
  8. (2002). Detecting Faces in Images: A Survey,” doi
  9. Detecting Facial Actions and their Temporal Segments in Nearly Frontal-View Face image Sequences." doi
  10. (1981). Determining optical flow,” doi
  11. (2006). Dynamics of facial expressions - recognition of facial actions and their temporal segments from face profile image sequences,” doi
  12. (2001). Elements of Statistical Learning: Data Mining, Inference and Prediction: doi
  13. (2002). Facial Action Coding System - The Manual," Research Nexus division of Network Information Research Corporation,
  14. (1978). Facial Action Coding System: A Technique for the Measurement of Facial Movement,” Consulting Psychologies Press
  15. (2002). FACS Investigator's Guide," Research Nexus, a subsidiary of Network Information Research Corporation,
  16. (2005). Fully Automatic Facial Feature Point Detection Using Gabor Feature Based Boosted Classifiers,” doi
  17. (1995). Human and Machine Recogntion of Faces: A Survey,” in doi
  18. (2008). Learning OpenCV: doi
  19. (1990). Lip reading by optical flow,”
  20. (2007). Machine Analysis of Facial Expressions," Face Recognition, doi
  21. (2010). Maja Pantic," doi
  22. (1996). Motion regularization for model-based head tracking, 362, doi
  23. Particle Filtering with Factorized Likelihoods for Tracking Facial Features." doi
  24. (2001). Rapid Object Detection using a Boosted Cascade of Simple features,” doi
  25. (2005). Recent advances in visual and infrared face recognition - a review,” Computer Vision and Image Understanding, doi
  26. (1991). Recognition of facial expression from optical flow,”
  27. (2005). Recognizing facial expression: machine learning and application to spontaneous behavior,” doi
  28. The Expression of the emotions in man and animals, doi
  29. (2007). The facial expression of pain in patients with dementia,” doi
  30. Tracking facial motion."
  31. (2007). Use of Automated Facial Image Analysis for Measurement of Emotion Expression," The handbook of emotion elicitation
  32. Webbased database for facial expression analysis." doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.