Manuscript Number : CSEIT172110

To Recognize Human Emotions Based on Facial Expression Recognition : A Literature Survey

Authors(2) :-Komal D. Khawale, D. R. Dhotre

Facial Emotion Recognition has been a very significant issue and an advanced area of research in the field of Human- Machine Interaction and Image Processing. Human-Machine relation is a major field for that different approaches have been proposed for developing methods for recognition of automated facial emotion analysis using not only facial expressions, also speech recognition. Facial expression detection the multiple varieties of human faces like texture, color, shape, expressions etc. are considered. Firstly, to detect a facial emotions of the human with variations in the facial movements including mouth, eyes, and nose are to be determined and after that considering those features using a very good classifier to recognize the human emotions. This paper gives a brief summary of emotion recognition methods like Feature Fusion, Deep Auto-Encoder, Sigma Pi-Neural Network, Genetic Algorithm, PHOG and Hierarchical Expression Model etc. which are used to recognize human emotions are presented.

Authors and Affiliations

Komal D. Khawale
Department of Computer Engineering, Amravati University, SSGMCE, Shegaon, Maharashtra, India
D. R. Dhotre
Department of Computer Engineering, Amravati University, SSGMCE, Shegaon, Maharashtra, India

Human Emotion Recognition, PHOG, Emotion Recognition, Expression Recognition.

  1. Ekman and Friesen, "Constants across cultures in the face and emotion," Journal of Personality and Social Psychology, vol. 17, no. 2, pp.124–129, 1971.
  2. Ashim Saha, Anurag De, Dr. M .C. Pal and Nirmalya Kar, "Different techniques of automatic facial expression recognition: a survey," Proc. of the Second Intl. Conf. on Advances in Computing, Communication and Information Technology- CCIT 2014.
  3. Cigdem Turan, Kin-Man Lam, Xiangjian He,"Facial Emotion Recognition with Emotion-Based feature Fusion", Proceedings of APSIPA Annual Summit and Conference, 2015.
  4. Fei Wang, Xiaofeng Ye, Zhaoyu Sun, Yujia Huang, Xing Zhang, Shengxing Shang,"Research on speech emotion recognition based on deep auto-encoder",Proc. of the 6th Annual IEEE International Conference on Cyber Technology in Automation, Control ,and Intelligent Systems June 19-22, 2016, Chengdu, China.
  5. Zhao Zhong, Gang Shen, Wenhu Chen," Facial Emotion Recognition Using PHOG and a Hierarchical Expression Model", 5th International Conference on Intelligent Networking and Collaborative Systems,2013.
  6. Nonna Kulishova," Emotion Recognition Using Sigma-Pi Neural Network", IEEE First International Conference on Data Stream Mining, Lviv, Ukraine, August 2016.
  7. Hadjer Boubenna , Dohoon Lee," Feature Selection for Facial Emotion recognition Based on Genetic Algorithm", 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), 2016.
  8. Hern´an F. Garcia,Cristian A. Torres, and Jorge Ivan Marin Hurtado,"Facial Expression Analysis for Emotion Recognition Using Kernel Methods and Statistical Models", 2014.
  9. -K. Kim, J. Kittler, and R. Cipolla, Discriminative learning and recognition of image set classes using canonical correlations, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 29(6): p. 1005-1018, 2007.
  10. Ojala, M. Pietikäinen, and T. Mäenpää, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," Pattern Analysis and Machine Intelligence, IEEE Transactions on, 24(7): p. 971-987, 2002.
  11. Ojansivu and J. Heikkilä, Blur insensitive texture classification using Local phase quantization, in Image and signal processing, Springer.pg. 236-243, 2008.
  12. Chen et al., WLD: A robust local image descriptor, Pattern Analysis and Machine Intelligence, IEEE Transactions on, 2010.
  13. Bosch, A. Zisserman, and X. Munoz, Representing shape with a spatial pyramid kernel, in Proceedings of the 6th ACM international conference on Image and video retrieval, 2007.
  14. Niyogi, Locality preserving projections. In Neural information Processing systems, 2004.
  15. Dalal and B. Triggs, Histograms of oriented gradients for human detection, in Computer Vision and Pattern Recognition, 2005, CVPR 2005, IEEE Computer Society Conference on, 2005.
  16. J. Lyons et al., The Japanese female facial expression (JAFFE) Database, 1998.
  17. E. Erdem, C. Turan, and Z. Aydin, BAUM-2: a multilingual audiovisual affective face database, Multimedia Tools and Applications, pg. 1-31, 2014.
  18. Maorong Wang, Ping Zhou, Xinxing Jjing. Mixing parameters of MFCC and short TEO energy used in speaker recognition Microelectronics and Computer, 2016.
  19. Wenjing Han, Haifeng Li, Huabin Ruan, Lin Ma. Review of the progress in the research of speech emotion recognition. Journal of Software, 25(1):37-50, 2014.
  20. Nirmesh J. Shah, Bhavik B. Vachhani, Hardik B. Sailor and Hemant A. Patil, "Effectiveness of PLP-Based Phonetic Segmentation for speech synthesis", IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP), 2014.
  21. Kohei Arai and Rosa Andrie, "Gait Recognition Method Based on Wavelet Transformation and Its Evaluation with Chinese Academy of Sciences (CASIA) Gait Database as a Human Gait Recognition Dataset", Ninth International Conference on Information Technology- New Generations, 2012.
  22. Kanade, J. F. Cohn and Y. Tian, "Comprehensive database for facial expression analysis,"In Automatic Face and Gesture Recognition, Proceedings. Fourth IEEE International Conference on, pp. 46-53, 2000.
  23. -Yi Lee, and Li-Ch. Liao, "Recognition of Facial Expression by Using Neural-Network System with Fuzzified Characteristic Distances Weights", in Proceedings of IEEE Int. Conf. Fuzzy Systems FUZZ-IEEE 2008.
  24. Viola and M.Jones, "Rapid Object Detection using a Boosted Cascade of Simple Features," IEEE CVPR, 2001.
  25. Bosch, A. Zisserman, and X. Munoz, "Representing shape with a spatial pyramid kernel," ACM International Conference on Image and Video Retrieval, 2007.
  26. N. Belhumeur, J. Hespanha, and D.J. Kriegman, "Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection" , 1996.
  27. V. Dasarathy (Editor), "Nearest neighbor (NN) norms: NN pattern classification techniques", IEEE Computer Society Press, Los Alamitos, California, 1990.
  28. Langner, R. Dotsch, G. Bijlstra, D. Wigboldus, S. Hawk, and A. Knippenberg, "Presentation and validation of the Radboud Faces Database," Cognition and Emotion 24 (8), 2010.
  29. Shirin Shokrani, Payman Moallem, and Mehdi Habibi, "Facial emotion recognition method based on Pyramid Histogram of Oriented Gradient over three direction of head," IEEE Computer and Knowledge Engineering (ICCKE), 2014.
  30. Matthews and S. Baker, "Active appearance models revisited," Int. J. Comput. Vision, vol. 60, pp. 135–164, November 2004.
  31. P. Lucey, J. Cohn, T. Kanade, J. Saragih, Z. Ambadar, and I. Matthews, "The extended Cohn-Kanade dataset (CK+): A complete dataset for action unit and emotion-specified expression," in Computer Vision and Pattern Recognition Workshops (CVPRW), IEEE Computer Society Conference on, June 2010.

Publication Details

Published in : Volume 2 | Issue 1 | January-February 2017
Date of Publication : 2017-02-28
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 35-41
Manuscript Number : CSEIT172110
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

Komal D. Khawale, D. R. Dhotre, "To Recognize Human Emotions Based on Facial Expression Recognition : A Literature Survey", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 2, Issue 1, pp.35-41, January-February-2017. |          | BibTeX | RIS | CSV

Article Preview