Published:11^th November, 2023

 

Application of Viola-Jones Control Model for Emotion Recognition Based on Facial Expression and Body Gestures

 

 

Fatima Isiaka
Zainab Adamu

 

Abstract

 

Body gestures are one of the crucial components of body language and can also be used for emotion recognition in people. This could include movement and depths and changes in the motion of the body in a confined environment. However, these aspects remain less explored to recognise emotion while facial expressions and examples such as speech-based approaches are widely investigated. This paper introduces a custom method of emotion recognition through facial expressions and body gestures in people based on Viola-Jones using Matlab images saved in the archive and a thousand images online collection of a thousand body gestures and facial expressions. A Viola Jones control model was used to save these images and to identify features that recognise different forms of emotion saved in the database. The surroundings of the person also help to map the right emotion and expression on the face of the person. Tracking points and error tracking were computed for each class of emotion detected; prediction accuracy is close to 78% for each predicted class of emotion.

Keywords: Body gestures, facial expression, Voila Jones, Point tracking, emotion recognition, Speed-based emotion recognition