Facial electromyography (fEMG) refers to an electromyography (EMG) technique that measures muscle activity by detecting and amplifying the tiny electrical impulses that are generated by muscle fibers when they contract.
It primarily focuses on two major muscle groups in the face, the corrugator supercilii group which is associated with frowning and the zygomaticus major muscle group which is associated with smiling.
Facial EMG has been studied to assess its utility as a tool for measuring emotional reaction. Studies have found that activity of the corrugator muscle, which lowers the eyebrow and is involved in producing frowns, varies inversely with the emotional valence of presented stimuli and reports of mood state. Activity of the zygomatic major muscle, which controls smiling, is said to be positively associated with positive emotional stimuli and positive mood state.
Facial EMG has been used as a technique to distinguish and track positive and negative emotional reactions to a stimulus as they occur. A large number of those experiments have been conducted in controlled laboratory environments using a range of stimuli, e.g., still pictures, movie clips and music pieces.
Although commonly used as an index of emotional responses, facial muscle activity is also influenced by the social context in which it is measured. Using facial EMG in immersive virtual environments, Philipp, Storrs, and Vanman showed that even relatively impoverished social cues in a virtual environment can cause increases in zygomaticus major activity that are unrelated to self-reported emotional states.
In 2012 Durso et al. were able to show that facial EMG could be used to detect confusion, both in participants who admitted being confused and in those who did not, suggesting that it could be used as an effective addition to a sensor suite as a monitor of loss of understanding or loss of situation awareness.
Market research and gaming
- Advertising research - Of late, facial EMG has been used to test audience response to commercial advertising. Facial EMG activity measures during a viewing of commercials embedded in TV program clips have been used to describe a commercial's level of emotional activation and engagement. Measurement of the corrugator and zygomatic muscles, yield an overall positive and negative emotional activation score. The moment to moment activation that are recorded are said to measure the dynamic emotional response to a commercial and yield useful insights about the elements of the commercials. Lou et al. showed that facial EMG activity can be used to forecast how game players would be addicted to an online game before the game is officially introduced to the market.
- Gaming and Human-Computer Interaction (HCI) - Ravaja, Hazlett and Mandryk used facial EMG techniques to demonstrate that positive and negative emotions can be measured in real time during video game play. The emotional profiling of games give a useful evaluation of a game's impact on a player, how compelling they find the game, how the game measures up to other games in its genre, and how the different elements of the game enhance or detract from the game's approach to engaging the player.
Proponents of Facial EMG point to the following advantages:
- Facial Electromyography (or fEMG) is a precise and sensitive method to measure emotional expression.
- Unlike self-reports, fEMG does not depend upon language and does not require cognitive effort or memory.
- fEMG is capable of registering the response even when subjects were instructed to inhibit their emotional expression.
- Yields a lot of data and is continuous and scalar (hence more credible.)
- It is able to measure facial muscle activities to even weakly evocative emotional stimuli.
- Less intrusive than other physiological measures like fMRI and EEG.
- Like other physiological measures, facial EMG measurement technique is often the only useful approach when movement is not visible.
- The technique is intrusive and may alter natural expression.
- The number of muscles it can employ is limited by how many electrodes can be attached to the face.
- Certain medicines that act on the nervous system, such as muscle relaxants and anticholinergics, can change electromyography (EMG) results.
- Larsen JT, Norris CJ, Cacioppo JT (September 2003). "Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii". Psychophysiology. 40 (5): 776–85. doi:10.1111/1469-8986.00078. PMID 14696731.
- Sato W, Fujimura T, Suzuki N (October 2008). "Enhanced facial EMG activity in response to dynamic facial expressions". Int J Psychophysiol. 70 (1): 70–4. doi:10.1016/j.ijpsycho.2008.06.001. PMID 18598725.
- Dimberg U (September 1990). "Facial electromyography and emotional reactions". Psychophysiology. 27 (5): 481–94. doi:10.1111/j.1469-8986.1990.tb01962.x. PMID 2274612.
- Wolf K, Mass R, Ingenbleek T, Kiefer F, Naber D, Wiedemann K (October 2005). "The facial pattern of disgust, appetence, excited joy and relaxed joy: an improved facial EMG study". Scand J Psychol. 46 (5): 403–9. doi:10.1111/j.1467-9450.2005.00471.x. PMID 16179022.
- Oberman LM, Winkielman P, Ramachandran VS (July 2009). "Slow echo: facial EMG evidence for the delay of spontaneous, but not voluntary, emotional mimicry in children with autism spectrum disorders". Dev Sci. 12 (4): 510–20. doi:10.1111/j.1467-7687.2008.00796.x. PMID 19635079.
- Hess, U; Banse, R; Kappas, A (1995). "The intensity of facial expression is determined by underlying affective state and social situation". Journal of Personality and Social Psychology. 69: 280–288. doi:10.1037/0022-35184.108.40.2060.
- Philipp, MC; Storrs, K; Vanman, E (2012). "Sociality of facial expressions in immersive virtual environments: A facial EMG study". Biological Psychology. 91: 17–21. doi:10.1016/j.biopsycho.2012.05.008.
- Durso, F.T., Geldbach, K.M. and Cotbalis, P., "Detecting Confusion Using Facial Electromyography", Human Factors, Vol. 54, No. 1, February 2012.
- Boll, P.D., Lang, A., Potter, R.F., The Effects of Message Valence and Listener Arousal on Attention, Memory and Facial Muscular Responses to Radio Advertisements. Communication Research, Vol. 28 (2001).
- Lou, Jing-Kai; Kuan-Ta Chen; Hwai-Jung Hsu; Chin-Laung Lei (November 2012), "Forecasting online game addictiveness", Proc. IEEE/ACM NetGames 2012, Venice, Italy, retrieved 2013-10-17
- Ravaja N, Turpeinen M, Saari T, Puttonen S, Keltikangas-Järvinen L (February 2008). "The psychophysiology of James Bond: phasic emotional responses to violent video game events". Emotion. 8 (1): 114–20. doi:10.1037/1528-35220.127.116.11. PMID 18266521.
- Mandryk, R.L.; Atkins, M. (2007). "A Fuzzy Physiological Approach for Continuously Modeling Emotion During Interaction with Play Environments". International Journal of Human-Computer Studies. 6 (4): 329–47. doi:10.1016/j.ijhcs.2006.11.011.
- Hazlett, R. L. (2006). "Measuring emotional valence during interactive experiences: boys at video game play". Proceedings of the SIGCHI conference on Human Factors in computing systems (CHI '06): 1023–6. doi:10.1145/1124772.1124925.
- Nacke, L. E.; Lindley, C. (December 2009). "Affective Ludology, Flow and Immersion in a First- Person Shooter: Measurement of Player Experience". Loading. 3 (5).