Abstract
The role of face and context in emotion perception was investigated by manipulating features relevant to the stimuli and to the observer. A nested-stimulus design was used, with subjects nested under stimulus item (an encoder’s facial expression or a written emotion-eliciting scenario presented alone or in an incongruent pair) and type of task instruction (judgment of encoder’s expressed or felt emotion). Subjects, using one type of task instruction, completed a decoding task in which they viewed a facial expression, a written scenario, or a facial expression paired with an emotion-incongruent scenario. Type of task instruction was intended to alter subjects’ perception by directing attention to favor face information (judgment of expressed emotion) or context information (judgment of felt emotion). Then subjects selected the predominant emotion and indicated the intensity of various emotions they perceived the encoder to be expressing or feeling. Judgments were examined for target emotion match to face and/or context using a by-stimulus analysis. The results suggest that when an encoder’s facial expression is discordant with the emotion-eliciting event, subjects will favor facial information when judging what the encoder is expressing, whereas they will favor context information when judging what the encoder is feeling. When face or context was seen alone, type of task instruction did not influence subjects’ judgments. This research provides a more detailed understanding of the role of face and context by exploring how features associated with the observer-encoder interaction influence emotion perception.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aguado, L., Martínez-García, N., Solís-Olce, A., Dieguez-Risco, T., & Hinojosa, J. A. (2018). Effects of affective and emotional congruency on facial expression processing under different task demands. Acta Psychologica, 187, 66–76. https://doi.org/10.1016/j.actpsy.2018.04.013
Aviezer, H., Trope, Y., & Todorov, A. (2012). Holistic person processing: Faces with bodies tell the whole story. Journal of Personality and Social Psychology, 103(1), 20–37. https://doi.org/10.1037/a0027411
Barrett, L. F., & Kensinger, E. A. (2010). Context is routinely encoded during emotion perception. Psychological Science, 21(4), 595–599. https://doi.org/10.1177/0956797610363547
Barrett, L. F., Mesquita, B., & Gendron, M. (2011). Context in emotion perception. Current Directions in Psychological Science, 20(5), 286–290. https://doi.org/10.1177/0963721411422522
Blanz, V., & Vetter, T. (1999). A morphable model for the synthesis of 3D faces. In Proceedings of the 26th annual conference on computer graphics and interactive techniques, pp. 187–194. https://doi.org/10.1145/311535.311556.
Calvo, M. G., Gutiérrez-García, A., Fernández-Martín, A., & Nummenmaa, L. (2014). Recognition of facial expressions of emotion is related to their frequency in everyday life. Journal of Nonverbal Behavior, 38(4), 549–567. https://doi.org/10.1007/s10919-014-0191-3
Carroll, J. M., & Russell, J. A. (1996). Do facial expressions signal specific emotions? Judging emotion from the face in context. Journal of Personality and Social Psychology, 70(2), 205–218. https://doi.org/10.1037/0022-3514.70.2.205
Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6(1), 84–107. https://doi.org/10.1016/0010-0285(74)90005-X
Cowen, A. S., Keltner, D., Schroff, F., Jou, B., Adam, H., & Prasad, G. (2021). Sixteen facial expressions occur in similar contexts worldwide. Nature, 589(7841), 251–257. https://doi.org/10.1038/s41586-020-3037-7
Darwin, C., & Ekman, P. (1872). The expression of the emotions in man and animals, 3rd edn. In P. Ekman (Ed.). Oxford University Press.
Diéguez-Risco, T., Aguado, L., Albert, J., & Hinojosa, J. A. (2015). Judging emotional congruency: Explicit attention to situational context modulates processing of facial expressions of emotion. Biological Psychology, 112, 27–38. https://doi.org/10.1016/j.biopsycho.2015.09.012
Doyle, C. M., & Lindquist, K. A. (2017). Language and emotion: Hypotheses on the constructed nature of emotion perception. In J. M. Fernández-Dols & J. A. Russell (Eds.), The science of facial expression (pp. 415–432). Oxford University Press.
Doyle, C. M., & Lindquist, K. A. (2018). When a word is worth a thousand pictures: Language shapes perceptual memory for emotion. Journal of Experimental Psychology: General, 147(1), 62–73. https://doi.org/10.1037/xge0000361
Ekman, P. (1971). Universals and cultural differences in facial expressions of emotion. Nebraska Symposium on Motivation, 19, 207–283.
Ekman, P., & Friesen, W. V. (1975). Unmasking the face: A guide to recognizing emotions from facial clues. Prentice-Hall.
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). GPower 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146
Fernández-Dols, J. M., & Carroll, J. M. (1997). Is the meaning perceived in facial expression independent of its context? In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 275–294). Cambridge University Press. https://doi.org/10.1017/CBO9780511659911.014
Gendron, M., Mesquita, B., & Barrett, L. F. (2013). Emotion perception: Putting the face in context. In D. Reisberg (Ed.), The Oxford handbook of cognitive psychology (pp. 539–556). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780195376746.013.0034
Gilbert, D. T. (1999). What the mind’s not. In S. Chaiken & Y. Trope (Eds.), Dual process theories in social psychology (pp. 3–11). Guilford Press.
Hall, J. A., Andrzejewski, S. A., Murphy, N. A., Mast, M. S., & Feinstein, B. A. (2008). Accuracy of judging others’ traits and states: Comparing mean levels across tests. Journal of Research in Personality, 42(6), 1476–1489. https://doi.org/10.1016/j.jrp.2008.06.013
Heavey, C. L., Lefforge, N. L., Lapping-Carr, L., & Hurlburt, R. T. (2017). Mixed emotions: Toward a phenomenology of blended and multiple feelings. Emotion Review, 9(2), 105–110. https://doi.org/10.1177/1754073916639661
Heider, F. (1958). The psychology of interpersonal relations. John Wiley & Sons Inc. https://doi.org/10.1037/10628-000
Izard, C. E. (1971). The face of emotion. Appleton-Century-Crofts.
Jones, E. E., & Davis, K. E. (1965). From acts to dispositions the attribution process in person perception. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 2, pp. 219–266). Academic Press. https://doi.org/10.1016/S0065-2601(08)60107-0
Krumhuber, E. G., Tamarit, L., Roesch, E. B., & Scherer, K. R. (2012). FACSGen 2.0 animation software: Generating three-dimensional FACS-valid facial expressions for emotion research. Emotion, 12(2), 351–363. https://doi.org/10.1037/a0026632
Lindquist, K. A. (2017). The role of language in emotion: Existing evidence and future directions. Current Opinion in Psychology, 17, 135–139. https://doi.org/10.1016/j.copsyc.2017.07.006
Masuda, T., Ellsworth, P. C., Mesquita, B., Leu, J., Tanida, S., & Van de Veerdonk, E. (2008). Placing the face in context: Cultural differences in the perception of facial emotion. Journal of Personality and Social Psychology, 94(3), 365–381. https://doi.org/10.1037/0022-3514.94.3.365
Matsumoto, D., & Hwang, H. S. (2010). Judging faces in context. Social and Personality Psychology Compass, 4(6), 393–402. https://doi.org/10.1111/j.1751-9004.2010.00271.x
Milanak, M. E., & Berenbaum, H. (2014). The effects of context on facial affect recognition. Motivation and Emotion, 38(4), 560–568. https://doi.org/10.1007/s11031-014-9401-x
Mumenthaler, C., & Sander, D. (2012). Social appraisal influences recognition of emotions. Journal of Personality and Social Psychology, 102(6), 1118–1135. https://doi.org/10.1037/a0026885
Naples, A., Nguyen-Phuc, A., Coffman, M., Kresse, A., Faja, S., Bernier, R., & McPartland, J. C. (2015). A computer-generated animated face stimulus set for psychophysiological research. Behavior Research Methods, 47(2), 562–570.
Neuberg, S. L., & Fiske, S. T. (1987). Motivational influences on impression formation: Outcome dependency, accuracy-driven attention, and individuating processes. Journal of Personality and Social Psychology, 53(3), 431–444. https://doi.org/10.1037/0022-3514.53.3.431
Ngo, N., & Isaacowitz, D. M. (2015). Use of context in emotion perception: The role of top-down control, cue type, and perceiver’s age. Emotion, 15(3), 292–302. https://doi.org/10.1037/emo0000062
Nook, E. C., Lindquist, K. A., & Zaki, J. (2015). A new look at emotion perception: Concepts speed and shape facial emotion recognition. Emotion, 15(5), 569–578. https://doi.org/10.1037/a0039166
Oosterhof, N. N., & Todorov, A. (2008). The functional basis of face evaluation. PNAS Proceedings of the National Academy of Sciences of the United States of America, 105(32), 11087–11092. https://doi.org/10.1073/pnas.0805664105
Philip, L., Martin, J.-C., & Clavel, C. (2018). Rapid facial reactions in response to facial expressions of emotion displayed by real versus virtual faces. I-Perception. https://doi.org/10.1177/2041669518786527
Reschke, P. J., Knothe, J. M., Lopez, L. D., & Walle, E. A. (2018). Putting “context” in context: The effects of body posture and emotion scene on adult categorizations of disgust facial expressions. Emotion, 18(1), 153–158. https://doi.org/10.1037/emo0000350
Reschke, P. J., Walle, E. A., Knothe, J. M., & Lopez, L. D. (2019). The influence of context on distinct facial expressions of disgust. Emotion, 19(2), 365–370. https://doi.org/10.1037/emo0000445
Righart, R., & de Gelder, B. (2008). Recognition of facial expressions is influenced by emotional scene gist. Cognitive, Affective & Behavioral Neuroscience, 8(3), 264–272. https://doi.org/10.3758/CABN.8.3.264
Rosenthal, R. (2005). Conducting judgment studies: Some methodological issues. In J. A. Harrigan, R. Rosenthal, & K. R. Scherer (Eds.), The new handbook of methods in nonverbal behavior research (pp. 199–234). Oxford University Press.
Russell, J. A. (1994). Is there universal recognition of emotion from facial expressions? A review of the cross-cultural studies. Psychological Bulletin, 115(1), 102–141. https://doi.org/10.1037/0033-2909.115.1.102
Schwarz, K. A., Wieser, M. J., Gerdes, A. B. M., Mühlberger, A., & Pauli, P. (2013). Why are you looking like that? How the context influences evaluation and processing of human faces. Social Cognitive and Affective Neuroscience, 8(4), 438–445. https://doi.org/10.1093/scan/nss013
Spencer-Smith, J., Wild, H., Innes-Ker, Å. H., Townsend, J., Duffy, C., Edwards, C., Ervin, K., Merritt, N., & Paik, J. W. (2001). Making faces: Creating three-dimensional parameterized models of facial expression. Behavior Research Methods, Instruments & Computers, 33(2), 115–123. https://doi.org/10.3758/BF03195356
Stewart, S. L. K., Schepman, A., Haigh, M., McHugh, R., & Stewart, A. J. (2018). Affective theory of mind inferences contextually influence the recognition of emotional facial expressions. Cognition and Emotion. https://doi.org/10.1080/02699931.2018.1450224
Taylor, S. E., & Fiske, S. T. (1978). Salience, attention, and attribution: Top of the head phenomena. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 11, pp. 249–288). Academic Press. https://doi.org/10.1016/S0065-2601(08)60009-X
Tomkins, S. S. (2008). Affect imagery consciousness: The complete edition: Two volumes. Springer Publishing Company.
Wallbott, H. G. (1988). Faces in context: The relative importance of facial expression and context information in determining emotion attributions. In K. R. Scherer (Ed.), Facets of emotion: Recent research (pp. 139–160). Lawrence Erlbaum Associates Inc.
Watson, D., & Stanton, K. (2017). Emotion blends and mixed emotions in the hierarchical structure of affect. Emotion Review, 9(2), 99–104. https://doi.org/10.1177/1754073916639659
Wieser, M. J., & Brosch, T. (2012). Faces in context: A review and systematization of contextual influences on affective face processing. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2012.00471
Yzerbyt, V. Y., Rogier, A., & Fiske, S. T. (1998). Group entitativity and social attribution: On translating situational constraints into stereotypes. Personality and Social Psychology Bulletin, 24(10), 1089–1103. https://doi.org/10.1177/01461672982410006
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Data that support findings are available from the corresponding author upon reasonable request.
Rights and permissions
About this article
Cite this article
Mendolia, M. Type of Task Instruction Enhances the Role of Face and Context in Emotion Perception. J Nonverbal Behav 46, 99–114 (2022). https://doi.org/10.1007/s10919-021-00383-1
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10919-021-00383-1