Remembering faces: The effects of emotional valence and temporal recency
Introduction
The goal of present study was to investigate whether the emotional content of an information might act as a memory enhancer, able to strengthen and consolidate recent, therefore weaker, traces in virtue of their emotional valence.
At this aim we designed an old/new memory paradigm in which faces of popular movie stars known for at least 5–8 consecutive years (therefor “old” faces), were contrasted with recently learned faces of fictional characters studied during the week preceding the EEG recording (“recent” faces) as opposed to previously unknown faces (“new” faces). The time course and functional properties of ERP responses elicited during face recognition were compared. In this way the effect of temporal recency on face remembering was investigated, by considering the gradient: old, recent, and new. Previous literature (e.g., Moreton & Ward, 2010) investigated the extent to which retrieval from long-term memory differs as a function of the retention time. In Moreton and Ward (2010), for example, participants were given 4 min to recall autobiographical events from the last 5 weeks, the last 5 months, or the last 5 years, and the results showed similar retrieval rates. This results has been interpreted in the light of the so-called SIMPLE model (Brown, Neath, & Chater, 2007), according to which correct memory recognitions would be a function of the relative temporal distinctiveness of the items to be remembered, not just of their recency. However, the neuroscientific literature provides evidence of a different neural representation of short vs. long term memories. For example, it has long been known that in case of damage to hippocampal or medial temporal regions, the retrograde amnesia deficit involves only the recent past (for example memories relative to the last few years preceding the cerebral insult) and not the remote past of the patient, thus indicating a greater strength of older memory traces (“Consolidation theory” by Manns, Hopkins, & Squire, 2003, see also Markowitsch and Staniloiu, 2013, Kopelman and Bright, 2012). In addition, according to the “Episodic-to-semantic shift” theory, also called “semanticisation”, episodic memories would acquire a more ‘semantic’ form as they get older, thereby protecting them against the effects of brain damage (Cermak, 1984) or oblivion. Furthermore neurophysiological data have provided multiple evidences that brain encoding of very recent memories would have a bioelectrical nature (e.g. Zamora, Corina, & Ojemann, 2016), while the deep encoding in LTM would be based on plastic structural changes and dendritic formations, also called long-term potentiation (LTP). Interestingly, evidences have been provided that working memory might also involve activity-silent neural states, especially at prefrontal level (Stokes, 2015).
Notwithstanding that, not many studies in humans have directly compared the neural markers of remembering information of different temporal recency, especially with the ERP technique, which is actually very sensitive to both recollection and familiarity processes. Stimuli recognized as known (as opposed to unknown) typically modulate the amplitude of two ERP components: a mid-frontal negativity FN400 sensitive to stimulus familiarity (Curran, 1999, Curran, 2000) and parietal old/new late positivity, indexing stimulus conscious recollection (Evans and Wilding, 2012, Hoppstädter et al., 2015, Rugg et al., 1996, Wilding and Rugg, 1996, Wilding and Sharpe, 2003). According to the dual-process model of recognition memory, judgments produced on the basis of familiarity are quick, automatic, and reflect a general feeling of knowing that a stimulus was previously presented. On the other hand, recollection requires actively reporting details about studied items and results in slow, more effortful judgments (Aggleton and Brown, 1999, Atkinson and Juola, 1974, Yonelinas et al., 1999, Yonelinas et al., 2002).
The present research applied the ERP technique to investigate whether emotional valence might affect recollection of recent memories with respect to old memories. We sought to comprehend if the possible memory enhancement involved face familiarity (N2 and FN400) and/or recognition (LP) and source memory (indexed by frontal responses, such as Late anterior negativity, LAN). In fact, a frontally distributed N400 (FN400), has been directly related to the concept of familiarity. For example, Curran (Curran, 1999, Curran, 2000) found an enhanced negative response between 300 and 500 ms post-stimulus at scalp anterior regions, which was larger to new than old items. Additionally, we expected a modulation of an earlier familiarity-related response (frontal N2) recently found to precede F/N400 effects, and being also larger to unknown than familiar items (Lawson et al., 2012). On the other hand, as previously mentioned, the parietal old/new LP has been associated to stimulus conscious recollection (Wilding and Rugg, 1996, Wilding and Sharpe, 2003).
At this aim the temporal course of brain bioelectrical activity was measured during recognition of faces of different emotional valence, sex, learning context and temporal recency. The study involved the presentation of 300 faces: some belonged to famous people (movie and TV stars), others were learned during a study phase starting one week before the experiment (very recent material), and the remaining were new faces (no familiarity). Faces to be studied (previously unknown) were presented as victims of murders or accidents with a description provided in the form of a police dossiers featuring a short text accompanied by several pictures of the victims. This experimental manipulation was included to explore the effect of emotional memory in the episodic encoding of faces. Indeed, convergent evidence suggests that emotional events attain a privileged status in memory (LaBar & Cabeza, 2006) and that memory tends to be better for emotionally arousing information than for neutral information (Buchanan & Lovallo, 2001). The reason for this potentiation has been explained by neuroscientific studies providing evidence of a more intense brain activity during coding of emotional information. For example, Mueller and Pizzagalli (2016) have provided direct electrophysiological evidence (via intracranial recordings) that faces that had been fear-conditioned (to become threatening stimuli) evoke increased activity in or in proximity of the left fusiform gyrus as early as 80 ms post-stimulus after presentation. The effect was visible starting from the same day of conditioning and, remarkably, it was still very strong one year after the fear-conditioning. In another experiment Proverbio, LaMastra, and Zani (2016) investigated the effect of social prejudice on memory for faces, by presenting hundreds of faces of male and female individuals in association with a derogatory or an appreciative description, and found that faces associated with a negative (vs. positive) prejudice elicited larger anterior negativities during encoding, smaller FN400s and larger LPs during recollection. The larger potentials for negatively-valenced faces were associated to increased activations of the limbic and parahippocampal areas.
Based on previous ERP literature, we predicted a significant modulation of FN400 and LP components as a function of stimulus familiarity (known vs. unknown). Both processes are thought to be related to two spatiotemporally different ERP effects (FN400 and LP), namely the early mid-frontal negativity (familiarity) and the late parietal old/new effect (recollection) (Evans and Wilding, 2012, Hoppstädter et al., 2015, Rugg et al., 1996, Wilding and Rugg, 1996, Wilding and Sharpe, 2003).
We sought also to investigate the impact of emotional valence on the remembering of recent faces, in the hypothesis that the threatening learning context of recently faces might made them equally memorable than robustly coded information (i.e., popular faces). Had this been the case we would have expected to find equally large FN400 responses to recent and old faces. Furthermore, we also expected a modulation of an earlier familiarity-related response (anterior N200) recently found to precede FN400 effects, and to be larger to unknown than familiar items (Lawson et al., 2012).
Additionally we also wished to investigate whether face sex significantly affected memory recollection. Indeed previous research on emotions and empathic resonance mechanisms showed that some specific factors can facilitate emotional mirroring, like perceived similarity (e.g., sex of viewer); it would influence empathic responding through the tendency to identify more closely with others who appear as being more similar in features such as personality (Gruen & Mendelsohn, 1986) or appearance (Bufalari, Porciello, Sperduti, & Minio-Paluello, 2015). On the basis of this literature (Proverbio, Riva, Martin, & Zani, 2010) we predicted a better recall of own-sex faces, sharing sexual gender with the viewer.
Section snippets
Participants
Twenty-two university students (11 males and 11 females) volunteered for this experiment. Females ranged in age from 20 to 26 years (mean age = 22.91 years, SD = 1.76) and had a high level of education (15.73 years in school, SD = 1.01). Males ranged in age from 20 to 27 years (mean age = 24.18 years, SD = 2.05) with the same level of education as females (15.82 years in school, SD = 1.66). All participants had heterosexual preferences as ascertained by a written questionnaire, had normal or
Behavioral results
Hits (familiarity factor): The analysis of correct responses (recognition of known faces and rejection of unknown faces) revealed a main effect of Familiarity (F2,42 = 6.06, p < 0.005); post-hoc comparisons showed that participants were less accurate in the recognition of new faces (71.17%, SE = 2.01) compared to old ones (p < 0.005; 78.73%, SE = 1.38), while no difference was found in the percentage of correct recognition of old vs. recent faces, new vs. recent faces, same vs. opposite face
Discussion
The present paper was aimed at investigating whether the emotional content of recent information might overcome their weakness acting as a memory enhancer, able to strengthen and consolidate their memory in virtue of their emotional valence. With this aim, we compared the time course, amplitude and topography of ERPs elicited during recalling of old and solid information from long term memory (such as the faces of popular movie stars), with that of recently acquired emotional information (faces
Conclusions
Overall, the present findings showed that the emotional content of recently learnt faces might enhance their memory traces regardless of their recency, making them as familiar as faces known for a long time. Accuracy and early negative potentials (N200 and FN400) indexing familiarity (Curran, 1999, Curran, 2000) were greater to old and recent (than new faces) with no distinctions between the two categories, thus suggesting a strong effect of the emotional manipulation of recent information. On
Authors and contributors
AMP and MEV designed the methods and experiment. MEV and SV prepared stimuli, performed stimuli validation, data acquisition and analyses. AMP interpreted the results and wrote the paper. All authors have contributed to, seen and approved the manuscript.
Data accessibility
Anonymized data and details about preprocessing/analyses will be made available to colleagues if requested.
Declaration of Competing Interest
The author(s) declare no competing financial interests.
Acknowledgments
Funded by 9928 013-ATE-0037 grant from University of Milano-Bicocca “How face avoidance affects action understanding and affective processing in Autism”. We are really grateful to Francesco De Benedetto for his technical support.
References (59)
- et al.
Socio-emotional functioning and face recognition ability in the normal population
Personality and Individual Differences
(2010) - et al.
Dissociation of short- and long-term face memory: Evidence from long-term recency effects in temporal lobe epilepsy
Brain and Cognition
(2007) - et al.
Enhanced memory for emotional material following stress-level cortisol treatment in humans
Psychoneuroendocrinology
(2001) The electrophysiology of incidental and intentional retrieval: ERP old/new effects in lexical decision and recognition memory
Neuropsychologia
(1999)- et al.
The FN400 indexes familiarity-based recognition of faces
Neuroimage.
(2007) - et al.
Neural correlates of control processes engaged before and during recovery of information from episodic memory
Neuroimage
(2006) - et al.
Simultaneous EEG-fMRI reveals brain networks underlying recognition memory ERP old/new effects
Neuroimage
(2015) - et al.
On remembering and forgetting our autobiographical pasts: Retrograde amnesia and Andrew Mayes's contribution to neuropsychological method
Neuropsychologia
(2012) - et al.
Sensation seeking predicts brain responses in the old-new task: Converging multimodal neuroimaging evidence
International Journal of Psychophysiology
(2012) - et al.
Regional and inter-regional theta oscillation during episodic novelty processing
Brain and Cognition
(2014)
Semantic memory and the human hippocampus
Neuron
The impairment of recollection in functional amnesic states
Cortex
Human emotion and memory: Interactions of the amygdala and hippocampal complex
Current Opinion in Neurobiology
Event-related potentials and the recollection of associative information
Brain Research Cognitive
'Activity-silent' working memory in prefrontal cortex: A dynamic coding framework
Trends in Cognitive Sciences
Episodic memory encoding and retrieval: Recent insights from event-related potentials
Human temporal cortical single neuron activity during working memory maintenance
Neuropsychologia
Episodic memory, amnesia, and the hippocampal-anterior thalamic axis
Behavioral and Brain Sciences
Lesions of the human amygdala impair enhanced perception of emotionally salient events
Nature
Search and decision processes in recognition memory
A temporal ratio model of memory
Psychological Review
Self-identification with another person's face: The time relevant role of multimodal brain areas in the enfacement illusion
Journal of Neurophysiology
Remembering emotional events
Memory & Cognition
The episodic-semantic distinction in amnesia
Eye fixations and memory for emotional events
Journal of Experimental Psychology. Learning, Memory, and Cognition
Brain potentials of recollection and familiarity
Memory & Cognition
Affective valence and the self-reference effect: Influence of retrieval conditions
British Journal of Psychology
Influence of facial expression on memory for facial identity: Effects of visual features or emotional meaning?
Emotion
From emotion resonance to empathic understanding: A social developmental neuroscience account
Development and Psychopathology
Cited by (6)
A machine learning approach to primacy-peak-recency effect-based satisfaction prediction
2023, Information Processing and ManagementCitation Excerpt :Yeh and Chen (2022) discovered that users’ first impressions of fit had a positive effect on their learning performance measured by test scores in subsequent sessions. The recency effect indicates that affective events and information occurring at end moments impact the overall evaluation of experiences (Proverbio et al., 2019). Garnefeld and Steinhoff (2013) investigated the impact of the position of affective events on the evaluation of overall performance.
When old information is intermixed with new elements: An event-related potential study
2021, Biological PsychologyCitation Excerpt :Additionally, Mograss et al. (2009) associated N2 with old/new discrimination, where the new stimuli induced a larger N2 compared to old stimuli. Proverbio et al. (2019) face recognition experiment supported Mograss et al.’s (2009) findings. The N270, part of the N2, reflected two types of conflict monitoring: the conflict between two external stimuli and the conflict between memory representation and external stimulus (Wang et al., 2000).
Symptoms of depersonalisation/derealisation disorder as measured by brain electrical activity: A systematic review
2020, Neuroscience and Biobehavioral ReviewsCitation Excerpt :Moreover, observation of N200 and frontally distributed N400 (FN400) components of ERP in DPD patients during a memory recall task might also help to discover the underlying nature of de-ideation. A study by Proverbio et al. (2019) showed no distinction in N200 and FN400 components between the retrieval of an old memory and the retrieval of more recent but emotionally salient memory, and both scenarios evoked smaller components in comparison with a recent neutral memory. Since these ERP components index familiarity of a stimulus (Curran, 1999, 2000), the authors argued that both time and emotional valence have effects on memory recall.
Motivated attention and task relevance in the processing of cross-modally associated faces: Behavioral and electrophysiological evidence
2023, Cognitive, Affective and Behavioral Neuroscience"I" Always Cooperate: Self-Positivity Bias in Destination Memory for Cooperation and Cheating
2021, Advances in Cognitive PsychologyNeural Mechanisms of Subliminal Mentor-Student Relationship Stimuli Processing: An ERP Study
2022, International Journal of Environmental Research and Public Health