Rule-based generalization of threat without similarity
Introduction
Generalization is the expression of a previously learned behavior in response to a novel stimulus. In a dynamically changing world where conditions never truly replicate, generalization of behavioral responses to novel stimuli is necessary for any organism to establish beneficial interactions with its environment. Responding to a novel generalization stimulus (GS) in terms of a previously learned conditioned stimulus (CS) presupposes that GS and CS are equated with respect to their reinforcement contingencies even though the GS has not been reinforced. The behavioral equation of GS and CS with respect to their reinforcement contingencies, can be motivated by perceptual similarity (e.g., Pavlov, 1927, Spence, 1937, Guttman and Kalish, 1956, Honig and Urcuioli, 1981) or by an abstract pattern or rule (e.g., Gershman and Niv, 2015, Lange et al., 2017, Meulders et al., 2017, Lei et al., 2019, Lovibond et al., 2019, Maes et al., 2017, Vervoort et al., 2014).
Perceptual similarity can be defined as the spatial distance between the GS and CS on a continuously varying psychological dimension, such as, for example, size or wavelength (Shepard, 1987), or as the degree of overlap between the feature sets of the GS and the CS (Tversky, 1977; for a more general Bayesian account, see Tenenbaum and Griffiths, 2001). Experiments have shown that behavioral and physiological responses are sensitive to the degree of similarity and generally decrease as the GS increasingly differs perceptually from the CS, thus forming a generalization gradient (Spence, 1937, Lissek et al., 2008).
In contrast to similarity-based generalization, rule-based generalization requires the organism to infer an abstract pattern that specifies when a GS should be behaviorally equated with a CS. In a paradigmatic study on rule-based generalization, Shanks and Darby (1998) showed that humans who have been trained on negative (A+, B+, AB) and positive (C, D, CD+) association patterns, generalized the learned rule of opposites (reinforcement for combined stimuli is opposite to singular stimuli) to novel stimulus patterns of the same type (E+, F+, EF?, correctly predicting EF; GH+, G?, H? correctly predicting G and H).
The main difference between similarity and rule-based generalization is that the latter requires some degree of abstraction from the identity of the stimulus and its concrete perceptual features, that is, inductive inference (Dunsmoor and Murphy, 2015). The abstraction required for rule-based generalization in the patterning task makes it possible to compare similarity-based and rule-based generalization (Shanks and Darby, 1998). However, the patterning task is focused exclusively on the rule of opposites, which might be a particular type of abstraction that requires other specific cognitive abilities, such as working memory or attention (Maes et al., 2015, Maes et al., 2017).
A simpler task to investigate rule-based generalization is based on the same/different distinction. In the match-to-sample (MTS) task, participants are first presented with a sample stimulus and then have to select the target stimulus that matches the sample stimulus from a range of comparison stimuli. Generalization in MTS is constituted by the selection of a target stimulus based on a previously reinforced matching relation between sample and target (e.g., color of elemental stimuli, or visual variance of compound stimuli; Urcuioli and Nevin, 1975). In its simpler form, MTS is problematic because successful performance in MTS generalization can be achieved through perceptual, that is, similarity-based, generalization using stimulus features such as visual entropy to assess visual variance (Young et al., 1997).
To address this issue with simple MTS tasks and to investigate rule-based generalization without similarity beyond the rule of opposites, we designed a novel paradigm that uses a relative – and therefore minimally abstract – property of compound stimuli to define sameness. The basic structure of our paradigm is as follows: on each trial, participants are consecutively presented with four different images, which together constitute a complex relational stimulus that acts as the CS. The first three images are all instances of the same semantic category, for example, three images of islands. The fourth image is either another member of that category (e.g., another image of an island) or not. The rule in this experiment is defined as a mapping from the relative perceptual properties of the four images to an abstract binary property of the CS (same/different). Reinforcement is contingent upon this abstract matching property of the CS, that is, depending on the CS-US contingency assignment, the CS is reinforced if the fourth stimulus is the same (CS+) but not otherwise (CS). Importantly, all stimuli used in the experiment are trial-unique and each stimulus is presented only once during the experiment.
We argue that this paradigm requires rule-based rather than similarity-based generalization because the GS-CS relation is dependent on the abstract matching property but not any perceptual features of the stimuli. Perceptual similarity is only relevant to derive the matching property but is otherwise ‘encapsulated’ within each trial. The transfer of a previously learned CS-US association onto a novel GS is independent of the perceptual similarity between the GS and any other CS. There are no perceptual properties, for example, associated with islands, that will allow the learner to generalize to novel stimuli, which depict, for example, airports.
One feature of abstraction is that it affords a high degree of flexibility. Commonly, flexibility is experimentally assessed using reversal tasks, where reinforcement contingencies are reversed after a certain number of trials and whatever stimulus acted as CS+ now becomes the CS and vice versa (Clark et al., 2004, Izquierdo et al., 2017). Rules, such as the one used in our paradigm, afford flexibility because the relation between the matching property of the CS and the US can simply be reversed upon encountering new evidence without the need to learn a novel abstraction. To test whether rule-based generalization in our paradigm is associated with behavioral flexibility, participants undergo a mid-session reversal of reinforcement contingencies.
As behavioral measures of learning, we recorded skin conductance responses (modeled as sudomotor nerve activity, SNA), stimulus-related changes in heart rate (heart rate responses, HRR), and online US expectancy ratings. Our main hypothesis is that participants will demonstrate differential, rule-based generalization across all three measures, that is, stronger responses to CS+ than CS irrespective of experimental phase. We further predicted that participants would flexibly adapt their behavioral responses after the contingency reversal, that is, differential responding to CS+ and CS would be maintained post contingency reversal.
Section snippets
Participants
53 right-handed young adults (age years, years, range = 19–39 years; 24 females) took part in the experiment after giving written consent in exchange for course credits or 10 in Amazon vouchers. The study was approved by the Research Ethics Committee at Swansea University's Department of Psychology.
Procedure and materials
Participants took part in a novel differential threat generalization task. During each trial, participants were consecutively presented with four images. The first three images
Expectancy ratings
Mean expectancy ratings were analyzed using repeated measures analyses of variance (ANOVA) with the factors stimulus type (CS+, CS) and experimental phase (pre, post reversal). The results demonstrate a significant interaction between stimulus type and experimental phase (F(1,52) = 4.12, p = 0.048, ) as well as a main effect of stimulus type (F(1,52) = 96.21, p < 0.001, ; see Fig. 2A). The main effect of experimental phase was not significant (F(1,52) = 1.13, p = 0.292).
Discussion
The primary aim of this study was to investigate anticipatory behavioral responses (US expectancy ratings, sudomotor nerve activity, and heart rate responses) during a novel rule-based threat generalization paradigm. All three measures indicated successful learning by showing significantly stronger responses to CS+ than CS. The secondary aim of this study was to test the effects of mid-session contingency reversal on behavior. The results demonstrated no effect of phase on US expectancy
Open Science statement
All experimental materials, data, and analysis code used in the production of this paper are freely accessible at https://osf.io/b47ax/.
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
This project has received funding from the European Union's Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement no. 663830.
References (47)
- et al.
The neuropsychology of ventral prefrontal cortex: Decision-making and reversal learning
Brain and Cognition
(2004) - et al.
Role of conceptual knowledge in learning and retention of conditioned fear
Biological Psychology
(2012) - et al.
Categories, concepts, and conditioning: How humans generalize fear
Trends in Cognition Sciences
(2015) - et al.
The neuropsychology of fear learning and fear regulation
International Journal of Psychophysiology
(2005) Direction of ContentsBiol Psychol contents
Biological Psychology
(1979)- et al.
The neural basis of reversal learning: An updated perspective
Neuroscience
(2017) - et al.
Human Amygdala Activation During Conditioned Fear Acquisition and Extinction: A Mixed-Trial fMRI Study
Neuron
(1998) - et al.
Influence of typicality in category-based fear generalization: Diverging evidence from the P2 and N400 effect
International Journal of Psychophysiology
(2019) - et al.
Generalization of conditioned fear-potentiated startle in humans: Experimental validation and clinical relevance
Behaviour Research and Therapy
(2008) - et al.
Cardiac defense response as a predictor of fear learning
International Journal of Psychophysiology
(2009)
A systematic review and meta-analysis of the evidence for unaware fear conditioning
Neuroscience & Biobehavioral Reviews
Generalization of pain-related fear based on conceptual knowledge
Behavior Therapy
Fear generalization in humans: Impact of feature learning on conditioning and extinction
Neurobiology of Learning and Memory
Fear generalization in humans: Impact of prior non-fearful experiences
Behaviour Research and Therapy
Rule-based generalisation in single-cue and differential fear conditioning in humans
Biological Psychology
Multiple imputation by chained equations: What is it and how does it work?
International Journal of Methods in Psychiatric Research
Model-based analysis of skin conductance responses: Towards causal models in psychophysiology
Psychophysiology
Publication recommendations for electrodermal measurements
Psychophysiology
MICE: Multivariate imputation by chained equations in R
Journal of Statistical Software
Modeling fear-conditioned bradycardia in humans
Psychophysiology
Moving beyond system 1 and system 2
Journal of Experimental Psychology
Threat intensity widens fear generalization gradients
Behavioral Neuroscience
Stimulus typicality determines how broadly fear is generalized
Psychological Science
Cited by (2)
Contingency Reversal in Conditioned Fear Learning: The Moderated Mediation Model of Intolerance of Uncertainty and Instruction
2024, Psychology Research and Behavior Management