Causal discovery and the problem of psychological interventions
Introduction
A key objective in psychological research is to distinguish causal relationships from mere correlations (Kendler & Campbell, 2009; Pearl, 2009; Pearl & Mackenzie, 2018; Shadish & Sullivan, 2012). For example, psychologists want to know whether having negative thoughts is a cause of anxiety instead of just being correlated with it: If the relationship is causal, then the two are not just spuriously hanging together, and intervening on negative thinking is one way of reducing anxiety in patients suffering from anxiety disorders. However, to what extent is it actually possible to find psychological causes?
In this paper, I will point out and discuss several obstacles to discovering psychological causes that have not been adequately discussed in the psychological and philosophical literature. First, I will highlight a crucial but often neglected distinction: The distinction between non-psychological and psychological interventions, which create very different contexts for causal inference. Second, I will argue that the latter context, discovery of psychological causes, is deeply problematic.
I will formulate my arguments in the framework of the interventionist theory of causation. It is a theory of causation that aims at elucidating the role of causal thinking in science, and defining a notion of causation that captures the difference between causal relationships and mere correlations in a way that reflects scientific practice (Pearl, 2000, 2009; Spirtes, Glymour, & Scheines, 2000; Woodward, 2003; Woodward & Hitchcock, 2003). Several authors have also argued that interventionism adequately captures the role of causal thinking and reasoning in psychological research (Campbell, 2007; Kendler & Campbell, 2009; Rescorla, 2018; Woodward, 2008a). Due to its conceptual clarity regarding the notions of causation and intervention, interventionism is exceptionally well suited for highlighting the problems that are the focus of this paper. However, as I will argue, these problems are not just restricted to interventionism, but should be seen as general challenges to the discovery of psychological causes.
The structure of this paper is as follows. I will start by giving a brief introduction to interventionism, and then turn to problems of interventionist causal inference in psychology: First, to problems related to psychological interventions (section 3), and then to problems arising from the requirement to “hold fixed” possible confounders (section 4). After this, I will show how these problems appear in some of the most common approaches to causal discovery in psychological research (section 5). In the last section, I consider different ways forward and various implications that my arguments have for psychology.
Section snippets
Interventionism
The guiding idea of interventionism is that causes are “difference-makers” for their effects: Causal relationships (unlike correlations) are such that we can manipulate or intervene on the cause to bring about a change in the effect (Woodward, 2003). As an intuitive example, if giving feedback to students is a cause of improved learning outcomes (and the two are not merely correlated), then interventions that increase feedback in a given population should result in improved learning outcomes.
Psychological interventions
In order to explain the problem of psychological interventions, one more key distinction has to be introduced first: The distinction between psychological and non-psychological causes. That is, there are on the one hand relationships where (1) the cause is non-psychological, and the effect is psychological, and on the other hand relationships (2) where the cause (and possibly also the effect) is psychological.5
The problem of “holding fixed”
I will now turn to a second problem for causal inference in psychology. Whereas the previous problem concerned the requirements imposed on interventions, this one is related to the way causation is defined in (M): X is a cause of Y (in variable set V) if and only if it is possible to intervene on X to change Y when all other variables (in V) that are not on the path from X to Y are held fixed to some value. The motivation for this requirement of “holding fixed” is to make sure that the change
Psychological interventions and causal inference in psychology
To summarize, what I have argued so far is that interventionist causal inference in psychology faces several obstacles: (1) Psychological interventions are typically fat-handed (and soft): They change several variables simultaneously, and do not completely determine the value(s) of the variable(s) intervened upon. It is not known to what extent such interventions give leverage for causal inference. (2) Due to the nature psychological measurement, the degree to which a psychological intervention
Discussion
In this paper, I have used the interventionist theory of causation to highlight problems in causal inference involving psychological causes. I have also argued that these problems are not just internal to interventionism, but challenges for psychological research in general, insofar as it aims at uncovering psychological causes.
The results of this paper have several implications for psychological research. First, the importance of the difference between psychological and non-psychological
CRediT authorship contribution statement
Markus I. Eronen: Conceptualization, Investigation, Methodology, Writing - original draft, Writing - review & editing.
References (72)
Interventionist causal exclusion and non-reductive physicalism
International Studies in the Philosophy of Science
(2009)Rendering interventionism and non-reductive physicalism compatible
Dialectica
(2013)The inherent empirical underdetermination of mental causation
Australasian Journal of Philosophy
(2018)- et al.
Constitutive relevance, mutual manipulability, and fat-handedness
The British Journal for the Philosophy of Science
(2016) Mental Mechanisms. Philosophical Perspectives on Cognitive Neuroscience
(2008)- et al.
The Oxford handbook of causation
(2009) Measuring the mind: Conceptual issues in contemporary psychometrics
(2005)- et al.
Network analysis: An integrative approach to the structure of psychopathology
Annual Review of Clinical Psychology
(2013) - et al.
The theoretical status of latent variables
Psychological Review
(2003) - et al.
Heating up the measurement debate: What psychologists can learn from the history of physics
Theory & Psychology
(2016)
Factors relevant to the validity of experiments in social settings
Psychological Bulletin
An interventionist approach to causation in psychology
Convergent and discriminant validation by the multitrait-multimethod matrix
Psychological Bulletin
Nature's capacities and their measurement
Learning high-dimensional directed acyclic graphs with latent and selection variables
Annals of Statistics
Contemporary thinking about causation in evaluation: A dialogue with
American Journal of Evaluation
Construct validity in psychological tests
Psychological Bulletin
Physical causation
Direct causes and the trouble with soft interventions
Erkenntnis
Interventions and causal inference
Philosophy of Science
Experimental manipulations of personal control do not increase illusory pattern perception
Collabra: Psychology
Robustness and reality
Synthese
Interventionism for the intentional stance: True believers and their brains
Topoi
Detecting psychological phenomena: Taking bottom-up research seriously
American Journal of Psychology
Why researchers should think “within-person”
Instrumental variables and inverse probability weighting for causal inference from longitudinal observational studies
Statistical Methods in Medical Research
Statistics and causal inference
Journal of the American Statistical Association
Causality. Philosophical theory meets scientific practice
On the psychology of prediction
Psychological Review
Interventionist causal models in psychiatry: Repositioning the mind-body problem
Psychological Medicine
The power of intervention
Minds and Machines
Evidential diversity and the triangulation of phenomena
Philosophy of Science
Evidence-based medicine versus personalized medicine: Are they enemies?
Journal of Clinical Psychopharmacology
Causation
The Journal of Philosophy
The n-of-1 clinical trial: The ultimate strategy for individualizing medicine?
Personalized Medicine
Causal discovery algorithms: A practical guide
Philosophy Compass
Cited by (34)
(When and how) does basic research in clinical psychology lead to more effective psychological treatment for mental disorders?
2022, Clinical Psychology ReviewCitation Excerpt :However, discovering causation using the experimental method may be systematically harder in psychology than in other sciences. Referring to formalized philosophical theories of causation, Eronen (2020) highlights a number of obstacles that hinder the success of causal discovery in psychology because of the nature of its subject, that is, internal processes. This includes the fact that interventions in psychology experiments that aim to manipulate a particular process (see Steps 2 and 3 of our proposed framework) are typically fat-handed.
A systematic review of the psychological distance of climate change: Towards the development of an evidence-based construct
2022, Journal of Environmental PsychologyCitation Excerpt :A common challenge with interventions in psychology is that they try to manipulate a psychological cause such as PD. Because it is usually not possible accurately to manipulate just one psychological variable without accidently causing other variables to change, it can be problematic to conclude that changes in the dependent variable (such as concern) are to be attributed to the psychological variable (such as PD) (Eronen, 2020). The reviewed literature indicates that this might be problematic within PD manipulations: manipulation checks were often unsuccessful and varied in the level of distance they were measuring, showing that the target variable of a manipulation is not always clearly identified.
A new science of mental disorders: Using personalised, transdiagnostic, dynamical systems to understand, model, diagnose and treat psychopathology
2022, Behaviour Research and TherapyCitation Excerpt :Certain symptoms are surely more severe than others, which makes sense to consider as well in the selection of the most important element (Bringmann et al., 2019). As ways forward, Bringmann et al. (2019) propose to (1) develop new centrality measures, (2) to use ‘old’ measures of variable importance, which were developed for the statistical models that are used to estimate psychological networks, or (3) to abandon the idea of centrality, as the focus on distinct symptoms or elements may not be ideal or realistic, also given the fat-hand problem (Erronen, 2020), the likeliness that interventions affect more than the targeted node alone. Instead, the focus might better be on the network as a whole, and mental disorders might better be defined as a complex system network (Bringmann et al., 2019).
Psychopathological networks: Theory, methods and practice
2022, Behaviour Research and TherapyCitation Excerpt :Similarly, interventions based on cognitive behavioral therapy typically target various aspects of sleep at the same time, for instance by combining sleep restriction intervention with attempts to change cognitive structures (Blanken et al., 2019; van der Zweerde, Van Straten, Effting, Kyle, & Lancee, 2019). In other words, is it possible to “surgically” target a single symptom in isolation, or are psychological interventions always “fat-handed”, changing several symptoms at the same time (Eronen, 2020)? It can also be challenging in practice to distinguish between an intervention that effectively targets a single symptom, whose reduction in severity then diminishes the severity of other symptoms shortly thereafter (which is what network-inspired clinical practice would aim to achieve) from an intervention that simultaneously affects several symptoms (i.e., a fat-handed intervention).
Making inferential leaps: Manipulation checks and the road towards strong inference
2022, Journal of Experimental Social PsychologyCitation Excerpt :Chester & Lasko (2020) recently reviewed the current state of validation practices and found that most manipulations are either unvalidated or are merely assessed by convergent measures. Given the previous discussion, on the problem of fat-handed manipulations (Eronen, 2020), it is not inconceivable that (in the typical psychological study) one or more non-focal constructs are manipulated. This is problematic however, as having a “thin-fingered” manipulation is critical for making a claim about the causal relevance of a specific variable (see Eronen, 2020; Woodward, 2003).