Elsevier

New Ideas in Psychology

Volume 59, December 2020, 100785
New Ideas in Psychology

Causal discovery and the problem of psychological interventions

https://doi.org/10.1016/j.newideapsych.2020.100785Get rights and content

Abstract

Finding causes is a central goal in psychological research. In this paper, I argue based on the interventionist approach to causal discovery that the search for psychological causes faces great obstacles. Psychological interventions are likely to be fat-handed: they change several variables simultaneously, and it is not known to what extent such interventions give leverage for causal inference. Moreover, due to problems of measurement, the degree to which an intervention was fat-handed, or more generally, what the intervention in fact did, is difficult to reliably estimate. A further complication is that the causal findings in psychology are typically made at the population level, and such findings do not allow inferences to individual-level causal relationships. I also discuss the implications of these problems for research, as well as various ways of addressing them, such as focusing more on the discovery of robust but non-causal patterns.

Introduction

A key objective in psychological research is to distinguish causal relationships from mere correlations (Kendler & Campbell, 2009; Pearl, 2009; Pearl & Mackenzie, 2018; Shadish & Sullivan, 2012). For example, psychologists want to know whether having negative thoughts is a cause of anxiety instead of just being correlated with it: If the relationship is causal, then the two are not just spuriously hanging together, and intervening on negative thinking is one way of reducing anxiety in patients suffering from anxiety disorders. However, to what extent is it actually possible to find psychological causes?

In this paper, I will point out and discuss several obstacles to discovering psychological causes that have not been adequately discussed in the psychological and philosophical literature. First, I will highlight a crucial but often neglected distinction: The distinction between non-psychological and psychological interventions, which create very different contexts for causal inference. Second, I will argue that the latter context, discovery of psychological causes, is deeply problematic.

I will formulate my arguments in the framework of the interventionist theory of causation. It is a theory of causation that aims at elucidating the role of causal thinking in science, and defining a notion of causation that captures the difference between causal relationships and mere correlations in a way that reflects scientific practice (Pearl, 2000, 2009; Spirtes, Glymour, & Scheines, 2000; Woodward, 2003; Woodward & Hitchcock, 2003). Several authors have also argued that interventionism adequately captures the role of causal thinking and reasoning in psychological research (Campbell, 2007; Kendler & Campbell, 2009; Rescorla, 2018; Woodward, 2008a). Due to its conceptual clarity regarding the notions of causation and intervention, interventionism is exceptionally well suited for highlighting the problems that are the focus of this paper. However, as I will argue, these problems are not just restricted to interventionism, but should be seen as general challenges to the discovery of psychological causes.

The structure of this paper is as follows. I will start by giving a brief introduction to interventionism, and then turn to problems of interventionist causal inference in psychology: First, to problems related to psychological interventions (section 3), and then to problems arising from the requirement to “hold fixed” possible confounders (section 4). After this, I will show how these problems appear in some of the most common approaches to causal discovery in psychological research (section 5). In the last section, I consider different ways forward and various implications that my arguments have for psychology.

Section snippets

Interventionism

The guiding idea of interventionism is that causes are “difference-makers” for their effects: Causal relationships (unlike correlations) are such that we can manipulate or intervene on the cause to bring about a change in the effect (Woodward, 2003). As an intuitive example, if giving feedback to students is a cause of improved learning outcomes (and the two are not merely correlated), then interventions that increase feedback in a given population should result in improved learning outcomes.

Psychological interventions

In order to explain the problem of psychological interventions, one more key distinction has to be introduced first: The distinction between psychological and non-psychological causes. That is, there are on the one hand relationships where (1) the cause is non-psychological, and the effect is psychological, and on the other hand relationships (2) where the cause (and possibly also the effect) is psychological.5

The problem of “holding fixed”

I will now turn to a second problem for causal inference in psychology. Whereas the previous problem concerned the requirements imposed on interventions, this one is related to the way causation is defined in (M): X is a cause of Y (in variable set V) if and only if it is possible to intervene on X to change Y when all other variables (in V) that are not on the path from X to Y are held fixed to some value. The motivation for this requirement of “holding fixed” is to make sure that the change

Psychological interventions and causal inference in psychology

To summarize, what I have argued so far is that interventionist causal inference in psychology faces several obstacles: (1) Psychological interventions are typically fat-handed (and soft): They change several variables simultaneously, and do not completely determine the value(s) of the variable(s) intervened upon. It is not known to what extent such interventions give leverage for causal inference. (2) Due to the nature psychological measurement, the degree to which a psychological intervention

Discussion

In this paper, I have used the interventionist theory of causation to highlight problems in causal inference involving psychological causes. I have also argued that these problems are not just internal to interventionism, but challenges for psychological research in general, insofar as it aims at uncovering psychological causes.

The results of this paper have several implications for psychological research. First, the importance of the difference between psychological and non-psychological

CRediT authorship contribution statement

Markus I. Eronen: Conceptualization, Investigation, Methodology, Writing - original draft, Writing - review & editing.

References (72)

  • M. Baumgartner

    Interventionist causal exclusion and non-reductive physicalism

    International Studies in the Philosophy of Science

    (2009)
  • M. Baumgartner

    Rendering interventionism and non-reductive physicalism compatible

    Dialectica

    (2013)
  • M. Baumgartner

    The inherent empirical underdetermination of mental causation

    Australasian Journal of Philosophy

    (2018)
  • M. Baumgartner et al.

    Constitutive relevance, mutual manipulability, and fat-handedness

    The British Journal for the Philosophy of Science

    (2016)
  • W. Bechtel

    Mental Mechanisms. Philosophical Perspectives on Cognitive Neuroscience

    (2008)
  • H. Beebee et al.

    The Oxford handbook of causation

    (2009)
  • D. Borsboom

    Measuring the mind: Conceptual issues in contemporary psychometrics

    (2005)
  • D. Borsboom et al.

    Network analysis: An integrative approach to the structure of psychopathology

    Annual Review of Clinical Psychology

    (2013)
  • D. Borsboom et al.

    The theoretical status of latent variables

    Psychological Review

    (2003)
  • L.F. Bringmann et al.

    Heating up the measurement debate: What psychologists can learn from the history of physics

    Theory & Psychology

    (2016)
  • D.T. Campbell

    Factors relevant to the validity of experiments in social settings

    Psychological Bulletin

    (1957)
  • J. Campbell

    An interventionist approach to causation in psychology

  • D.T. Campbell et al.

    Convergent and discriminant validation by the multitrait-multimethod matrix

    Psychological Bulletin

    (1959)
  • N. Cartwright

    Nature's capacities and their measurement

    (1989)
  • D. Colombo et al.

    Learning high-dimensional directed acyclic graphs with latent and selection variables

    Annals of Statistics

    (2012)
  • T.D. Cook et al.

    Contemporary thinking about causation in evaluation: A dialogue with

    American Journal of Evaluation

    (2010)
  • L.J. Cronbach et al.

    Construct validity in psychological tests

    Psychological Bulletin

    (1955)
  • P. Dowe

    Physical causation

    (2000)
  • F. Eberhardt

    Direct causes and the trouble with soft interventions

    Erkenntnis

    (2014)
  • F. Eberhardt et al.

    Interventions and causal inference

    Philosophy of Science

    (2007)
  • M. van Elk et al.

    Experimental manipulations of personal control do not increase illusory pattern perception

    Collabra: Psychology

    (2018)
  • M.I. Eronen

    Robustness and reality

    Synthese

    (2015)
  • M.I. Eronen

    Interventionism for the intentional stance: True believers and their brains

    Topoi

    (2020)
  • B.D. Haig

    Detecting psychological phenomena: Taking bottom-up research seriously

    American Journal of Psychology

    (2013)
  • E.L. Hamaker

    Why researchers should think within-person”

  • J.W. Hogan et al.

    Instrumental variables and inverse probability weighting for causal inference from longitudinal observational studies

    Statistical Methods in Medical Research

    (2004)
  • P.W. Holland

    Statistics and causal inference

    Journal of the American Statistical Association

    (1986)
  • P. Illari et al.

    Causality. Philosophical theory meets scientific practice

    (2014)
  • D. Kahneman et al.

    On the psychology of prediction

    Psychological Review

    (1973)
  • K.S. Kendler et al.

    Interventionist causal models in psychiatry: Repositioning the mind-body problem

    Psychological Medicine

    (2009)
  • K.B. Korb et al.

    The power of intervention

    Minds and Machines

    (2006)
  • J. Kuorikoski et al.

    Evidential diversity and the triangulation of phenomena

    Philosophy of Science

    (2016)
  • J. de Leon

    Evidence-based medicine versus personalized medicine: Are they enemies?

    Journal of Clinical Psychopharmacology

    (2012)
  • D. Lewis

    Causation

    The Journal of Philosophy

    (1973)
  • E.O. Lillie et al.

    The n-of-1 clinical trial: The ultimate strategy for individualizing medicine?

    Personalized Medicine

    (2011)
  • D. Malinsky et al.

    Causal discovery algorithms: A practical guide

    Philosophy Compass

    (2018)
  • Cited by (34)

    • (When and how) does basic research in clinical psychology lead to more effective psychological treatment for mental disorders?

      2022, Clinical Psychology Review
      Citation Excerpt :

      However, discovering causation using the experimental method may be systematically harder in psychology than in other sciences. Referring to formalized philosophical theories of causation, Eronen (2020) highlights a number of obstacles that hinder the success of causal discovery in psychology because of the nature of its subject, that is, internal processes. This includes the fact that interventions in psychology experiments that aim to manipulate a particular process (see Steps 2 and 3 of our proposed framework) are typically fat-handed.

    • A systematic review of the psychological distance of climate change: Towards the development of an evidence-based construct

      2022, Journal of Environmental Psychology
      Citation Excerpt :

      A common challenge with interventions in psychology is that they try to manipulate a psychological cause such as PD. Because it is usually not possible accurately to manipulate just one psychological variable without accidently causing other variables to change, it can be problematic to conclude that changes in the dependent variable (such as concern) are to be attributed to the psychological variable (such as PD) (Eronen, 2020). The reviewed literature indicates that this might be problematic within PD manipulations: manipulation checks were often unsuccessful and varied in the level of distance they were measuring, showing that the target variable of a manipulation is not always clearly identified.

    • A new science of mental disorders: Using personalised, transdiagnostic, dynamical systems to understand, model, diagnose and treat psychopathology

      2022, Behaviour Research and Therapy
      Citation Excerpt :

      Certain symptoms are surely more severe than others, which makes sense to consider as well in the selection of the most important element (Bringmann et al., 2019). As ways forward, Bringmann et al. (2019) propose to (1) develop new centrality measures, (2) to use ‘old’ measures of variable importance, which were developed for the statistical models that are used to estimate psychological networks, or (3) to abandon the idea of centrality, as the focus on distinct symptoms or elements may not be ideal or realistic, also given the fat-hand problem (Erronen, 2020), the likeliness that interventions affect more than the targeted node alone. Instead, the focus might better be on the network as a whole, and mental disorders might better be defined as a complex system network (Bringmann et al., 2019).

    • Psychopathological networks: Theory, methods and practice

      2022, Behaviour Research and Therapy
      Citation Excerpt :

      Similarly, interventions based on cognitive behavioral therapy typically target various aspects of sleep at the same time, for instance by combining sleep restriction intervention with attempts to change cognitive structures (Blanken et al., 2019; van der Zweerde, Van Straten, Effting, Kyle, & Lancee, 2019). In other words, is it possible to “surgically” target a single symptom in isolation, or are psychological interventions always “fat-handed”, changing several symptoms at the same time (Eronen, 2020)? It can also be challenging in practice to distinguish between an intervention that effectively targets a single symptom, whose reduction in severity then diminishes the severity of other symptoms shortly thereafter (which is what network-inspired clinical practice would aim to achieve) from an intervention that simultaneously affects several symptoms (i.e., a fat-handed intervention).

    • Making inferential leaps: Manipulation checks and the road towards strong inference

      2022, Journal of Experimental Social Psychology
      Citation Excerpt :

      Chester & Lasko (2020) recently reviewed the current state of validation practices and found that most manipulations are either unvalidated or are merely assessed by convergent measures. Given the previous discussion, on the problem of fat-handed manipulations (Eronen, 2020), it is not inconceivable that (in the typical psychological study) one or more non-focal constructs are manipulated. This is problematic however, as having a “thin-fingered” manipulation is critical for making a claim about the causal relevance of a specific variable (see Eronen, 2020; Woodward, 2003).

    View all citing articles on Scopus
    View full text