On the relationship between explicit and implicit self-concept of extraversion and neuroticism

https://doi.org/10.1016/j.jrp.2020.104061Get rights and content

Highlights

  • It is unclear how implicit measures of personality relate to explicit measures.

  • We focused on extraversion and neuroticism dimensions.

  • Self-report personality questionnaires and IATs were used.

  • Extraversion explicit-implicit measures were more strongly correlated.

  • We show that the measures are related, but they do measure distinct constructs.

Abstract

Indirect methods such as the implicit association test (IAT) could complement traditional self-report questionnaires of personality traits. However, it is unclear whether IAT scores and self-report scores of nominally the same personality trait measure the same construct or overlapping but distinct constructs. To investigate how IAT and self-report personality scores relate to each other, we conducted a web-based data collection where participants completed self-report personality questionnaires (n = 432) and IATs for extraversion (n = 393) and neuroticism (n = 385). We found that extraversion self-report and IAT scores were more strongly correlated with each other than corresponding neuroticism scores. Overall, our findings suggest that although extraversion and neuroticism self-report and implicit measures are related, they do measure distinct constructs.

Introduction

Personality psychology relies heavily on well-established self-report (or “explicit”) methods that can be biased by factors such as distorted self-concept and social desirability (Perugini & Banse, 2007). Researchers have therefore developed indirect (or “implicit”) personality measures where attributes of the self-concept are inferred from reaction times with little or no bias from conscious self-reflection (De Houwer & Moors, 2010). However, it is unclear how implicit reflections of personality relate to explicit reflections. Explicit and implicit personality measurements are usually correlated (De Cuyper et al., 2017), but not very strongly or consistently (e.g. Siers and Christiansen, 2013, Steffens and König, 2006). This pattern can be interpreted in at least one of two ways. One possibility is that explicit and implicit methods tap into the same construct and their inconsistent correlations reflect methodological confounds. Another possibility is that explicit and implicit measures of personality reflect at least partially distinct constructs. In this study, we compare these possibilities in the context of two core personality dimensions: extraversion and neuroticism (Costa & McCrae, 1995).

A popular method for assessing implicit constructs ranging from self-esteem to attitudes is the implicit association test (IAT, Greenwald, McGhee, & Schwartz, 1998). The IAT is also being increasingly used in personality psychology (De Cuyper et al., 2017). For instance, it has been used to assess personality traits, such as anxiousness and angriness (Schnabel et al., 2006), and to predict spontaneous personality-related behaviour (Steffens & König, 2006). The IAT has methodological limitations and can suffer from low reliability (Azar, 2008, De Cuyper et al., 2017). However, as long as it’s reliability is explicitly tested, the IAT holds promise as a measure of relatively context-independent constructs like the self-concept.

The IAT is a classification task where reaction times indicate the strength of the relationship between two concepts, such as the self-concept and concepts corresponding to personality traits. For example, implicit extraversion can be measured with an IAT relating two target categories – “self” and “others” – to two attribute categories – “extraversion” and “introversion”. During the task, participants sort words, such as “mine” or “outgoing”, to their respective categories of “self” and “extraversion”. In some blocks, the same physical response is used to categorize words into “self” and “extraversion”, whereas in other blocks the response is shared between “self” and “introversion”. A strong association between categories is assumed to decrease reaction times when the categories share a response and increase reaction times when they do not.

It is not entirely clear how implicit personality scores relate to explicit personality scores. On the one hand, many studies suggest that explicit and implicit personality measures tap into related but different constructs (De Cuyper et al., 2017). On the other hand, considering the current replication crisis in psychology (Maxwell et al., 2015), these studies require replication. There is some evidence of publication bias in this field (De Cuyper et al., 2017), and the sample sizes of past studies have often been small. For instance, the median study in the meta-analysis by De Cuyper et al. (2017) included 95 participants. Therefore, the question of whether explicit and implicit personality scores reflect the same or different underlying constructs still needs clarification.

In the present study, we focused on the core personality traits of extraversion and neuroticism, and conducted an extensive web-based data collection to increase statistical power compared to some previous studies which have shown inconsistent results (Schmukle and Egloff, 2005, Siers and Christiansen, 2013, Steffens and König, 2006). Using these data, we first assessed the strength of correlation between the explicit and corresponding implicit methods, expecting it to be low to moderate (e.g. Schmukle and Egloff, 2005, Siers and Christiansen, 2013). Second, we tested the fit of three structural equation models representing three possible relationships between explicit and implicit personality measures (see Fig. 2). Model 1, the same trait model, assumes that explicit and implicit measures tap into the same personality trait. Model 2, the different trait model, proposes instead that explicit and implicit measures reflect related but distinct traits. Model 3, or the multi-trait multimethod (MTMM) model (Widaman, 1985), tests the possibility that the same trait and different trait accounts are partially correct at the same time.

Section snippets

Participants and procedure

The data were collected as a part of an undergraduate course during a two-month period on three consecutive years. A total of 442 students from the regular and open university program participated for course credit (age: M = 25.38, Mdn = 21, SD = 7.92; 381 female).

Most participants completed two self-report measures, the Short 5 personality questionnaire (n = 432) and a questionnaire composed of the adjectives in the IAT attribute categories (n = 429), and the main IAT for extraversion (n

Results

First, we expected to find correlations between explicit and implicit measures (Table 2). The extraversion IAT had a moderate correlation with the Short 5 self-report extraversion (r = .41, p < .01), rated extraversion adjectives (r = .41, p < .01), and introversion adjectives (r = −.42, p < .01). On the other hand, neuroticism IAT showed low correlations with the Short 5 self-report neuroticism (r = .25, p < .01), rated neuroticism adjectives (r = .24, p < .01), and calmness adjectives (r

Discussion

We used a web-based study focusing on the extraversion and neuroticism traits to investigate whether explicit and implicit personality measures reflect the same underlying construct or instead different constructs. Our findings offer several interesting insights.

First, we expected to find low to moderate correlation between the explicit and implicit methods. We indeed found a moderate correlation between explicit and implicit measures of extraversion, and a small correlation between the

CRediT authorship contribution statement

Martin Kolnes: Conceptualization, Investigation, Formal analysis, Visualization, Writing - original draft, Writing - review & editing. Andero Uusberg: Conceptualization, Writing - review & editing. Kenn Konstabel: Conceptualization, Investigation, Formal analysis, Writing - review & editing.

Acknowledgements

This work was supported by the Estonian Research Council grants MOBTP69, PSG525, and IUT42-2.

References (20)

  • B.P. Siers et al.

    On the validity of implicit association measures of personality traits

    Personality and Individual Differences

    (2013)
  • B. Azar

    IAT: Fad or fabulous?

    Monitor in Psychology

    (2008)
  • T.A. Brown

    Confirmatory factor analysis for applied research

    (2015)
  • P.T. Costa et al.

    Domains and facets: Hierarchical personality assessment using the revised NEO personality inventory

    Journal of Personality Assessment

    (1995)
  • K. De Cuyper et al.

    Using indirect measurement tasks to assess the self–concept of personality: A systematic review and meta–analyses

    European Journal of Personality

    (2017)
  • J. De Houwer et al.

    Implicit measures: Similarities and differences

  • A.G. Greenwald et al.

    Measuring individual differences in implicit cognition: The implicit association test

    Journal of Personality and Social Psychology

    (1998)
  • A.G. Greenwald et al.

    Understanding and using the Implicit Association Test: I. An improved scoring algorithm

    Journal of Personality and Social Psychology

    (2003)
  • K. Konstabel et al.

    The ‘Short Five’ (S5): Measuring personality traits using comprehensive single items

    European Journal of Personality

    (2012)
  • H.W. Marsh et al.

    In search of golden rules: comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings

    Structural Equation Modeling: A Multidisciplinary Journal

    (2004)
There are more references available in the full text version of this article.

Cited by (3)

  • The implicit measurement of psychopathy

    2023, Journal of Research in Personality
  • Measuring honesty-humility with an implicit association test (IAT): Construct and criterion validity

    2022, Journal of Research in Personality
    Citation Excerpt :

    To show convergent validity (Campbell & Fiske, 1959), IAT scores should covary1 with scores from other assessment methods used to measure the same construct. For example, recent research shows that, although self-report and implicit measures of extraversion and neuroticism converge, they appear to measure distinct constructs (Kolnes et al., 2021). This raises questions about convergent validity (across methods) to assess other personality traits.

This research was not preregistered. The analysis script and processed data are openly available in OSF repository at https://osf.io/95s8w/. The raw data of this study are available from the corresponding author upon reasonable request.

View full text