Validation of three mental health scales among pregnant women in Qatar

Abstract

Objectives

The objective of this study is to validate three mental health scales in a targeted sample of pregnant Arab women living in Qatar: the Kuwait University Anxiety Scale, the Perceived Stress Scale, and the Edinburgh Postnatal Depression Scale.

Methods

Random split-half exploratory factor analysis and confirmatory factor analyses (n = 336; n = 331), conducted separately, were used to evaluate scale dimensionality, factor loadings, and factor structure of the KUAS, the PSS, and the EPDS.

Results

Fit statistics for the three scales suggested adequate fit to the data and estimated factor loadings were positive, similar in magnitude, and were significant. The final CFA model for the KUAS supported a 19-item, two factor structure. CFA models also confirmed 8- and 10-item, single-factor structures for the PSS and EPDS, respectively.

Conclusions

The validation of scales for these aspects of mental health in Arab pregnant women is critical to ensure appropriate screening, identification, and treatment to reduce the risk of sequelae in women and their children. Findings offer a useful comparison to mental-health scale validations in other Arab contexts.

Plain English summary

Mental health during pregnancy is important for the long-term physical and mental well-being of mothers and their children. Screening for common mental disorders, including stress, anxiety, and depression requires valid measurement tools carefully tested for the populations in which they are used. Valid measurements of mental health during pregnancy can facilitate appropriate treatment and follow-up.

In this study, we tested the validity of three scales for measuring anxiety (Kuwait University Anxiety Scale), stress (Cohen’s Perceived Stress Scale), and depression (Edinburgh Postnatal Depression Scale) in a sample of Arab pregnant women in Qatar waiting to receive antenatal care. For statistical analysis, the sample was randomly split in half (336 women and 331 women). Exploratory factor analysis was conducted on one half of the sample and confirmatory factor analysis on the second half. These analyses were conducted to assess the dimensions of each scale and how questions were related to the underlying concepts they are supposed to measure.

Our data supported a 19-question version of the anxiety scale with two dimensions reflecting cognitive/affective anxiety and somatic anxiety. The data also supported an 8-question scale for measuring stress and a 10 -question depression scale. Each of those two scales reflected one dimension only.

Our findings suggest that the tested scales can be used adequately in the population of Arab pregnant women. Differences with results from other samples emphasize the importance of carefully testing instruments for use in varied populations. Valid tools are needed for appropriate screening and subsequent treatment of mental illnesses.

Background

Globally, mental disorders affect 10% of pregnant women and 13% of postpartum women [1]. Women from lower-income countries are at even higher risk for mental disorders; 16% of pregnant women and 20% of postpartum women [1, 2]. Failing to identify psychopathology in the perinatal period can lead to malnourishment of the mother and baby, stunted physical and cognitive development of the child, and in extreme cases, infanticide, or suicide [3]. Though validated and reliable screening scales exist for anxiety, stress, and depression, these scales have not been fully explored across Arab contexts, with diverse samples, including pregnant women.

The 20-item Kuwait University Anxiety Scale (KUAS) [4] screens for anxiety symptoms and has been validated chiefly among student or non-clinical samples across several Arab countries [5, 6]. A 14-item Perceived Stress Scale (PSS) measuring past-month stress levels and appraisals [7] has been validated in Jordan among teachers and technical workers [8] and in a small sample of Lebanese pregnant women, postpartum women, and students [9]. The 10-item Edinburgh Postnatal Depression Scale (EPDS) [10] has been validated in small samples of postpartum women in the United Arab Emirates (UAE) [11] and Lebanon [12].

While prior studies have validated Arabic translations of the KUAS, PSS, and EPDS in adult samples of men and women, the objective of this study is to validate these scales in a targeted sample of pregnant Arab women living in Qatar, to support prenatal mental health assessment and to facilitate appropriate treatment.

Methods

Sample

Arab women over 18 years waiting for prenatal appointments at the Women’s Hospital of Hamad Medical Corporation (Qatar) were recruited. English forms were translated into Qatari Arabic and back-translated by a separate translator to ensure their standard administration. Prior to data collection, cognitive interviews were conducted by trained interviewers among women varied on demographic attributes to ensure local acceptance of topics, wording, and item order. Informed consent and quantitative interviews that covered demographics, resources, agency, and prenatal mental health were administered verbally in language of choice (Arabic or English). The study was approved by the institutional review boards of all collaborating institutions; Hamad Medical Corporation, Emory University, and Qatar University. A fixed interval sampling procedure with replacement was used in that every 7th eligible woman was approached, until satisfying the proposed sample size for completed interviews. Supervisors randomly chose starting points between 1 and 7 each day. The interval was chosen based on pilot testing patient flow. Interviews were conducted in private areas of the clinic. Data collection occurred from January through February of 2017. Of 5896 eligible patients, 840 were invited to participate: 667 completed the interview (response rate: 79.1%); 125 women refused participation, 48 interviews were incomplete, and 2 cases were lost due to ineligibility. Most women who declined participation, did so due to lack of time; incomplete interviews occurred when the woman did not return to complete an interview after her appointment. The prenatal mental health module was estimated to take approximately 10–15 min of the full interview (approximately 55 min).

Measures

Kuwait University anxiety scale

The original KUAS is a 20-item scale that captures cognitive/affective anxiety (9 items), subjective anxiety or nervousness (7 items), and somatic anxiety (4 items) [4]. Example items include “I worry over the future,” “I feel jittery,” and “My heart beats fast.” Original response options were a four point Likert-type intensity scale anchored by rarely (=1) and always (=4). For this analysis, we recoded response options as never (=0), rarely/sometimes (=1), fairly often/always (=2). Collapsing response options for all measures was an effort to retain ordinality while reducing statistical noise caused by synonymous, quantifiably indistinguishable—and for the EPDS, inconsistent—middle response options [13]. The scale has shown good internal consistency (Cronbach alpha from .70 to .93 test-retest) [4]. In 3064 college students across 10 Arab countries (Egypt, Emirates, Iraq, Jordan, Kuwait, Lebanon, Oman, Palestine, Saudi Arabia, and Syria) [6], the scale had high loadings on all three factors, respectively (> .4, .55–.92, .67–.76). Our study dropped one item, I am a nervous person, based on recommendations in the literature to avoid interitem redundancy (with item, I feel nervous). for a total of 19 items [14]. Internal reliability was adequate in this sample (α = .819; n = 330).

Perceived stress scale

The revised PSS is a two-factor 10-item tool that measures one’s appraisal of life events as stressful and was originally validated among a probability U. S. sample with good internal consistency (Chronbach’s alpha = .78)) [15]. Factors align with statements worded negatively (n = 6) and positively (n = 4). Sample items include: “In the past month, how often have you … felt nervous or stressed?; felt that things were going your way?; and, been upset because of something that happened?” Original responses were Likert-type frequency options anchored by never (=1) and very often (=5) and recoded as never (=0), rarely/sometimes (=1), fairy often/very often (=2) in this study. The PSS-10 has been validated across diverse Arab samples, including perinatal women, with adequate internal consistency (Cronbach alpha = .74–.80); its’ factors have been described as “perceived helplessness” and “perceived self-efficacy” [8, 9]. In our sample, items worded negatively were reversed and the internal reliability of an 8-item scale was adequate (α = .776; n = 331).

Edinburgh postnatal depression scale

The EPDS is a single factor 10-item measure intended to screen for perinatal depression originally developed among Scottish mothers [10]. Participants respond with varied Likert-type frequency options ranging from never/not at all/as usual (=0) to most of the time/quite a lot/quite often/not as usual (=3) across items such as “In the past week … I have felt sad or miserable; I have looked forward with enjoyment to things; and I have been so unhappy that I have had difficulty sleeping.” Middle response options were collapsed for this study and anchored by never/not at all/as usual (=0) and most of the time/quite a lot/quite often/not as usual (=2). The EPDS has been validated and utilized in diagnostic contexts in the United Arab Emirates (UAE) (Chronbach’s alpha = .84) and Lebanon [11, 12]. Internal reliability was adequate in the sample (α = .753; n = 330).

Procedure

Analysis for the current study used exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), conducted separately for each scale in random split-half samples (n = 336; n = 331). Conducting EFA/CFA in random split samples is a routine way to explore factor patterns and test the dimensionality and fit of a factor model in two independent samples. EFA assessed scale dimensionality and item factor loadings. CFA tested the factor structure of the final EFA models, and factors were extracted by mean- and variance-adjusted weighted least squares method. Factor loadings were evaluated using standard model fit indices: root mean square error of approximation (RMSEA close to 0.060 or lower), comparative fit index (CFI close to 0.950 or higher), and Tucker-Lewis index (TLI close to 0.950 or higher) after GEOMIN oblique type rotation. Items were removed if they loaded negatively on a factor, loaded < 0.300, or cross-loaded > ǀ0.300ǀ on another factor. MPlus 7.3 [16] and IBM SPSS 24 [17] statistical software were used for all analyses.

Results

Descriptive characteristics of the participants are shown in Table 1. On average women were 30 years old (SD = 5.08), married in their early 20s to husbands in their late 20s, had three pregnancies, and had two viable births. The sample was predominantly in their 3rd trimester of pregnancy and a majority had attained at least some secondary education or vocational training. Significant differences were observed between Qatari and non-Qatari women. In general, Qatari women were younger at time of interview, married earlier to younger husbands, and had higher numbers of both pregnancies and viable births. Non-Qatari women were more likely to have both secondary/vocational and university/graduate education compared to Qatari women.

Table 1 Sample characteristics, pregnant women, Doha, Qatar

Among sample women (N = 667), the average KUAS sum score was 16.06 (range: 0.00–38.00, 38.00 possible; M = 0.85; SD = 7.73). On average, PPS-10 mean scores were 1.03 (SD = 0.33) and the average sum score was 10.29 (range: 0.00–19.00; 20.00 possible). Women’s mean EPDS score was 0.54 (SD = 0.36), on average, with sum scores ranging from 0.00 to 17.00 of 20.00 possible (M = 5.42; SD = 3.61). Descriptive statistics at scale level are presented in Table 2. Item-level descriptive results and inter-item correlations for each scale are available upon request.

Table 2 Results of the confirmatory factor analysis for the KUAS, PPS, and EPDS (N = 331)

Fit statistics and estimated factor loadings for the final EFA and CFA models are presented in Table 3. EFA and CFA fit statistics for the three scales suggested an adequate fit to the data and estimated factor loadings were positive, similar in magnitude, and were significant. The final CFA model for the KUAS yielded data fit for the 19-item, two factor structure: (a) items 1–15, cognitive and affective anxiety, and (b) items 16–19, somatic anxiety.

Table 3 Results of the split-half sample analysis for the KUAS, PSS, and EPDS

Final CFA models also confirmed 8- and 10-item, single-factor structures for the PSS and EPDS, respectively. During EFA estimations, non-loading PSS item 4 and item 7 were dropped sequentially. Too few perceived efficacy items remained to support a 2-factor model of perceived stress [18]. During CFA, the error variances of PSS items 5 and 8 were allowed to correlate based on modification indices. Internal consistency of factors results and complete factor loadings for the three scales can be found in Additional file 1, respectively.

Discussion

This cross-sectional study validated scales for depression, anxiety, and perceived stress in a diverse sample of pregnant Arab women in Qatar. The validation of scales for these aspects of mental health in Arab pregnant women is critical to ensure appropriate screening, identification, and treatment to reduce the risk of sequelae in women and their children. Our findings offer a useful comparison to mental-health scale validations in other Arab contexts. For the KUAS, studies among Arab [4, 19, 20] and non-Arab samples [21] suggest 3-factor or 2-factor solutions [14], and our results confirmed a 2-factor solution reflecting cognitive/ affective anxiety and somatic anxiety. For the PSS, research suggests a 2-factor solution, conceptualized as perceived helplessness and perceived self-efficacy [21], and our results suggest that one-factor model offers a concise and theoretically justified solution. For the EPDS, studies among non-Arab populations have generally supported 1- or 2-factor solution [22, 23]. In Arab populations, known validity studies lack information about factor structure and are among postpartum (not pregnant) women resident in Lebanon [12] and UAE [11]. Our study confirms that a one-factor solution capturing overall depressive symptomatology offers a reasonable solution.

In the present study, cognitive interviewing ensured item clarity and cultural appropriateness. Differences in factor structures between our study and prior work may be explained by measures that are insufficiently validated in Arab women (PSS, EPDS), intended to assess depressive symptomology among postpartum women (KUAS, EPDS), or originating from a English-language Western context (PSS, EPDS). The saliency of depressive symptoms may differ across postpartum and prenatal women (e.g., different emphasis on somatic items) [24] or across normal and high-risk pregnancies (e.g., different emphasis on anxiety) [25].

Notably, the cross-sectional design precluded an assessment of scale stability over time and a clinic-based sample limits generalizability to pregnant women resident in Qatar. Also, single-country analyses limit generalization to populations in dissimilar contexts. Finally, collapsed response options may miss nuances in some women’s experiences. Despite these caveats, the findings are based on a fixed-interval sample of Qatari and non-Qatari Arab women of diverse socioeconomic levels attending the country’s largest health care provider responsible for caring for the vast majority of births in Qatar, and the response rate was high, at 80%. Scales should be validated in cohorts of pregnant women, to assess stability over time.

Conclusion

This analysis fills a critical gap in knowledge by rigorously testing scale dimensionality and factor structure of three mental health scales in a diverse sample of pregnant Arab women. Mental health care often is lacking or insufficiently integrated into antenatal care in Arab settings, including Qatar. Most cases of postnatal depression are preceded by antenatal depression [26], thus identification during pregnancy is important. The KUAS, PSS, and EPDS already are known in the health community and their use among pregnant women can be a practical extension for the assessment of mental health. Having well validated Arabic-language scales to capture different dimensions of mental health with due attention to cultural context is critical for the systematic implementation of mental health assessments in prenatal care. In turn, enhanced measurement will lead to wider recognition of mental health issues in pregnancy, their social and biological determinants, and more timely and appropriate prevention and management. Findings also offer a useful comparison to mental-health scale validations in other Arab contexts.