Background

Multidimensional family therapy (MDFT) is a comprehensive evidence-based treatment programme for improving both substance abuse and criminal offending outcomes in diverse adolescent populations and treatment delivery settings (Galanter et al. 2014; Liddle 2010; Van der Pol et al. 2017b). In most randomised controlled treatment trials, MDFT was pitched against effective “treatments as usual”, including cognitive behavioural therapy (CBT). (Dakof et al. 2015; Hendriks et al. 2011; Liddle et al. 2011, 2009; Rigter et al. 2013).

In the studies cited, the effect of treatment on criminal behaviour was assessed from adolescents’ self-reports of the crimes they had committed, apart from Dakof et al. (2015), who collected crime data from registries to complement the study participants’ self-reports. Further, meta-analyses analysing criminal behaviour, comparing primarily CBT with systemic treatments; MDFT, multisystemic therapy (MST) and functional family therapy, reported slightly better results for the systemic treatments (Hartnett et al. 2017; Van der Pol et al. 2017b; Van der Stouwe et al. 2014). Both self-report and official record (arrests) studies were included in the meta-analyses.

The literature disagrees about the validity of self-reported criminal offences. Self-report data may be biased, with respondents holding back on confessing all transgressions of the law. On the other hand, self-report may invite respondents to also mention criminal offences that went unnoticed to police and justice authorities (Kirk 2006). The alternative source of information, official record reports, may yield more objective information, but these databases often are incomplete (Kirk 2006).

To compare the two forms of assessing the prevalence of criminal offending—self-report and registry—, we first carried out a self-report study among the Dutch and Swiss adolescents with a cannabis use disorder from the transnational INCANT trial (International Cannabis Need of Treatment study) (Rigter et al. 2010; Van der Pol et al. 2017). We followed these youths for 1 year after baseline, i.e. from the moment they entered randomly allocated treatment with either MDFT or the comparison treatment (CBT in the Hague, the Netherlands; less structured individual psychotherapy in Geneva, Switzerland). Half of all these adolescents said they had committed one or more criminal offences in 90 days before the baseline assessment. The proportion reporting to be non-delinquent in chunks of 90 days rose in the year after treatment entry, most so in the MDFT group. Furthermore, MDFT as hypothesized, yielder better results than the comparison therapy in reducing the number of violent offences among adolescents who reported a criminal offence history at baseline (Van der Pol et al. 2017a).

Next, we analysed registry data from the national police arrests database in the Netherlands. Subjects were the Dutch adolescents from INCANT. For these youths, arrest data were retrieved for 3 years preceding and 3 years following treatment entry. The number of police arrests which rose in 3 years before treatment was initiated and dropped sharply in 3 years thereafter, with no difference seen between MDFT and CBT in the follow-up period, possibly with exception of a property crime measure (Van Der Pol et al. 2018).

The database enabled us to extend the follow-up period from the usual 1 to 2 years in MDFT trials to 7 years. We reasoned that amassing more data from the trial would give more insight concerning the impact of the two treatment conditions. Our first aim of this study is to investigate if the obtained decrease of police arrests for the Dutch adolescents could be retained for a longer follow-up period. The second aim was to investigate if both treatments would differ in their retainment capability and to analyse whether baseline characteristics of the adolescent differentially predicted treatment effect—reduction of registered arrests—in MDFT and CBT. We hypothesized that MDFT would be better able to retain the low police arrest rates. Further, we did not expect any influence of baseline characteristics on treatment outcome.

Methods

Sample

The study included 109 adolescents from the Hague and the surrounding region in the Netherlands. All had a DSM-IV cannabis use disorder. They were between 13 and 18 years old (mean age 16.8 years). Eight in ten were boys. Seven in ten were of Dutch or another Western ethnicity (Van Der Pol et al. 2018). At the time of treatment entry, 66% had a police arrest history (for more information see Table 1).

Table 1 Baseline characteristics of study sample (n = 109) a

The adolescents concerned were enrolled in the transnational INCANT trial. INCANT compared the effectiveness of MDFT and treatment as usual—CBT in the Hague—to reduce cannabis use and the prevalence of cannabis use disorder (Rigter et al. 2010). Apart from not meeting the broad inclusion criteria, adolescents were only excluded from the study if needing inpatient treatment (Rigter et al. 2010). Treatment sites were Parnassia Brijder (Mistral unit; addiction care) and De Jutters (Palmhuis unit; forensic care).

Treatments

CBT, the cognitive-behavioural therapy protocol developed by Korrelboom et al. (Korrelboom and Ten Broek 2004), was administered in this study; the treatment entails consistently involving enhancement of treatment motivation, sessions with the individual adolescents (not with the parents except to inform them on treatment progress) and relapse prevention, for a full description of the treatment protocol see Rigter et al. (2010, 2013).

MDFT developed by Liddle (2002, 2010) consists of three stages. The first one focuses on intensively enhancing treatment motivation, building multiple therapeutic alliances and drafting the treatment plan. In stage 2, treatment plan interventions targeting the youth and his or her family are carried out, including education about adolescence, behavioural development and risk factors for problem behaviour, relapse prevention, improving family communication and relationships and strengthening parental educational skills. Stage 3 involves sealing off the treatment, agreeing on a relapse prevention plan and providing booster sessions if needed.

In INCANT, both MDFT and CBT were scheduled to last for 6 months. MDFT was administered in approximately two sessions per week—in roughly equal proportion to be held with the adolescent, parent(s) and family (adolescent and parent(s) together. In CBT, the number of sessions with the adolescent was matched to be similar to MDFT. Rowe et al. (2013) present details on the actual treatment dose received and the efforts made to evaluate and safeguard treatment integrity and fidelity.

Procedures

The research institute of the Ministry of Security and Justice of the Netherlands, the WODC, retrieved police arrest (with summons) records from the National Police Information Services database (IPOL) for all 109 adolescents for a period of 10 years, running from 3 years preceding treatment entry through 7 years thereafter. This covered the period 2003–2013 for the adolescents from the first year of recruitment for INCANT up to the period 2006–2016 for the last recruited adolescents (2010). For the flow diagram of the study, see van der Pol et al. (2018). Only one of the 109 adolescents dropped out from the trial during the follow-up period.

Measurements: criminal offences

We categorized offences as violent crimes (aggression, violent sexual offences and violent property offences), property crimes and others. The Dutch BOOG scale was used to score offence severity (Mulder et al. 2010). This scale converts law codes into a 12-degree severity index, i.e. (1) misdemeanour; (2) drug offence; (3) vandalism; (4) property offence; (5–7) moderate, sizable or serious violent offence; (8) sexual offence; (9) child sexual offence; (10) (attempted) manslaughter; (11) arson and (12) (attempted) murder. To calculate a severity score for an adolescent, we multiplied for each year the registered crime(s) with the severity score of the crime(s). These time period (“time chunks”) severity scores were used to analyse the crime trajectories of the adolescents.

Measurements: cannabis use

To record the frequency of consumption of cannabis, we applied the timeline follow-back (TLFB; Sobell and Sobell 1992), a calendar method to collect information on the adolescent’s use of cannabis in 90 days before each assessment. Adolescents were classified as low-severity cannabis users if they took cannabis on fewer than 65 days (the baseline median value in the trial), and as high-severity users if they took the drug on 65 or more days. We delivered the adolescent diagnostic interview (ADI-Light; Winters and Henly 1993) to determine if the youth met the criteria for a cannabis use disorder.

Measurements: possible treatment modifying factors

Earlier studies suggested that some factors may alter the response to MDFT treatment. MDFT outperformed comparison therapy, including CBT, in reducing cannabis use problems especially in adolescents with a severe level of cannabis use at baseline (Henderson et al. 2010; Hendriks et al. 2011; Van der Pol et al. 2017b). In our present analyses, we maintained the distinction between low-severity and high-severity cannabis users (Van der Pol et al. 2017b). Other factors found to correlate with MDFT treatment superiority are the young age of the adolescent, the presence of an externalizing disorder and the level of family functioning (Hendriks et al. 2011). To examine if these latter factors mattered in the current study as well, we first administered the National Institute of Mental Health Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV; Shaffer et al. 2000) to determine if the adolescent had conduct disorder (CD) or oppositional defiant disorder (ODD) in the year before treatment entry. We evaluated family functioning with the Dutch version of the Family Environment Scale subscales Conflict and Cohesion (Grotevant and Carlson 1989; Jansma and De Coole 1995; Moos and Moos 1994)

Statistical analyses

Analyses were run with SPSSv24.0. The adolescent’s first day of treatment was taken to retrospectively define the 3 pre-treatment years and the 7 years of follow-up. We carried out pairwise comparisons, with the log rank statistic, to identify differences between the MDFT and CBT conditions. We assessed group differences in police arrests, number of arrests at issue and the type and severity of these offences. The data for 3 years before and 7 years after treatment entry, respectively, were analysed with separate repeated measure general linear models (rmGLM) for frequency, type (violent and property offences) and severity of recorded offences.

Next, each pre-treatment year and each follow-up year was entered as a separate “chunk” in the analyses, as a within-subject variable. Treatment was handled as a between-subject variable. In addition, we ran moderator analyses to examine second-order interactions: age (both continuous and categorical (13–16 versus 17–18 years), history of crimes, baseline cannabis use rate (severe versus non-severe), of conduct disorder (CD) or oppositional defiant disorder (ODD) and family functioning. To account for any departures from sphericity, we applied Huynh-Feldt-corrected estimates if ∑ ≥ 0.75, and Greenhouse-Geisser correction if ∑ < 0.75 applied in rmGLM analyses (Girden 1992).

Results

Reasons for pre-treatment police arrests

Of the total sample, 66.1% had been arrested at least once in 3 years before treatment entry. As reason for arrest, property crimes and violent crimes were most prevalent (see Table 1). The two treatment groups did not differ in distribution of offence categories, nor did they differ in criminal offending severity score; the sum score across this period was 16.4 (SD 18.4) for the total sample and 15.4 (16.9) and 17.4 (19.9) for the MDFT and CBT groups, respectively.

Change in the total number of arrests

The total number of police arrests increased across the 3 pre-treatment years and decreased after treatment entry (Fig. 1). According to rmGLM analyses, the number of arrests grew linearly in the pre-treatment period in both groups (time: Huynh-Feldt F1.7,178.5 = 16.9, p < 0.001, η2 = 0.14; linear F1,107 = 32.1, p < 0.001, η2 = 0.23). The two groups did not differ on pre-treatment delinquency increase (Huynh-Feldt F1.7,178.5 = 0.2, p = 0.82, η2 = 0.001) or intercept (F1,107 = 0.1, p = .76, η2 = 0.001). In the 7 years of follow-up after treatment entry, the number of total offences fell to almost zero level (time: Greenhouse-Geisser F3.8,403.4 = 14.5, p < 0.0001, η2 = 0.12). The decline was similar in both treatment groups (Greenhouse-Geisser F3.8,403.4 = 0.4, p = 0.82, η2 = 0.03).

Fig. 1
figure 1

Mean number of arrests per year from the start of CBT or MDFT. CBT = cognitive behavioural therapy; MDFT = multidimensional family therapy

Change in severity of arrests

The severity of the offences increased across the three pre-treatment years, from an average severity score of 2.06 (SD 5.08) to 8.07 (SD 11.8), in both groups to the same extent (time: Huynh-Feldt F1.7,178.7 = 13.9, p < 0.0001, η2 = 0.12, time*treatment: Huynh-Feldt F1.7,178.7 = 0.11, p = .86, η2 = 0.001). Group models did not differ in their intercepts (F1,107 = 0.2, p = 0.65, η2 = 0.002). In the years after treatment entry, the offences became less severe (time: F3.5,375.9 = 14.4, p < 0.0001, η2 = 0.12). The decline in severity followed a quadratic trajectory (linear: F1,107 = 51.5, p < 0.001, η2 = 0.33; quadratic: F1,107 = 20.3, p < 0.001, η2 = 0.16), with a severity score of 1.76 (SD 4.23) in the third year after the start of treatment, which remained low up until the seventh year after treatment 1.46 (SD 4.98), with no difference in intercept (F1,107 < 0.001, p = 0.99, η2 < 0.001) or decline rate (Greenhouse-Geisser F3.5,375.9 = 0.65, p = 0.61, η2 = 0.01) noted between the treatment groups.

Violent and property offences

With the same set of analyses, we targeted violent and property crimes, respectively. In the follow-up period, both types of offences dropped in number: violent (Greenhouse-Geisser F4.0,25.6 = 8.3, p < 0.0001, η2 = 0.07); property (Greenhouse-Geisser F3.2,338.2 = 4.9, p = 0.002, η2 = 0.04). Both violent and property offending did not follow a purely linear decrease trajectory (violence: linear F1,107 = 33.4, p < 0.001, η2 = 0.24, quadratic F1,107 = 10.4, p = 0.002, η2 = 0.09, 7th order F1,107 = 5.7, p = 0.019, η2 = 0.05; property: F1,107 = 9.9, p = 0.002, η2 = 0.08, quadratic F1,107 = 12.5, p = 0.001, η2 = 0.10): offending rates dropped in the first 3 years after treatment, to remain low afterwards (Figs. 2 and 3). There was no significant difference between treatment groups in decrease of frequency of both violent (Greenhouse-Geisser F4.0,425.6 = 1.6, p = 0.16, η2 = 0.02) and property offending (Greenhouse-Geisser F3.2,338.2 = 1.8, p = 0.15, η2 = 0.02).

Fig. 2
figure 2

Mean annual number of police arrests for violent offences, from the start of CBT or MDFT treatment. CBT = cognitive behavioural therapy; MDFT = multidimensional family therapy

Fig. 3
figure 3

Mean annual number of police arrests for property offences, from the start of CBT or MDFT treatment. CBT = cognitive behavioural therapy; MDFT = multidimensional family therapy

Baseline predictors of a differential treatment effect

We performed second-order interaction analyses to assess if MDFT and CBT differed from each other in reducing criminal offending when pre-defined baseline characteristics were entered in the calculations: age of the adolescence, crime offence history, severity of cannabis use, a diagnosis of disruptive behaviour disorder status (oppositional defiant disorder (ODD) and/or conduct disorder (CD)) and family functioning (Hendriks et al. 2011; Rigter et al. 2013). None of these variables influenced crime offending rates (p > 0.15).

Discussion

Both MDFT and CBT decreased the number of police arrests and the severity of the criminal offences that were the reason for arrest. The decline was sharp in the first 3 years of follow-up and there was no return to higher levels during the remainder of the 7-year follow-up period. These findings appear not to confirm our hypothesis; however, they are consistent with the drop in self-reported criminal offending seen among adolescents from Dutch and Swiss treatment sites—the Dutch adolescents being the same as in the present study (Van der Pol et al. 2017a). Of note, in the study using the self-report data, MDFT outperformed treatment as usual, including CBT, in reducing violent offences, whereas the MDFT and CBT groups did not differ on any offence measure.

We here report on a follow-up period of 7 years. Even with this larger data set, we could not establish any difference in treatment effect between the CBT and MDFT groups of adolescents. Both treatments lowered the incidence of police arrests for total, violent and property offences. As expected, the baseline characteristics did not influence treatment outcome; these results confirm the findings of our previous study Van Der Pol et al. (2018).

The lack of difference between the two treatment groups might suggest that both treatments were equally effective, unlike in other RCT-based investigations (Dakof et al. 2015; Liddle et al. 2011; Rigter et al. 2013; Van der Pol et al. 2017b). However, this conclusion—there was a general treatment effect—cannot be drawn with certainty, as crime offence rates fell markedly in the general population of the Netherlands during the course of our study. Crime offence rates usually increase to the age of 18, but then decline to lower levels during emerging adulthood (Hill et al. 2016; Moffitt 1993). In other words, although we prolonged the follow-up period to 7 years, which is exceptionally long, and extended the data set, we could not exclude a general population trend as a confounding factor.

The present study relied on police arrest registry measures as a proxy of criminal offending. Recent literature suggests that self-report is the best approach to establish statistically significant differences between treatment groups. In studies of another family therapy, multisystemic therapy (MST), MST—although weakly effective at best—scored better on self-report measures than on crime records measures (Asscher et al. 2014; Fonagy et al. 2018). Of interest, Dutch police-records based crime statistics for adolescents have dropped with roughly 40% in the past decade, while self-report crime rates decreased with only 10% (De Waard 2017; Van der Laan et al. 2014). The 40% registry measure decline falls short of the present study’s 87% reduction in total police-arrest criminal offences for the combined treatment groups across the same period of time. Thus, at least part of the observed police-records based decline in criminal offending rate appears to reflect a treatment effect, for both MDFT and CBT.

The registry measure of criminal offending requires further examination. Why did the prevalence of registry-measured crime offences fall so sharply in the general population in the past decade? Perhaps, police procedures (letting young or first-time offenders walk without a booking) have changed. In addition, growing use of social media and smart phones may have kept youths away from the temptations of the street (De Waard 2017).

Thus, we cannot exclude a general population trend as a confounding factor in the apparent treatment effect. A methodological solution to resolve this impasse would have been to add a waiting-list control group to the trial. This was not an option. It would have been unethical to not offer an effective therapy to youths needing treatment. Another limitation is that the targeted population is primarily addicted with comorbid problem behaviour and high in risk for criminal activities. Therefore, a more severe criminal adolescent population and/or a broader measurement strategy could have given more clarification and a context for the criminal behaviour of the adolescents.

A strength of the present investigation was that it was embedded in a randomised controlled trial, with the methodological advantages of this type of study design (Weisburd et al. 2001; Welsh et al. 2011). Another strong point, from a youth developmental perspective, was the long timespan of the study and especially the long duration of the follow-up period, which ranged from adolescence to early adulthood, creating an overall developmental perspective of adolescent crime. Following RCT participants up for 7 years is rare in treatment trials.

To generate more insight for the research field, this study should preferably be replicated with a larger sample of adolescents, recruited for criminal offending rather than for abusing cannabis. In a replication study, follow-up periods for self-report and for registry assessments should be the same and more information should be collected on the determinants and the nature of the delinquent behaviour of the youths concerned.

Conclusions

The incidence of police arrests fell after adolescents entered 6-month treatment with MDFT or CBT. The police arrest rate dropped sharply in the first 3 years after treatment entry and remained at close to zero levels in the next 4 years of follow-up. The MDFT and CBT groups did not differ on any measure.