Abstract

1 Background
1.1 DESCRIPTION OF THE CONDITION
Youth drug use 1 that persists beyond curious experimentation is a severe problem worldwide (United Nations Office of Drugs and Crime (UNODC), 2010). Use of non-opioids drugs such as cannabis, amphetamine and cocaine is strongly associated with a range of health and social problems, including delinquency, poor scholastic attainment, fatal automobile accidents, suicide and other individual and public calamities (Deas & Thomas, 2001; Essau, 2006; Rowe & Liddle, 2006; Office of National Drug Control Policy (ONDCP), 2000; Shelton, Taylor, Bonner & van den Bree, 2009). More than 20 million of the 12 to 25 year-olds in the US, and more than 11 million of the 12 to 34 year-olds in Europe have used illicit 2 drugs during the month prior to survey interviews in 2009 (Substance Abuse and Mental Health Services Administration (SAMSHA), 2010; European Monitoring Centre for Drugs and Drug Addiction (EMCDDA), 2010). Seven percent of Australian 12-17 year olds have used some kind of drug during the month prior to survey interviews in 2008 (White & Smith, 2009). In Canada 26 percent of 15-24 year olds had used any illicit drugs during the past year (Health Canada, 2010).
Not all young drug users progress to severe dependence, however some do and may therefore require treatment (for further reading, see e.g. Liddle et al., 2004; Crowley, Macdonald, Whitmore & Mikulich, 1998). For example, 8.4 percent of 18 to 25 year-olds in the US are classified as needing treatment for illicit drug use, but less than one tenth of these young people actually receive treatment (National Survey on Drug Use and Health (NSDUH), 2007). Likewise among young people aged 12 to 17, 4.5 percent were estimated to be in need of treatment for a drug use problem, but only one tenth in this group actually received any (SAMSHA, 2010). Research calls attention to the significant gap between young people classified in need of treatment and young people actually receiving treatment (SAMSHA, 2010; NSDUH, 2007).
There is a growing public concern regarding the effectiveness and high costs of available treatments for young people, and by the high rates of treatment dropout and post-treatment relapse to drug use (Austin, Macgowan & Wagner, 2005; Najavits & Weiss, 1994; Stanton & Shadish, 1997). Accordingly, treatment to help young drug users should be as engaging as possible in order to avoid dropout and relapse (Simmons et al., 2008; National Institute on Drug Abuse, 2009), and services provided should be empirically supported in order to increase the likelihood that 1. Treatment will be successful, and 2. Public spending supports the interventions with the most effect.
Researchers point to the fact that many research projects have empirically validated different kinds of treatment approaches for young drug users as effective (e.g. Rowe & Liddle, 2006; Waldron, Turner & Ozechowski, 2006; Williams, Chang & Addiction Centre Adolescent Research Group, 2000; Austin et al., 2005). The current dilemma in the field of youth substance abuse treatment is that it is not clear what works best as the research suggest that most interventions lead to reduced drug use. While there are some promising individually based cognitive and motivational therapies, i. e. Cognitive Behavioral Therapy (CBT) (Waldron & Turner, 2008; Kaminer, 2008; Deas & Thomas, 2001; Galanter & Kleber, 2008), family-based approaches may also show some promise. Family therapy covers a range of different interventions, based on different manuals and varying theoretical sources such as behavioral and cognitive behavioral theory, structural and strategic family theory, and family systems theory (Williams et al., 2000; Austin et al., 2005). Some reviews suggest that these family-based therapies are superior to individual-based programs in reducing youth drug use (Williams et al., 2000: Lipsey et al., 2010; Waldron, 1997)
Young people with persistent drug use have unique needs due to their particular cognitive and psychosocial development. Young people are specifically sensitive to social influence, with family and peer groups being highly influential. Youth drug treatments facilitating positive parental and peer involvement, and integrating other systems in which the young person participates (such as schools, social services, justice authorities) are key to youth drug reduction (National Institute on Drug Abuse, 2009). A number of studies and reviews show positive results for family therapies in general, but there is a need to synthesize individual study results for specific family therapies to determine whether and to what extent specific family therapy interventions work for young drug users (Williams et al., 2000; Austin et al., 2005; Waldron & Turner, 2008; Kaminer, 2008; Deas & Thomas, 2001).
This review will specifically explore the family-based intervention Brief Strategic Family Therapy (BSFT) (Szapocznik, Hervis & Schwartz, 2003; Robbins & Szapocznik, 2000) as aggregated evidence for BSFT's effects is needed. The review seeks to clarify the effects of the BSFT program for relevant groups of young people age 11-21. The review focus on young people enrolled in treatment for drug use, independent of how their problem is labeled. Enrolment in treatment means that the severity of the young person's drug use has caused a significant adult close to the young person (teacher, parent, social services, school counselor, etc.) to require treatment. The intervention (BSFT) is delivered in outpatient treatment settings 3 to young people age 11-21 living with their family. The review will focus primarily on non-opioid drugs use 4 , and will consider poly-drug use if relevant.
This review will be one in a series of reviews on manual-based family therapy interventions for young people in treatment for non-opioid drug use 5 .
1.2 DESCRIPTION OF THE INTERVENTION
BSFT is a manual-based family-oriented prevention and treatment intervention for young people's drug use. BSFT is a problem focused family therapy, aiming at creating changes in interactions relevant to the identified problems within families, and in individual family members resisting changes.
BSFT is one of many family therapy forms that meet the general characteristics of manual-based family therapies as it targets young people and their families as a system throughout treatment, and thereby recognizes the important role of the family system in the development and treatment of young people's drug use problems (Liddle et al., 2001, Muck et al. 2001).
BSFT was developed at the Centre for Family Studies, University of Miami. The program was developed in the 1970s as an intervention targeting Hispanic minority young people, primarily immigrants from Cuba (Robbins & Szaspocznik, 2000). BSFT was developed to be culturally sensitive, originally in relation to Cuban immigrants in Miami, but has since been revised and is now a broadly applied intervention for young people, primarily with problematic behavior and drug use problems (Robbins & Szaspocznik, 2000). BSFT is adaptable and incorporates relevant issues depending on the population served and is supposedly sensitive to different cultural and ethnic groups as well as rural versus inner-city conditions (Robbins, Szapocznik & Horigian, 2009).
1.2.1 Theoretical background
BSFT is a family systems approach that relies on both structural family theory and strategic family theory (Robbins & Szapocznik, 2000; Szapocznik et al., 2003).
BSFT along with other family-systems based therapies builds on the assumption that families can be viewed as systems and as such each individual in the family is important for the family system as a whole (Poulsen, 2006). In family systems theory the family is perceived as a unique system consisting of interdependent and interrelated members. The family members are influenced by each other's actions and are strongly related to each other, and as such they can be viewed as a unique and changeable system. The behavior of each family member must be understood in relation to the family context. Young family member's problematic behavior is associated with maladaptive social interaction patterns in the family, and therefore interventions must be implemented at family level. The family itself is part of a larger social system, and as young people are influenced by their families, the family is influenced by the larger social (and cultural) systems in which they exist (Poulsen, 2006; Doherty & McDaniel, 2010; O'Farrell & Fals-Steward, 2008; Kaminer & Slesnick, 2005; Austin et al., 2005). Family therapies are concerned with the wider social context in which the individual and the family is embedded.
The structural family theory is based on the idea that subsystems, structures and hierarchies within families influence or determine individual family members' actions (Goldenberg & Goldenberg, 2008; Minuchin, 1985). In structural family theory social interactions are understood structurally, as repetitive patterns of interaction. The family structure can range from a supportive structure to a maladaptive structure. Either way the structure of interactions affects the family members and could play a pivotal part in maintaining positive as well as problem behavior (Poulsen, 2006; Doherty & McDaniel, 2010; O'Farrell & Fals-Steward, 2008; Kaminer & Slesnick, 2005; Austin et al., 2005; Madanes & Haley, 1977).
BSFT is a strategic approach whereby components are planned, practical and problem-focused. Intervention components are tailored to the young person and family. Components are selected based on the components' likelihood of targeting the identified core problems and positively affecting the young person and their family in a desired direction (e.g., reduced drug use, improved family interactions). The components are problem-focused in the sense that only the interactions that most directly affect the young person's drug use problems are targeted. The intervention components are well planned in the sense that the therapist determines which interactions are directly linked to the symptomatic behavior of the young person and determines which of these will be targeted. The therapist creates a tailored plan to help the family develop more appropriate patterns of interaction (Szapocznik et al., 2003; Horigian, Robbins & Szapocznik, 2004; Szapocznik & Williams, 2000; Robbins & Szapocznik, 2000).
1.2.2 BSFT components
BSFT contains three major components: ‘joining’, ‘diagnosing’ and ‘restructuring’ (Szapocznik et al., 2003; Horigian et al., 2004; Szapocznik & Williams, 2000; Robbins & Szapocznik, 2000).
Joining
‘Joining’ refers to engaging young people and family members in treatment through the establishment of a good therapeutic relationship. Joining occurs at the individual level (the therapist establishes a relationship with each family member) and at the family level (the therapist joins with the family system to create a new therapeutic system by becoming a temporary member of the family). Through recognizing, respecting and maintaining the family's characteristic interactional patterns the therapist attempts to establish an alliance with the individual family members and the family as a whole (Szapocznik et al., 2003; Horigan et al., 2004; Szapocznik & Williams, 2000; Robbins & Szapocznik, 2000).
Diagnosing
BSFT focuses on identifying inappropriate family alliances and family boundaries, and maladaptive interaction patterns. Prior to the diagnosing, BSFT therapists must create a therapeutic context where family members are free to interact in their typical style. These “enactments” permit the therapist to directly observe how the family behaves, and on this basis diagnose (Horigian et al., 2004). The ‘diagnosis’ of alliances, boundaries and patterns will reveal how the characteristics of family interactions contribute to the family's difficulties to meet the objective of eliminating or reducing the young person's drug problems. The therapist will analyze family interactions on five interactional dimensions: structure, resonance, developmental stage, identified patient, and conflict resolution (Robbins & Szapocznik, 2000; Horigian et al., 2004; Szapocznik et al., 2003). Diagnosing includes seeing the patterns of family interaction and their influence on the young person's problems in context (e.g. the young person's network and social setting). Individual and social risk and protective factors will therefore be taken into consideration by the therapist when evaluating the impact of family interactions on the young person's drug problems (Szapocznik et al., 2003). The diagnosing component allows for the BSFT program to be flexible and adaptable to different social settings, family structures and cultures, and co-occurring conditions, e.g. juvenile justice system issues, co-morbid mental health conditions.
Restructuring
The goal for ‘restructuring’ will be to change maladaptive family interaction patterns related to the young drug users problems to more adaptive and successful ways of interacting (Horigian et al., 2004; Robbins & Szapocznik, 2000; Szapocznik et al., 2003). Key restructuring components are ‘working in the present’, ‘reframing’ and ‘working with boundaries and alliances’ (Horigian et al., 2004; Robbins & Szapocznik, 2000; Szapocznik et al., 2003).
Working in the present. BSFT focuses primarily on the current interaction among family members, and distinguishes between process and content. The main focus during therapy sessions is on interaction processes between family members.
Reframing. The aim of reframing is to disrupt maladaptive interaction patterns and create a new context for family interactions. Reframing offers positive alternatives to the family, i.e., by shifting the family members' view of the young drug user from a ‘troubled young person’ to e.g., a ‘vulnerable young person in pain‘. Highly gendered interaction patterns in the family may also be adjusted in the reframing process.
Working with boundaries and alliances. According to BSFT families with drug using young people need strong parental leadership, meaning a strong alliance between parents, with the power to make executive decisions together. For single parents there is a need for a strong parental position. The therapist will work to restore the parent alliance in families with weak or disrupted parent alliances. For single parents the therapist will work to establish and/or reinforce a strong parental position. In BSFT the therapist will also aim to set clear boundaries between family members, thereby allowing all members some privacy and independence within the family. Boundaries and alliances may vary according to e.g. gender and age, and can be attended to in this process.
Intervention components in BSFT are tailored to the young person and his/her family needs and are based on the components' likelihood of positively affecting the young drug user and family in a desired direction (e.g., reduced drug use, improved family interactions). Therefore, BSFT intervention varies in distribution of components to suit the needs of family members. The tailoring of the BSFT program and the focus on family system and family functioning potentially catalyze side effects such as improved overall family functioning, improved educational outcome for the young person in treatment and siblings affected by better family functioning, and other related outcomes.
1.2.3 Duration and setting
The average length of BSFT intervention is 12-16 sessions 6 , however the program is flexible and can be tailored to individual needs (Robbins, Bachrach & Szapocznik, 2002). Likewise BSFT is flexible in its implementation and can be delivered in a variety of settings including clinical or community facilities or in the family home (Robbins et al., 2002).
1.3 HOW THE INTERVENTION MIGHT WORK
BSFT has two primary objectives: 1) to eliminate or reduce young people's drug use, and 2) to change the family interactions associated with young people's drug use. Randomized controlled trials and systematic reviews show that BSFT reduces drug use in participants and contributes to reduction in conduct problems and delinquency (Robbins et al., 2002; Santisteban et al., 2003; Waldron & Turner, 2008; Austin et al., 2005). The program outcomes may be affected by participant characteristics and program mechanisms. Participant characteristics that have been found to predict program drug use reduction or abstinence are history and severity of drug use pretreatment, general peer and parental support, particularly in relation to non-drug use, and higher levels of school attendance and functioning pretreatment (Williams et al., 2000). Practitioners need knowledge on highly relevant participant characteristics such as age, gender, minority background, family composition (e.g., single parents) and co-occurring conditions. These participant characteristics are potential predictors of treatment outcome and practitioners need to be able to assess the programs relevance for any particular type of client.
1.3.1 Intervention mechanisms
Treatment variables with positive impacts on treatment outcomes have been identified across reviews of a range of treatments for youth drug use (Waldron & Turner, 2008; Williams et al., 2000).
Treatment completion is the variable with most consistent relationship to drug use reduction (Williams et al., 2000; Waldron & Turner, 2008). Early alliance building predicts the likelihood that adolescent complete treatment and that they reduce drug use (Waldron & Turner, 2008). It remains unclear if this is a direct treatment impact, or an indicator for treatment motivation, which is another key to positive treatment outcome. Either way, these findings points to the importance of the BSFT component ‘joining’ as a key mechanism, influencing treatment compliance and attendance. Studies show that BSFT positively affects engagement and retention of young people and families (Santisteban et al., 2003; Coatsworth et al., 2001; Santisteban et al., 1996), which can be linked directly to the joining effort. In BSFT, joining has two aspects: joining is the steps a therapist takes to prepare the family for change, and joining occurs when a therapist gains a position of leadership within the family. A number of techniques can be used to prepare the family to accept therapy and to accept the therapist as a leader of change. For example the therapist can present him/herself as an ally, appealing to family members with the greatest dominance over the family unit, and attempting to fit in with the family by adopting the family's manner of speaking and behaving. These techniques are adaptable to the needs of various clients groups.
Motivation, being key to positive treatment outcome (Williams et al., 2000), is also linked to the support and influence of the family system. The family systems ability to influence the young person to a non-drug-using lifestyle is a possible mechanism of change related to the family systems focus of BSFT. Studies find that BSFT positively influences family interaction changes, family functioning, and contributes to the reduction in young people's drug use (Santisteban et al., 2003; Robbins et al., 2002). For example, Robbins et.al., (2009) find that parent participants in the BSFT intervention gain from the parenting training and education in youth and family struggles, leading to reduction in the young person's drug use. According to Robbins et.al. (2009) parent participants in the BSFT intervention have been found to display improved ability to identify signs of for instance youth gang participation, improved ability to communicate with the young person about gang issues and drug issues, and improved knowledge about parent's responsibility related to youth gang and drug participation. In addition, BSFT participating parents also display improved knowledge about the negative health and legal consequences of substance use.
The young person's participating in BSFT also display positive behavior improvements over the course of the treatment intervention, such as improved conflict resolution skills, improved self-concept and sense of personal resources, and reduced gang and drug identification (Robbins et.al., 2009). Improvements are gained through the reframing phase, during which the therapist work with both the young person and family members, to change their ways of behavior towards a more constructive behavior (Robbins et al., 2009). The therapist coaches the young person and family members on constructive interaction methods, and ensures that new interaction patterns are practiced at home in naturally occurring situations (e.g., when setting a curfew or when eating meals together) (Szapocznik et al., 2003).
The quality of the therapeutic alliance predicts the family's engagement, retention and gains from therapy (Robbins et al., 1998). Robbins et al. (2004) have demonstrated how unbalanced alliances between therapist and young person and/or family in early BSFT session were associated with program dropout. In BSFT, one of the most useful strategies a therapist can employ in joining is to support the existing family power structure. Szapocznik et al., (2003) concludes that
The BSFT counselor supports those family members who are in power by showing respect for them. This is done because they are the ones with the power to accept the counselor into the family; they have the power to place the counselor in a leadership role, and they have the power to take the family out of counseling. In most families, the most powerful member needs to agree to a change in the family, including changing himself or herself. For that reason, the counselor's strongest alliance must initially be with the most powerful family member. (Szapocznik et al., 2003:26).
The family systems focus and the joining effort in BSFT are both key ingredients in BSFT, and influence family functioning and facilitate changes in young people's drug problems.
1.4 WHY IT IS IMPORTANT TO DO THIS REVIEW
Persistent drug use among young people is a significant social problem, and treatment of young people's drug use is challenging and costly, not least because the treatments for young people's drug use problems is plagued by high dropout rates and post-treatment relapse to drug use. Research suggests that nearly half of the young drug users never complete drug use treatment (SAMSHA, 2008). There is a need to identify effective treatments for addressing young people's drug use problems, and to reduce treatment dropout and post-treatment relapse. Furthermore, the growing interest among policy makers in increasing funding for empirically supported interventions is a strong motivation to add to the evidence base with a systematic review on a promising treatment for young drug users.
There are a number of studies indicating that BSFT is a promising treatment for young people with non-opioid drug use. By aggregating individual studies' results on BSFT, this review will contribute to the knowledge about treatment of young drug-users and their families. The review will inform practice by exploring the effects of BSFT for relevant client groups.
2 Objective of the review
The aim of this review is to evaluate the current evidence on the effects of BSFT on drug use reduction for young people in treatment for non-opioid drug use.
A further objective of this review is, if possible, to examine mediators of drug use reduction effects, specifically analyzing whether BSFT works better for particular types of participants.
3 Methods
3.1 CRITERIA FOR CONSIDERING STUDIES FOR THIS REVIEW
3.1.1 Types of studies
The study designs included in the review will be: Controlled trials
7
(all parts of the study are prospective, i.e. recruitment of participants, assessment of baseline, allocation to intervention, selection of outcomes and generation of hypotheses, see Higgins & Green, 2008): RCT - randomized controlled trials QRCT - quasi-randomized controlled trials (i.e. participants are allocated by means such as alternate allocation, person's birth date, the date of the week or month, case number or alphabetical order) NRCT - non-randomized controlled trial (i.e. participants are allocated by other actions controlled by the researcher such as location difference or time difference).
We will include study designs that use a well-defined control group. Comparison will be no intervention, wait list control, TAU and alternative active intervention. Studies using single group pre-post comparison will not be included.
The rationale for including NRCTs is as follows:
The aim of this review is to evaluate the current evidence and synthesize all of the potentially high quality international evidence in this topic area. If only RCTs are included, studies from countries that do not have a tradition for conducting RCTs in the area of youth drug use (at the time this protocol was written) would be excluded 8 . There is a long tradition for doing randomized controlled trials on social interventions in North America. However this is not the case in Europe.
3.1.2 Types of participants
The population included in this review will be young people aged 11-21 years enrolled in manual based BSFT drug treatment for non-opioid drug use (e.g., cannabis, amphetamine, ecstasy or cocaine).
Definitions of young people, and the age in which a person is considered a young person and may be entitled special services, such as drug treatment varies internationally (United Nations, 2011). Age group distinctions for young people are unclear as the boundaries are fluid and culturally specific (Weller, 2006). Furthermore young people start experimenting with illegal drugs at different ages in different countries (Hibell et al., 2009). Patterns of young people's independence from parents and independent living patterns likewise vary internationally. In order to capture international differences we have set the age range from 11 to 21 (Hibell et al., 2009; United Nations, 2011; SAMHSA, 2010; Danish Youth Council, 2011).
In addition, only out-patient interventions are included in order to evaluate effects of BSFT on youth living with their family, since family interactions are cardinal in BSFT.
No universal international consensus exists concerning what categories to use when classifying drug users 9 , and different assessment tools and ways of classifying the severity of drug use are applied in different research studies (American Psychiatric Association, 2000; World Health Organization (WHO), 2011; Nordegren, 2002). We include participants regardless of formal drug use diagnosis. The main criteria for inclusion is the fact that the young person is enrolled to participate in treatment (i.e. intervention or comparison condition). Referral and enrolment in drug use treatment requires a level of drug use such that a significant other, or authority (or the young person) finds it necessary to solicit or require treatment. We define the population as young people referred to or in treatment for using non-opioid drugs.
We will include poly drug users, as long as the majority of drug users in a study are non-opioid drug users. Psychosocial interventions for youth opioid dependence has been evaluated in Cochrane reviews (Amato et al., 2011; Minozzi et al., 2010), and we wish to avoid duplication of effort. Populations who exclusively use alcohol will be excluded.
3.1.3 Types of interventions
The review will include outpatient manual based BSFT interventions of any duration delivered to young people and their families (see 1.2 Description of the intervention). The BSFT intervention must be an outpatient intervention that does not include overnight stays in a hospital or other treatment facility. The BSFT intervention can take place in the home, at community centers, in a therapist's office or at outpatient facilities. Interventions in restrictive environments, such as prisons or other locked institutions 10 (e.g., detention centers, institutions for sentence-serving juvenile delinquents) will be excluded.
BSFT is a family intervention requiring the active participation of the young drug user and his or her family, and with the aim of improving family functioning. In cases with the young drug user placed outside the family home (e.g. in-patient treatment and incarceration in any locked facility) the core condition of the program will be seriously compromised.
Interventions focusing exclusively on treating mental disorders will also be excluded. Studies where BSFT is delivered with add-on components will be included as long as BSFT is the primary intervention.
Eligible control and comparisons will include no intervention, waitlist controls and alternative interventions, as we are interested in both absolute and relative effects. Due to ethical considerations and nature of the problem (i.e., young peoples' drug use) the likelihood of no treatment control group is small. We expect that the most frequent comparison will be alternative interventions (Lipsey, Tanner-Smith, & Wilson, 2010).
3.1.4 Types of outcomes
Primary outcome(s)
Abstinence or reduction of drug use as measured by e.g.,: Biochemical test (e.g., urine screen measures for drug use); Self-reported estimates of drug use (e.g., Time-line Follow Back interview) (Fals-Stewart, O'Farrell, Freitas, McFarlin & Rutigliano 2000); Psychometric scales (e.g., Addiction Severity Index) (McLellan, Luborsky, Woody & O'Brien, 1980).
Secondary outcomes
Family functioning (e.g., measured by the Beavers Interactional Competence Scale) (Beavers & Hampson, 2000). Education or vocational involvement (e.g., measured by grade point average, attendance, self-reported or reported by authorities, files, registers, or employment record). Retention (e.g., measured by days in treatment, completion rates and/or attrition rates). Risk behavior, such as crime rates, prostitution (e.g., measured by self-reports or reports by authorities, administrative files, registers). Other adverse effects (e.g., measured by rates of hospitalization, suicide and overdoses).
The primary outcome is abstinence or reduction of drug use, as the overall review question is to evaluate current evidence on BSFT's effects on drug use reduction for young people in treatment for drug use. We seek evidence on how to best reduce or eliminate drug use, as drug use is understood as the young people's primary problem.
Outcomes will be considered in the following intervals: Short term (end of treatment to less than 6 months after end of treatment) Medium term (6 to 12 months after end of treatment) Long term (more than 12 months after end of treatment)
3.2 SEARCH METHODS FOR IDENTIFICATION OF STUDIES
3.2.1 Electronic searches
Relevant studies will be identified through electronic searches of bibliographic databases, government and policy databanks. No language or date restrictions will be applied to the searches.
The following bibliographic databases will be searched:
Medline
Embase
Cinahl
Social Science Citation Abstract
Science Citation Abstract
Socindex
PsycINFO
Cochrane
Danbib
Libris
Bibsys
Social Care Online
Eric
SweMed+
Criminal Justice Abstracts
Bibliography of Nordic Criminology
3.2.2Search terms
An example of the search strategy for MEDLINE searched through the Ovid platform is listed below. This strategy will be modified for the different databases. We will report details of the modifications used for other databases in the completed review. BSFT.af. (Brief adj1 Strategic* adj1 Famil*).af.) 1-2/or
3.2.3 Searching other resources
The review authors will check reference lists of other relevant reviews and included primary studies for new leads. Citation searching in the Web of Science will also be considered. We will contact international experts to identify unpublished and on- going studies, and provide them with the inclusion criteria for the review along with the list of included studies, asking for any other published, unpublished or ongoing studies relevant for the review.
3.2.4 Searching other resources
The following international journals will be hand searched for relevant studies: Addiction Journal of Consulting and Clinical Psychology Journal of Substance Abuse Treatment Journal of Clinical and Adolescent Psychology
Searching will be performed on editions from 2011 to review submission of the journals mentioned, in order to capture any relevant studies recently published and therefore not captured in the systematic search.
3.2.5 Grey literature
Additional searches will be made by means of Google and Google Scholar and we will check the first 1500 hits. OpenGrey (http://www.opengrey.eu/) will also be used to search for European grey literature. Copies of relevant documents will be made and we will record the exact URL and date of access for each relevant document.
In addition we will search these sites:
National Institute on Drug Abuse (NIDA)
The European Monitoring Centre for Drugs and Drug Addiction (EMCDDA)
Substance abuse and Mental Health Services administration (SAMHSA)
3.3 DATA COLLECTION AND ANALYSIS
3.3.1 Selection of studies
Two members of the review team will independently screen titles and abstracts in order to exclude studies that are clearly irrelevant under the supervision of ML (SLO & MS 11 ). Studies considered eligible by at least one of the reviewers will be retrieved in full text. The full texts will then be screened by two members of the review team to determine study eligibility based on the inclusion criteria. Any disagreements about eligibility will be resolved by a third review author (TF). Reasons for exclusion will be documented for each study that is retrieved in full text. The study inclusion coding sheet will be piloted and adjusted if required by the review authors (see Appendix 5.1).
The overall search and screening process will be illustrated in a flow-diagram.
3.3.2 Data extraction and management
At least two review authors (ML, MS, PSR, & KK) will independently code and extract data from the included studies. A data extraction sheet will be piloted on several studies and revised as necessary (see Appendix 5.2). Extracted data will be stored electronically. Any disagreements will be resolved by consulting a third reviewer with extensive content and methods expertise (TF). Analysis will be conducted in RevMan5 and/or STATA. Data and information will be extracted on; characteristics of participants (e.g., age, gender, and drug use history), intervention characteristics and control conditions, research design, sample size, outcomes and results.
3.3.3 Assessment of risk of bias in included studies
We will assess the methodological quality of studies using a risk of bias model developed by Prof. Barnaby Reeves in association with the Cochrane Non-Randomized Studies Methods Group (Reeves, Deeks, Higgins, & Wells, 2011) 12 . This model, an unpublished extension of the existing Cochrane Collaboration's risk of bias tool (Higgins & Green, 2008), covers both risk of bias in RCTs and in non-randomized studies that have a well-defined control group.
The extended model is organized and follows the same steps as the existing Risk of Bias model according to the Cochrane Hand book, chapter 8 (Higgins & Green, 2008). The extension to the model is explained in the three following points: The existing Cochrane risk of bias tool needs elaboration when assessing non-randomized studies because, for non-randomized studies, particular attention must be paid to selection bias / risk of confounding. The extended model therefore specifically incorporates a formalised and structured approach for the assessment of selection bias in non-randomised studies
13
by adding an explicit item about confounding (Reeves, Deeks, Higgins & Wells, 2011). It is based on a list of confounders considered important and defined in the protocol for the review. The assessment of confounding is made using a worksheet where for each confounder it is marked whether the confounder was considered by the researchers, the precision with which it was measured, the imbalance between groups and the care with which adjustment was carried out (see Appendix 5.3). This assessment will inform the final risk of bias score for confounding. Another feature of non-randomized studies that make them at greater risk of bias compared to RCTs is that RCTs must have a protocol in advance of starting to recruit whereas non-randomized studies need not. The item concerning selective reporting therefore also requires assessment of the extent to which analyses (and potentially other choices) could have been manipulated to bias the findings reported, e.g. choice of method of model fitting, potential confounders considered / included. In addition the model includes two separate yes/no items asking reviewers whether they think the researchers had a pre-specified protocol and analysis plan. Finally the risk of bias assessment is refined, making it possible to discriminate between studies with varying degrees of risk. This refinement is achieved with the addition of a 5-point scale for certain items (see the following section Risk of bias judgement for details).
The refined assessment is pertinent when thinking of data synthesis as it operationalizes the identification of studies (especially in relation to non-randomized studies) with a very high risk of bias. The refinement increases transparency in assessment judgements and provides justification for not including a study with a very high risk of bias in the meta-analysis.
Risk of bias judgement items and assessment
The risk of bias model used in this review is based on 9 items (see Appendix 5.3 for guidelines & Appendix 5.4 for risk of bias coding sheets).
The 9 items refer to
The assessment will be based on pre-specified questions (see Appendix 5.3). “Yes” indicates a low risk, “No” indicates a high risk of bias, and “Unclear” indicates an unclear or unknown risk of bias. In the 5 point scale 1 corresponds to No/Low risk of bias (e.g.1 = a high quality RCT) and 5 corresponds to Yes/High risk of bias (e.g. 5= too risky, too much bias, e.g., a poor quality study). A judgement of 5 points on any one of the items assessed translates to a risk of bias so high that the findings will not be considered in the data synthesis (because they are more likely to mislead than inform). (See Appendix 5.3). A judgment of 5 is given with precaution and only in cases of extreme biases. Judgements will be justified and reported.
Confounding
An important part of the risk of bias assessment of nonrandomized studies is how the studies deal with confounding factors. Selection bias is understood as systematic baseline differences between intervention vs. control (or comparison) groups that can therefore compromise their comparability.
For this review, the following confounding factors are considered as the most relevant: age, gender, and drug use history. If other confounders are considered by study investigators in the included studies they will be assessed in the same manner (Appendix 5.3).
We focus on three confounders - age, gender and drug use history -as they are major predictors of drug use. Young people are in a transitional and development life phase, and their patterns of drug use are connected to age (Labouvie & White, 2002; Kaminer, 2008; Waldron & Kaminer, 2004). Gender is also identified as confounding factor drug use, i.e., males generally have higher drug use than females (Østergaard & Bastholm Andrade, 2011; McCabe, Morales, Cranford, Delva, McPherson & Boyd, 2007). And finally history of drug use and persistent patterns of use affect treatment outcomes (Labouvie & White, 2002; Kaminer, 2008).
Review authors (at least two PRS, ML, MS, & KK) will independently assess the risk of bias for each included study as described in the previous sections. Disagreements will be sought by a third reviewer with content and statistical expertise (FT). We will report the risk of bias assessment in risk of bias tables for each included study in the completed review. This assessment will also inform the data synthesis.
3.3.4 Measures of treatment effect
Discrete data
For dichotomous outcomes we will calculate odds ratios or risk ratios with 95 % confidence intervals and p-values. Urine Drug Screen data is an example of a relevant dichotomous outcome in this review.
Continuous data
For continuous outcomes, effects sizes with 95 % confidence intervals will be calculated if means and standard deviations are available. If means and standard deviations are not available, the review authors will request this information from principle investigators. If no information is yielded we will use methods by Lipsey and Wilson (2001) to calculate SMDs from e.g., F-ratios, t-values, chi-squared values and correlation coefficients. Hedges g will be used for estimating standardized mean differences (SMD) where scales measure the same outcomes in different ways (e.g., reduction of drug use). If there is a mix of studies with some reporting change scores and others reporting final values, we will contact authors and request the final values. If we do not obtain these values, we will analyze change scores and final values separately (Higgins & Green, 2008, section 9.4.5.2). Any scales related to drug use, family functioning, education (grade score), etc. are examples of relevant continuous outcomes in this review.
There are statistical approaches available to re-express dichotomous and continuous data to be pooled together (Sáchez-Meca, Marín-Martínes & Chacón-Moscoso, 2003). We will only transform dichotomous effect sizes to SMD if appropriate e.g., as may be the case with the primary outcomes ‘abstinence and reduction’ of drug use that can be measured with binary and continuous data.
When effect sizes cannot be pooled, study-level effects will be reported in as much detail as possible. Software for storing data and statistical analyses will be RevMan 5.0, Excel and STATA 10.0.
3.3.5 Unit of analysis issues
We will take into account the unit of analysis of the studies to determine whether individuals were randomized in groups (i.e. cluster randomized trials), whether individuals may have undergone multiple interventions, whether there were multiple treatment groups and we will check for multiple publications for some studies (i.e., whether several studies are based on the same data source).
Multiple intervention groups
Multiple intervention groups (with different individuals) within a study with one control group will not be pooled, nor will multiple controls groups be pooled. Data will be rigorously checked to avoid overlapping samples.
Multiple interventions per individual
Multiple intervention per individual e.g. BSFT plus add on components such as motivation interviewing or a pharmacological treatment will be analyzed separately.
Multiple time points
When the results are measured at multiple time points, as a guideline they will be analyzed at available time points in the following groups: short-term (0- <6 months after participation), medium term (6- 12 months after participation) long term (at least 12 months after participation). We will not pool different time points, due to the sensitivity of outcomes in relation to time from end of treatment.
Cluster randomized trials
If cluster randomized trials are included in this review we will check for consistency in the unit of allocation and the unit of analysis, as statistical errors can occur when they are different. When suitable cluster analysis is used, effect estimates and their standard errors will be meta-analyzed (Higgins & Green, 2008). In cases where study investors have not applied appropriate analysis methods controlling for clustering, we will approximate the intra-cluster correlation (see Donner et al., 2001) and correct standard errors.
3.3.6 Dealing with missing data and incomplete data
The reviewers will assess missing data and attrition rates in the included studies. In the case of missing data (e.g., valid Ns, means and standard deviations) the reviewers will contact primary study authors for missing data. The review authors will record attrition rates and (if possible) reasons for attrition from included studies
The reviewers will record information on intention to treat analysis (ITT). We run separate meta-analysis with studies that did not use ITT. We will perform sensitivity analysis to examine influences on effects in studies using ITT analysis vs. studies not using ITT analysis.
3.3.7 Assessment of heterogeneity
Statistically significant heterogeneity among primary outcome studies will be assessed with Chi-squared (Q) test and I-squared (Higgins, Thompson, Deeks, & Altman, 2003). A significant Q (P<.05) and I-squared of at least 50% will be considered as statistical heterogeneity.
3.3.8 Assessment of publication bias
Reporting bias refers to both publication bias and selective reporting of outcome data and results. Selective reporting will be dealt with in the risk of bias assessment and any concerns will be reported.
We will use funnel plots for information about possible publication bias if we find sufficient studies (Higgins & Green, 2008). However asymmetric funnel plots are not necessarily caused by publication bias (and publication bias does not necessarily cause asymmetry in a funnel plot). If asymmetry is present, we will consider possible reasons for this.
3.4 DATA SYNTHESIS
Studies that have been coded with a very high risk of bias (5 in any of the items judged on the 5 point scale) will not be included in the data synthesis. Analysis of the absolute effects of BSFT will involve comparing BSFT to no treatment and to untreated wait list controls. The relative effects of BSFT (versus other interventions) will be conducted separately and will include studies that compare BSFT to other interventions and/or Treatment-As-Usual (TAU). All follow-up durations reported in the primary studies will be recorded and we will do separate analyses for available time points within short-term, medium-term and long-term outcomes.
Meta-analysis will be used when effect sizes are available or can be calculated and when studies include similar design features (RCTs vs. Non-RCTS), intervention modalities (e.g., intervention duration) methodology (e.g., time point measurements) and outcome measurements. Random effects meta-analysis will be used. We will report the 95% confidence intervals and provide a graphical display (forest plot) of effect sizes. When meta-analysis is inappropriate, a narrative description of the individual study results will be provided, and in this case any conclusions about the effectiveness of BSFT will not be possible.
3.4.1 Moderator analysis/subgroup analysis and investigation of heterogeneity
We will investigate the following study-level covariates (if possible) with the aim of explaining observed heterogeneity: intervention characteristics (e.g., treatment duration, treatment intensity, composition of components), and study level summaries of participants' characteristics (e.g., gender, age, family composition, ethnicity, co-morbidity, and history of drug use) and comparison intervention characteristics.
If the number of included studies is sufficient (dependent on the spread of the study means of the covariates and study sizes, see Borenstein, Hedges, Higgins & Rothstein (2009) and Simmonds & Higgins (2007)), we will perform moderator analyses (meta-regression) to explore how observed variables are related to heterogeneity using a mixed model. We will estimate the (new) residual variance component to be used in a weighted least squares analysis conditional on this variance component estimate.
The residual variance component will be estimated using the method-of-moments estimator (Hartung et al., 2008; Konstantopoulos, 2006). We will report the 95% confidence intervals for regression parameters. Conclusions from meta-regression analysis will be cautiously drawn and will not be based on significance tests.
Otherwise single factor subgroup analysis will be performed. The assessment of any difference between subgroups will be based on 95% confidence intervals. No conclusions from subgroup analyses will be drawn and interpretation of relationships will be cautious, as they are based on subdivision of studies and indirect comparisons.
3.4.2 Sensitivity analysis
Sensitivity analysis will be used to evaluate whether the pooled effect sizes are robust across study design and components of methodological quality. For methodological quality, we will consider sensitivity analysis for each major component of the risk of bias checklists. To check for the possible influence on developer bias effect sizes, we will run sensitivity analysis on studies conducted by program developers vs. studies conducted by independent researchers. Developer bias can occur in studies conducted by developers who may unconsciously influence the success of an intervention (Petrosino & Soydan, 2005; Eisner, 2009; Sherman & Strang, 2009).
We will also consider sensitivity analysis for program fidelity, i.e. compliance with program manual and requirements for therapist training.
Footnotes
5 Appendices
1
The terms use, abuse and dependence will be used interchangeably throughout the protocol and refer to an addiction stage of non-medical drug usage.
2
Cannabis, amphetamine, cocaine and other non-opioid and opioid drugs are illegal in most, but not all countries. For instance, use of cannabis in small amounts is tolerated in the Netherlands.
3
A Cochrane review has evaluated psychosocial interventions for substance abuse and misuse in young offenders in locked facilities (Townsend et al., 2009).
4
Two Cochrane reviews have evaluated psychosocial treatments for treatment of opioid dependence (Amato et al., 2011; Minozzi et al. 2010).
Please see the following Title Registrations in the Campbell Library for further information:
Maia Lindstrøm, Pernille Skovbo Rasmussen, Krystyna Kowalski, Trine Filges, Anne-Marie Jørgensen: Family Behavior Therapy (FBT) for young people in treatment for illicit non-opioid drug use
Krystyna Kowalski, Maia Lindstrøm, Pernille Skovbo Rasmussen, Trine Filges, Anne-Marie Jørgensen: Functional Family Therapy (FFT) for young people in treatment for illicit non-opioid drug use
Pernille Skovbo Rasmussen, Maia Lindstrøm, Krystyna Kowalski, Trine Filges, Anne-Marie Jørgensen: Multidimensional Family Therapy (MDFT) for young people in treatment for illicit non-opioid drug use
6
Despite the program title Brief Strategic Family Therapy, the duration of BSFT is comparable to other family therapy programs.
7
A controlled trial typically includes at least two groups, an intervention/experimental group and a control group, and pre- and post-outcome measures.
8
Lipsey, Tanner-Smith, & Wilson (2010) have conducted a meta-analysis of the findings from experimental and quasi-experimental studies on the effectiveness of adolescent substance abuse interventions. They found and included a limited number of non-randomized studies in their analysis (8%). However it should be noted that the searches had a number of restrictions including language (searches were limited to studies reported in English), dates (date filter 1980-2008) and participant inclusion criteria was narrower (12 to 17 years of age).
9
Different tools classify clients into different categories, e.g., users, misusers and dependents. These specific categorizations are used in the Diagnostic and Statistical Manual of Mental Disorders (DSM) (American Psychiatric Association, 1994, 2000). While the DSM-IV is a widely used as an assessment tool, other relevant tools such as the International Statistical Classification of Diseases and Related Health problems (ICD, now ICD-10) developed by the World Health Organisation (WHO) are also in wide use. Differences between the tools concern both terminology and categorization criteria. For example the DSM-IV includes the category ‘abuse‘, while the ICD-10 explicitly avoids this term on the grounds of its ambiguity; harmful use and hazardous use are the equivalent terms in WHO usage, but the categories are not identical while the ICD-10 solely operates with physical and mental criteria the DSM-IV also includes social criteria (WHO, 2011; Nordegren, 2002).
10
A Cochrane review has evaluated psychosocial interventions for substance abuse and misuse in young offenders in locked facilities (Townsend et al., 2009).
11
Stine Lian Olsen and Madina Saidj are members of the review team and will assist the review authors with screening titles and abstracts.
12
This risk of bias model was introduced by Prof. Reeves at a workshop on risk of bias in non-randomized studies at SFI Campbell, February 2011. The model is developed by the Cochrane Non-Randomized Studies Method Group (NRSMG).
13
The extended model was developed to ensure standardization of guidelines and procedures in the Risk of Bias assessment of NRS.
14
This risk of bias model was introduced by Prof. Reeves at a workshop on risk of bias in non-randomised studies at SFI Campbell, February 2011. The model is a further development of work carried out in the Cochrane Non-Randomised Studies Method Group (NRSMG).
