- Research article
- Open Access
- Open Peer Review
Assessing and improving organizational readiness to implement substance use disorder treatment in primary care: findings from the SUMMIT study
BMC Family Practice volume 18, Article number: 107 (2017)
Millions of people with substance use disorders (SUDs) need, but do not receive, treatment. Delivering SUD treatment in primary care settings could increase access to treatment because most people visit their primary care doctors at least once a year, but evidence-based SUD treatments are underutilized in primary care settings. We used an organizational readiness intervention comprised of a cluster of implementation strategies to prepare a federally qualified health center to deliver SUD screening and evidence-based treatments (extended-release injectable naltrexone (XR-NTX) for alcohol use disorders, buprenorphine/naloxone (BUP/NX) for opioid use disorders and a brief motivational interviewing/cognitive behavioral –based psychotherapy for both disorders). This article reports the effects of the intervention on key implementation outcomes.
To assess changes in organizational readiness we conducted pre- and post-intervention surveys with prescribing medical providers, behavioral health providers and general clinic staff (N = 69). We report on changes in implementation outcomes: acceptability, perceptions of appropriateness and feasibility, and intention to adopt the evidence-based treatments. We used Wilcoxon signed rank tests to analyze pre- to post-intervention changes.
After 18 months, prescribing medical providers agreed more that XR-NTX was easier to use for patients with alcohol use disorders than before the intervention, but their opinions about the effectiveness and ease of use of BUP/NX for patients with opioid use disorders did not improve. Prescribing medical providers also felt more strongly after the intervention that XR-NTX for alcohol use disorders was compatible with current practices. Opinions of general clinic staff about the appropriateness of SUD treatment in primary care improved significantly.
Consistent with implementation theory, we found that an organizational readiness implementation intervention enhanced perceptions in some domains of practice acceptability and appropriateness. Further research will assess whether these factors, which focus on individual staff readiness, change over time and ultimately predict adoption of SUD treatments in primary care.
Several evidence-based treatments for substance use disorders (SUDs)—medications in particular, but also brief therapy—are available and appropriate for delivery in primary care settings [1,2,3,4,5,6,7], but are underutilized [8,9,10,11]. Primary care is thought to be well-suited to provide SUD treatment because the prevalence of alcohol use disorders and use of illicit drugs is higher among primary care patients than in the general population due to comorbidity of SUDs with other illnesses that bring people into medical care [12, 13], and most individuals visit a primary care provider at least once a year . Further, expanded coverage under the Patient Protection and Affordable Care Act (PPACA) has increased the number of individuals seeking medical care in primary care clinics in United States [15, 16]. Increasing identification of SUDs and availability of SUD treatment in primary care could increase access to treatment for millions of individuals who need but never receive treatment for a number of reasons, including low perceived need for treatment, lack of readiness, SUD-related stigma, or because speciality treatment centers lack the capacity to provide timely treatment [17,18,19,20]. Despite the potential benefits, few primary care providers have integrated treatment for SUDs into their practice.
Although there is little available data on barriers to the uptake of SUD treatment by primary care providers, some of the known barriers include lack of leadership buy-in for integrating SUD care into medical practices; lack of confidence among physicians in their own or their clinic’s ability to treat SUDs; lack of adequate physician role models and access to decision support consultants; deficiencies in training and expertise in addiction treatment (i.e., workforce issues), Medicaid regulations that impede payment for the use of certain medications and same-day medical and mental health visits, and negative attitudes towards and biases against people with SUDs [21,22,23,24,25,26]. Other barriers common to the adoption of any new practice include perceived complexity and effectiveness of the new practice, perceived fit with and relevance to existing practices, and the feasibility of implementing the new practice , including inability to visualize how the new practice will fit into the existing workflow (i.e., lack of written protocols) [28,29,30]. Further, providers in primary care clinics face large workloads, imbalance between skills and increasing job demands, and lack of team support, all of which can lead to burnout and could impede organizational readiness for and implementation of new practices [31,32,33].
Organizational and behavioral change theories, such as Rogers’ (1995) diffusion of innovation theory  and Bandura’s (1977) theory of behavior change , posit that individuals’ perceptions of the characteristics of new practices, their self-efficacy to implement the practices, and their perceptions of the capacity of their organization to implement the practices, are critical precursors of behavior change that support implementation. These precursors are often referred to in the organizational change literature as elements of “organizational readiness” [28, 29, 35,36,37,38,39,40,41]. Although definitions of organizational readiness vary widely, they have in common several key constructs, such as whether an organization’s culture and climate are ready to make general changes (for example, organizations with stronger staff morale, less staff turnover, and openness to new practices in general typically are more likely to support implementation of new practices) [42,43,44], whether individual members view their organization as capable of change, or whether individual members are themselves prepared and willing to make a specific change or adopt a specific new practice [28, 43, 45]. Weiner et al. (2008) suggest that conceptualization of organizational readiness is most practical when it focuses on organization members’ preparedness to implement intentional change, that is, whether individuals within an organization are psychologically and behaviorally prepared and willing to implement a specific new practice. Although some studies suggest an association between various organizational readiness constructs, including readiness of individuals as well as the culture and climate of their organizations, and adoption of new practices [46,47,48,49], no studies to date have examined the readiness of individual primary care clinic providers and other clinic staff to deliver treatment for SUDs.
To prepare a federally qualified health center (FQHC) in Los Angeles, California to deliver SUD screening and treatment to patients with opioid and alcohol use disorders (OAUDs), we employed a multi-faceted implementation intervention using a cluster of implementation strategies. FQHCs are community health clinics that receive support from the U.S. government to provide primary care and other services to medically underserved populations. We tested the intervention in a FQHC because FQHCs are responsible for delivering a large proportion of publicly funded primary care treatment in the U.S. We operationalized ‘organizational readiness’ as perceptions of the acceptability, appropriateness and feasibility of practices, and intentions to adopt the practices; these constructs are considered ‘implementation outcomes’ according to implementation researchers and theorists [27, 28, 34, 45, 50] and are based on organizational and behavioral change theory [27, 34, 50]. We focused on the treatment of OAUDs because there are FDA-approved medications to treat these disorders. Our full study design, which included an RCT phase where a collaborative care service delivery intervention was added 18 months after the start of the organizational readiness intervention, is described in the study protocol paper .
In this article, we describe the organizational readiness intervention and present pre- to post-intervention implementation outcomes after 18 months of the intervention and prior to the RCT. Some elements of the organizational readiness intervention, such as technical assistance and training of new staff, continued throughout the RCT. We hypothesized that the organizational readiness intervention would increase provider and staff acceptance and perceptions of appropriateness and feasibility of three evidence based SUD treatments—extended-release injectable naltrexone (XR-NTX) for alcohol use disorders, buprenorphine/naloxone (BUP/NX) for opioid use disorders, and a 6-session motivational interviewing/cognitive behavioral therapy (MI/CBT)-based psychotherapy for both disorders—and greater intention to adopt these treatments among the providers (i.e., physicians for the medications and therapists for the psychotherapy). XR-NTX is effective for people with alcohol or opioid disorders and also is feasible for delivery in primary care [52,53,54,55,56]; BUP/NX has been proven effective for patients with opioid use disorders and is feasible for delivery in office-based settings [1,2,3,4,5,6,7]; and MI/CBT-based therapies have shown efficacy in reducing substance use across settings [57,58,59,60]. For this study, prescribing medical providers were trained to deliver XR-NTX for alcohol use disorders only.
Study setting and participants
We conducted the study at a multi-site FQHC in Los Angeles, California. The FQHC’s two largest adult-care sites, which serve approximately 20,000 low-income patients annually, were included in the study, and provide more than 106,000 primary care, specialty care, mental health, dental, and health education visits annually. Services include diagnosis, treatment, medications, follow-up care, and laboratory tests; prior to the study, the clinic did not provide screening or treatment for any SUDs. The sites were treated as a single site due to providers working across locations. Full-time staff working at the two clinics asked to participate in the survey consisted of 18 prescribing medical providers, 9 behavioral health providers, 42 medical assistants and 24 discharge coordinators (referred to as “general staff”) in Year 1, and 18 prescribing medical providers, 9 behavioral providers, 43 medical assistants and 23 discharge coordinators in Year 2.
Organizational readiness implementation intervention
To enhance organizational readiness to provide evidence-based treatment for OAUDs, we employed multiple theory-based strategies hypothesized to increase adoption of evidence-based practices (EBP) in community organizations [28, 29, 41, 61,62,63,64,65,66,67,68,69,70]. The organizational readiness implementation intervention aimed to increase “behavioral and psychological willingness” to implement OAUD treatment in primary care among providers and staff .
The organizational readiness intervention consisted of six implementation strategies delivered over 18 months (see Fig. 1). The strategies fall within three key implementation process categories outlined by Powell et al. (2011): plan for change; educate at all levels; and restructure delivery systems .
Process category 1: Plan for change
We convened an implementation team to engage and increase buy-in  from clinic leadership and staff. The core team consisted of key members of the research team (the Principal Investigator and co-Investigator, with other relevant researchers joining for some meetings to provide input on special topics) and the clinic medical director and behavioral health director. The full implementation team met bi-weekly and in-person during the first 18 months of the study and once a month during the RCT. A variety of key clinic leaders were periodically invited to attend the meeting, including the clinic Chief Operating Officer, the head of the clinic’s call center (where all patient calls are received), and the nursing/medical assistant director. Core team members also conducted two briefings for the Chief Executive Officer to share updates on our implementation progress and our implementation intervention protocols—one at the organizational readiness intervention and another prior to the start of the pilot period.
To assess barriers to and resources to deliver SUD treatment, we conducted focus groups with prescribing medical providers (N = 9) and behavioral health providers (N = 8), and semi-structured interviews with administrators (N = 8). Administrators included the Executive Director, Medical Director, Associate Medical Director, Behavioral Health Services Director, Nursing Supervisor, Case Manager Supervisor, Front Desk Supervisor, and Security Supervisor. To assess the “present state” workflow, we observed clinic procedures and interviewed multiple clinic leaders. We created detailed “present state” workflow diagrams to assess how SUD screening, assessment and treatment delivery would be incorporated (i.e., who would do what to whom, when, and where). In the interest of providing rapid feedback to the implementation team, we summarized key barriers identified in the focus groups and interviews and provided the summary to the team.
Based on barriers identified during focus groups and interviews and on present state workflow diagrams, the research team drafted “future state” workflow and clinic-specific implementation protocols for each treatment. The implementation team then iterated until the workflow and protocols aligned with the clinic’s practices and culture. The final “future state” workflow diagram and clinic-specific implementation protocols allowed staff to visualize how (when, where and by whom) the SUD treatments would be implemented [72,73,74].
Strategy 4: Select and train “champions” 
We selected and trained prescribing medical provider- and behavioral health- champions. A champion is a well-respected individual within an organization who is enthusiastic about a new practice and who can serve as a role model for adopting new practices . The medical director (a primary care provider) and behavioral health director (a licensed clinical social worker), along with one additional primary care provider, became champions of the SUD treatments. An addiction medicine physician led the trainings for prescribing medical providers for both of the medications. Only physicians participated in the BUP/NX training, as nurse practitioners and physician assistants were not yet authorized to prescribe this medication. An MI/CBT-expert led the psychotherapy training. After receiving training, the two primary care providers began offering the two medications to eligible patients to identify barriers and to inform development of the clinic-specific protocols [72,73,74]. The behavioral health director did the same with the MI/CBT-based psychotherapy.
Process category 2: Educate at all levels
We provided multiple trainings for prescribing medical providers, behavioral health providers, and general clinic staff on the SUD treatments. Trainings were tailored to specific staff roles within the organization and were as follows:
All clinic providers, administrators, staff at all levels of the organization, and volunteers (approximately 100 staff members and clinic volunteers): A 30-min “all-staff” kick-off meeting that included an overview provided by the researchers of the significance of incorporating SUD treatment into primary care, a review of how clinic workflow would accommodate SUD treatment (i.e., the “future state” workflow), and a brief informative talk by a local, well-respected local psychologist who specializes in integration of SUD treatment in primary care;
Prescribing medical providers: XR-NTX training consisting of 2.5 h of training for all prescribing medical providers (physicians, physician assistants, nurse practitioners) provided by an addiction medicine physician (7 participated in training during the first 18-months); “Provider’s Clinical Support System for Medication-Assisted Treatment (PCSS-MAT)” training on BUP/NX, which required completion of a 3.75-h on-line module followed by 4.25 h of in-person training by an addiction medicine physician and receipt of the X-waiverFootnote 1 for BUP/NX prescribing (7 participated in training during the first 18-months);
Behavioral health providers: A 1-h overview (8 participated in the first 18 months), plus 16 h of training on the MI/CBT-based brief therapy for licensed clinical social workers (LCSWs), conducted by a psychologist with expertise in MI and CBT (5 participated in the first 18 months).
SUD care coordinators (2 care coordinators participated): 8 h of training on care coordination and motivational interviewing techniques provided by the researchers and the MI/CBT expert. The two care coordinators in this study were paraprofessionals who also had other responsibilities at the clinic;
Nurse practitioners and physician assistants (3 and 2, respectively, participated in training during the first 18 months): 1 h of training on administering XR-NTX conducted by an addiction medicine physician;
Clinic pharmacists and pharmacy technicians (4 and 3, respectively, participated): 1-h of training on medications to be provided to patients and pharmacy procedures for administering XR-NTX (BUP/NX was not provided by the clinic pharmacy), conducted by an addiction medicine physician.
Medical assistants, call center staff, discharge coordinators: 1 h of training on SUD screening and referral procedures with two booster trainings and individual trainings for volunteers, who also conducted screenings, conducted by research staff.
We also provided ongoing technical assistance consisting of access to the addiction medicine physician and MI/CBT expert and ongoing support and monitoring of screening, referral and care coordination by research staff.
Process category 3: Restructure delivery systems
Strategy 6: Pre-test protocols using plan-do-study-act (PDSA) cycles, pilot test protocols, complete protocol adaptation
Soon after the treatment protocols were drafted, the champions began implementing the three treatments. That is, the two medical provider champions began to deliver XR-NTX and BUP/NX to eligible, interested patients and the behavioral health champion began providing the MI-based psychotherapy to eligible, interested patients. Although the designated champions initiated delivery, medication administration also involved nurse practitioners (to deliver XR-NTX injections) and pharmacy staff (to dispense and track XR-NTX). Throughout this process, the implementation team made iterative adaptations to the protocols using plan-do-study-act (PDSA) cycles [67,68,69,70], revising the protocols as feedback on implementation was received, and then repeating the cycle. PDSA cycles offer a structured approach to engaging staff in making iterative, feedback-based changes in service delivery [67, 68]. Adaptation of protocols helps ensure the fit of protocols within the organization and can lower resistance from individuals who will be affected by the change in delivery . Of note, prior to the study, the clinic did not conduct screening for SUD, a sizable barrier to implementing treatment. Because the clinic needed to implement screening in order to identify patients with SUD, we included SUD screening in the future state clinic workflow and assisted in its adoption in a similar fashion as the other practices—we began with a screening protocol and tested and revised it using PDSA cycles. After all staff members were trained and protocols were developed (after 10 months of the organizational readiness intervention), we conducted an 8-month pilot study that involved screening and treating patients using draft protocols. Final protocol adaptations were made following the pilot.
Data collection procedures and measures
For the present analysis, we used data from staff surveys conducted before the organizational readiness intervention was executed and 18-months later (and prior to the RCT) to assess changes in acceptability, perceptions of appropriateness and feasibility of, and intention to adopt SUD treatment during this period. The survey included previously developed measures, modifications of previously developed measures, as well as locally developed items. Surveys were web-based; for providers without access to clinic e-mail, we distributed paper and pencil surveys.
(1) Acceptability. Acceptability refers to satisfaction with the complexity or ease of use of a new practice and its effectiveness, or credibility . To measure acceptability we adapted items from Moore and Benbasat’s validated instrument  which measures items that parallel elements of successful diffusion of new practices . Within the acceptability domain, we measured ease of use perceptions among prescribing medical providers (a two-item scale for each of the two medications) and behavioral health providers (the same two-item scale but pertaining to the MI/CBT-based psychotherapy). The two scale items were “overall, I believe that extended-release injectable naltrexone [or other EBP] is easy to use,” and “extended-release injectable naltrexone [or other EBP] is clear and understandable.” Response options ranged from 1, Extremely Disagree, to 7, Extremely Agree (α = 0.96). We also included items from the National Center for Addiction and Substance Abuse’s (CASA) National Survey of Primary Care Physicians and Patients on Substance Abuse ) that capture providers’ opinions about the effectiveness of SUD EBP (one item per EBP) (response options ranged from 1, Not Effective, to 4, Very Effective), as well whether providers find it difficult to discuss SUDs with their patients (two items per EBP) (response options ranged from 1, Very Difficult, to 4, Not at all Difficult). (2) Appropriateness. Appropriateness refers to the compatibility of each EBP with current practices . To measure compatibility of the EBPs with current practices we adapted an item from Moore and Benbasat for each EBP . This item was “I think buprenorphine/naloxone [or other EBP] will fit with the way I like to work.” Response options ranged from 1, Extremely Disagree, to 7, Extremely Agree. We also used locally-developed items to ask about whether providers and general staff believed SUDs could be effectively treated in primary care and the clinic itself, and also asked about fit with the clinic’s mission and values (three items). Response options ranged from 1, Strongly Disagree, to 5, Strongly Agree. (3) Feasibility. Feasibility is the actual fit of an EBP within an organization . We asked about feasibility using items from CASA’s National Survey of Primary Care Physicians and Patients on Substance Abuse  that capture how prepared providers feel about identifying patients with alcohol use disorders (AUD) and opioid use disorders (OUD) (one item for AUD, one for prescription OUD, and one for street OUD/heroin) (response options ranged from 1, Not at all Prepared, to 5, Very Prepared). (4) Intent and/or willingness to adopt the EBP. To measure intention or willingness to adopt, we used the three-item “demonstrability” scale from Moore and Bensabet , which present statements such as “I believe I can communicate to others the consequences of using extended-release injectable naltrexone [or other EBP].” We also asked providers questions about whether they were willing to consider using each of the EBPs in their practice (e.g., I would consider using buprenorphine/naloxone in my practice). Note that for all variables that asked prescribing medical providers about medications, our pre-intervention survey items combined the two medications (XR-NTX and BUP/NX) and referred to “medication-assisted treatment (MAT) for OAUDs,” as providers were not familiar with each medication. Our instructions for these items described the two medications and explained the indications of each; we use this measure as a proxy for the pre-intervention assessment of each medication. For our post-intervention measures, we asked questions about each medication separately. Post-intervention, all prescribing medical providers were asked about XR-NTX, and only physicians (not nurse practitioners or physician’s assistants) were asked about BUP/NX because at the time of the survey only physicians were authorized to prescribe this medication.
To measure changes between the two time points we conducted Wilcoxon signed rank tests. To adjust p-values for multiple tests, we used Benjamini and Hochberg false discovery rate (FDR) correction . We examined responses by type of clinic staff. Due to staff turnover and post-intervention non-response, the sample size varied across variables and percentages are based on the total number of participants who responded both pre- and post-intervention. Due to the very small number of behavioral health providers who completed surveys at both time periods, we do not report on changes in behavioral health providers’ perceptions.
Fifteen of 18 (83%) prescribing medical providers, 8 of 9 (89%) behavioral health providers and 46 of 66 (70%) general clinic staff (medical assistants and clinic coordinators) completed the year 1 survey and 16 of 20 (80%) prescribing medical providers, 8 of 9 (89%) behavioral health providers and 46 of 66 (70%) general clinic staff completed the year 2 survey. Participating staff were mostly female (84%) and Hispanic (70%). More than half of the staff who responded (52%) had been in their current position at the clinic for more than 10 years (see Table 1).
Pre-post organizational readiness intervention results
As shown in Table 2, prescribing medical providers’ perceptions of the acceptability of medication-assisted treatment were fairly low across most domains prior to the intervention execution, with mean scores for ease of use at 3.05 (all prescribing providers) and 2.94 (physicians only), on a 7-point scale (7 = strongly agree with statements about ease of use); mean effectiveness scores ranging from 2.33 to 2.9 on a 4-point scale (4 = very effective); and difficulty of discussing alcohol use and opioid use with patients at 3.25 and 2.67, respectively, on a 4-point scale (4 = not at all difficult).
Among all prescribing providers, ease of use of XR-NTX for alcohol use disorders changed significantly (p < .05) from pre- to post- intervention, with mean scores changing from 3.05 pre- to 4.77 post- intervention, with standard deviations of 1.29 and 1.23, respectively. Changes in perceptions of ease of use of BUP/NX did not change significantly, and mean scores were lower in after the intervention than XR-NTX ease of use scores. Perceptions of the effectiveness of medication for the treatment of alcohol use disorders improved, but changes were not significant after the FDR adjustment for multiple statistical tests. Perceptions of ease of use of BUP/NX and effectiveness of medication for opioid use disorders did not change significantly, but were similar to post-intervention mean scores for XR-NTX effectiveness. Prescribing medical providers’ perceptions of the effectiveness of mental health counseling for either disorder was over the mid-point at both time points and did not change significantly.
In the appropriateness domains, prescribing medical providers’ perceptions of the compatibility of aspects of SUD treatment with primary care varied pre-intervention by the type of treatment, with the mean score for the fit of counseling for patients with alcohol and opioid use disorders at the clinic at 4.42 (the highest), the mean score for whether SUDs could be treated at this clinic at 2.83 (the lowest), on a scale from 1 to 5 (5 = strongly agree with statements about appropriateness in primary care). Among general clinic staff, pre-intervention scores were similar, with scores ranging from 2.94 (fit of providing medications to patients with OAUDs at this clinic) to 3.72 (fit of providing counseling to patients with OAUDs with clinic mission and goals), also on a 5-point scale. With regard to prescribing medical providers’ perceptions of compatibility of MAT with current practices, mean scores were fairly low—3.36 among all prescribing providers and 3.13 among physicians only, on a scale from 1 to 7 (7 = strongly agree with statements about compatibility).
Prescribing medical providers agreed more post-intervention that SUDs could be treated in primary care settings (in general), with mean scores changing significantly (p < .01) on a scale from 1 to 5, with a 5 indicating strong agreement (M = 3.00, SD = .60 pre-intervention; M = 4.26, SD = .87 post-intervention). However, views about whether SUDs could be treated at this clinic did not change. Post-intervention, prescribing providers also thought XR-NTX was more compatible with their current practices than they did pre-intervention, with statistically significant (p < .01) changes in mean scores on a scale from 1 to 5, with 5 indicating a high degree of compatibility (M = 3.36, SD = 1.79 pre-intervention; M = 4.77, SD = 1.22, post-intervention); opinions of compatibility of BUP/NX with current practices, did not change significantly pre- and post-intervention. Prescribing medical providers’ ratings of the fit of counseling for SUDs in primary care with the clinic’s mission and goals were significantly (p < .01) lower post- intervention on a scale from 1 to 5, with a 5 indicating strong agreement with a statement about fit (M = 4.42, SD = .67 pre-intervention; M = 3.67, SD = .98 post-intervention).
Among general clinic staff, views about the appropriateness of SUD treatment changed significantly pre- to post-intervention (p < .01). Post-intervention, staff agreed more with statements suggesting that SUDs could be treated in primary care settings on a scale from 1 to 5, with 5 indicating strong agreement with the statement (M = 3.17, SD = 1.01 pre-intervention; M = 4.06, SD = .76 post-intervention), that SUDs could be effectively treated at this clinic (M = 3.17, SD.98 pre-intervention; M = 3.86, SD = .77 post-intervention), and that providing medications to patients with alcohol or opioid use disorders fit the mission and goals of the clinic (M = 2.94, SD = .97 pre-intervention; M = 3.89, SD = .76 post-intervention). General clinic staff perceptions that providing counseling to patients with alcohol and opioid use disorders fit the clinic’s mission and goals was initially positive and did not change pre- to post-intervention.
Before the organizational readiness intervention, prescribing medical providers’ mean scores on feeling prepared to identify patients with alcohol, heroin and prescription opioid use disorders were 3.0, 3.27 and 3.42, respectively, on a scale from 1 to 4 (4 = very prepared). Post-intervention, prescribing medical providers felt more prepared than at baseline to identify patients with alcohol disorders, but these changes were not statistically significant after the FDR correction.
Intention to adopt
Pre-intervention, prescribing medical providers’ scores were similar for perceived demonstrability, with mean scores of 4.21 (all prescribing providers, XR-NTX) and 4.11 (physicians, BUP/NX), on a scale from 1 to 7 (7 = strongly agree with statements of demonstrability). With respect to whether providers would consider using each medication in their practice, mean scores were 4.09 for XR-NTX and 3.80 for BUP/NX. Post-intervention, prescribing medical providers were more willing to use XR-NTX in their practice but these changes were not statistically significant after the FDR correction. Willingness to use BUP/NX did not change significantly.
We hypothesized that a multi-component implementation intervention aimed at planning, educating providers and staff, and restructuring the care delivery system would lead to greater organizational readiness, measured by four implementation outcome domains: improved perceptions of acceptability, appropriateness, feasibility and intention or willingness to adopt evidence based treatments for OAUDs; these hypotheses were partially supported. Specifically, convening a researcher-clinic implementation team, assessing barriers, resources and workflows, creating future state workflows and protocols tested by champions and in a clinic-wide pilot, providing training and technical assistance to all providers and general clinic staff, adapting workflows and protocols to meet clinic needs, improved perceptions of the appropriateness of treating SUD in primary care among both prescribing medical providers and the general clinic staff and perceptions of the acceptability of XR-NTX among prescribing medical providers. Immediately post-intervention, prescribing medical providers showed greater changes in their perceptions of ease of use and compatibility of XR-NTX with current practice, but no changes with respect to perceptions of BUP/NX ease or compatibility. Prescribing medical providers’ intention to adopt XR-NTX also increased after the organizational readiness intervention, but changes were not significant after the FDR correction. General clinic staff had significant improvements in their opinions about the appropriateness of SUD treatment in primary care on three of three measures – that SUDs can be effectively treated in primary care, that SUDs can be effectively treated at this clinic, and that providing medications for alcohol or opiate use disorders fits the clinic’s mission and goals. These results suggest that the organizational readiness intervention was successful at changing at least some important implementation outcomes, which are theoretically associated with the adoption of new practices .
Prescribing medical providers’ opinions changed significantly in a negative direction with respect to their belief that providing counseling to patients with alcohol and opioid use disorders fit with the clinic’s mission and goals. This may have been because during the organizational readiness intervention period, prescribing medical providers incorrectly perceived that the question about counseling pertained to prescribing medical providers providing counseling, instead of behavioral health providers. Interestingly, opinions of general clinic staff about the fit of providing counseling for opioid and alcohol use disorders did not change significantly, but the mean score was already higher (i.e., supporting the idea that counseling was a good fit) than the mean scores of the variables that did change. Although general clinic staff will not directly “adopt” the SUD treatments, they do play an important role in screening patients and making appointments for patients seeking SUD treatment; implementation theory suggests that ultimately opinions and buy-in of staff at all levels of the organization could affect overall adoption of SUD treatment at the clinic .
Although our hypotheses generally were supported, the findings were somewhat nuanced. First, although prescribing medical providers and general staff opinions improved with regard to the appropriateness of providing SUD treatment in primary care in general, prescribing medical providers’ opinions about the appropriateness of providing SUD treatment at their particular clinic did not change significantly. Further, and perhaps related to this, while the findings suggest that the intervention we employed may have improved prescribing medical providers' readiness in the “acceptability” and “appropriateness” domains to deliver XR-NTX to patients with alcohol use disorders, the intervention did not improve readiness in those domains for the use of BUP/NX to treat opioid disorders, despite providers having treatment protocols that were adapted for their setting and extensive training. It is possible that views about treating patients with SUDs in general and about using BUP/NX to treat patients with opioid use disorders could improve with hands-on experience treating patients. Further, although the change was not statistically significant, prescribing medical providers’ opinions about the demonstrability of BUP/NX actually changed in a negative direction after the 18 months of the intervention. While we do not know the reasons for the perceived differences between XR-NTX and BUP/NX, it may be that the need to get a DEA waiver to prescribe BUP/NX, the DEA requirement that providers maintain a list of all patients being prescribed BUP/NX and participate in DEA audits, and that the clinic pharmacy does not include narcotics on the clinic formulary, influenced perceptions of BUP/NX’s acceptability and appropriateness for the clinic. Further, it is also possible that opinions will change after implementation of the service delivery intervention, with champions continuing to prescribe BUP/NX and more patients with OAUDs being referred to prescribing medical providers for treatment.
Importantly, prescribing medical providers’ views of the feasibility of and their intention to adopt either XR-NTX or BUP/NX did not change after we adjusted for multiple statistical tests, although there was a trend towards providers perceiving XR-NTX as more feasible and being willing to adopt this practice. The lack of statistical significance may be because of the small sample size and need to correct for multiple comparisons, or because additional interventions are needed to change these readiness outcomes.
Of note, although this study was designed to increase the clinic’s capacity (i.e., infrastructure) to deliver SUD treatment, which can affect adoption of new practices [45, 81, 82], we did not objectively measure organizational capacity. However, providers’ perceptions of whether the treatments are acceptable and appropriate may reflect perceptions of capacity. As noted by Weiner et al. (2008), to be motivated and willing to implement a new practice, individuals must believe that they and their organizations are capable of delivering an intervention . As health care organizations attempt to integrate SUD and other EBPs, it may be important for implementation interventions to explicitly address capacity as part of improving organizational readiness. Health care organizations must also consider the feasibility of implementing the organizational readiness intervention itself, and some adaptation (for example, in meeting frequency, number of providers invited to attend training, length of training) may be needed to fit individual settings.
This study has some limitations. First, we used a pre-post design, at a single FQHC, with no control group. Therefore, our findings cannot be solely attributed to the organizational readiness intervention, as there may have been other changes in or outside of the clinic or external environment that influenced findings. Generalizability to other FQHCs and other primary care settings is limited, as organizational culture and patient populations may differ across different types of primary care practices. Future study of the effects of the intervention on organizational readiness, including measures of organizational functioning (e.g., turnover, morale), in a larger, randomized sample of primary care clinics is needed. We describe our findings using central tendency statistics (means and standard deviations) for ease of interpretation, but caution should be used in interpreting the results because of the small sample sizes. Because there are few validated measures of implementation outcomes, we included some locally developed items and items from scales that have not been validated. In addition, in our pre-intervention survey, the two medications were combined and compared with follow-up measures that asked about each medication separately. We tested a bundled intervention that comprised of several different implementation strategies designed to enhance organizational readiness, and cannot separate the effects of each strategy. Finally, because we believe that perceptions of acceptability, appropriateness and feasibility, as well as intent to adopt continue to improve as staff and providers see patients benefitting from receiving treatment for their OAUD, we do not view these outcomes as final measures of the effectiveness of the organizational readiness intervention or as final indicators of the readiness of prescribing medical providers to adopt either medication.
We found that an organizational readiness intervention consisting of multiple theoretically grounded implementation strategies aimed at the entire organization, improved some implementation outcomes related to integrating treatment for OAUDs in primary care, but not all. There were differences in prescribing medical providers' perceptions of XR-NTX and BUP/NX, and providers generally saw treating patients with alcohol use disorders with XR-NTX as more acceptable and appropriate than treating patients with opioid use disorders with BUP/NX immediately after 18-months of the intervention. Additional work may be needed to prepare primary care providers to treat patients with OUDs and to adopt BUP/NX. These results demonstrate the value of incorporating several implementation strategies to build support for implementation of SUD treatment in primary care settings.
In the U.S., medical providers are permitted to dispense or prescribe approved Schedule III, IV, and V narcotic medications (i.e., those that have a lower risk for abuse, like buprenorphine/naloxone) in settings other than an opioid treatment program (OTP). In order to prescribe or dispense buprenorphine, medical providers must qualify for an “X-waiver” which includes completing 8 h of required training and applying for the wavier with the drug enforcement agency (DEA) .
Alcohol use disorder
Center for addiction and substance abuse
Cognitive behavioral therapy
Drug enforcement agency
Food and drug administration
Federally Qualified Health Center
Human subject protection committee
National institute on drug abuse
Opioid and alcohol use disorders
Opioid use disorder
Provider’s clinical support system for medication-assisted treatment
Patient protection and affordable care act
Randomized controlled trial
Substance use disorder
Substance use, motivation and medication integrated treatment
Schackman BR, et al. Cost-effectiveness of long-term outpatient buprenorphine-naloxone treatment for opioid dependence in primary care. J Gen Intern Med. 2012;27(6):669–76.
Myles J, Law F, Raybould T. A double-blind randomised controlled trial of buprenorphine/naloxone (suboxone) versus methadone/lofexidine for the detoxification of opiate-dependent addicts. Drug Alcohol Depend. 2000;60(Suppl 1):S156.
Tofighi B, et al. Outcomes among buprenorphine-naloxone primary care patients after hurricane Sandy. Addict Sci Clin Pract. 2014;9:3.
Mauger S, Fraser R, Gill K. Utilizing buprenorphine-naloxone to treat illicit and prescription-opioid dependence. Neuropsychiatr Dis Treat. 2014;10:587–98.
Drainoni ML, et al. Patient perspectives of an integrated program of medical care and substance use treatment. AIDS Patient Care STDs. 2014;28(2):71–81.
Doolittle B, Becker W. A case series of buprenorphine/naloxone treatment in a primary care practice. Subst Abus. 2011;32(4):262–5.
Balhara YP. Time to include buprenorphine-naloxone combination in the WHO model list of essential medicines. J Opioid Manag. 2014;9(4):237.
Aspy C, et al. Integrating screening and interventions for unhealthy behaviors into primary care practices. Am J Prev Med. 2008;35(Suppl):S373–80.
Bradley KA, et al. Implementation of evidence-based alcohol screening in the veterans health administration. Am J Manag Care. 2006;12(10):597–606.
Boldt R. Obstacles to the development and use of pharmacotherapies for addiction. J Health Care L & Policy. 2010;13:1–6.
Friedmann P, et al. Screening and intervention for alcohol problems: A national survey of primary care physicians and psychiatrists. J Gen Intern Med. 2000;15(2):84–91.
Pilowsky DJ, Wu LT. Screening for alcohol and drug use disorders among adults in primary care: a review. Subst Abuse Rehabil. 2012;3(1):25–34.
Cherpitel CJ, Ye Y. Trends in alcohol- and drug-related emergency department and primary care visits: data from four U.S. national surveys (1995-2010). J Stud Alcohol Drugs. 2012;73(3):454–8.
Blackwell D, Lucas J, Clarke T. Summary health statistics for U.S. adults: National Health Interview Survey, 2012. Vital Health Stat. 2014;10(260):1-161.
U.S. Department of Health and Human Services Health Resources and Services Administration. The Affordable Care Act and health centers. 2013 [cited 22 Jan 2015]; Available from: http://bphc.hrsa.gov/about/healthcenterfactsheet.pdf.
Glied S, Ma S. How will the affordable care act affect services? In Issue Brief, T.C. Fund, Editor. New York and Washington, D.C: The Commonwealth Fund; 2015.
Substance Abuse and Mental Health Services Administration, results from the 2013 national survey on drug use and health: summary of national findings, NSDUH series H-46, HHS publication no. (SMA) 14–4863. Substance Abuse and Mental Health Services Administration: Rockville, MD 2014.
Fortney J, et al. Factors associated with perceived stigma for alcohol use and treatment among at-risk drinkers. J Behav Health Serv Res. 2004;31(4):418–29.
Luoma JB, et al. Stigma predicts treatment length in residential substance use disorder treatment. Am J Drug Alcohol Abus. 2014;40:206–12.
Rapp RC, et al. Treatment barriers identified by substance abusers assessed at a centralized intake unit. J Subst Abus Treat. 2006;30(3):227–35.
Amaral-Sabadini MB, Saitz R, Souza‐Formigoni ML. Do attitudes about unhealthy alcohol and other drug (AOD) use impact primary care professionals’ readiness to implement AOD-related preventive care? Drug Alcohol Rev. 2010;29(6):655–61.
Urada D, et al. Integration of substance use disorder services with primary care: health center surveys and qualitative interviews. Subst Abuse Treat Prev Policy. 2014;9:15.
Quest TL, et al. Buprenorphine therapy for opioid addiction in rural Washington: the experience of the early adopters. J Opioid Manag. 2012;8(1):29–38.
DeFlavio JR, et al. Analysis of barriers to adoption of buprenorphine maintenance therapy by family physicians. Rural Remote Health. 2015;15:3019.
Padwa H, et al. Integrating substance use disorder services with primary care: the experience in California. J Psychoactive Drugs. 2012;44(4):299–306.
Padwa H, et al. Barriers to serving clients with co-occurring disorders in a transformed mental health system. Psychiatr Serv. 2015;66(5):547–50.
Rogers E. Diffusion of innovations. 4th ed. New York: The Free Press; 1995.
Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379–436.
Damschroder LJ, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Grol R, et al. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Quarterly. 2007;85(1):93–138.
Shanafelt TD, et al. Potential impact of burnout on the US physician workforce. Mayo Clin Proc. 2016;91(11):1667–8.
Linzer M, et al. Predicting and preventing physician burnout: results from the United States and the Netherlands. Am J Med. 2001;111(2):170–5.
Shaw RJ, et al. Organizational factors associated with readiness to implement and translate a primary care based telemedicine behavioral program to improve blood pressure control: the HTN-IMPROVE study. Implement Sci. 2013;8:106.
Bandura A. Self-efficacy: towards unifying theory of behavioral change. Psychol Rev. 1977;84:191–215.
Amatayakul M. EHR? Assess readiness first. Healthc Financ Manage. 2005;59(5):112–3.
Cassidy J. System analyzes readiness for integrated delivery. Health Prog. 1994;75(3):18–20. 22
Hardison C. Readiness, action, and resolve for change: do health care leaders have what it takes? Qual Manag Health Care. 1998;6(2):44–51.
O’Connor EJ, Fiol CM. Creating readiness and involvement. Physician Exec. 2006;32(1):72–4.
Greenhalgh T, et al. Diffusion of innovations in service review organizations: systematic review and recommendations. Millbank Quarterly. 2004;82(4):581–629.
Aarons GA, Sommerfeld DH, Walrath-Greene CM. Evidence-based practice implementation: the impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice. Implement Sci. 2009;4:83.
Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Admin Pol Ment Health. 2011;38(1):4–23.
Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.
Lehman WE, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abus Treat. 2002;22(4):197–209.
Glisson C, et al. Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Admin Pol Ment Health. 2008;35(1–2):98–113.
Scaccia JP, et al. A practical implementation science heuristic for organizational readiness: R = MC. J Community Psychol. 2015;43(4):484–501.
Fuller BE, et al. Organizational readiness for change and opinions toward treatment innovations. J Subst Abus Treat. 2007;33(2):183–92.
Gotham HJ, et al. Increasing program capability to provide treatment for co-occurring substance use and mental disorders: organizational characteristics. J Subst Abus Treat. 2009;38(2):160–9.
Saldana L, et al. The organizational readiness for change scale in adolescent programs: criterion validity. J Subst Abus Treat. 2007;33(2):159–69.
Simpson DD, Joe GW, Rowan-Szal GA. Linking the elements of change: program and client responses to innovation. J Subst Abus Treat. 2007;33(2):201–9.
Proctor E, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.
Ober AJ, et al. An organizational readiness intervention and randomized controlled trial to test strategies for implementing substance use disorder treatment into primary care: SUMMIT study protocol. Implement Sci. 2015;10
Lee JD, et al. Extended-release naltrexone plus medical management alcohol treatment in primary care: findings at 15 months. J Subst Abus Treat. 2012;43(4):458–62.
Garbutt JC, et al. Efficacy and tolerability of long-acting injectable naltrexone for alcohol dependence: a randomized controlled trial. JAMA. 2005;293(13):1617–25.
Kranzler H, Wesson D, Billot L. Drug abuse sciences: Naltrexone depot study group. Naltrexone depot for treatment of alcohol dependence: a multicenter, randomized, placebo-controlled clinical trial. Alcohol Clin Exp Res. 2004;28:1051–9.
Krupitsky E, et al. Injectable extended-release naltrexone (XR-NTX) for opioid dependence: long-term safety and effectiveness. Addiction. 2013;108(9):1628–37.
Hartung DM, et al. Extended-release naltrexone for alcohol and opioid dependence: a meta-analysis of healthcare utilization studies. J Subst Abus Treat. 2014;47(2):113–21.
Miller WR, Benefield RG, Tonigan JS. Enhancing motivation for change in problem drinking: a controlled comparison of two therapist styles. J Consult Clin Psychol. 1993;61(3):455–61.
Miller WR, Sanchez VC. Motivation of young adults for treatment and lifestyle change. In: Howard G, editor. Issues in alcohol use and misuse by young adults. Notre Dame, IN: University of Notre Dame Press; 1994. p. 55–82.
Miller WR, et al. Motivational Enhancement Therapy: A clinical research guide for therapists treating individuals with alcohol abuse and dependence, National Institute on Alcohol Abuse and Alcoholism. National Institutes of Health: Rockville; 1994.
Ball SA, et al. Site matters: multisite randomized trial of motivational enhancement therapy in community drug abuse clinics. J Consult Clin Psychol. 2007;75(4):556–67.
Powell BJ, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57.
Leeman J, et al. What strategies are used to build practitioners' capacity to implement community-based interventions and are they effective?: a systematic review. Implement Sci. 2015;10:80.
Wandersman A, Chien VH, Katz J. Toward an evidence-based system for innovation support for implementing innovations with quality: tools, training, technical assistance, and quality assurance/quality improvement. Am J Community Psychol. 2012;50(3–4):445–59.
Fixsen DL, et al. Implementation Research: A Synthesis of the Literature. New York and Washington D.C: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231); 2005.
Chinman M, et al. Intervening with practitioners to improve the quality of prevention: one-year findings from a randomized trial of assets-getting to outcomes. J Prim Prev. 2013;34(3):173–91.
Acosta J, et al. An intervention to improve program implementation: findings from a two-year cluster randomized trial of assets-getting to outcomes. Implement Sci. 2013;8:87.
Deming W. Out of the crisis, 1986, vol. 507. Cambridge, MA: Massachusetts Institute of Technology Center for Advanced Engineering Study iii; 1991.
Berwick DM. Developing and testing changes in delivery of care. Ann Intern Med. 1998;128(8):651–6.
Chinman M, Hunter S, Ebener P. Employing continuous quality improvement in community-based substance abuse programs. Int J Health Care Qual Assur. 2012;25(7):606–17.
Hunter SB, et al. Promoting success: a getting to outcomes guide to implementing continuous quality improvement for community service organizations. Santa Monica: RAND Corporation; 2015.
Weiner BJ, Lewis MA, Linnan LA. Using organization theory to understand the determinants of effective implementation of worksite health promotion programs. Health Educ Res. 2009;24(2):292–305.
Heinzerling KG, et al. SUMMIT: Procedures for Medication-Assisted Treatment of Alcohol or Opioid Dependence in Primary Care. Santa Monica: RAND Technical Manual R. Corporation; 2016.
Osilla K, et al. Brief treatment for substance use disorders: a guide for behavioral health providers. Santa Monica: R. Corporation; 2016.
Ober AJ, et al. SUMMIT study protocol: step-by-step procedures for providing screening, brief intervention and treatment services to primary care patients with alcohol or Opioid use disorders. Santa Monica: R. Corporation. In Press.
Beidas R, Kendall P. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol. 2010;17:1–30.
Hunter S, et al. Technical assistance as a prevention capacity-building tool: a demonstration using the getting to outcomes framework. Health Educ Behav. 2009;36:810–28.
Chinman M, et al. The getting to outcomes demonstration and evaluation: an illustration of the prevention support system. Am J Community Psychol. 2008;41:206–24. PMCID: PMC2964843
Moore G, Benbasat I. Development of an instrument to measure the perceptions of adopting an information technology innovation. Inf Syst Res. 1991;2(3):192–222.
CASA Columbia, Missed Opportunity: Survey of Primary Care Providers and Patients on Substance Abuse. New York and Washington D.C: CASA Columbia; 2000.
Benjamini Y, Hochberg Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J R Stat Soc Series B-Methodological. 1995;57(1):289–300.
Simpson DD, Dansereau DF. Assessing organizational functioning as a step toward innovation. Sci Pract Perspect. 2007;3(2):20–8.
Meyer AM, Davis M, Mays GP. Defining organizational capacity for public health services and systems research. J Public Health Manag Pract. 2012;18(6):535–44.
Substance Abuse and Mental Health Services Administration. Buprenorphine Waiver Management. Medication-Assisted Treatment 2016 [cited 20 Dec 2016]; Available from: https://www.samhsa.gov/medication-assisted-treatment/buprenorphine-waiver-management.
We acknowledge all providers and staff at the Venice Family clinic for their contributions to and participation in the study. We thank the SUMMIT team, including Kirsten Becker and the RAND Survey Research Group, David Devries, Scot Hickey and Tiffany Hruby for their contributions to carrying out the study. We acknowledge the National Institute on Drug Abuse (NIDA) for funding the study under 1R01DA034266 and Alkermes for provision of extended-release injectable naltrexone for study patients. We also acknowledge the SUMMIT Scientific Advisory Board for their input on the study design and protocols: Frank de Gruy; Adam Gorden; Miriam Komaromy; Tom McLellan; Harold Pincus; Rick Rawson; Richard Saitz; Jurgen Unutzer.
This research was funded by National Institute on Drug Abuse (NIDA) R01DA034266 (PI: Watkins).
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study protocol was approved by the RAND Human Subjects Protection Committee (HSPC). HSPC-approved information sheets which contained all elements of informed consent preceded electronic and paper surveys; completion of the electronic survey indicated “electronic consent” and completion of the paper survey indicated “implied” consent. No individual patient data are reported.
Consent for publication
Financial competing interests.
The authors are employees of The RAND Corporation (“RAND”), a nonprofit institution that helps improve policy and decisionmaking through research and analysis. Within the past 3 years, RAND has received funding for research projects from Alkermes plc (“Alkermes”) relating to the pharmaceutical Vivitrol, which is manufactured and sold by Alkermes. Allison Ober participated in RAND research projects funded by Alkermes. Katherine Watkins participated in RAND research projects funded by Alkermes and served as Principal Investigator. To the extent that this paper suggests a benefit related to greater provider acceptance of Vivitrol, this finding may have a positive financial effect on Alkermes. Prior to submission, RAND conducted additional internal quality reviews of this article with a particular focus on the possibility of bias.
Alkermes provided Vivitrol at no charge to certain patients participating in this study. This arrangement was disclosed and approved by the National Institutes of Health project officer.
Non-financial competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Ober, A.J., Watkins, K.E., Hunter, S.B. et al. Assessing and improving organizational readiness to implement substance use disorder treatment in primary care: findings from the SUMMIT study. BMC Fam Pract 18, 107 (2017) doi:10.1186/s12875-017-0673-6
- Implementation intervention
- Organizational readiness
- Evidence-based substance use disorder treatment
- Primary care
- Collaborative care
- Care coordination
- Medication-assisted treatment
- Extended-release injectable naltrexone
- Motivational interviewing