- Research article
- Open Access
- Open Peer Review
The impact of a prescription review and prescriber feedback system on prescribing practices in primary care clinics: a cluster randomised trial
BMC Family Practice volume 19, Article number: 120 (2018)
To evaluate the effectiveness of a structured prescription review and prescriber feedback program in reducing prescribing errors in government primary care clinics within an administrative region in Malaysia.
This was a three group, pragmatic, cluster randomised trial. In phase 1, we randomised 51 clinics to a full intervention group (prescription review and league tables plus authorised feedback letter), a partial intervention group (prescription review and league tables), and a control group (prescription review only). Prescribers in these clinics were the target of our intervention. Prescription reviews were performed by pharmacists; 20 handwritten prescriptions per prescriber were consecutively screened on a random day each month, and errors identified were recorded in a standardised data collection form. Prescribing performance feedback was conducted at the completion of each prescription review cycle. League tables benchmark prescribing errors across clinics and individual prescribers, while the authorised feedback letter detailed prescribing performance based on a rating scale. In phase 2, all clinics received the full intervention. Pharmacists were trained on data collection, and all data were audited by researchers as an implementation fidelity strategy. The primary outcome, percentage of prescriptions with at least one error, was displayed in p-charts to enable group comparison.
A total of 32,200 prescriptions were reviewed. In the full intervention group, error reduction occurred gradually and was sustained throughout the 8-month study period. The process mean error rate of 40.7% (95% CI 27.4, 29.5%) in phase 1 reduced to 28.4% (95% CI 27.4, 29.5%) in phase 2. In the partial intervention group, error reduction was not well sustained and showed a seasonal pattern with larger process variability. The phase 1 error rate averaging 57.9% (95% CI 56.5, 59.3%) reduced to 44.8% (95% CI 43.3, 46.4%) in phase 2. There was no evidence of improvement in the control group, with phase 1 and phase 2 error rates averaging 41.1% (95% CI 39.6, 42.6%) and 39.3% (95% CI 37.8, 40.9%) respectively.
The rate of prescribing errors in primary care settings is high, and routine prescriber feedback comprising league tables and a feedback letter can effectively reduce prescribing errors.
National Medical Research Register: NMRR-12-108-11,289 (5th March 2012).
Adverse drug events (ADEs) are one of the important causes of morbidity and mortality in primary care [1,2,3]. Such adverse events are frequently associated with medication errors [4,5,6], which can occur during any step of the medication use process–prescribing, transcribing, dispensing, administration, and monitoring . Prescribing, the first stage in the medication use pathway, is most often the source of a series of drug-related problems in the healthcare system. A systematic review in 2007 reported that the largest proportion of errors in ambulatory care originated in the prescribing stage, accounting for 64.7% of all preventable ADEs, and 56.0% of preventable ADEs resulting in hospital admission .
Medication safety in primary care is considerably important, as primary care clinics are increasingly responsible for complex medication regimens, and a large portion of medical encounters are with government primary care practices . However, despite primary care services playing an integral part of the healthcare delivery, quality improvement programs are less widespread in ambulatory settings compared to inpatient settings. Given that prescribing errors are theoretically preventable, interventions should target errors in prescribing .
Several published articles have described programs designed to improve physician prescribing behaviour. Recent reviews suggest that, in order to change prescribing behaviour, an active intervention is required [10,11,12,13,14]. Implementation research has also revealed the ineffectiveness of passive strategies such as printed education materials on actual prescribing behaviour, while relatively more active strategies such as audit with on-going feedback have shown greater promise in certain types of prescribing practices [11, 15]. However, the positive impact of audit with feedback was inconclusive [16, 17]. A Cochrane systematic review in 2006  and the updated review in 2012  concluded that the impact of audit and feedback on professional practice is small but potentially important, and is affected by the feedback delivery mechanism.
There is relatively little research about improving prescribing practice in primary care. As providing feedback is proven useful for changing behaviour, we aimed to design a prescription review and prescriber feedback program and to evaluate its effectiveness on improving prescribing practices in government primary care clinics. We designed the study to minimally change daily practices as the ultimate aim was to improve prescribing quality in the primary care system nationwide.
Study design and participants
We conducted a three-group pragmatic cluster randomised controlled trial among government primary care clinics with pharmacists in Perak, Malaysia. We chose a cluster design because the intervention was applied at the health clinic level. Of a total 79 government health clinics in Perak providing primary care services, 55 clinics with pharmacists were identified for the study, as the intervention involved prescription review by pharmacists. Excluded were health clinics with electronic prescribing systems, as the quality of computerised prescribing differed from that of manual prescribing . Primary care prescribers of the remaining 51 health clinics were the target of this pragmatic intervention. We included prescribers of different expertise levels: family medicine specialists, medical officers, and medical assistants, all who routinely prescribe medications to patients in the primary care setting. Handwritten prescriptions of these prescribers were prospectively reviewed by pharmacists to screen for prescribing errors.
This pragmatic trial was conducted over eight months in two phases (May to December 2012). In phase 1 (May to August 2012), health clinics were randomised into one of three groups to receive either a) full feedback intervention [structured prescription review and prescribing performance feedback (league tables and authorised feedback letter)], b) partial feedback intervention [structured prescription review and prescribing performance feedback (league tables only)], or c) usual care as control (structured prescription review only). Prescription data collected in May 2012 represented the baseline data for the study. Interventions based on group allocation were implemented after the collection of baseline data. At the end of this phase, the prescribing performance of these three groups were compared to determine the intervention’s effect on error rates. In phase 2 (September to December 2012), all study groups received full feedback intervention, and prescribing performance was monitored until the end of the phase. In December 2012, the last batch of prescribing performance feedback was sent to prescribers and the trial ended. See Fig. 1 for the trial methodology flow chart of the trial.
Allocation and blinding
In Perak, the 51 eligible health clinics come under the administration purview of ten health districts, each headed by a district health officer. Therefore, for the purpose of implementing the intervention program, we stratified the ten health districts by size (large: ≥6 health clinics, small: < 6 health clinics) and randomly allocated them in a 1:1:1 ratio to three parallel groups: full intervention group (full feedback intervention), partial intervention group (partial feedback intervention), and control group (usual care) by simple randomisation. Stratification by district size was to obtain an even distribution of large and small districts in each study group.
Due to the nature of the community interventions, it was not possible to blind neither the pharmacists nor the prescribers. The prescribers in the full and partial intervention groups were aware of the interventions when the first batch of prescribing performance feedback was mailed to them after the collection of baseline data. It was also not possible to blind the data analyst because the intervention program was implemented continuously and monthly feedback was provided to prescribers. However, the intervention assignments were concealed to the pharmacists and prescribers prior to randomisation.
Prescription review and prescriber feedback program
As a pragmatic trial, state managers and clinicians were engaged throughout the study design, especially with designing the intervention program and its implementation work flow. The intervention program consists of two core components: a) structured prescription review and b) prescribing performance feedback containing two items: i) league tables and ii) authorised feedback letter. The structured prescription review component is built upon the basic duty of pharmacists—review prescriptions presented to them and intervene when necessary to ensure that prescriptions are therapeutically appropriate for patients. As this component closely resembles the pharmacist’s daily professional practice, it is therefore considered as ‘usual care’, albeit more structured and standardised (see Structured prescription review by pharmacists and Training of pharmacists).
Structured prescription review by pharmacists
Structured prescription review was conducted monthly by pharmacists in the health clinics. This process was conducted in accordance with a structured protocol prepared by the researchers; pharmacists were specially trained to conduct comprehensive prescription reviews (see Training of pharmacists), and researchers regularly audited this process to ensure its quality throughout the study. Handwritten prescriptions of prescribers in eligible clinics were consecutively collected by pharmacists and screened for errors. Pharmacists were required to collect 20 prescriptions per prescriber for up to five working days, starting from a randomly selected date in each month. To ensure that all prescription reviews were consistently conducted across health clinics, we constructed a standardised form for data collection. Errors identified in the prescriptions were recorded in the Prescribing Error Record Form (see Additional file 1). The definition of a prescribing error was adapted from that of Dean et al. . The prescriptions were checked for: incomplete patient and prescriber information, incomplete dosing regimen (duration/quantity, dose, frequency, dosage form, strength), illegibility, use of non-standard abbreviations, inappropriate/incorrect dosing regimen (dose, frequency, duration, dosage form), polypharmacy, medication duplicity, and contraindications. These errors were subcategorised into drug errors, information errors, and administrative errors (Table 1). Prescribing errors that do not fall into any of the predefined subcategories were categorised as other errors. The Prescribing Error Record Form, along with photocopied prescriptions, were delivered to the researchers for data entry, analysis, and generation of prescribing performance feedback for prescribers. As an implementation fidelity strategy, each prescription was re-evaluated for errors by the researchers . Errors missed or wrongly identified during this process were promptly corrected by the researchers, and communicated to the pharmacists via email. This strategy was conducted to improve subsequent data collection by pharmacists.
Prescribing performance feedback to prescribers
At the completion of each prescription review cycle, data on prescribing errors recorded in the Prescribing Error Record Form were analysed to generate personalised performance feedback reports for prescribers. The first batch of prescribing performance feedback was mailed to prescribers using the baseline data in May 2012. The prescribing performance feedback reports included two items. The first item was a graphical presentation of prescribing performance data—league tables (bar charts) displaying the percentage of prescribing errors at the health district, health clinic levels, as well as of individual prescribers (see Additional file 2). The specific types of prescribing error were also displayed in this item. The second item was an authorised feedback letter detailing individual prescribing error rate and prescribing performance based on a performance rating scale (see Additional File 3) . This scale consisted of five levels of performance: excellent (top 10% of scale), good (top 11–30% of scale), average (middle 40% of scale), below average (bottom 11–30% of scale), and poor (bottom 10% of scale). Trends in prescribing errors were also shown in this item. Prescribing performance feedback reports were mailed to individual prescribers within two weeks of completion of each prescription review cycle. There were two exceptions—prescribing performance feedback reports for September and November were delivered to prescribers together with the reports for October and December, respectively (e.g. prescribing performance feedback reports in October contains data for September and October). The delay in the delivery of prescribing performance feedback reports was because the computer-generated dates for prescription review of the consecutive months were in close proximity; thus there was insufficient time to generate and mail reports to prescribers before the next structured prescription review cycle. To ensure that appropriate actions were taken to improve prescribing practice, a summary prescribing performance feedback report was also mailed to the district health officer of each health district, who is responsible for the administrative overview of the health district.
Training of pharmacists
We provided training to pharmacists on prescription review, data collection, and document delivery. The training was done over three sittings, with different pharmacists according to health districts as per group allocation, to avoid treatment contamination between study groups. Pharmacists were trained on standard operating procedures, the types of prescribing errors, and the data collection process. Each pharmacist received a folder containing essential documents for the study, which included a) instructions and a flow chart on data collection and document delivery, b) operational definitions and examples of the specific types of prescribing error, c) prescriber code list containing unique identification codes for each prescriber, d) copies of the Prescribing Error Record Form, and e) researchers’ contact details. A test was administered after the training to determine the competency of pharmacists in identifying and recording prescribing errors. A set of four prescriptions with and without errors was given to each pharmacist, and each were asked to identify and record errors into the Prescribing Error Record Form. All pharmacists were required to achieve the passing mark of 85%, and those who failed received re-training until they passed the test.
Sampling method and sample size
Using multi-stage sampling, we sampled prescriptions for review. First, we randomly selected a date in each month from a list of random numbers generated using EpiCalc 2000 . This randomly selected day is the first of the five prescription collection days. Following this, we consecutively sampled prescriptions from all eligible prescribers for review.
We estimated that a minimum of 20 prescriptions per prescriber was sufficient to determine the percentage of prescribing errors each month, based on the number of prescriptions to be collected for each prescriber, the sampling unit. Assuming the percentage of errors in the average prescriber was 45% , the minimum errors to be detected was 15% (null hypothesis), a significance level of 5% and a power of 90%, the required sample was 19. No drop out was expected as all handwritten prescriptions were consecutively collected by pharmacists. Therefore, the number of prescriptions per prescriber to be collected was 20.
The primary outcome was the percentage of prescriptions with at least one error. To evaluate the impact of the prescription review and prescriber feedback program on prescribing errors, we calculated the mean percentage error for phases 1 and 2 for each study group (see formula below). Secondary outcomes included a) the percentage of prescriptions with at least one drug error, information error, or administrative error, and b) the percentage of prescriptions with a specific type of error within each error subcategory. The denominator for calculating all percentages was the total number of prescriptions reviewed in that month.
Data gathered at the end of each month was entered into SPSS version 20.0 (IBM Corp., Armonk NY) for analysis. Further statistical analysis was performed using Stata V.11 statistical software. Categorical data were presented as frequency with percentages and 95% confidence intervals. Continuous data were summarised as means with standard deviations if approximately normally distributed, or median and interquartile ranges if otherwise.
To enable the comparison of outcomes between study groups, the primary outcome, the percentage of prescriptions with error, was displayed in a statistical process control (SPC) chart [26,27,28]. The p-chart (p stands for proportion) was chosen because the outcome measure was binary (error versus no error) and the number of prescriptions with error and no error was known, with varying number of prescriptions (sample size) at each time point [26, 29]. The p-charts were constructed using data exported to Microsoft Excel.
This study was approved by the National Medical Research and Ethics Committee of the Ministry of Health Malaysia ((2) dlm.KKM/NIHSEC/08/0804/P12–186). In addition, permission to conduct the study was obtained from the state health director of Perak, who was in charge of public health administrative issues in the state. Confidentiality of information in the prescription was crucial, and no identifiable information on the prescription was recorded. To ensure confidentiality, names of the prescribers were not disclosed to individuals not involved in the intervention. Each prescriber was assigned a unique identification code, encrypted to preserve anonymity. Prescribers were not informed in advance about this study to prevent practice bias. Therefore, no informed consent was obtained from prescribers. However, errors identified by pharmacists during the study were communicated to the prescribers as part of their daily legal, professional, and ethical responsibilities to patients.
Study group characteristics
The characteristics of the three study groups during the 8-month study period are summarised in Table 2. The full intervention group had a larger number of health clinics, as two of the four health districts in this group were large; this is also reflected in the volume of prescribers and prescriptions in this group.
Volume of prescription review
Figure 2 shows the volume of prescribers evaluated and prescriptions screened monthly in the three study groups. Over the 8-month study period, a total of 32,220 prescriptions were reviewed by the pharmacists. On average, more than 1000 prescriptions were reviewed and approximately 60% of prescribers were evaluated each month in each study group. We were not able to conduct prescription review for some prescribers as no prescriptions were written by them during the 5-day prescription collection window, and therefore these prescribers are not included in the analysis for that particular time point. These prescribers were on leave, did not see patients as frequently due to delegation of other work duties, or away from the clinic during the prescription review period.
Baseline prescribing error rate
The prescribing error rate in the first month of the study represented the baseline error rate. In this month, a total of 4280 prescriptions were reviewed in all three study groups, and of these, 2055 were found to have prescribing errors. This gives an overall prescribing error rate of 48.0% (95% CI 46.5, 49.5) at baseline.
Comparison of prescribing trend between study groups
To compare prescribing performance between the study groups, we applied the p-chart to illustrate the impact of the prescription review and prescriber feedback program on the percentage of prescribing errors. Figure 3 compares the aggregate p-charts of the study groups over the 8-month study period. Study phases and interventions are directly annotated onto the charts.
In the full intervention group, the p-chart illustrated a positive impact of the intervention program on the prescribers (Fig. 3a). Overall, reduction in the percentage of errors occurred gradually and was sustained throughout the study period. The phase 1 p-chart indicated an average percentage of errors (central line) of 40.7% (95% CI 27.4, 29.5%). There is common-cause (random) variation in both phases 1 and 2, but less variability and more process stability was observed in the latter. There was an out-of-control episode (below the lower control limit) at the end of phase 1, suggesting an adaptation of the intervention program in the prescribing system. The phase 2 p-chart indicated an improved process with percentage of errors averaging 28.4% (95% CI 27.4, 29.5%). The full intervention program consisting of structured prescription review and a combination of league tables and authorised feedback letters likely encouraged more complete compliance, less variability, and sustained improvement in prescribing performance.
Improvement in the prescribing performance of the partial intervention group was not well sustained, and showed a seasonal pattern in the later part of the p-chart (Fig. 3b). The phase 1 p-chart indicates clearly that a less stable and inferior prescribing process was operating for the first four months of the study, with an average performance of 57.9% (95% CI 56.5, 59.3%). Similar to the full intervention group, an out-of-control episode was observed at the end of phase 1. In phase 2, the p-chart reveals a stable process with no special-cause variation, and an improved performance with percentage of errors averaging 44.8% (95% CI 43.3, 46.4%). However, the process variability in this phase is larger than that of the full intervention group, possibly due to the introduction of authorised feedback letters and the higher prescriber turnover in this group, causing changes in the prescribing system.
The prescribing performance of the control group appeared to be different from the other two study groups (Fig. 3c). As illustrated in the p-chart, although processes in both phases 1 and 2 are stable, there was no improvement in phase 2 when prescribing performance feedback was introduced into the system. The phase 1 p-chart indicated an average percentage of errors of 41.1% (95% CI 39.6, 42.6%). The single out-of-control episode in this phase could be attributed to chance (random or common-cause variation), since no prescribing performance feedback was introduced during this period (the control group received usual care in phase 1). No improvement in the process was observed in phase 2 with percentage of errors averaging 39.3% (95% CI 37.8, 40.9%).
Subcategory of prescribing errors
Prescribing errors identified during the structured prescription review process were subclassified into drug, information, and administrative errors. The percentage of prescriptions with these errors in each study group are illustrated in line graphs with 95% confidence intervals (see Fig. 4). Overall, there was a trend toward a reduction of all error subcategories. The reduction appeared to be more consistent in the full intervention group, regardless of error subcategory. The most frequent error subcategory committed by all study groups was information error, which consisted of incomplete prescribing information or unclear instructions on the prescription. Although there was a reduction in the percentage of prescriptions with information errors, this error subcategory appeared to be less impacted by the intervention program compared to drug and administrative errors. The mean percentage errors of each error subcategory are presented in Table 3.
Types of prescribing error
The specific types of prescribing error within each error subcategory are summarised in Table 3. Prescribing errors that do not fall into any of the predefined error subcategories were classified as other error. Across the three study groups, the most common drug errors were inappropriate drug dose, inappropriate drug frequency, and polypharmacy. Most types of drug error appear to have decreased, but the percentage of prescriptions with contraindications have at least doubled. We hypothesised that pharmacists’ vigilance during the structured prescription review process could have led to the identification of prescriptions with antihistamines for children under 2 years old. Drug frequency not specified is the most frequent information error in prescriptions, and also the most common type of error in this study. Although overall legibility and other types of information error improved throughout the study period, increasing number of prescriptions were found with drug dose not specified. The majority of administrative errors arose from prescriptions without diagnosis, followed by prescriptions without patient age. After the initiation of the feedback interventions, violation of legal or procedural requirements of prescription writing, such as absence of prescriber’s name and signature, were reduced, although this reduction was not observed across all study groups. Prescriptions with wrong patient name, though accounting for a small proportion of the total prescriptions reviewed, are serious errors as they may cause patient harm. The numbers of such errors reduced in all groups.
Our study explored whether monthly personalised feedback of prescribing performance to primary care prescribers using league tables and authorised feedback letters would result in reduction in prescribing error rates. Comparison between study groups, illustrated by the p-chart, demonstrated a gradual and sustained reduction in the percentage of prescribing errors in the full intervention group. Compared to the other two study groups, the process in the full intervention group was stable with less random variation. In the partial intervention group, there was also a reduction in the percentage of errors, but owing to a larger process variability, the prescribing performance was inferior to that of the full intervention group. There was no evidence of error reduction in the control group although the process was relatively stable. Overall, there is a trend toward a reduction of all error subcategories, but information errors appeared to be less impacted by the intervention program, compared to drug and administrative errors.
Comparison with other studies
In this study, we demonstrated that mailed personalised feedback could lead to meaningful changes in prescribing behaviour of primary care prescribers. A review in 2012 reported that mailed interventions are well received by prescribers, and are able to evoke significant changes in prescribing patterns . This finding is encouraging and illustrates the potential in using feedback to drive prescribing performances in primary care through benchmarking among prescribers. In addition, the feedback in our study was non-punitive and conducted in a confidential manner, an approach reported to be effective in detecting and addressing problems in several clinical settings . The league tables enabled the prescribers to compare their performance with that of their peers, and likely offered them motivation to improve. The effect of authorised feedback letters acting as “report cards” appeared to strongly stimulate quality improvement [32, 33]. Furthermore, we provided feedback to individual prescribers and district health officers, which appeared to have a larger impact than feedback provided to district health officers alone . Our study findings echoed previous studies that showed that audit and feedback can provide a framework for a proactive safety culture [35, 36], and direct constructive feedback to prescribers can effectively reduce errors [34, 37, 38].
We chose to compare prescribing error rates between study groups using SPC charts, as control charts would provide an intuitive technique from assessing to monitoring and improving quality of healthcare performance [39, 40]. We did not use mixed effect models to analyse the data as we recognise that only a small proportion of the variance will be explained by the explanatory variables in the model, as most of the variability in a health system cannot be measured in practice . In any health system, common-cause variation is inherent, and so it becomes important to recognise special-cause variation and intervene as necessary . Recent published studies have utilised the SPC chart to improve prescribing performance in an effort to reduce errors [37, 38, 42]. Other studies have used the SPC chart as a feedback tool to reduce infection rates , improve adherence to prescribing guidelines , and improve reporting of medical errors . These studies have shown that the SPC chart is an effective way to communicate mistakes, continuously monitor impact of interventions, and drive sustainable improvement in patient care. Control charts have also been demonstrated as appropriate tools to aid health service decision making for health authorities and managers . The advantage of SPC charts over classical statistical tests is that SPC methods integrate statistical significance tests with temporal trend of summary data, and acknowledge that unexplained variance is a reflection of random variation in a health system that is under control .
Our study reported an overall prescribing error rate of 48.0% at baseline, similar to the results of a study done locally in 12 conveniently selected primary care clinics . In a subsequent study to reduce errors , the authors implemented an intervention package mainly comprising educational training, which resulted in an absolute reduction of 18.0% in the intervention group, and only 2.3% in the control group. Other studies that employed similar definitions of error as used in our study reported lower error rates. In the UK, community pharmacists reported that less than 1% of prescriptions had a prescribing error , and outpatient pharmacists in Norway detected errors in 2.6% of the prescriptions dispensed . However, these two studies did not conduct a formal audit of prescriptions but relied on the reporting of prescribing errors by pharmacists. In both studies, the majority of prescriptions had incomplete or illegible drug information, followed by prescriptions with incomplete administrative endorsement, and a small proportion with incorrect drug information [48, 49].
Strengths and limitations
This is the first national study to evaluate the effectiveness of providing prescribing performance feedback to primary care prescribers, with the aim of reducing prescribing errors in the primary care setting. The pragmatic design of this study, the delivery of interventions in ‘real world’ settings by staff with typical experience, and active stakeholder involvement provide the effectiveness of the interventions in everyday practice to answer questions of decision makers. Preliminary findings of this study were presented to managers in the Ministry of Health Malaysia, and plans to revise the intervention for feasible implementation is under way. We utilised a longitudinal randomised controlled study design, with repeated and regular prescription review and prescriber feedback, a methodological design strongly recommended by systematic reviews for this purpose. In addition, we incorporated implementation fidelity practices in the study design to ensure consistent intervention implementation, thus strengthening the validity of the study.
Several methodological challenges were identified in our study. The large volume of data collected each month for the generation of prescribing performance feedback reports, limited the ability of the researchers to provide timely feedback to prescribers (there was a time lag of one month between structured prescription review and the delivery of feedback in September and November). This might have interrupted the critical processes in our feedback system, thus impairing the impact of the intervention towards prescribers. We used p-charts to compare prescribing performance between study groups, as this method allows the differentiation between common-cause and special-cause variation in a system environment. However, to adequately assess changes and trends in prescribing performance on a control chart, it would be ideal to have more time points for this study (i.e. an extension of the data collection period), as it is common in practice, to evaluate prescriptions written by every prescriber over a convenient time period. In our study, baseline data from a single time point may not be adequate to monitor changes and the impact of the intervention program on the health system. However, we were unable to extend the period for collection of baseline data as there were urgent requests from managers to rectify prescribing errors in primary care. We initially planned a third phase of the study to assess the feasibility of the intervention program, and to specifically determine whether the intervention program can be implemented independently by pharmacists in the primary care clinics. Unfortunately, this phase of the study could not be conducted due to insufficient support from the pharmacists, as there was a general impression that they could not cope with the volume of work that the intervention program would entail. Extending the data collection period would require substantial resources, of which could not be supported by public sector funding. Additionally, although managers were pleased with the improvements in prescribing performance, they were in agreement that the intervention program was too labour- and resource-intensive for long-term implementation. Therefore, the data collection period for the study was limited to eight months, and the impact of the intervention program on prescribing performance was evaluated within this time period.
Implications for clinicians and policymakers
This study shows that a high rate of prescribing errors occur routinely in primary care settings. Important measures should be taken to reduce these errors in an effort to improve and maintain prescribing safety. Routine prescriber feedback comprising league tables and a feedback letter acting as “report cards” by “warning” poorly performing prescribers and praising well-performing or compliant prescribers is effective in reducing prescribing errors. Ongoing monitoring of prescribing errors using SPC charts allows easier recognition of special-cause variation in a health system process to be targeted for improvement. Managers in primary care could adopt this intervention program along with temporal monitoring of prescribing performance as a quality improvement tool.
Unanswered questions and future research
Future research on prescriber feedback should examine the impact of the intervention over a longer period of time to determine sustainability. Classifying prescribing errors according to clinical severity (e.g. fatal, life-threatening, serious, significant) and their potential harm to the patient should be considered for future work. The impact of an electronic prescribing system in detecting prescribing errors and allowing for corrections and computer-generated feedback, especially for administrative and information errors, should be evaluated.
This study shows that the rate of prescribing errors in primary care is high, and routine feedback comprising league tables and a feedback letter could effectively reduce prescribing errors. The challenge now is to develop a feedback intervention program that is feasible and sustainable for long-term implementation.
Adverse drug event
Statistical process control
Avery AJ, Rodgers S, Cantrill JA, Armstrong S, Cresswell K, Eden M, et al. A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. Lancet. 2012;379(9823):1310–9.
Bourgeois FT, Shannon MW, Valim C, Mandl KD. Adverse drug events in the outpatient setting: an 11-year national analysis. Pharmacoepidemiol Drug Saf. 2010;19(9):901–10.
Gandhi TK, Weingart SN, Borus J, Seger AC, Peterson J, Burdick E, et al. Adverse drug events in ambulatory care. N Engl J Med. 2003;348(16):1556–64.
Hughes RG, Blegen MA. Medication administration safety. In: Hughes RG, editor. Patient safety and quality: an evidence-based handbook for nurses. Rockville (MD): Agency for Healthcare Research and Quality (US); 2008. Chapter 37. http://0-www.ncbi.nlm.nih.gov.brum.beds.ac.uk/books/NBK2656/
Morimoto T, Gandhi T, Seger A, Hsieh T, Bates D. Adverse drug events and medication errors: detection and classification methods. Qual Saf Health Care. 2004;13(4):306–14.
Runciman WB, Roughead EE, Semple SJ, Adams RJ. Adverse drug events and medication errors in Australia. Int J Qual Health Care. 2003;15(Suppl 1):i49–59.
Institute of Medicine, Committee on quality of health Care in America. To err is human: building a safer health system. Washington, DC: The National Academies Press; 2000. http://www.nap.edu/catalog/9728.html
Thomsen LA, Winterstein AG, Sondergaard B, Haugbolle LS, Melander A. Systematic review of the incidence and characteristics of preventable adverse drug events in ambulatory care. Ann Pharmacother. 2007;41(9):1411–26.
Sivasampu S, Lim Y, Norazida AR, Hwong WY, Goh PP, Hisham AN. National Clinical Research Centre. National Medical Care Statistics (NMCS) 2012. Kuala Lumpur; 2014.
Lu CY, Ross-Degnan D, Soumerai SB, Pearson SA. Interventions designed to improve the quality and efficiency of medication use in managed care: a critical review of the literature - 2001-2007. BMC Health Serv Res. 2008;8:75.
Soumerai SB, McLaughlin TJ, Avorn J. Improving drug prescribing in primary care: a critical analysis of the experimental literature. Milbank Q. 2005;83(4):10.
Roque F, Herdeiro MT, Soares S, Teixeira Rodrigues A, Breitenfeld L, Figueiras A. Educational interventions to improve prescription and dispensing of antibiotics: a systematic review. BMC Public Health. 2014;14:1276.
Kamarudin G, Penm J, Chaar B, Moles R. Educational interventions to improve prescribing competency: a systematic review. BMJ Open. 2013;3(8):e003291.
Ioannidis JP, Lau J. Evidence on interventions to reduce medical errors: an overview and recommendations for future research. J Gen Intern Med. 2001;16(5):325–34.
Freemantle N, Harvey EL, Wolf F, Grimshaw JM, Grilli R, Bero LA. Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2000;(2):CD000172.
Sondergaard J, Andersen M, Vach K, Kragstrup J, Maclure M, Gram LF. Detailed postal feedback about prescribing to asthma patients combined with a guideline statement showed no impact: a randomised controlled trial. Eur J Clin Pharmacol. 2002;58(2):127–32.
Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, et al. Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001;39(8 Suppl 2):II2–45.
Jamtvedt G, Young JM, Kristoffersen DT, O’Brien MA, Oxman AD. Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006;(2):CD000259.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259.
The Health Foundation. Evidence Scan: Reducing prescribing errors. London: April 2012. http://www.health.org.uk/sites/health/files/ReducingPrescribingErrors.pdf. Accessed 10 May 2016.
Dean B, Barber N, Schachter M. What is a prescribing error? Qual Health Care. 2000;9(4):232–7.
Dusenbury L, Brannigan R, Falco M, Hansen WB. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Educ Res. 2003;18(2):237–56.
Linn BS, Arostegui M, Zeppa R. Performance rating scale for peer and self assessment. Br J Med Educ. 1975;9(2):98–101.
Gilman J, Myatt MA. EpiCalc 2000 v1.02 - A statistical calculator for epidemiologists. Llanidloes, UK: Brixton Health; 1998.
Khoo EM, Lee WK, Sararaks S, Abdul Samad A, Liew SM, Cheong AT, et al. Medical errors in primary care clinics--a cross sectional study. BMC Fam Pract. 2012;13:127.
Carey RG, Lloyd RC. Measuring quality improvement in healthcare: a guide to statistical process control applications. New York: Quality Resources; 2001.
Cheung YY, Jung B, Sohn JH, Ogrinc G. Quality initiatives: statistical control charts: simplifying the analysis of data for quality improvement. Radiographics. 2012;32(7):2113–26.
Amin SG. Control charts 101: a guide to health care applications. Qual Manag Health Care. 2001;9(3):1–27.
Mohammed MA, Worthington P, Woodall WH. Plotting basic control charts: tutorial notes for healthcare practitioners. Qual Saf Health Care. 2008;17(2):137–45.
Ho MJ, Venci J. Improving the success of mailed letter intervention programs to influence prescribing behaviors: a review. J Manag Care Pharm. 2012;18(8):627–49.
American College of Physicians–American Society of Internal Medicine. Assessing Individual Physician Performance By Managed Care Organizations. Philadelphia: American College of Physicians–American Society of Internal Medicine; 2001. White Paper. (Available from American College of Physicians–American Society of Internal Medicine, 190 N. Independence Mall West, Philadelphia, PA 19106.)
Goldfield N, Gnani S, Majeed A. Primary care in the United States: profiling performance in primary care in the United States. BMJ. 2003;326(7392):744–7.
Smith PC, Mossialos E, Papanicolas I. Performance measurement for health system improvement: experiences, challenges and prospects, vol. 2008. Tallinn: World Health Organization 2008 and World Health Organization, on behalf of the European Observatory on Health Systems and Policies; 2008. http://www.who.int/management/district/performance/PerformanceMeasurementHealthSystemImprovement2.pdf. Accessed 10 May 2016
Franklin BD, O’Grady K, Paschalides C, Utley M, Gallivan S, Jacklin A, et al. Providing feedback to hospital doctors about prescribing errors; a pilot study. Pharm World Sci. 2007;29(3):213–20.
Herbert CP, Wright JM, Maclure M, Wakefield J, Dormuth C, Brett-MacLean P, et al. Better prescribing project: a randomized controlled trial of the impact of case-based educational modules and personal prescribing feedback on prescribing for hypertension in primary care. Fam Pract. 2004;21(5):575–81.
Fowler S, Webber A, Cooper BS, Phimister A, Price K, Carter Y, et al. Successful use of feedback to improve antibiotic prescribing and reduce Clostridium difficile infection: a controlled interrupted time series. J Antimicrob Chemother. 2007;59(5):990–5.
Sullivan KM, Suh S, Monk H, Chuo J. Personalised performance feedback reduces narcotic prescription errors in a NICU. BMJ Qual Saf. 2013;22(3):256–62.
Tiah L, Lee WY, Tiruchittampalam M. The use of individual performance metrics to reduce prescription errors in the emergency department. Proceedings of Singapore Healthcare. 2011;20(3):174–80.
Thor J, Lundberg J, Ask J, Olsson J, Carli C, Harenstam KP, et al. Application of statistical process control in healthcare improvement: systematic review. Qual Saf Health Care. 2007;16(5):387–99.
Benneyan JC, Lloyd RC, Plsek PE. Statistical process control as a tool for research and healthcare improvement. Qual Saf Health Care. 2003;12(6):458–64.
Neuhauser D, Provost L, Bergman B. The meaning of variation to healthcare managers, clinical and health-services researchers, and individual patients. BMJ Qual Saf. 2011;20(Suppl_1):i36–40.
Furuya H, Morimoto T, Ogawa Y. Relationship between the use of an electronic commercial prescribing system and medical and medication errors in a teaching hospital. Tokai J Exp Clin Med. 2013;38(1):33–6.
Curran E, Harper P, Loveday H, Gilmour H, Jones S, Benneyan J, et al. Results of a multicentre randomised controlled trial of statistical process control charts and structured diagnostic tools to reduce ward-acquired meticillin-resistant Staphylococcus aureus: the CHART project. J Hosp Infect. 2008;70(2):127–35.
Mertens WC, Higby DJ, Brown D, Parisi R, Fitzgerald J, Benjamin EM, et al. Improving the care of patients with regard to chemotherapy-induced nausea and emesis: the effect of feedback to clinicians on adherence to antiemetic prescribing guidelines. J Clin Oncol. 2003;21(7):1373–8.
Marshall T, Mohammed MA, Rouse A. A randomized controlled trial of league tables and control charts as aids to health service decision-making. Int J Qual Health Care. 2004;16(4):309–15.
Neuspiel DR, Stubbs EH, Liggin L. Improving reporting of outpatient pediatric medical errors. Pediatrics. 2011;128(6):e1608–13.
Khoo EM, Sararaks S, Lee WK, Liew SM, Cheong AT, Abdul Samad A, et al. Reducing medical errors in primary care using a pragmatic complex intervention. Asia Pac J Public Health. 2015;27(6):670–7.
Chen YF, Neil KE, Avery AJ, Dewey ME, Johnson C. Prescribing errors and other problems reported by community pharmacists. Ther Clin Risk Manag. 2005;1(4):333–42.
Haavik S, Soeviknes S, Erdal H, Kjonniksen I, Guttormsen AB, Granas AG. Prescriptions from general practitioners and in hospital physicians requiring pharmacists’ interventions. Pharmacoepidemiol Drug Saf. 2011;20(1):50–6.
We thank the Director General of Health, Malaysia for permission to publish this paper. We also thank the Perak State Health Department, especially Asmah Zainal Abidin, and the Pharmaceutical Services Division of Perak for providing the logistic support for this study. We are grateful to Siti Nur Umi Aminah Zainal Bahri and Afida Nor Abu Hussain for their assistance with the training of clinic pharmacists and the audit of collected prescriptions and data. We greatly appreciate the support of clinic pharmacists in Perak involved in structured prescription review and data collection. We thank pharmacists Doris George Visuvasam and Abdul Haniff Mohamad Yahaya for their assistance in the development of the data collection form. We also acknowledge Sivanesan Seevagan for his assistance with data entry.
This research was partly funded by the National Institutes of Health, Ministry of Health Malaysia, under the 10th Malaysia Plan Research Priority Area Health Policy and Systems.
Availability of data and materials
All data generated or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study had waiver of informed consent from the Medical Research & Ethics Committee (MREC), Ministry of Health Malaysia ((2) dlm.KKM/NIHSEC/08/0804/P12–186) as data in the study were routinely collected prescription data and identifying information was not disclosed. This cluster randomised trial was not registered with the International Clinical Trials Registry as the purpose of this trial was to examine the effect of the intervention only on the prescribers (healthcare providers) and not patients, in compliance with the International Committee of Medical Journal Editors (ICMJE) guidelines on clinical trial registration. The trial is registered with the National Medical Research Registry (NMRR-12-108-11,289), Ministry of Health Malaysia as per guidelines of the MREC.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Prescribing Error Record Form (a standardised data collection form to record prescribing errors identified during the structured prescription review process) (DOCX 20 kb).
League tables (bar charts displaying the percentage of prescribing errors for the health districts, health clinics, and of individual prescribers) (DOCX 226 kb).
Authorised feedback letter (a letter signed by the state health director showing individual prescribing error rate and prescribing performance based on a performance rating scale) (DOCX 15 kb).
About this article
Cite this article
Lim, W.Y., HSS, A.S., Ng, L.M. et al. The impact of a prescription review and prescriber feedback system on prescribing practices in primary care clinics: a cluster randomised trial. BMC Fam Pract 19, 120 (2018) doi:10.1186/s12875-018-0808-4
- Prescribing errors
- Statistical process control chart
- League tables
- Prescription review
- Primary care