- Research article
- Open Access
Patient experiences with family medicine: a longitudinal study after the Dutch health care reforms in 2006
BMC Family Practice volume 17, Article number: 118 (2016)
In 2006 The Dutch Health Care system changed to a market oriented system. The GP remuneration changed from ± 2/3 capitation patients and 1/3 private patients before 2006 to a mixed payment scheme. From 2006 onward every patient was insured and the GP received partly capitation, partly fees for consultations and for specific services. This change coincided with many other organisational changes in General Practice care. Our research question was if during the years after 2006 patient experiences of Dutch family practice had changed. We also wanted to explore the influence of patient and practice characteristics on patient experiences. Data on patient experiences were available from 2007 to 2012.
In a series of annual cross sectional patient surveys the performance of GPs and practices was measured. Patient sampling took place as a part of the Dutch accreditation program in 1657 practices involving 2966 GPs. Patients’ experiences, gender, age, health status, and number of annual consultations were documented as well as the type and location of practices. Linear regression analysis was used to examine time trends in patient experiences and the impact of patient and practice characteristics.
78,985 patients assessed the performance of 2966 GPs, and 45,773 patients assessed the organisation of 1657 practices. The number of patients with positive experiences increased significantly between 2007 and 2012; respectively 4.8 % for GPs (beta 0.20 and p < 0.0001) and 6.6 % for practices (beta 0.10, p < 0.004). Higher age, having no chronic illness, more frequent consultations and attending single-handed practices, predicted better patient experiences.
In our evaluation of patient experiences with general practice care from 2007 to 2012 we found an increase of 4.8 % for GPs and 6.6 % for practices respectively. This improvement is significant. While no direct causation can be made, possible explanations may be found in the various reforms in Dutch family practice since 2006. More insight is needed into key determinants of this improvement before policymakers and care providers can attribute the improvement to these reforms.
In 2006 The Dutch Health Care system changed to a market oriented system (Table 1). The GP remuneration changed from a 2/3 capitation and 1/3 private patients before 2006 to a mixed payment scheme. From 2006 onward every patient was insured and the GP received partly capitation, partly fee for consultations and for specific services. Between 2005 and 2007 costs for GP care rose 11,2 % yearly before slowing down to 2.7 % yearly till 2012 . This switch coincided with other organisational changes in general practice care, which were all meant to improve quality of care e.g. an increase in the number of nurse practitioners, incentivizing diagnostic and therapeutic activities, rewarding adherence to guidelines on availability and accessibility. and strengthening vocational training (Table 2). Changes like incentivizing care and increasing staff for chronic disease management improved clinical care in some settings, but whether these changes improved patient experience is unclear [2, 3]. Clinical care and patient experiences are distinct aspects of quality. Information on the patients’ overall evaluation of the quality of family practice care following the changes in The Netherlands was lacking . The data of patient experiences using Europep  of a large sample of practices entering the Dutch Practice accreditation scheme each year, offered an opportunity to monitor patient experiences. The study also explored the impact of patient and practice characteristics.
The Europep questionnaire has proved to be sufficiently responsive to detect changes in countries with various health policy decisions . The study of Petek et al. also used Europep and compared patients with cardiovascular disease in eight European countries in 2009 with a subgroup of patients with self-defined chronic illness from their study in 1998 . It showed no overall trends for the eight countries combined, but some changes in specific countries.
Allan at al. looked at the effect of Continuous Quality Improvement (CQI) on patient satisfaction using patient questionnaire data collected in a Patient Participation Program of the RACGP in Australia with a 10 year follow-up (1993–2003) . They found no significant change in satisfaction but the scores showed little variation (often close to 100 % from the start). We did not find other long term studies showing measurable improvement in patient experience following organisational interventions. We therefore hypothesized that we would not find significant changes in patient experience in the years 2007-2012 in our study.
Study design and setting
The data were collected as part of the Dutch accreditation program (NPA) between 2007 and 2012. The study focused on the patient survey that was part of the data collection preceding the Practice visit. Participating in the NPA was voluntary, yet strongly supported by the Dutch College of General Practitioners, incentivized by the insurers and becoming a future reregistration obligation for GP-trainers. The incentives stimulated hundreds of practices to enter the NPA-program each year . The central outcome measures were the scores on the Dutch Europep questionnaire, which measures patient experiences with the GP- and the practice organisation. Patients (>18 years) who visited the practice were asked by the practice assistant to complete the questionnaire in the waiting room before or after the consultation, and to drop it in a sealed box warranting anonymity. The practice staff was asked to make sure that close to 30 questionnaires per GP were returned. The results of the questionnaire were used only for internal feedback for the GP and the team.
Participants were 30 invited patients per GP entering the accreditation program.
The Europep questionnaire has 23 items; 17 items on the GP performance and 6 items on the practice management . The items of Europep are a concise reflection of what patients view as important aspects of general practice care across European countries. All items use a Likert scale (1 = poor and 5 = excellent), and a sixth option “do not know/ not applicable”. To warrant anonymity no patient characteristics were asked for except gender and age. From 2009 to 2012 the questionnaires had additional questions on percentage with chronic illness and consultation rate to allow more in depth analysis. Europep was validated in several studies and has proved to show relevant variation on all items . Practice and respondents characteristics are in Tables 3 & 4.
We assessed the scores per item by calculating the percentage of people with a rating of 4 or 5 on the 5-point Likert scale . The response to the category “do not know/not applicable” was excluded. Two separate means were calculated for the items regarding GP- and practice performance.
In a linear regression model using SPSS we evaluated the trend in patient experiences over time (from 2009 to 2012; 2007 and 2008 did not have sufficient data for a linear regression). Associations between time (year) and the total scores on GP- and practice performance were explored. We also analyzed the trend for each of the individual items in separate models. In addition, we used models in which we corrected for patient age, gender, whether they self-reported chronic illness, the consultation frequency of the patients and whether the practice was a single handed practice or not.
In total 2966 GPs in 1657 practices were included. We excluded 8.0 % of the questionnaires using three exclusion criteria; respondent age (3.8 % was below 18), number of questionnaires per practice (1.0 % had less than 10 questionnaires) and repeated measurements in the same practice (3.2 %). This resulted in 78,985 questionnaires on the performance of 2966 GPs and 45,773 questionnaires on the performance of their 1657 practices. Out of 30 questionnaires on average 27 were completed per GP and 28 per practice. The study practices were reasonably representative for Dutch general practices (Table 3). Training practices were overrepresented (around 50 % with a top of 69 % in 2010).
General trend in patient experiences
Overall, more than 80 % of the patients rated the performance of their GP positively on aspects of time, empathy, listening, examining, informing, treatment and advice (Table 5). The positive trend from 82.1 % to 86.9 % (Fig. 1) over 2007–2012 is significant (Beta 0.20 and p < 0.001). Table 5 shows that GPs improved their care from 2009 up to 2012 regarding time for the patient, empathy, shared decision making, communication, thoroughness, patient centeredness and providing information. An analysis which corrected for differences between the cross-sectional samples regarding patient and practice characteristics confirms the positive trend between 2009 and 2012 (Beta 0,10 and p < 0.001).
Patients rated the practice organisation slightly less positively than they rated their GP. The rating was 64.9 % in 2007 and 71.5 % in 2012 (rise of 6.6 %) (Fig. 1). This positive trend is significant (beta 0.19, p < 0.001) and was confirmed after correcting for differences between the cross-sectional samples in the period 2009–2012 (Beta 0.10, p < 0.004). Almost all items contribute to this positive trend (Table 5). The best scoring items are on “helpfulness of the staff”, “getting a suitable appointment” and “getting through to the practice on the phone”.
Factors associated with patient experiences
Table 6 shows which factors are associated with GP performance and practice management. The year of the visit is an important explanatory factor. The trend in the period 2009–2012 in improved patient experience was confirmed after correcting for background variables.
Patient and practice factors which related to patient experiences are consistent across the year cohorts. The GP performance and practice management are rated significantly higher by older compared to younger patients and by patients with a higher frequency of consultations. Patients with a chronic disease rated the GP performance and the practice management less positively than other patients. Patients’ gender and practice urbanisation do not affect the ratings. The practice management was rated higher in single handed practices than in other types of practices, but practice type (group practice, health center) had no effect on GP performance.
Patient experience with Dutch general practice care changed positively in the period 2007–2012 with 4.8 % on GP personal performance and 6.6 % on practice organisation (Fig. 1). The positive change could be demonstrated for each item. The increase followed a period of profound changes in the healthcare system among which ‘investments in primary care’ and ‘the introduction of incentives in the healthcare system’. This positive trend in Dutch patient experiences is reinforced by the yearly results of the European Health Consumers Index (EHCI), that reported the Netherlands to be in the top 3 since 2007 and a first position in 2014 with a 40 points advantage over number 2 in 2014 .
Changes in primary care since 2006 that could have affected patient experiences
Various bodies of research provide potential determinants for positive change in patient experiences. A Cochrane meta-analysis showed that investment in practice nurses for the treatment of chronic diseases had a positive effect on patient experiences . In our practices the available time of practice nurses rose from 4.8 to 5.7 h per 1000 patients between 2009 and 2011. More time per patient proved to be associated with better patient experience in a previous study that used the same data base of practice visits .
A change in reimbursement for the care of chronic patients proved to be effective in the UK for clinical care . But in the evaluation of the pay-for-performance (P4P) program conducted from 2003 to 2007, patients did not experience changes in quality of care for communication, nursing care, coordination, and overall satisfaction [2, 15]. Some aspects of access improved but patients reported seeing their usual physician less often and gave lower satisfaction ratings for continuity of care .
Patients highly value the accessibility and availability of general practice . Starting in 2008 Dutch insurers incentivised service with 4 € extra capitation per patient when targets on accessibility and availability were met (Table 1). This could have helped the positive change in patient experiences on access, availability and continuity. In the UK these aspects of care did not change or worsened after P4P was introduced .
A positive effect on patient experience may be attributed to the change to ‘fee per consultation’ (9 € ) and ‘home visit’ (14 €) meant to compensate for the proportionate lowering of the capitation (114 € to 57 €). Although GP care was exempted from market forces and competition, the new blended system of capitation and fee for service aligning incentives more closely to professional values may have influenced patient experiences positively [14, 16].
From 2006 onward the scope of diagnostic and therapeutic procedures widened and more procedures were done in the practice also because it was financially attractive. In previous research a wider scope was associated with better medical performance in videotaped patient contacts .
Improvement in patient experiences may also be attributed to an extensive project to renew vocational training, which was completed in 2006. The project focused on assessing and improving trainers’ skills in giving feedback, coaching of and assessing the CANMEDS (Canadian Medical Education Directives for Specialists concerning 7 competencies: Medical Expert, Communicator, Collaborator, Manager, Health Advocate, Scholar, and Professional). Dutch GP-trainers score significantly better on quality of care and organisation including patient experiences than non-training GPs .
In the UK investment in family medicine training—both in GP-trainers & trainees—improved the score on the GPPS in the P4P program in the UK. GP training practice status (29 % of practices) was a significant predictor of positive GPPS responses to all questions in the ‘doctor care’ (n = 6) and ‘overall satisfaction’ (n = 2) domains but not to any of the ‘nurse care’ or ‘out-of-hours’ domain questions . Doctors in GP training practices appeared to offer more patient-centered care with patients reporting more positively on attributes of doctors such as ‘listening’ or ‘care and concern’.
Extra patient time, introducing practice nurses, enhancing accessibility and availability, changing some payments in fee for services, improving consultation skills during vocational training all could have attributed to positive patient experiences. A negative effect could be expected from the increase in practice size between 2007 and 2012. Larger practices with more GPs have less positive experiences with care  and many patients prefer smaller practices [20, 21].
Strengths & limitations
The data were collected within the Dutch accreditation program with a voluntary participation of practices and with maybe better practices entering first. This selection of the better practices entering first is at odds with the increase of improved patient experience. However, year after year practices who felt ready for the practice visit entered the program. This yearly mix of training and non-training practices is a selection of voluntary practices, but we had expected a negative change in patient experience in the later years, because less ambitious practices entered later in the program. We consider this a strength of this study.
Another strength is the large and representative sample of practices that could be analysed and the high numbers of new patients each year that completed the questionnaires. Selection bias due to selecting patients would very likely to have been constant over the years.
Unfortunately we could only do a linear regression analysis for the years 2009–2012, because we lacked sufficient data in 2007 & 2008.
Comparison with other studies
Previous studies of patient experience did show no change or mixed results after organisational change. All but one of these studies concerned P4P-studies, whereas our study included all patients who had an appointment with their doctor. Our findings that a higher age, a ‘higher frequency of consulting the GP’, ‘having no chronic illness’ and ‘a short waiting time for the consultation’ were associated with more positive patient experiences on GP performance resonate with similar analyses in previous studies [8, 24–26].
The positive change in patient experiences with family practice cannot be related to the interventions in General Practice care. Patient experience was found to be correlated to better clinical quality in hospitals in a review by Price et al. Research indicates that better patient care experiences are associated with higher levels of adherence to recommended prevention and treatment processes, better clinical outcomes, better patient safety within hospitals, and less health care utilisation . In primary care the correlation between patient experience measured with national General Practice Patient Survey (GPPS) and the national pay-for-performance scheme (QOF) was weak. The 2 domains of quality of care remain predominantly distinct .
Longitudinal data collection on patient experiences should span longer periods with a standardized and validated instrument such as Europep, to allow comparison over the years. Such data could enable GPs and policymakers to make better choices on practice organisation, e.g. optimal list size, being a training practice, optimal staff, etcetera .
In our evaluation following the trend in patient experiences from 2007 to 2012 we found an increase of 4.8 % for GPs and 6.6 % for practices respectively. This is considerable given the often reported limited range for improvement in patient experience surveys. Most previous studies of patient experiences over time showed no or mixed results.
Though an attribution of the reforms to the improvement of patient experiences is impossible on the basis of this research, it is important to study the changes in Dutch Family Medicine preceding the improved patient experiences . The literature yields as possible contributors to improved patient experience: 1. The introduction of a practice nurse for chronic diseases, 2. incentivizing accessibility and availability, 3. change to a mixed capitation and fee for service payment + incentivizing additional diagnostic and therapeutic services and 4. improvement of the vocational FM-training. Policymakers and professionals could benefit from monitoring patient experiences.
Continuous Quality Improvement
European Health Consumers Index
Dutch Association of Family Medicine
Dutch College of General Practitioners
Dutch Accreditation Program
Hendriks M, Spreeuwenberg P, Rademakers J, Delnoij DM. Dutch healthcare reform: did it result in performance improvement of health plans? A comparison of consumer experiences over time. BMC Health Serv Res. 2009;9:167.
Martinez-Gonzalez NA, Djalali S, Tandjung R, Huber-Geismann F, Markun S, Wensing M, Rosemann T. Substitution of physicians by nurses in primary care: a systematic review and meta-analysis. BMC Health Serv Res. 2014;14:214.
Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M. Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009;361(4):368–78.
Rademakers J, Delnoij D, de Boer D. Structure, process or outcome: which contributes most to patients’ overall assessment of healthcare quality? BMJ Qual Saf. 2011;20(4):326–31.
Wensing M. EUROPEP 2006: Revised Europep Instrument and User Manual. Nijmegen: Centre for Quality of Care Research, Radboud university; 2006.
Wensing M, Hermsen J, Grol R, Szecsenyi J. Patient evaluations of accessibility and co-ordination in general practice in Europe. Health Expect. 2008;11(4):384–90.
Petek D, Kunzi B, Kersnik J, Szecsenyi J, Wensing M. Patients’ evaluations of European general practice--revisited after 11 years. Int J Qual Health Care. 2011;23(6):621–8.
Allan J, Schattner P, Stocks N, Ramsay E. Does patient satisfaction of general practice change over a decade? BMC Fam Pract. 2009;10:13.
van den Hombergh P, Grol R, van den Hoogen HJ, van den Bosch WJ. Assessment of management in general practice: validation of a practice visit method. BrJGenPract. 1998;48(436):1743–50.
Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, et al. Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract. 2000;50(460):882–7.
Wensing M, Mainz J, Ferreira P, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J, Grol R. General practice care and patients’ priorities in Europe: an international comparison. Health Policy (New York). 1998;45(3):175–86.
Björnberg: Euro Health Consumer Index 2014. Health Consumer Powerhouse Ltd.,2015.
van den Hombergh P, Kunzi B, Elwyn G, van Doremalen J, Akkermans R, Grol R, Wensing M. High workload and job stress are associated with lower practice performance in general practice: an observational study in 239 general practices in the Netherlands. BMC Health Serv Res. 2009;9:118.
Roland M, Campbell S. Successes and failures of pay for performance in the United Kingdom. N Engl J Med. 2014;370(20):1944–9.
Campbell SM, Kontopantelis E, Reeves D, Valderas JM, Gaehl E, Small N, Roland MO. Changes in patient experiences of primary care during health service reforms in England between 2003 and 2007. Ann Fam Med. 2010;8(6):499–506.
Roland M. Incentives must be closely aligned to professional values. BMJ. 2012;345:e5982.
Ram P, Grol R, van den Hombergh P, Rethans JJ, van der Vleuten C, Aretz K. Structure and process: the relationship between practice management and actual clinical performance in general practice. Fam Pract. 1998;15(4):354–62.
van den Hombergh P, Schalk-Soekar S, Kramer A, Bottema B, Campbell S, Braspenning J. Are family practice trainers and their host practices any better? Comparing practice trainers and non-trainers and their practices. BMC Fam Pract. 2013;14:23.
Llanwarne NR, Abel GA, Elliott MN, Paddison CA, Lyratzopoulos G, Campbell JL, Roland M. Relationship between clinical quality and patient experience: analysis of data from the english quality and outcomes framework and the National GP Patient Survey. Ann Fam Med. 2013;11(5):467–72.
Põlluste K, Kalda R, Lember M. Primary health care system in transition: the patient’s experience. Int J Qual Health Care. 2000;12(6):503–9.
Kontopantelis E, Roland M, Reeves D. Patient experience of access to primary care: identification of predictors in a national patient survey. BMC Fam Pract. 2010;11:61.
Rahmqvist M. Patient satisfaction in relation to age, health status and other background factors: a model for comparisons of care units. Int J Qual Health Care. 2001;13(5):385–90.
Pedersen LB, Kjaer T, Kragstrup J, Gyrd-Hansen D. Do general practitioners know patients’ preferences? An empirical study on the agency relationship at an aggregate level using a discrete choice experiment. Value Health. 2012;15(3):514–23.
Lyratzopoulos G, Elliott M, Barbiere JM, Henderson A, Staetsky L, Paddison C, Campbell J, Roland M. Understanding ethnic and other socio-demographic differences in patient experience of primary care: evidence from the English General Practice Patient Survey. BMJ Qual Saf. 2012;21(1):21–9.
Campbell JL, Ramsay J, Green J. Age, gender, socioeconomic, and ethnic differences in patients’ assessments of primary health care. Qual Health Care. 2001;10(2):90–5.
Paddison C, Elliott M, Parker R, Staetsky L, Lyratzopoulos G, Campbell JL, Roland M. Should measures of patient experience in primary care be adjusted for case mix? Evidence from the English General Practice Patient Survey. BMJ Qual Saf. 2012;21(8):634–40.
Anhang Price R, Elliott MN, Zaslavsky AM, Hays RD, Lehrman WG, Rybowski L, Edgman-Levitan S, Cleary PD. Examining the role of patient experience surveys in measuring health care quality. Med Care Res Rev. 2014;71(5):522–54.
van den Hombergh P, Campbell S. Is ‘practice size’ the key to quality of care? Br J Gen Pract. 2013;63(614):459–60.
We thank the Dutch College of General Practitioners (NHG) and NHG Practice Accreditation for collecting and delivering the large amount of data for our study.
No funding, IQhealthcare partly employed the authors except Stephen Campbell.
Availability of data and materials
The raw data belong to the Dutch Practice Accreditation (NPA). Data can be obtained from the NPA on request. The accreditation organization is a member of the ISQUA (The International Society for Quality in Health Care).
PvdH designed data collection tools of the VIP-method, drafted and revised the paper. AvD helped with the statistical analysis, cleaned and analyzed the data and revised the paper. SC collaborated for many years on implementation research in IQhealthcare, put the paper in international perspective and revised several versions of the paper. MW designed data collection tools of the Europep patient questionnaire, commented on the design of the study and revised all versions of the paper. JB initiated the collaborative project, supervised the project from its early start to the end, coached the participants and revised all versions. All authors accepted the revised paper. All authors read and approved the final manuscript.
The lead author* affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and registered) have been explained.
Consent for publication
Ethics approval and consent to participate
The ethics committee of the Radboud university medical center provided a waiver for the study.
“The Corresponding Author has the right to grant on behalf of all authors and does grant on behalf of all authors, a worldwide license to the Publishers and its licensees in perpetuity, in all forms, formats and media (whether known now or created in the future), to 1) publish, reproduce, distribute, display and store the Contribution, 2) translate the Contribution into other languages, create adaptations, reprints, include within collections and create summaries, extracts and/or, abstracts of the Contribution, 3) create any other derivative work(s) based on the Contribution, 4) to exploit all subsidiary rights in the Contribution, 5) the inclusion of electronic links from the Contribution to third party material where-ever it may be located; and, 6) license any third party to do any or all of the above.”
About this article
Cite this article
van den Hombergh, P., van Doorn-Klomberg, A., Campbell, S. et al. Patient experiences with family medicine: a longitudinal study after the Dutch health care reforms in 2006. BMC Fam Pract 17, 118 (2016). https://0-doi-org.brum.beds.ac.uk/10.1186/s12875-016-0519-7
- Health care reform
- Payment system
- Patient experience
- Quality of care
- Practice performance
- Investment in Family Medicine
- Primary care