Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Advance care planning with people with dementia: a process evaluation of an educational intervention for general practitioners

BMC Family Practice volume 21, Article number: 199 (2020) Cite this article

Abstract

Background

General practitioners (GPs) are advised to offer advance care planning (ACP) to people with dementia (PWD). In a randomized controlled trial, an educational intervention for GPs aimed at initiating and optimizing ACP proved to be effective. During the intervention most GPs were accompanied by their practice nurse (PN). To provide insights into the intervention’s successful components and what could be improved, we conducted a process evaluation and explored implementation, mechanisms of impact and contextual factors.

Methods

We used the Medical Research Council guidance for process evaluations. Implementation was explored identifying reach and acceptability. We performed descriptive analyses of participants’ characteristics; selection, inclusion and intervention attendance; a GP post-intervention survey on initiating ACP; a post intervention focus group with trainers of the intervention.

Mechanisms of impact were explored identifying adoption and appropriateness. We used: participants’ intervention ratings; a GP post-intervention survey on conducting ACP; ACP documentation in PWD’s medical files; post-intervention interviews with PWD/FC dyads. All data was used to identify contextual factors.

Results

The intervention was implemented by a small percentage of the total Dutch GP population invited, who mostly included motivated PWD/FC dyads with relatively little burden, and PWD with limited cognitive decline. The mechanisms of impact for GPs were: interactively learning to initiate ACP with training actors with a heterogeneous group of GPs and PNs. For PWD/FCs dyads, discussing non-medical preferences was most essential regarding their SDM experience and QoL. Some dyads however found ACP stressful and not feasible. Younger female GPs more often initiated ACP. Male PWD and those with mild dementia more often had had ACP. These characteristics and the safe and intimate training setting, were important contextual facilitators.

Conclusion

We recommend Interventions aimed at improving ACP initiation with PWD by GPs to include interactive components and discussion of non-medical preferences. A safe environment and a heterogeneous group of participants facilitates such interventions. However, in practice not all FC/PWD dyads will be ready to start. Therefore, it is necessary to check their willingness when ACP is offered.

Peer Review reports

Background

Dementia is a life limiting syndrome with a worldwide rising number of people being diagnosed per year [1, 2]. Earlier research advised dementia care to be proactive, person-centred and to focus on living and dying well [3, 4]. All these aspects of care can be improved with advance care planning (ACP) [5, 6]. ACP has recently been defined as: “the process which enables individuals to define goals and preferences for future care with family and healthcare professionals and to record and review these preferences when appropriate” [7]. ACP thereby focuses on medical and non-medical care preferences, and should not be restricted to end of life care [7,8,9]. Particularly in dementia, because of the deteriorating cognition, it is advised to start ACP timely. As most people with dementia (PWD) live in the community, ACP initiation by general practitioners (GPs) is most appropriate [2, 10, 11]. However, this hardly takes place.

To train GPs in timely initiating ACP with PWD, we developed an interactive educational intervention, which we evaluated in a cluster randomised controlled trial (RCT) with 38 GPs. The 19 GPs in the intervention group initiated ACP significantly more often and discussed a statistically significant larger number of medical and non-medical preferences than those in the control group. No effects were found on patient-related secondary outcome measures, such as quality of life (QoL), shared decision making (SDM), and family caregivers’ (FCs) competence [12].

The educational intervention under study consisted of multiple components [13]. For such a complex intervention, a process evaluation can help healthcare professionals, researchers and policy makers to understand what contributes to the intervention’s success, and what can be improved. In addition, a process evaluation can provide insights into the intervention’s mechanisms of impact on everyday life by exploring if study participants adopted the trained skills in daily practice and if all stakeholders found these skills appropriate [14, 15].

Also, recruiting GPs, PWD and FCs for research is challenging and often has low GPs’ participation rates and high PWD/FC dropout rates [16, 17].

It is therefore essential to identify the population reached by the educational intervention and investigate if the intervention was found acceptable for both GPs and PWD/FC dyads [18,19,20].

For those reasons, we aimed to explore the implementation of the educational intervention by focussing on reach and acceptability. We also aimed to explore the impact of the intervention’s mechanisms on everyday life by focussing on the adoption and appropriateness of ACP in daily practice, including the experiences of GPs, PWD and their FCs. We also defined contextual factors important to both implementation and the mechanisms of impact.

Methods

We used a mixed methods approach and followed the Medical Research Council (MRC) guidance for process evaluations [19]. We addressed the intervention’s implementation, mechanisms of impact on everyday life and relevant contextual factors. With regard to implementation, we focussed on reach and acceptability. Reach was defined as the educational intervention having reached the intended stakeholders. For GPs this meant that they participated in the training. For PWD/FC dyads this meant that they participated in at least one ACP conversation with their GP. Acceptability was defined as the educational intervention being acceptable, as experienced by the stakeholders [19,20,21]. With regard to the intervention’s mechanisms of impact in daily practice we focussed on adoption and appropriateness. Adoption was defined as the participants’ intention or initial decision to employ ACP in practice. Appropriateness was defined as participants perceiving ACP relevant in daily primary care practice [19,20,21]. As for contextual factors, we focussed on the setting of the intervention and the characteristics of the study participants. Contextual factors can influence both implementation and mechanisms of impact [19].

Ethical consent

The study was approved by the medical ethics committee (CMO) of the region Arnhem-Nijmegen in accordance with the Medical Research Involving Human Subjects Acts and the declaration of Helsinki (NL52613.091.15). Anonymity was assured by removing all participant information that could lead to identification from this manuscript.

The educational intervention

Between March and June 2016, we trained 19 GPs in initiating ACP with PWD during two workshops in a small theatre. We hypothesised that first discussing near future non-medical preferences (e.g. housing, daily activities) before preferences on medical scenarios (e.g. hospital admission, or resuscitation) were discussed, would facilitate PWD’s engagement in ACP [8, 9, 22]. Discussing such preferences was therefore included in the training.

We used role playing exercises with training actors, combined with other didactic and interactive, proven effective strategies [23]. A model for shared decision making (SDM) with frail elderly was introduced by a GP specialised in this topic and was used to guide the ACP conversations [24]. Barriers and facilitators (e.g. a trust-based relationship with the GP, engaging all stakeholders, GPs’ proactive attitude, starting timely and regularly reviewing ACP) were addressed by a GP specialized in elderly care (MP) [8, 9]. Participating GPs were invited to bring a practice nurse (PN), as PNs have an important role in dementia care communication in primary care [8, 9]. A full description of the intervention is published elsewhere [12].

Process evaluation participants

The study population consisted of GPs, PNs and PWD/FCs dyads who participated in the RCT, and all trainers who provided the educational intervention. We purposefully selected dyads from different GP practices in order to include participants with characteristics that allowed answering our research questions. Besides, we aimed to include female and male PWD and female and male FCs who had had at least one ACP conversation after their GP was trained.

Data collection on reach and acceptability

With regard to the intervention’s reach we used the following information. Regarding GPs we registered numbers of those invited to the cluster RCT and characteristics of those who decided to participate. We documented which GP included a PN as well as GPs’ and PNs’ workshop attendance. Six months after the intervention, all intervention group GPs were invited to complete an 8-item survey. The first item explored reach as it addressed barriers to include PWD and FCs in the study, using a five-point Likert-scale (totally disagree (1) – totally agree (5)). From PWD and FCs, we registered numbers of those invited to the cluster RCT and characteristics of those who decided to participate. When PWD and FCs decided not to participate they were asked for their reasons.

With regard to exploring the acceptability of the educational intervention we used the following information. GPs and PNs were asked to complete an evaluation form after each of both workshops. This evaluation form consisted of 10 items. Nine items used a five-point Likert-scale (totally disagree (1) - totally agree (5)), rating separate training elements (e.g. the use of training actors; the heterogeneity of the group, meaning that the group consisted of GPs and PNs with different levels of experience). We considered a rating positive when participants agreed or totally agreed with an item. With the last item of the evaluation form, participants were asked to rate the complete workshop (1–10). From all trainers who provided the educational intervention we gathered qualitative data. They took part in a focus group interview, 9 months after the intervention. All were asked for written informed consent. The topic list used was established during several meetings with the research team (BT, MP, YE, RK, MVD) (Supplementary file 1). A researcher (YE), trained in interviewing, chaired the focus group.

Data collection on adoption and appropriateness

With respect to adoption we used the following information. From GPs we used documented ACP conversations in the medical files of included PWD to determine per GP if they initiated ACP discussions. Six months after the intervention, the medical files were analysed retrospectively by two researchers who were blinded to study allocation [12]. We also used item 2 of the GP survey, addressing barriers to initiate ACP with PWD.

With respect to appropriateness we used items 3 to 8 of the GP survey and qualitative data from PWD and FCs. We invited PWD/FCs dyads from the intervention condition to participate in a semi-structured interview. All participants were asked for written informed consent. A researcher (BT), trained in interviewing, conducted each interview at PWD’s homes, assisted by a research assistant. To guide the interviews, a topic list, constructed during several meetings with the research team (BT, MP, YE, RK, MVD) was used. (Supplementary file 2). Data collected are shown in Table 1.

Table 1 Data used to answer our research questions.
Full size table

Additional data

From all participants, demographic characteristics were collected at baseline.

Data analyses

For all quantitative data we used descriptive statistics. With regard to reach we compared the characteristics of PWD, FCs, PNs and GPs who participated in the RCT or who declined. In addition, we analysed the first item of the GP survey on barriers for the inclusion of PWD/FC dyads.

For acceptability, we analysed PNs’ and GPs’ workshop attendance and evaluation. The focus group was audio-taped, transcribed verbatim and analysed with content analysis separately by at least two researchers using Atlas. Ti version 7 software [25]. Text fragments related to our research aim were coded. After each interview, codes from both researchers were compared and merged and a codebook was created. As a next step, the codes were combined into categories and eventually themes. Disagreements during this process were discussed with other members of the research team (MP, YE) [25].

With regard to adoption we compared GPs who did or did not conduct ACP with PWD and FCs. ACP conversations documented in the PWD’s medical file and item 2 of the GP survey were used as our source of data.

For appropriateness, we analysed items 3 to 8 of the GP survey. To analyse the interviews with PWD and FCs, we used content analyses as described above [25].

Results

Implementation of the educational intervention

Reach

We invited 1313 GPs by mail of whom 36 GPs (2.7%) agreed to participate. Characteristics of GPs who declined are unknown. Before randomisation, participating GPs contacted 182 PWD/FCs dyads. Of those, 140 dyads, (78%) gave informed consent (mean age PWD 82y, 58% female; mean age FC 69y, 65% female). For those who declined (n = 42; 22%; mean age PWD 84y, 56% female; mean age FC 76y, 65% female) the expected burden of participation was the most frequently mentioned reason (n = 10).

Item 1 of the survey was completed by 16 (84%) of the 19 GPs from the intervention group. Thirteen (68%) GPs stated they did not invite all PWD who met the inclusion criteria (age ≥ 65, any stage of dementia, FC also participating in the study) to participate. (supplementary file 3) Several reasons for this were mentioned: dementia severity (n = 4); PWD’s/FCs’ lack of motivation to discuss ACP (n = 11), PWD/ FCs not being aware or accepting the dementia diagnosis (n = 5), PWD/FCs denying possible future problems (n = 4).

Acceptability

Of the 19 GPs in the intervention group (range age 36-63y, 8 females), 16 (84%) attended both workshops, and three (16%) attended one workshop. Reasons for non-attendance were: lack of time (n = 2) and illness (n = 1). Of the 18 practice nurses, 15 (83%) attended both workshops. Three (17%) attended only one workshop due to time constraints.

Twenty-six participants (GPs and PNs) completed the workshop’s evaluation form. All were positive about practicing ACP with training actors. All but one (96%) were positive about the workshops’ relevance and alignment with daily practice. Twenty-one (81%) were positive about the presentations on ACP and the SDM model with frail elderly. Twenty-two (85%) were positive about the location of the workshops. Fifteen (58%) were positive about the presentation given by a FC. The workshops received a mean overall rating of 8.1 (out of 10).

The focus group interview with the seven trainers (range age 40-66y, four women) took place in November 2017 at the Radboud University Medical Centre. Data analyses resulted in two themes (the workshops’ successful elements and elements which could be improved; contextual factors) and five categories (communicating goals during ACP; from theory to practice; workshop components which could be improved; the heterogeneity of the workshop participants; the workshop environment). (Table 2).

Table 2 Categories and codes from the focus group interviews with trainers and training actors.
Full size table

Theme 1: the workshops’ successful elements and elements which could be improved

The trainers found practicing ACP with training actors and starting ACP with non-medical preferences currently important to the PWD’s QoL, the most successful workshop elements. In addition, the trainers stated that they demonstrated that for ACP it is important to establish a personal relationship with the person with dementia and FC. Such a relationship creates an atmosphere where difficult issues concerning care preferences and maintaining a dignified remaining phase of life with optimal quality can be discussed. Balancing theoretical and interactive exercises was also considered a successful element.

“When there was more tranquillity during an ACP conversation, and we (trainers who acted as PWD) were given the time to tell things, we actually won time and were able to discuss difficult subjects...... When a GP was rushed, you (training actor) became restless or confused. When there is tranquillity and time is taken, you get a completely different conversation which is also more pleasant.”

Trainers stated that each participant (GPs and PNs) had a different learning curve and that their experiences with PWD and ACP prior to the training differed. This heterogeneity made the workshops challenging. Nevertheless, trainers preferred such a heterogeneous group because participants then also learned from each other.

“I (trainer) have to say... when a group is more diverse, it gets more interesting, especially when a group is not that big, diversity is nice. To me it is not that interesting whether a participant is a PN or a GP. I just see 15 people who want to learn from each other.”

According to the trainers, the presentation given by a FC left room for improvement, as this did not fully address the complexity of caring for a person with dementia. Looking back, the trainers found that they had not discussed the aims of her presentation thoroughly enough with the FC.

Theme 2: contextual factors

According to the trainers, the workshop location (a small theatre) and the limited number of participants (maximum of 15 participants with four trainers), created an intimate and safe setting. As a result, trainers were able to give sufficient personal attention and feedback and participants dared to experiment when practicing ACP conversations.

Mechanisms of impact on everyday life

Adoption

Review of the medical records showed that 16 (84%) of the 19 GPs in the intervention group had had at least one ACP conversation with at least one person with dementia during the 6 months after the intervention. Nine GPs (47%) had had at least one ACP conversation with more than half of the included PWD from their practice. These GPs were younger (45.1 vs. 51.7 years) and more often female (7 out of 9 vs. 3 out of 10) compared to the 10 (53%) GPs who had had ACP conversations with less than half of the PWD from their practice. (Supplementary file 3).

In the GP survey, thirteen (68%) GPs stated they had initiated ACP with all included PWD. (Supplementary file 3) Those who did not, stated that a lack of time and dementia severity were the main reasons for not having initiated ACP.

PWD who had had at least one ACP conversation during the 6 months after the intervention were more often male (71% male vs. 29% female) compared to those who had not had ACP 53% male vs. 47% female). In addition PWD who had ACP more often had very mild dementia (14%) compared to those who had not had ACP (3%). (Table 3).

Table 3 Characteristics of PWD and FCs who had ACP or had no ACP.
Full size table

Appropriateness

Most GPs (57%) found it important to start ACP with discussing non-medical preferences of PWD. All GPs stated that continuing ACP about medical scenarios became easier after these non-medical preferences were known. Fifteen (78%) GPs wanted to start ACP early in the disease trajectory and found engaging FCs not difficult. Nine GPs (47%) found engaging PWD not difficult (Supplementary file 3).

Ten FCs (range age 70-84y, 6 females) and two PWD (age 70 and 84y, both female) were interviewed between January and June 2017. The first two interviews, with PWD, showed that PWD had trouble remembering ACP conversations and were not able to provide information concerning our research aims. We therefore decided to conduct the remaining interviews by telephone with only the FC. After eight interviews no new codes emerged and two more interviews were conducted to confirm saturation. Two themes (experiences with discussing goals, making timely shared decisions) including four categories (discussing medical and non-medical issues, additional ACP outcomes, shared decision making, proactive behavior) were derived. (Table 4).

Table 4 Appropriateness: Categories and codes from the interviews with family caregivers and people with dementia.
Full size table

Theme 1: experiences with discussing preferences

Most FCs indicated that starting ACP with near future non-medical care preferences suited the PWD’s needs as these preferences importantly influenced their current situation and QoL.

“I really liked the fact that not only medical issues were discussed. I always say: when discussing well-being, all aspects of the person have to be discussed”.

Some FCs however stated that ACP had mostly focused on the PWD’s illness and medical preferences. According to them, this was a missed opportunity. Capabilities of PWD and non-medical issues should have been addressed as well.

Most FCs found ACP important as it provided tranquility, clarity, increased their knowledge about dementia, improved the contact with their GP and increased trust in healthcare professionals. FCs also stated that the GP gained more insight in their living situation. Some FCs however found discussing future preferences confronting, stressful and not useful. These FCs only wanted to discuss care when a problem actually arose.

Theme 2: making timely shared decisions

FCs appreciated that they, with the person with dementia, were engaged in ACP conversations. They could both participate and co-decide. FCs felt no hierarchy between them and the GP.

“I really felt we could co-decide. She (GP) would put it on the table, so to speak and then we start talking about it......”

Most FCs appreciated the GPs’ proactive behaviour as FCs would not have initiated ACP themselves.

Some FCs doubted if engaging PWD in ACP was possible because of their memory problems or limited insights. If PWD were unable to make decisions themselves, FCs decided for them, which they found difficult. Most FCs found an annual evaluation of ACP sufficient, while some wanted this at least twice a year. One FC stated that during ACP, the GP gave little opportunity for SDM.

Discussion

In this process evaluation we aimed to explore the implementation of an educational intervention for GPs and PNs about ACP with PWD and their FCS, and the intervention’s mechanisms’ impact including important contextual factors.

The intervention was implemented by a small part of the invited GPs. The participating GPs mostly reached PWD/FC dyads who were motivated and experienced relatively little burden. The intervention’s most successful elements were practicing and experiencing timely ACP with training actors in a heterogeneous group, with near future non-medical preferences and improving QoL as the starting point. The highly appreciated training was acceptable to all stakeholders. The intimate and safe environment appeared to be an important contextual factor.

Most GPs adopted ACP in daily practice. With regard to appropriateness, GPs stated that an early start of ACP including non-medical preferences facilitated ACP. PWD/FCs dyads stated that ACP, including non-medical preferences, improved SDM and was important to PWD’s current QoL. Some FCs doubted the feasibility of ACP. ACP was more often applied by younger female GPs. Male PWD and persons with mild dementia more often had ACP. We therefore consider gender of professionals, PWD and FCs, and dementia severity important contextual factors.

Interpretation of the study in comparison with other literature

Training healthcare professionals in communication skills regarding future care has been shown effective before [26,27,28]. Using role models, simulations and mixed interactive and didactic education in a small and safe environment, as we did, are thereby the most effective approaches [23, 29,30,31,32,33]. Although a Cochrane review concluded that the overall effects of training healthcare professionals are limited, [23] our study showed that education on professional behaviour in performing ACP in daily primary care practice can be substantial. Nevertheless, a maximum implementation degree was not reached [12, 23].

It is not surprising that GPs included PWD/FC dyads of whom they thought to be capable and willing to participate in ACP [7, 34]. ACP and SDM, when aimed at deciding on future medical preferences, require the ability to imagine future scenario’s, which is difficult for PWD, especially when dementia is severe. In addition, willingness and motivation depend on the right timing, perceived barriers and subjects discussed, and are therefore not fixed states assessable at one time point [8, 35, 36]. Regularly checking PWD/FCs dyads’ willingness and motivation, and customizing ACP to the needs and capabilities of those involved, leads to more dyads being engaged and prevents that ACP is experienced as stressful or not feasible [37,38,39,40,41]. In addition, taking in account the role of FCs, as cognitive decline progresses and FCs are deemed to decide for PWD, is thus important [40]. As shown in our results and earlier research, including non-medical preferences in ACP facilitates ACP as these are important to PWD’s current QoL and SDM [8, 9, 42]. To provide appropriate ACP in primary care, we recommend to include such non-medical aspects in future educational interventions.

Our research showed that gender of GPs and PWD are important contextual factors. Younger female GPs more often initiated ACP than their male and older colleagues. This is congruent with previous studies which showed that younger female GPs have more knowledge and more positive attitudes towards dementia care management [43]. We also showed that male PWD more often had had ACP than female PWD. This contrasts with earlier research which found that females are more active in decision making, are more inclined to discuss a wider variety of preferences for future care, feel more empowered by discussing care preferences and believe preferences will be granted when documented [44, 45]. On the other hand, as these characteristics also apply to FCs, the mostly female FCs of the male PWD in our study will have had an important role in initiating ACP in dementia.

In contrast to the secondary outcomes of the cluster RCT, this process evaluation shows that ACP, in which discussing nearby non-medical preferences has a central role, has an impact on experienced involvement in decision making and is important to QoL. This contrast can be explained by the fact that quantitative measurements of QoL do not properly reflect those aspects of daily life individuals find important and appraise for their QoL [46,47,48,49]. Also, earlier research indicated that PWD and FCs find qualitative research methods more appropriate to assess important aspects related to their QoL [50]. Given the above, we emphasize the importance of future research on PWD’s, FCs’ and GPs’ gender, GPs’ age, and relevant more personalised measurements of QoL for PWD.

Study strengths and limitations

This study has several strengths. With the MRC guidance for the process evaluation of complex interventions we were able to provide insights into the effective working mechanisms of the multiple components of the educational intervention and the experiences of stakeholders when gained skills were applied in daily practice [19]. We used a mixed-methods approach, included the views of PWD, FC, GPs and trainers, and included researchers with a wide range of expertise. As a result, triangulation and in-depth understanding of our research findings was achieved [51].

Our study also has some limitations. Recruiting GPs for palliative care education research is known to be difficult and in this study only a small percentage decided to participate [17]. It is known that GPs mainly participate in research they personally find important or valuable for the medical profession as a whole [52, 53]. In addition, part of the GPs doubt the feasibility of ACP in daily practice and are uncertain about how to discuss end-of-life preferences [8, 9]. This might have contributed to the GPs’ low participation rate. However, interventions aimed at relatively new and complex skills are often implemented first in a small group of motivated professionals and from there on spread to the rest of the target population [54].

We were not able to retrieve characteristics of GPs who did not respond or declined to participate. Hence, we were not able to determine if these GPs differed from the participating GPs and could not further explore possible consequences for the intervention’s external validity.

As we did not confront GPs with the difference between the mentioned and documented ACP conversations, we were not able to explain why this discrepancy was found. This can be caused by incomplete medical records which do not reflect actual medical performance [55]. It can also be caused by GPs giving socially desirable answers in the survey.

As PWD were not able to remember ACP conversations, we may not have a complete view of how ACP was applied and experienced in daily practice.

Conclusion

We recommend to include interactive and didactic elements in future educational interventions on ACP with PWD in primary care, and focus on practicing ACP with non-medical preferences aimed at remaining QoL as a starting point. A safe learning environment and heterogeneous groups will increase learning effects. GPs’ younger age and female gender, and PWD’s male gender may positively influence ACP initiation.

In daily practice, ACP can be experienced as stressful and not feasible by some PWD. GPs should therefore check PWD/FC dyads’ willingness to be engaged and only start when they are ready. Future research on interventions to increase engagement of PWD and FCs in ACP is recommended.

We also advise future research to include a broad sample of GPs, PWD and FCs and to take into account how gender of both the professional and patient, and age of healthcare professionals, influences ACP application in daily practice. To improve further initiation of ACP in dementia, we suggest a wider implementation of our educational intervention.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

ACP:

Advance care planning

SDM:

Shared decision making

PWD:

People with dementia

FC:

Family caregiver

GP:

General practitioners

MRC:

Medical research council

QoL:

Quality of life

References

  1. World Health Organization. Dementia fact sheet 2017 [Available from: http://www.who.int/mediacentre/factsheets/fs362/en/.

  2. Winblad B, Amouyel P, Andrieu S, Ballard C, Brayne C, Brodaty H, et al. Defeating Alzheimer’s disease and other dementias: a priority for European science and society. Lancet Neurol. 2016;15:455–532.

    Article  PubMed  Google Scholar 

  3. The Lancet Committee on Dementia. Living and dying with dementia. Lancet. 2018;391(10138):2390.

    Google Scholar 

  4. van der Steen JT, Radbruch L, Hertogh CM, de Boer ME, Hughes JC, Larkin P, et al. White paper defining optimal palliative care in older people with dementia: a Delphi study and recommendations from the European Association for Palliative Care. Palliat Med. 2014;28(3):197–209.

    Article  PubMed  Google Scholar 

  5. Dixon J, Karagiannidou M, Knapp M. The effectiveness of advance care planning in improving end-of-life outcomes for people with dementia and their carers: a systematic review and critical discussion. J Pain Symptom Manage. 2018;55(1):132–50.e1.

    Article  PubMed  Google Scholar 

  6. Houben CH, Spruit MA, Groenen MT, Wouters EF, Janssen DJ. Efficacy of advance care planning: a systematic review and meta-analysis. J Am Med Dir Assoc. 2014;15(7):477–89.

    Article  PubMed  Google Scholar 

  7. Rietjens JAC, Sudore RL, Connolly M, van Delden JJ, Drickamer MA, Droger M, et al. Definition and recommendations for advance care planning: an international consensus supported by the European Association for Palliative Care. Lancet Oncol. 2017;18(9):e543–e51.

    Article  PubMed  Google Scholar 

  8. Tilburgs B, Vernooij-Dassen M, Koopmans R, van Gennip H, Engels Y, Perry M. Barriers and facilitators for GPs in dementia advance care planning: A systematic integrative review. Plos One. 2018;13(6):e0198535.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  9. Tilburgs B, Vernooij-Dassen M, Koopmans R, Weidema M, Perry M, Engels Y. The importance of trust-based relations and a holistic approach in advance care planning with people with dementia in primary care: a qualitative study. BMC Geriatr. 2018;18(1):184.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Schers H, van den Hoogen H, Bor H, Grol R, van den Bosch W. Familiarity with a GP and patients’ evaluations of care. A cross-sectional study. Fam Pract 2005;22(1):15–19.

  11. Evans N, Costantini M, Pasman HR, Van Den Block L, Ga D, Miccinesi G, et al. End-of-life communication: A retrospective survey of representative general practitioner networks in four countries. J Pain Symptom Manag. 2014;47(3):604–19.

    Article  Google Scholar 

  12. Tilburgs B, Koopmans R, Vernooij-Dassen M, Adang E, Schers H, Teerenstra S, et al. Educating Dutch General Practitioners in Dementia Advance Care Planning: A Cluster Randomized Controlled Trial. J Am Med Dir Assoc. 2020;21(6):837–42.

  13. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

  14. Glasgow RE, Klesges LM, Dzewaltowski DA, Estabrooks PA, Vogt TM. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21(5):688–94.

    Article  PubMed  Google Scholar 

  15. Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Hubbard G, Downs MG, Tester S. Including older people with dementia in research: Challenges and strategies. Aging Ment Health. 2003;7(5):351–62.

    Article  CAS  PubMed  Google Scholar 

  17. Thoonsen B, Vissers K, Verhagen S, Prins J, Bor H, Van Weel C, et al. Training general practitioners in early identification and anticipatory palliative care planning: a randomized controlled trial. BMC Fam Pract. 2015;16(1):126.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what is it and how do we do it. BMJ. 2013.

  19. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350.

  20. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Republished research: Implementation research: what it is and how to do it. BMJ. 2014;48(8):731–6.

    Google Scholar 

  22. van de Pol MH, Fluit CR, Lagro J, Slaats Y, Olde Rikkert MG, Lagro-Janssen AL. Shared decision making with frail older patients: Proposed teaching framework and practice recommendations. Gerontol Geriatr Educ. 2017;38:482–95.

  23. Forsetlund L, Bjørndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf FM, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;2.

  24. van de Pol MH, Fluit CR, Lagro J, Slaats YH, Rikkert MGO, Lagro-Janssen AL. Expert and patient consensus on a dynamic model for shared decision-making in frail older patients. Patient Educ Couns. 2016;99(6):1069–77.

    Article  PubMed  Google Scholar 

  25. Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24(2):105–12.

    Article  CAS  PubMed  Google Scholar 

  26. Back AL, Arnold RM, Tulsky JA, Baile WF, Fryer-Edwards KA. Teaching Communication Skills to Medical Oncology Fellows. J Clin Oncol. 2003;21(12):2433–6.

    Article  PubMed  Google Scholar 

  27. Clayton JM, Adler JL, O’Callaghan A, Martin P, Hynson J, Butow PN, et al. Intensive Communication Skills Teaching for Specialist Training in Palliative Medicine: Development and Evaluation of an Experiential Workshop. J Palliat Med. 2012;15(5):585–91.

    Article  PubMed  Google Scholar 

  28. Clayton JM, Butow PN, Waters A, Laidsaar-Powell RC, O’Brien A, Boyle F, et al. Evaluation of a novel individualised communication-skills training intervention to improve doctors’ confidence and skills in end-of-life communication. Palliat Med. 2013;27(3):236–43.

    Article  PubMed  Google Scholar 

  29. Alanazi AA. The use of simulation training to improve knowledge, skills, and confidence among healthcare students: a systematic review. Internet J Allied Health Sci Pract. 2017;15(3):2.

    Google Scholar 

  30. Mehdi Z, Roots A, Ernst T, Birns J, Ross A, Reedy G, et al. Simulation training for geriatric medicine. Clin Teach. 2014;11(5):387–92.

    Article  PubMed  Google Scholar 

  31. Leah V, Combes J, McMillan M, Russell L, McCune K. Experiences of using simulation in dementia education. Nurs Older People (2014+). 2017;29(8):27.

    Article  Google Scholar 

  32. Braude P, Reedy G, Dasgupta D, Dimmock V, Jaye P, Birns J. Evaluation of a simulation training programme for geriatric medicine. Age Ageing. 2015;44(4):677–82.

    Article  PubMed  Google Scholar 

  33. Berkhof M, van Rijssen HJ, Schellart AJM, Anema JR, van der Beek AJ. Effective training strategies for teaching communication skills to physicians: An overview of systematic reviews. Patient Educ Couns. 2011;84(2):152–62.

    Article  PubMed  Google Scholar 

  34. Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, et al. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012;27(10):1361–7.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Mullick A, Martin J, Sallnow L. An introduction to advance care planning in practice. BMJ. 2013;347(7930):28–32.

    Google Scholar 

  36. van der Steen JT, van Soest-Poortvliet MC, Hallie-Heierman M, Onwuteaka-Philipsen BD, Deliens L, de Boer ME, et al. Factors associated with initiation of advance care planning in dementia: a systematic review. J Alzheimers Dis. 2014;40(3):743–57.

    Article  PubMed  Google Scholar 

  37. Politi MC. importance of clarifying patients desired role in shared decision making to match their level of engagement with their preferences. BMJ. 2013;347:7066.

    Article  Google Scholar 

  38. Elwyn G, Durand MA, Song J, Aarts J, Barr PJ, Berger Z, et al. A three-talk model for shared decision making: multistage consultation process. BMJ. 2017;359.

  39. Fried TR, Bullock K, Iannone L, O’Leary JR. Understanding Advance Care Planning as a Process of Health Behavior Change. J Am Geriatr Soc. 2009;57(9):1547–55.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Groen-van de Ven L, Smits C, Span M, Jukema J, Coppoolse K, de Lange J, et al. The challenges of shared decision making in dementia care networks. Int Psychogeriatr. 2016:1–15.

  41. Glaudemans JJ, Moll van Charante EP, Willems DL. Advance care planning in primary care, only for severely ill patients? A structured review. Fam Pract. 2015;32(1):16–26.

    Article  PubMed  Google Scholar 

  42. Mignani V, Ingravallo F, Mariani E, Chattat R. Perspectives of older people living in long-term care facilities and of their family members toward advance care planning discussions: a systematic review and thematic synthesis. Clinical Interv Aging. 2017;12:475–84.

    Article  Google Scholar 

  43. Turner S, Iliffe S, Downs M, Wilcock J, Bryans M, Levin E, et al. General practitioners’ knowledge, confidence and attitudes in the diagnosis and management of dementia. Age Ageing. 2004;33(5):461–7.

    Article  PubMed  Google Scholar 

  44. Perkins HS, Hazuda HP, Cortez JD. Advance Care Planning: Does Patient Gender Make a Difference? Am J Med Sci. 2004;327(1):25–32.

    Article  PubMed  Google Scholar 

  45. Arora NK, McHorney CA. Patient preferences for medical decision making: who really wants to participate? Med Care. 2000;38.

  46. Muldoon MF, Barger SD, Flory JD, Manuck SB. What are quality of life measurements measuring? BMJ. 1998;316(7130):542–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Prutkin JM, Feinstein AR. Quality-of-life measurements: origin and pathogenesis. Yale J Biol Medi. 2002;75(2):79–93.

    Google Scholar 

  48. Bowling A, Rowe G, Adams S, Sands P, Samsi K, Crane M, et al. Quality of life in dementia: a systematically conducted narrative review of dementia-specific measurement scales. Aging Ment Health. 2015;19(1):13–31.

    Article  PubMed  Google Scholar 

  49. Gill TM, Feinstein AR. A critical appraisal of the quality of quality-of-life measurements. Jama. 1994;272(8):619–26.

    Article  CAS  PubMed  Google Scholar 

  50. Øksnebjerg L, Diaz-Ponce A, Gove D, Moniz-Cook E, Mountain G, Chattat R, et al. Towards capturing meaningful outcomes for people with dementia in psychosocial intervention research: A pan-European consultation. Health Expect. 2018;21(6):1056–65.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Kuper A. An introduction to reading and appraising qualitative research. BMJ. 2008;337(7666):404.

    Google Scholar 

  52. Heywood A, Mudge P, Ring I, Sanson-Fisher R. Reducing systematic bias in studies of general practitioners: the use of a medical peer in the recruitment of general practitioners in research. Fam Pract. 1995;12(2):227–31.

    Article  CAS  PubMed  Google Scholar 

  53. Rosemann T, Szecsenyi J. General practitioners’ attitudes towards research in primary care: qualitative results of a cross sectional study. BMC Fam Pract. 2004;5(1):31.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Berwick DM. Disseminating innovations in health care. Jama. 2003;289(15):1969–75.

    Article  PubMed  Google Scholar 

  55. Chan KS, Fowles JB, Weiner JP. Review: Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature. Med Care Res Rev. 2010;67(5):503–27.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

The author(s) disclose receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by the ZonMw Memorabel program, project number 79–73305–98-420. The funders had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Author notes

  1. Marieke Perry and Yvonne Engels contributed equally to this work.

Authors and Affiliations

  1. Department of IQ Healthcare, Radboudumc, Nijmegen, The Netherlands

    Bram Tilburgs & Myrra Vernooij-Dassen

  2. Department of primary and community care, Radboudumc, Nijmegen, The Netherlands

    Raymond Koopmans, Henk Schers & Marieke Perry

  3. Radboudumc Alzheimer Centre, Nijmegen, The Netherlands

    Raymond Koopmans & Marieke Perry

  4. Joachim en Anna, Centre for specialized geriatric care, Nijmegen, The Netherlands

    Raymond Koopmans

  5. Research Group Innovating with Older Adults, Windesheim University of Applied Sciences, Zwolle, The Netherlands

    Carolien Smits

  6. Department of geriatric medicine, Radboudumc, Nijmegen, The Netherlands

    Marieke Perry

  7. Department of anesthesiology, pain and palliative medicine, Radboudumc, Nijmegen, The Netherlands

    Yvonne Engels

Authors
  1. Bram Tilburgs
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Raymond Koopmans
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Henk Schers
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carolien Smits
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Myrra Vernooij-Dassen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Marieke Perry
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Yvonne Engels
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

BT: contributed to the conception and design, data analysis and data interpretation, writing of the manuscript. RK: contributed to the design, data analysis, data interpretation and writing of the manuscript. MvD: contributed to the design, data interpretation and writing of the manuscript. HS: contributed to data interpretation and writing of the manuscript. CS: contributed to data interpretation and writing of the manuscript. YE: contributed to the design, data analysis, data interpretation and writing of the manuscript. MP: contributed to the design, data analysis, data interpretation and writing of the manuscript. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Bram Tilburgs.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the research ethics committee (CMO) of the region Arnhem-Nijmegen in accordance with the Medical Research Involving Human Subjects Acts and the declaration of Helsinki (NL52613.091.15). Anonymity was assured by removing all participant information that could lead to identification from the transcripts. Written consent was obtained from all participants. The family caregiver gave consent on behalf of the person with dementia.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Supplementary file 1.

Topic list focus group interview with workshop trainers.

Additional file 2: Supplementary file 2

. Topic list interviews with people with dementia and family care givers.

Additional file 3: Supplementary file 3.

Characteristics of GPs who did or did not have ACP and the items of the GP survey.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tilburgs, B., Koopmans, R., Schers, H. et al. Advance care planning with people with dementia: a process evaluation of an educational intervention for general practitioners. BMC Fam Pract 21, 199 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12875-020-01265-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12875-020-01265-z

Keywords

BMC Primary Care

ISSN: 2731-4553

Contact us