- Research article
- Open Access
Feasibility and success rates of response enhancing strategies in a stepwise prevention program for cardiometabolic diseases in primary care
BMC Family Practice volume 21, Article number: 228 (2020)
Prevention programs for cardiometabolic diseases (CMD), including cardiovascular disease, diabetes mellitus and chronic kidney disease are feasible, but evidence for the cost-effectiveness of selective CMD prevention programs is lacking. Response rates have an important role in effectiveness, but methods to increase response rates have received insufficient attention. The aim of the current study is to determine the feasibility and the success rate of a variety of response enhancing strategies to increase the participation in a selective prevention program for CMD.
The INTEGRATE study is a Dutch randomised controlled trial to assess the effectiveness and cost-effectiveness of a stepwise program for CMD prevention. During the INTEGRATE study we developed ten different response enhancing strategies targeted at different stages of non-response and different patient populations and evaluated these in 29 general practices.
A face-to-face reminder by the GP increased the response significantly. Digital reminders targeted at patients with an increased CMD risk showed a positive trend towards participation. Sending invitations and reminders by e-mail generated similar response rates, but at lower costs and time investment than the standard way of dissemination. Translated materials, information gatherings at the practice, self-management toolkits, reminders by telephone, information letters, local media attention and SMS text reminders did not increase the response to our program.
Inviting or reminding patients by e-mail or during GPs consultation may enhance response rates in a selective prevention program for CMD. Different response-enhancing strategies have different patient target populations and implementation issues, therefore practice characteristics need to be taken into account when implementing such strategies.
Dutch trial Register number NTR4277. Registered 26 November 2013.
Cardiometabolic diseases (CMD), including cardiovascular disease, diabetes mellitus and chronic kidney disease exercise increasing pressure on the healthcare costs. Because of the modifiable nature of many risk factors, 80% of cardiometabolic diseases can be prevented . Selective prevention programs for CMD, targeting an apparently healthy population with a stepwise program in order to select only those at high risk, seem a promising and cost-effective strategy [1, 2]. With this approach risk-reducing interventions can be targeted at patients at high risk. However, up to now, no convincing evidence has been provided that selective prevention programs for CMD are cost-effective . An important aspect in the effectiveness of a prevention program is the response rate , as studies have shown a wide variation in participation [2, 3, 5]. Mapping response rates and identifying methods to improve them has received little attention so far. If we could increase participation in prevention programs, their effectiveness on population level would increase simultaneously.
Several studies have been performed to gain more insight into the characteristics of non-responders in prevention programs for CMD [5,6,7,8,9,10,11,12,13,14]. Non-responders are reported to be more often male, smoke more often and being of younger age [5, 7, 8, 10,11,12,13,14]. A lower socio-economic status (SES) and a migrant status is also reported to be related to non-response [5, 7, 9, 10, 15]. If these groups could be reached with targeted response enhancing strategies, this could lead to an increased participation.
Various studies explored strategies to enhance response rates in preventive and screening programs in general [16, 17] and for prevention programs for CMD specifically . Commonly used methods are reminders by letter or telephone, face-to-face reminders by a physician, providing educational material and publicity through different media. With the aforementioned characteristics of non-responders taken into account, more advanced response-enhancing strategies are developed to specifically reach the underperforming groups. Invitations or reminders by e-mail  or SMS text messages  might be attractive for the younger population. The provision of a toolkit for self-testing already resulted in an enhanced uptake for cervical cancer screening . Patients from lower SES groups and migrants may benefit from culture specific information meetings and translated questionnaires .
Successful response enhancing strategies may also be guided by specific preferences of non-responders. During the INTEGRATE study  we assessed attitudes towards different response enhancing strategies amongst non-responders. Most non-responders would reconsider participation if they would receive a face-to-face invitation by their own GP, if the awareness of the program would be enhanced through media exposure or if more informative information would be offered. However, the feasibility and success rates of these strategies are yet to be determined in clinical practice.
The design of the INTEGRATE study  made it possible to develop and to evaluate response enhancing strategies in the same study population. Here we report on the feasibility and the success rates of a variety of response enhancing strategies to increase the participation in a selective prevention program for CMD.
The INTEGRATE study is a stepped-wedge randomized controlled trial that ran from 2014 to 2017. The aim of the INTEGRATE study is to assess the cost-effectiveness of a stepwise CMD prevention program. In 37 participating general practices, all listed patients between 45 and 70 years old without CMD, hypertension or hypercholesterolemia were invited to participate in the prevention program. Patients were randomly allocated to an intervention group or a waiting list control group that was invited for the program after 1 year. To minimize the workload in the GP practices, both the intervention and the waiting list control group were enrolled gradually using different time slots (intervention group 1 and 2 in April and June 2015 and control group 1 and 2 in April and June 2016). The first step was selecting eligible patients, who were subsequently asked to complete a risk estimation score (RS) consisting of seven risk factors for CMD (age, gender, smoking status, body mass index (BMI), waist circumference, family history of type II diabetes mellitus and cardiovascular disease). Eligible patients received a personal invitation letter from their own GP to complete the RS online. All invitation letters included a short summary of the instruction in English, Turkish and Arab. All patients who did not respond within 2 weeks received a reminder for the online RS and additionally a paper version of the RS and a return envelope.
Patients with a low score on the RS received (online) tailored lifestyle advice. Patients with a high score on the RS (increased risk patients) were advised to visit their GP for additional measurements to complete their risk profile, followed by a tailored lifestyle advice and/or treatment if indicated. Further details of the design of the INTEGRATE study are described elsewhere .
All strategies were implemented during the follow-up phase of the trial, during which the waiting list control groups were invited for participation in the prevention program. The patients in the waiting list group were randomly assigned to a subgroup within the same practice, the ‘strategy group’ (exposed to a response enhancing strategy) or to the ‘standard method group’ (approached as described in the previous section).
Different strategies for increasing response were targeted at non-responders at different stages of the prevention program, stage 1 and stage 2. Non-responders stage 1 were the non-responders who did not respond to the online or paper RS, non-responders stage 2 were the non-responders with an increased risk score on the RS who did not contact their GP. Some strategies were aimed at both types of non-responders (stage 1 + 2). An overview of the different strategies timed at the different stages is shown in Fig. 1.
In 29 of the 37 participating practices in the INTEGRATE study one or more response enhancing strategies was implemented; in 8 practices it was not feasible to arrange a strategy within the set timeframe. The different strategies were allocated in consultation with the participating practices, guided by specific practice characteristics such as patient population (number of people of low SES and/or migrant status), the percentage of patients of whom the e-mail address or mobile phone number was known in the practice, the availability of support staff and the individual preferences of the GP or practice nurse.
Response enhancing strategies
Based on the literature and a survey among first phase non-responders  we developed ten different response enhancing strategies. Taking the suggestions of the first phase non-responders into consideration, we selected strategies using a pop-up reminder in the computer system of the GP, extended information letters and information gatherings at the general practice, among others. The background and implementation of these strategies, their timing, types of non-responders (stage 1, stage 2 or stage 1 + 2) and the number of practices and patients involved are described in Table 1 and Fig. 1.
The success rate was based on the response rates of either step of the program. The response to the RS was defined as the percentage of patients who completed the RS (either online or on paper) of the total number of patients who received an invitation to do so. Participation in stage 2 of the prevention program was defined as the number of patients with an increased risk score on the RS who visited the GP according to the case report forms, electronic medical record or self-reported in the study questionnaire.
To determine the feasibility of the response enhancing strategies we estimated the time investment and additional costs per strategy, which were subsequently expressed in categories (low/average/high) for an average sized practice population for 1 full-time GP (n = 2095 patients). The definition of time investment was low when the time spent was half or less than half the time compared to the standard method. Time investment was high when twice as much time or more was needed. Costs were low when the costs were half or less compared to the costs for the standard method, the costs were high when the costs were twice as high or more.
Descriptive analyses of all measurements were performed. Univariate multilevel logistic regression analyses were used to compare the differences in response rates between those exposed to the response enhancing strategies and those exposed to the standard method. Crude odds ratios and 95% confidence intervals were reported. Stata version 15 was used for all statistical analyses.
The response for the RS showed a 3% seasonal variation (June vs. April), most likely due to a lower response during the summer holiday. This difference was seen in the two intervention groups as well as in the waiting list control groups. We therefore adjusted the response rates in the groups invited in June by adding 3% to the response at the RS.
All ten response enhancing strategies turned out to be feasible in the setting of the INTEGRATE study; 29 general practices implemented one or more strategies. Response rates for the RS in the standard method groups was on average 33%, ranging from 16 to 48% between practices. From all patients filling in the RS 38% turned out to be at increased risk, 38% of these patients visited the GP.
We sent a translated version of the RS (strategy 2) to 4604 patients; only 12 (0.3%) completed translated RSs were returned (2 in English, 7 in Turkish and 3 in Arab).
Mobile numbers were known for only 73 of the 188 patients eligible to receive a reminder via SMS (strategy 5). They received a SMS reminder 4 weeks after the invitation letter. Sixteen patients (22%) filled in the RS after receiving the SMS, whereas 11 patients from the standard method group (15%) spontaneously filled in the RS in these 4 weeks. Nine out of the sixteen patients who filled in the RS after an SMS had an increased risk. None of the patient who received an SMS showed up for a GP consultation.
Of the 34 patients who were scheduled for a reminder by telephone (strategy 6), 11 patients (32%) could not be reached by telephone after two attempts within office hours. Among those who could be reached, 13 patients (38%) completed the RS of which 4 patients had an increased risk and reported to have already made an appointment with the GP. The remainder 10 patients (29%) indicated not to be interested in participating.
The two information gatherings (strategy 8) were scarcely attended: of the 545 invited patients only 3 patients showed up from the first practice and 2 patients at the meeting in the second practice (response rate of 0.9%).
Self-management toolkits (strategy 9) were offered for free to 174 patients at increased risk. 33 toolkits were ordered, 22 patients completed their risk profiles with self-executed measures, resulting in 6 patients with an increased risk who were given the advice to visit their GP of which 1 patient actually visited.
To determine the effectiveness of the other response enhancing strategies (strategy 1, 3,4,7 and 10) we compared the response rates of the RS (stage 1) and participation of stage 2 of the prevention program between the strategy groups and the standard method groups. The results of these analyses are shown in Table 2.
We found a significant increase in the participation rate for stage 2 of the prevention program when the GP received a pop-up reminder when opening the patient’s electronic medical record (strategy 7) (OR 4.63 [1.15–18.67]).
Although invitations and reminders by e-mail (strategy 1) did show a positive trend in improving participation (OR 1.51 [0.92–2.46]), none of the implemented combinations of invitations and/or reminders by e-mail showed a significant increase in response amongst the non-responders at stage 1. However, we observed in practices who implemented strategy 1 that, independently of the invitation method, the response rate for the RS amongst patients with an e-mail address known to the GP practice was statistically significantly higher than amongst patients without a known e-mail address (49% vs. 32%, p = 0.000, not shown in table), demonstrating that this variable is strongly associated with response.
Sending an e-mail reminder to increased risk patients (strategy 10) also had a positive, but not statistically significant, effect on the number of patients who consulted their GP (OR 1.46 [0.86–2.48]).
We found no effect of local media attention (strategy 4) on the response rates. Those who received an extended information letter (strategy 3) had a lower response rate to the RS and a lower participation rate to stage 2 of the program, although this difference was not statistically significant (OR 0.79 [0.58–1.08]).
Table 3 shows an overview of the response enhancing strategies which we implemented during this study, with their target group, an estimation of the costs and time investment required and implementation challenges experienced in the participating practices. The time spent on the standard method was on average 10 h per practice, with the costs involved estimated at € 750 per average sized practice. The required time for the different strategies ranged from 4 h to 47 h, the costs ranged from € 0 to € 2025. More details about the actual time investment and the calculation of the costs can be found in Additional file 1. E-mail reminders and/or invitations are low in costs and require limited time investment, however do require computer skilled personnel and a substantial part of the patients whose e-mail address is known in the practice. All response enhancing strategies had their specific target population and implementation issues, making different strategies more suitable for different practices depending on practice characteristics and patient population. Therefore, the feasibility of the different strategies strongly depends on the circumstances and characteristics of the practice.
In this study we evaluated different strategies to increase the participation rates in a selective prevention program for CMD in primary care. Using a pop-up reminder, integrated in the computer system of the GP, increased the participation to our prevention program significantly. We also found a positive trend in the response rate when using e-mail invitations and reminders, a method that requires little time investment and the costs. Translated materials, information gatherings at the practice, self-management toolkits, reminders by telephone, extended information letters, local media attention and SMS text reminders did not increase the response to our program.
Strengths and limitations
This is the first study to implement and evaluate different response enhancing strategies within the context of an RCT evaluating the effectiveness of a CMD prevention program. For most response enhancing strategies we were able to compare the effect of the intervention to a control group from the same practice. The design of the INTEGRATE study made it possible to develop different response enhancing strategies with input from the target population and implement the strategies in the same study population. One of the most important limitations of our study is that due to the many strategies tested, the number of patients in the strategy and standard method groups were small, which influenced the statistical power and therefore the robustness of the results. Nevertheless, the results provide a useful insight into the more and less effective strategies.
Comparison with current literature
The positive effect of face-to-face reminders by the GP is in line with the results of a meta-analysis of Cheong et al. , who found reminding physicians to invite patients for cardiovascular screening to be effective. The time investment for entering pop-ups in the computer system, however, is high so this method would be best suited for practices that work with a computer system that has an option to create pop-ups automatically. This method also requires that the GP is motivated to address the cardiovascular risk when a patient consults for different reasons.
To the best of our knowledge, this is the first study on the effect of reminders and invitations by e-mail on the response rates in prevention programs for CMD. This strategy can be easily implemented, the extra time investment and the costs are low. The different combinations of e-mail invitations and/or reminders for the RS we implemented did not significantly increase the response. Nevertheless, approaching patients by e-mail resulted in comparable response rates as the standard method, but at lower costs and with less time investment. A remarkable observation was that patients whose e-mail address was known in the GP practice, were more likely to participate regardless the method of approaching. This might be explained by the health care consumption pattern of these patients. Those with a high health care utilization have more frequent contacts with their GP, which makes it more likely that their e-mail address is recorded. In addition, patients who have a better relationship with their GP might feel more compelled when their GP sends them a personal invitation for a RS. In contrast, patients with a tendency to avoid health care have no regular contacts with their GP and may therefore not be inclined to fill in a RS.
Sending an additional reminder by e-mail to patients with an increased risk showed a positive trend on the response rate at stage 2 of the program. Both this additional reminder and the face-to-face reminders target patients who scored high on the RS, these patients showed to have an increased risk for CMD and also showed to be willing to enter the program by participating in stage 1. Nevertheless, on average only 1 in 3 patients with an increased risk visited their GP. These non-responders are an interesting target group for they could potentially benefit most from a prevention program.
The effectiveness of reminders by telephone was low in this study. This is in line with the non-response analysis we performed earlier, where 78% of the non-responders reported that they would not reconsider participation when approached by telephone . Letter and telephone reminders showed significantly higher response rates in cancer screening programs [16, 17] and prevention programs for CMD, some of them in a study population with a low SES [24,25,26]. It is a possibility that reminders by telephone are more effective when they can be targeted more specifically.
The effect of the extended information letter showed a negative effect on the response rate, although this effect was not statistically significant. It is possible that an information ‘overload’ decreased the motivation to participate. Previous studies showed heterogeneous results for extended educational material and public information campaigns [17, 27]. The extended information letter that we used in our study was not personalised, a potentially stimulating factor that might be addressed more with a face-to-face reminder [5, 9, 28].
Translated materials and information gatherings, strategies specifically targeted at the migrant and/or low SES population, were unsuccessful even though the costs were high. These strategies cannot be recommended for other prevention programs.
Part of the suggested response enhancing strategies given by the first phase non-responders during our earlier survey did not function in real condition. A possible explanation for this gap is that motivation for prevention and health behaviour are more complex than we, and the non-responders themselves, had estimated and therefore proves difficult to influence.
Patients identified at increased CMD risk are the optimal target group for response enhancing strategies, this could be achieved with the installation of pop-ups in the GPs’ computer systems to facilitate personal reminders. Invitation by e-mail for a prevention program is feasible at relatively low costs and time investment, though further research to confirm these findings is warranted. Finally, enhancing response in prevention programs for CMD is a difficult and complex process. There is no ‘one size fits all’ response enhancing protocol for all general practices. Population and practice characteristics need to be carefully considered to select successful recruitment strategies.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Body mass index
Piepoli MF, Hoes AW, Agewall S, Albus C, Brotons C, Catapano AL, et al. 2016 European Guidelines on cardiovascular disease prevention in clinical practice. Eur Heart J. 2016;37:2315–81.
Den Engelsen C, Koekkoek PS, Godefrooij MB, Spigt MG, Rutten GE. Screening for increased cardiometabolic risk in primary care: a systematic review. Br J Gen Pract. 2014;64:e616–26.
Dyakova M, Shantikumar S, Colquitt JL, Drew CM, Sime M, Maciver J, et al. Systematic versus opportunistic risk assessment for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2016;2016(1):CD010411.
Andersen MR, Urban N, Ramsey S, Briss PA. Examining the cost-effectiveness of cancer screening promotion. Cancer. 2004;101(5 Suppl):1229–38.
Koopmans B, Nielen M, Schellevis F, Korevaar J. Non-participation in population-based disease prevention programs in general practice. BMC Public Health. 2012;12:856.
Assendelft WJJ, Nielen MMJ, Hettinga DM, Van Der Meer V, Van Vliet M, Drenthen AJM, et al. Bridging the gap between public health and primary care in prevention of cardiometabolic diseases; background of and experiences with the prevention consultation in the Netherlands. Fam Pract. 2012;29(Suppl 1):i126–31.
Lambert AM, Burden AC, Chambers J, Marshall T. Cardiovascular screening for men at high risk in heart of Birmingham teaching primary care trust: the “deadly trio” programme. J Public Health (Bangkok). 2012;34:73–82.
Dalton ARH, Bottle A, Okoro C, Majeed A, Millett C. Uptake of the NHS health checks programme in a deprived, culturally diverse setting: cross-sectional study. J Public Health (Oxf). 2011;33:422–9.
Groenenberg I, Crone MR, van Dijk S, Ben Meftah J, Middelkoop BJC, Assendelft WJJ, et al. Determinants of participation in a cardiometabolic health check among underserved groups. Prev Med Rep. 2016;4:33–43.
Hoebel J, Starker A, Jordan S, Richter M, Lampert T. Determinants of health check attendance in adults: findings from the cross-sectional German health update (GEDA) study. BMC Public Health. 2014;14:913.
Weinehall L, Hallgren CG, Westman G, Janlert U, Wall S. Reduction of selection bias in primary prevention of cardiovascular disease through involvement of primary health care. Scand J Prim Health Care. 1998;16:171–6.
Klijs B, Otto SJ, Heine RJ, Van Der Graaf Y, Lous JJ, De Koning HJ. Screening for type 2 diabetes in a high-risk population: study design and feasibility of a population-based randomized controlled trial. BMC Public Health. 2012;12:1.
Lang SJ, Abel GA, Mant J, Mullis R. Impact of socioeconomic deprivation on screening for cardiovascular disease risk in a primary prevention population: a cross-sectional study. BMJ Open. 2016;6:1–9.
de Waard AKM, Wändell PE, Holzmann MJ, Korevaar JC, Hollander M, Gornitzki C, et al. Barriers and facilitators to participation in a health check for cardiometabolic diseases in primary care: a systematic review. Eur J Prev Cardiol. 2018;25:1326–40.
Cochrane T, Gidlow CJ, Kumar J, Mawby Y, Iqbal Z, Chambers RM. Cross-sectional review of the response and treatment uptake from the NHS health checks programme in Stoke on Trent. J Public Heal. 2013;35:92–8.
Jepson R, Clegg A, Forbes C, Lewis R, Sowden A, Kleijnen J. The determinants of screening uptake and interventions for increasing uptake: a systematic review. Health Technol Assess. 2000;4:14.
Camilloni L, Ferroni E, Cendales BJ, Pezzarossi A, Furnari G, Borgia P, et al. Methods to increase participation in organised screening programs: a systematic review. BMC Public Health. 2013;13:464.
Cheong A, Liew S, Khoo E, Mohd Zaidi N, Chinna K. Are interventions to increase the uptake of screening for cardiovascular disease risk factors effective? a systematic review and meta-analysis. BMC Fam Pract. 2017;18:4.
Gabrielli E, Bastiampillai AJ, Pontello M, Beghi G, Ceresa P, Pirola ME, et al. Observational study to evaluate the impact of internet reminders for GPs on colorectal cancer screening uptake in northern Italy in 2013. J Prev Med Hyg. 2016;57:211–5.
Heatley E, Middleton P, Hague W, Crowther C. The DIAMIND study: postpartum SMS reminders to women who have had gestational diabetes mellitus to test for type 2 diabetes: a randomised controlled trial – study protocol. BMC Pregnancy Childbirth. 2013;13:92.
Groenenberg I, Crone MR, van Dijk S, Gebhardt WA, Ben Meftah J, Middelkoop BJC, et al. Check it out! “Decision-making of vulnerable groups about participation in a two-stage cardiometabolic health check: A qualitative study”. Patient Educ Couns. 2015;98:234–44.
Badenbroek IF, Nielen MMJ, Hollander M, Stol DM, Drijkoningen AE, Kraaijenhagen RA, et al. Mapping non-response in a prevention program for cardiometabolic diseases in primary care: How to improve participation? Prev Med Rep. 2020;19(April):101092.
Badenbroek IF, Stol DM, Nielen MM, Hollander M, Kraaijenhagen RA, De Wit GA, et al. Design of the INTEGRATE study: effectiveness and cost-effectiveness of a cardiometabolic risk assessment and treatment program integrated in primary care. BMC Fam Pract. 2014;15:1–10.
Thorogood M, Coulter A, Jones L, Yudkin P, Muir J, Mant D. Factors affecting response to an invitation to attendfor a health check. J Epidemiol Community Health. 1993;47:224–8.
Groenenberg I, Crone MR, van Dijk S, Ben Meftah J, Middelkoop BJC, Assendelft WJJ, et al. Response and participation of underserved populations after a three-step invitation strategy for a cardiometabolic health check. BMC Public Health. 2015;15:854.
Gidlow C, Ellis N, Randall J, Cowap L, Smith G, Iqbal Z, et al. Method of invitation and geographical proximity as predictors of NHS health check uptake. J Public Health (Oxf). 2015;37:195–201.
Sallis A, Bunten A, Bonus A, James A, Chadborn T, Berry D. The effectiveness of an enhanced invitation letter on uptake of National Health Service Health Checks in primary care: a pragmatic quasi-randomised controlled trial. BMC Fam Pract. 2016;17.
Ellis N, Gidlow C, Cowap L, Randall J, Iqbal Z, Kumar J. A qualitative investigation of non-response in NHS health checks. Arch Public Health. 2015;73:14.
The authors thank NIPED Institute for the contribution to data management.
This work was supported by ZonMW (The Netherlands Organization for Health Research and Development) under grant number 50–51515–98-192; Lekker Lang Leven (a collaboration of the Dutch Diabetes Research Foundation, the Dutch Heart Foundation and the Dutch Kidney Foundation) under grant number 2012.20.1595; and Innovatiefonds Zorgverzekeraars (Healthcare Insurance Innovation Fund) under grant number 2582. The sponsors played no role in study design, data collection, data analysis, data interpretation, or writing of the report.
Ethics approval and consent to participate
The INTEGRATE study was judged by the UMC Utrecht Institutional Review Board and exempted from full assessment according to the Medical Research involving human subjects Act (WMO). A written informed consent was obtained from all participants.
Consent for publication
The authors declare that there is no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Detailed overview of different response enhancing strategies. p.p. = per patient, min = minute(s), RS = risk score * Average practice size of 2095 patient, approximately 375 patients eligible for prevention program. ** If 19% of patients with increased risk on RS order the box (17 patients).
About this article
Cite this article
Badenbroek, I.F., Nielen, M.M.J., Hollander, M. et al. Feasibility and success rates of response enhancing strategies in a stepwise prevention program for cardiometabolic diseases in primary care. BMC Fam Pract 21, 228 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12875-020-01293-9
- Cardiovascular diseases
- Primary prevention
- Health risk assessment
- General practice
- Patient participation rates