- Study protocol
- Open Access
- Open Peer Review
Targeted prevention in primary care aimed at lifestyle-related diseases: a study protocol for a non-randomised pilot study
BMC Family Practice volume 19, Article number: 124 (2018)
The consequences of lifestyle-related disease represent a major burden for the individual as well as for society at large. Individual preventive health checks to the general population have been suggested as a mean to reduce the burden of lifestyle-related diseases, though with mixed evidence on effectiveness. Several systematic reviews, on the other hand, suggest that health checks targeting people at high risk of chronic lifestyle-related diseases may be more effective. The evidence is however very limited. To effectively target people at high risk of lifestyle-related disease, there is a substantial need to advance and implement evidence-based health strategies and interventions that facilitate the identification and management of people at high risk. This paper reports on a non-randomized pilot study carried out to test the acceptability, feasibility and short-term effects of a healthcare intervention in primary care designed to systematically identify persons at risk of developing lifestyle-related disease or who engage in health-risk behavior, and provide targeted and coherent preventive services to these individuals.
The intervention took place over a three-month period from September 2016 to December 2016. Taking a two-pronged approach, the design included both a joint and a targeted intervention. The former was directed at the entire population, while the latter specifically focused on patients at high risk of a lifestyle-related disease and/or who engage in health-risk behavior. The intervention was facilitated by a digital support system. The evaluation of the pilot will comprise both quantitative and qualitative research methods. All outcome measures are based on validated instruments and aim to provide results pertaining to intervention acceptability, feasibility, and short-term effects.
This pilot study will provide a solid empirical base from which to plan and implement a full-scale randomized study with the central aim of determining the efficacy of a preventive health intervention.
Registered at Clinical Trial Gov (Unique Protocol ID: TOFpilot2016). Registered 29 April 2016. The study adheres to the SPIRIT guidelines.
In this paper we report on a non-randomized pilot study examining the efficacy of a preventive healthcare intervention. The intervention has been designed to systematically identify patients at high risk of developing lifestyle-related disease, and provide targeted and coherent preventive services to these individuals .
Lifestyle-related disease refers to health conditions that are predominantly caused by health-risk behaviors, such as poor diet, smoking, high consumption of alcohol, or lack of exercise. The consequences of lifestyle-related disease represent a major challenge for the individual as well as for society at large . In Denmark, people who smoke tobacco, consume excessive amounts of alcohol, and have a sedentary lifestyle are nearly seven times as likely to die from lifestyle-related diseases than physically active non-smokers with a moderate intake of alcohol . It is estimated that 80% of cardio-vascular disease (CVD), type 2-diabetes mellitus (T2DM), and chronic obstructive pulmonary disease (COPD), and 40% of all cancers may be averted by maintaining healthy dietary habits, regularly exercising, and refraining from smoking . Indeed, preventable lifestyle-related diseases account for approximately 50 to 60% of all hospital admissions . It is expected that increasing rates of obesity and physical inactivity will lead to a surge in the number of patients with lifestyle-related diseases in the decades to come [6,7,8]. In light of these trends, there is a substantial need to advance and implement evidence-based health strategies and interventions that facilitate the identification and management of people at risk of developing these diseases .
Disease prevention is a central task in general practice in Denmark and the Nordic countries . Two recent systematic reviews of general practice health checks suggest that people at high risk of chronic disease may benefit from targeted preventive health checks [11, 12]. Indeed, targeted, or selective, preventive healthcare is a generally accepted and well-integrated part of healthcare systems worldwide (e.g. treatment of hypertension and hyperlipidemia). Other studies, however, suggest that systematic screening of the general population does not improve clinical endpoints above and beyond those associated with opportunistic screening. These studies indicate that, at a population level, systematic screening of the general population does more harm than good [13,14,15]. Overall, however, the evidence on targeted and systematic screening of chronic disease is very limited, possibly providing an explanation for the apparent contradictions in the literature. To this end, projects in the Netherlands and Great Britain are currently underway, testing different approaches to targeted and systematic intervention in general practice [16, 17].
There is an even greater lack of evidence when it comes to targeted preventive interventions that comprise both general practice and community health services. In such an approach the general practitioner (GP) targets patients at high risk for lifestyle-related diseases and engages in risk-management of biomarkers and disease with behavior change and pharmaceutical interventions when needed. Community health services, on the other hand, focus primarily on the prevention of health-risk behaviors - including tobacco use, poor diet, excessive alcohol consumption, and sedentary lifestyles - and provide behavior-change interventions such as smoking cessation assistance and dietary advice. Danish studies suggest a potential to enhance the collaboration and cohesiveness of the various components that comprise the preventive healthcare services in the Danish primary care system – especially between GPs and community health services [18, 19]. Outside of the Danish context, the benefits of a more unified and coherent healthcare service have also been advanced in peer-reviewed studies [20, 21]. However, effectiveness studies of a unified approach, such as that described above, seem to be lacking.
In 2012, we carried out a feasibility study, testing a novel approach to population-based risk stratification at four Danish GP clinics . The intervention combined lifestyle survey data with health record information in order to identify presumably healthy individuals who nonetheless were at high risk of developing lifestyle-related diseases. These individuals were then offered a health check at their GP for a more definitive assessment of their general health as well as their risk of developing lifestyle-related diseases. Results indicated that this approach to preventive action was indeed feasible, and thus ultimately inspired the development of a large randomized study, the present TOF-project (TOF is a Danish acronym for Early Detection and Prevention). The principal aim of the upcoming TOF-project is to examine the efficacy of a preventive healthcare intervention that systematically identifies individuals at high risk of lifestyle-related disease, and provides targeted and coherent preventive services. We expect that significant changes in the targeting and systematization of disease prevention in the Danish primary care sector, including earlier detection and more coherent preventive services, will diminish the individual and societal burden of chronic disease. Due to the complexity of the TOF intervention, and the relatively high number of stakeholders, a pilot study needs to be conducted before full-scale implementation and evaluation . The aim of the pilot study is to test the acceptability, feasibility, and short-term effects of a selective preventive program, designed to systematically help patients evaluate their individual risk of lifestyle-related disease. The program also offers targeted and coordinated preventive services in the primary healthcare sector.
The pilot study was designed as a population based non-randomized study in the Region of Southern Denmark, comprising 22 municipalities, 787 GPs, and a general population of 1,2 million. The Danish health care system is a tax-based system comprising three levels: A national level responsible for, among other things, public health, planning, and patient safety; a regional level responsible for the hospitals and the primary care sector; and a municipal level responsible for primary prevention, rehabilitation, and patient education. General practice and the municipalities have shared responsibility for preventive services aimed at the individual. Specifically, GPs assess patient health and implement disease-specific secondary prevention. The municipalities, however, are tasked with primary prevention such as smoking cessation, alcohol treatment, and other lifestyle related services. GPs are organized in clinics with an average of two GPs per clinic. While most clinics comprise a single GP, some have up to ten. Almost all Danish citizens (98%) are registered with a GP [24, 25]. Each GP has an average of 1600 registered patients.
The pilot study targets adults born between year 1957 and 1986. All 22 municipalities in the Region of Southern Denmark were invited to participate in TOF. Ten municipalities (Esbjerg, Haderslev, Varde, Sønderborg, Aabenraa, Middelfart, Kerteminde, Nyborg, Svendborg, Langeland) submitted expressions of interest to participate in the study, and were approved for participation by the Regional Council. Two of the municipalities (Haderslev and Varde) volunteered to participate in the pilot study.
The municipalities of Haderslev and Varde comprise 55,971 and 50,110 citizens, and 37 and 29 GPs, respectively. All GPs from each municipality were invited to an information meeting before being formally invited to participate in the pilot study. The invitation was followed up with telephone calls to the individual GP clinics. All patients were invited at baseline, and the intervention was taken up by the patients at their own convenience during the intervention period. See Additional file 1 for a more detailed project flow showing the recruitment, intervention and evaluation phases.
Organization and development of the intervention
The intervention was planned during a two-year combined effort involving all stakeholders. End users were involved in the design of the intervention, including patients, GPs, and municipal health professionals. A group of seven GPs developed the targeted intervention at a general practice level during five workshops. Similarly, a group of 10 municipal health workers, one from each of the participating municipalities, developed the targeted intervention at a municipal level during 10 workshops. The workshops lasted between 2 h and 2 days. A digital support system was created and tested by user populations, including patients, non-government patient organizations, GPs, and municipal health professionals.
A steering committee was established at the start of the project, consisting of managers or board members from the Region of Southern Denmark (project owner), The Organization of General Practitioners in Denmark (PLO), the 10 participating municipalities, the Research Unit for General Practice at the University of Southern Denmark (FEA), and the Danish Quality Unit for General Practice (DAK-E). The chair of the committee is the health director from the Region of Southern Denmark. A research committee with participation from the steering committee chair and the primary investigator has been established. A mission statement has been approved by the steering committee and an agreement of co-operation has been signed between the Region of Southern Denmark and the University of Southern Denmark. The agreement states that the University of Southern Denmark holds all rights, intellectual as well as judicial, to the research data, and that the Region of Southern Denmark has no right to oppose publication of results. The research committee approves all access to research data from affiliated researchers.
Prior to study commencement, all enrolled GPs, practice nurses (PN), and health professionals from the municipalities were invited to a joint three-hour training course (August 2016). The course focused on the assigned intervention activities and tasks both within the GP clinics and the municipality respectively, and between GPs and the municipality.
Invitation and consent
The source population received an invitation to participate, sent on behalf of the GP and the municipality to the individual’s digital mailbox. All permanent residents in Denmark are obligated to have a digital mailbox, which is essentially a digital mail-system provided by the government for secure and direct communication between individuals and public authorities and other trusted organizations (e.g. banks and insurance companies) . People may opt out of the digital mail system, citing low IT-literacy (usually elderly persons), cognitive impairment, or other complicating factors. To enroll in the study, individuals were asked to follow a link in the invitation to a digital support system protected by a two-phased NemID password . NemID is a password system providing an exact identification of the user. This system is utilized by Danish public and non-public institutions to provide secure access to personal information, such as health and financial data. Through digital mail and NemID, we were able to reach and identify 97% of the target population. In April 2016, participants received an invitation with an embedded hyperlink to a digital consent form on a secure webpage in their digital mailbox. The consent form outlined study participation and disclosure of data from the GPs electronic patient record (EPR) and was supplemented with short videos describing the purpose of the study and the intervention. Participants were asked to read the information and electronically sign the consent form. Two reminders were sent after one and 2 weeks if participants failed to sign the form. Enrollment closed after 6 weeks. At this time, information on relevant diagnosis (International Classification of Primary Care (ICPC-2) codes) and prescribed medicine (Anatomical Therapeutic Chemical Classification (ATC) codes incl. Text fields with indication for treatment) were collected from the GPs EPR system (See Table 1 for the ICPC-2 codes and ATC codes that were accessed based on the consent). Five months after consent (September 2016), participants received another digital invitation in the digital mailbox, this time to fill in a questionnaire and access a personal health profile. Participants could opt-out at any time during the intervention period by clicking an “opt-out” button on the digital support system.
The duration of the intervention was 3 months and took place between September 2016 and December 2016. The intervention comprised a two-pronged approach:  a joint intervention applied to the entire sample, regardless of whether the participants were healthy, at risk, or already in treatment for T2DM, COPD, CVD, hypercholesterolemia or hypertension  a targeted intervention that was offered only to participants who presumably would benefit from either further examinations at the GP (high risk), or from receiving community health services, such as smoking cessation, dietary advice, or physical activity (health-risk behavior).
The joint intervention consisted of:
Stratification to one of four risk groups. Stratification to a specific risk group was determined by use of risk algorithms and EPR information
A digital support system with user interfaces for all users, including the patient, the GP, and the municipal health professional
An individual health profile
The targeted intervention consisted of:
A focused clinical examination and a subsequent health dialogue with a GP (targeting patients at high risk), and / or
A short telephone-based health dialogue with a municipal health professional. For patients with limited capability to care for their own health, this initial talk could be followed up with a subsequent face-to-face health dialogue (targeting patients with health-risk behavior)
For all present intents and purposes, the term health dialogue refers to a consultation that includes the elements of the 5As model (see Table 1) and the techniques used in motivational interviewing [28, 29].
The joint intervention
All participants gained access to the digital support system and were invited to fill in a questionnaire. The participant questionnaire contained 15 items on height, weight, self-perceived health status, family history of lifestyle-related diseases, COPD related symptoms, smoking status, leisure activity level, alcohol consumption, diet, and osteoarthritis risk factors. Questions about family history of diabetes and leisure activity level were taken from the Danish Diabetes Risk model . Similarly, questions on COPD-related symptoms and smoking status were derived from the COPD-PS screener  and the Heartscore BMI score . Items tapping dietary habits were from the Swedish National Guidelines on Disease Prevention . The questionnaire took approximately 5 min to complete.
Based on the questionnaire and information from the individual EPR, participants were stratified into four distinct risk groups:
Group 1 – Participants with a pre-existing diagnosis and/or in current treatment for a lifestyle-related disease.
Group 2 – Participants at high risk of developing lifestyle-related disease, and thus eligible for the offer of a targeted intervention at the GP.
Group 3 – Participants engaging in health-risk behavior, and thus eligible for the offer of a targeted intervention at the municipality.
Group 4 – Participants with a healthy lifestyle and no need for further intervention.
Stratification to group 1
EPR data was collected via certified EPR-suppliers. We used International Classification of Primary Care-2 codes (ICPC-2) registered by the GP and/or Anatomical Therapeutic Chemical Classification (ATC) codes for prescribed medicine within the past 2 years, together with the indication for prescribing the medicine, to identify Group 1 participants (see Table 2).
Given the pre-existing diagnosis and/or treatment, Group 1 was excluded from the subsequent risk estimation and stratification into Group 2, 3, and 4.
Stratification to group 2
Next, participants at risk of lifestyle-related disease were identified using three validated risk scores: the Chronic Obstructive Pulmonary Disease Population Screener (COPD-PS), the Danish Diabetes Risk model, and a modified Heartscore BMI score [30,31,32]. The COPD-PS uses an algorithm accounting for age, lifetime use of cigarettes, and smoking-related symptoms to identify at-risk patients who may benefit from a spirometry to test for COPD (Table 3) . The Danish Diabetes Risk score is based on an algorithm that incorporates age, sex, BMI, known hypertension, leisure activity level, and family history of diabetes (Table 4) . The modified Heartscore BMI score accounts for age, sex, body mass index (BMI), and smoking status (Table 5) .
Consistent with the criteria of the four distinct stratification groups defined above, participants were categorized into Group 2 when one or more of the risk assessment algorithms indicated high likelihood of developing lifestyle-related disease (see Tables 3, 4 and 5).
Stratification to group 3 and 4
Finally, participants engaging in health-risk behavior with one or more risk factors were categorized in Group 3 (Group 3). Health-risk behavior was defined by the presence of at least one of the following behaviors: smoking tobacco on a daily basis, consuming more than 14/21 (male/female) standard units of alcohol per week, sustaining an unhealthy diet (diet score ≤ 4 on a 12-point score drawn from the Swedish National Guidelines on Disease Prevention) , maintaining a BMI ≥ 35, and/or engaging in a generally sedentary lifestyle. Lastly, participants with no lifestyle-related disease or risk thereof were stratified into Group 4.
Digital support system
All users had access to a digital support system in the form of a web page with a common database and specific user interfaces for the GP, the municipality health professionals, and the patient. No apps were developed. The system design drew inspiration from the work by Krist and colleagues’ research on preventive EPRs, and was further inspired by the results of a Delphi process carried out to identify factors for optimal development of health-related websites [34,35,36]. Due to challenges in terms of interoperability between the eight suppliers of EPR systems used by GPs, and at least three suppliers of electronic care records (ECR) in the municipalities, it was not feasible to develop a support system that completely integrated the EPR and ECR systems. Instead, the digital support system was developed as a parallel system with an additional functionality facilitating the transfer of information (e.g. relating to lifestyle and/or prevention plans) to the EPR and ECR systems using Electronic Data Interchange (EDIfact) messages . The patient controlled access to personal health information on the system, such that the GP and municipal health professional were only able to access this information with the explicit consent of the patient.
The digital support system was developed iteratively in collaboration with the users during the before mentioned workshops with municipality health professionals and GPs and in the form of usability tests with patients. The user interface for the patient was responsive and compatible with most devices, including mobile phones, tablets, laptops and stationary computers. Due to technical constraints in the secure log-in provided by NemID, the user interface for health professionals was only developed for laptops and stationary computers. In order to make the user interface for the patient as intuitive and user-friendly as possible, the digital support system made extensive use of simple visualizations, icons, and short information videos (Fig. 1). The primary text-based messages were kept short and concise with the provided possibility of accessing secondary in-depth information, retrieved from the Danish Health Portal, sundhed.dk .
Beyond facilitating the intervention, the digital support system also enabled data collection for research purposes. A number of questionnaires were sent from the digital support system to the participants at specific time-points, including immediately after consent, after receiving the personal health profile, following the health dialogue at the GP, and at the end of the implementation period. Questionnaire reminders were sent by e-mail with a link to the digital support system. The GPs and municipal health professionals received audits in the form of short questionnaires immediately after each consultation as well as before and after the study period (GPs only).
Personal health profile
Based on results of the stratification process, each patient received a personal health profile on the digital support system. The purpose of the health profile was to encourage patients to change their health-risk behavior and follow the tailored advice provided by the system. Patients who were at increased risk of developing a lifestyle-related disease (Group 2) were advised to consult their GP for further examination and advice. Similarly, patients engaging in health-risk behavior (Group 3) were offered lifestyle counseling, or lifestyle courses from the municipality health services. By definition, Group 4 patients lead a relatively healthy life with no need for health-risk behavior change. Group 1 patients were advised to continue their treatment and use the information provided to change health-risk behavior.
The personal health profile included individualized information on current health-risk behavior and risk of disease. The information was tailored based on the questionnaire, the information from the EPR, and the risk scores on COPD, T2DM, and CVD. It also included general health information and information about preventive health services concerning smoking, diet, exercise, and alcohol consumption. This information was provided by the municipality, the Region of Southern Denmark, or national health services, and targeted the individual (e.g. via links to apps and webpages) based on his/her specific health-risk behavior.
The targeted intervention
The intervention at the GP
The intervention at the general practice level consisted of a focused clinical examination and a subsequent health dialogue and was offered to patients who were at increased risk of developing a lifestyle-related disease (Group 2). Group 2 patients accepted the offer of the intervention by scheduling an appointment at the GP (either by phone or the GP’s webpage). Whether the patient participated in the intervention or not was thus determined by their motivation and capabilities as well as the extent to which the content of the personal health profile motivated the patient to take action. The intervention was applied within the framework of the 5As model (see Table 1) . The content of the focused clinical examination was based on the patient’s health profile, and might include measurements of blood glucose (HbA1c) and cholesterol levels, as well as height, weight, blood pressure, and lung function measurements and Electrocardiogram (ECG). Results from the examinations were registered in the digital support system where both the patient and the GP could access them at any time. After the focused clinical examination all patients were given the opportunity to prepare for the subsequent health dialogue by answering a questionnaire inspired by three systematic reviews on the determinants of behavior change [38,39,40]. These included questions about motivation, resources, former experiences with behavior change, social network, mental health (WHO-5 for stress and Major Depression Inventory (MDI) for depression) [41, 42], and a scheme to qualitatively self-report on facilitators and barriers to behavior change (a so-called balance-sheet). The questionnaire results were shared with the GP on the digital support system. Based on the health dialogue, the GP and the patient developed a prevention plan that included a goal, a time frame, and identification of the appropriate means to fulfill the plan (e.g. reference to a smoking cessation course, or follow-up at the GP). The prevention plan was registered on the digital support system by the GP and was accessible to both the GP and the patient.
The intervention at the municipal level
The intervention at the municipal level was offered to patients exhibiting health-risk behavior (Group 3) and consisted of a short telephone consultation with a health professional – for example a nurse, a dietician, or a physiotherapist. A subsequent face-to-face health dialogue was offered to patients who were deemed to potentially benefit from more extensive support. Group 3 patients requested the intervention on the digital support system by filling in a short form and sending it by e-mail to the municipality. A municipal health professional would then call the patient within the following week. Similar to the GP intervention, the intervention at the municipal level was thus also determined by patient motivation and capabilities as well as the extent to which the content of the personal health profile motivated the patient to take action. Immediately after the intervention, a participation form was sent to the municipality. Patients could prepare for the upcoming call from a municipal health professional in the same way as Group 2 patients prepared for the health dialogue – that is, by answering a short questionnaire. Ultimately, a prevention plan, including concrete details on its execution, was developed based on the telephone consultation and the face-to-face health dialogue. The prevention plan was registered by the municipal health professional and presented on the user interfaces of both the municipality and the patient.
Sample size calculation
While aiming to test the acceptability, feasibility, and short-term effects of the pilot, we estimated a sample size for each GP that would allow the GP to familiarize him/herself with the intervention without unnecessary increases in workload during the intervention period. In agreement with the GP representative in the Region of Southern Denmark, we set a target of four health checks for each GP. From the feasibility study, we estimated that 60% would consent to the study, and that 75% of these participants would receive a personal digital health profile . Also based on the feasibility study, we estimated that 12% of the study population would be recommended to consult their GP (Group 2). From results obtained in similar Dutch studies, we finally estimated that 35% of the these patients (Group 2) would eventually consult the GP . Given these figures, we calculated that a total sample of approximately 200 patients from each GP would be required to reach the target of four completed health checks per GP.
Data collection and analysis
Evaluation of the study will be carried out using quantitative as well as qualitative research methods (Table 6). All outcome measures are based on validated instruments and aim to provide results pertaining to intervention acceptability, feasibility, and short-term effects. In addition, outcomes related to other associated topics will be included. The specific instruments used will be described in detail in later publications.
Qualitative data will be derived from interviews (individual and focus groups comprising GPs, practice staff members, municipality staff members, patients from group 2 and 3, stakeholders, project leaders and researchers) and participant observations (during the health dialogues at the GP). The estimated number of participants is shown in Table 6.
Quantitative data will be derived from questionnaires as well as Danish National registers (see section below). Table 7 shows the content of the questionnaires applied while a diagram, attached as Additional file 1, shows a flow of the entire intervention and the timing of the questionnaires during the intervention.
Register based data
Data from the Danish national registers concerning demographic information, prescriptions, and health care usage of the target population (n = 9.400) will be obtained from Statistics Denmark (https://www.dst.dk/da) . Information from the different registers will be linked by the patients’ Danish Personal Identification Number.
Information on socio-demography encompassed educational level, occupation, income, cohabitation status, ethnicity, and residency.
Education is defined as the highest formal educational attainment obtained on the first of October in each calendar year.
Occupation is defined as the occupational status on the first of November in each calendar year.
OECD-adjusted income level is defined as the individual’s/family’s disposable income, adjusted for family size and categorized in relative terms (low/middle/high income) .
Cohabitation status is defined as cohabitating or living alone.
Ethnicity is based on country of origin and descendance.
Information on health/disease status (hypertension, hypercholesterolemia, type-2 diabetes, cardio-vascular disease) is defined in terms of ICD-10 diagnosis codes and medical usage. The ‘National Patient Registry’ will provide information on ICD-10 diagnostic codes. The ‘Register of Medicinal Product Statistics’ provide information on medical usage [46, 47].
Contextual variables include information on study site and neighborhood social deprivation. Neighborhood social deprivation will be derived on a census district level and is principally defined in terms of the following three variables: educational attainment, employment status (employed/social welfare), and income (mean family disposable income). Educational, employment, and income deprivation thus specifically refer to the proportion of citizens within each census district who has access to basic education (up to high school), who is unemployed (e.g. students, unemployed workers), and who belongs to the lowest income quartile, respectively. Each variable is ranked, grouped in quartiles, and given a value between 0 and 3 (3 = high deprivation). This results in an aggregated ranking system ranging from 0 (low deprivation) to 9 (high deprivation). The aggregated rank is then grouped in quartiles. A neighborhood social deprivation score will be calculated for all census districts in Denmark in order to obtain local deprivation scores that mirror the relative social deprivation of the individual census district .
This pilot study will provide a solid empirical base from which to plan and implement a full-scale randomized study with the central aim of determining the efficacy of a preventive health intervention. The intervention was designed to systematically identify persons at risk of developing lifestyle-related disease or who engage in health-risk behavior, and provide targeted and coherent preventive services to these individuals.
Strengths and limitations
Much effort has been made to define the specific nature and objective of pilot and/or feasibility studies. In a scoping review of optimization strategies for complex interventions prior to randomized trials, Levati asserts the notion that different frameworks for intervention development, such as intervention mapping and the MRC framework for complex intervention, call for different approaches to pilot and feasibility studies . As a common feature when developing complex randomized trials, the authors suggest “that the acceptability of the intervention to those directly involved in the delivery and receipt of the final intervention, together with the anticipated effect of the intervention, are important elements to take into account as early as possible in the pre-trial stage.” .
Eldridge et al. used a Delphi survey to arrive at distinct definitions of feasibility and pilot studies . They suggest that “feasibility study” is an overarching term with “pilot study” representing a subset of feasibility studies. Generally, feasibility studies ask whether something can be done, should we proceed with it, and if so, how? Pilot studies ask the same questions, but with a specific design feature of a larger study, conducted on a smaller scale. According to the authors, pilot studies can be separated in two distinct types: non-randomized and randomized. Non-randomized pilot studies do not include a control group and are usually external to the subsequent randomized controlled trial (RCT), that is, the participants are not included in the effect analysis of the RCT. Randomized pilot studies, on the other hand, randomize participants to an intervention or control group and can be internal to the subsequent RCT. Bowen et al. complement the work of Eldridge et al. and propose eight foci (design features) of feasibility studies: Acceptability, demand, implementation, practicality, adaptation, integration, expansion, and limited efficacy .
According to Eldridge et al., the study presented in this paper is a non-randomized pilot study. We chose a non-randomized design in order to examine the specific design features of a stepped wedge cluster randomized design for the full-scale randomized study. A stepped-wedge design is a type of cluster randomized design that meets the specific ethical and logistical demands of a delayed intervention performed in routine care where all participants will be offered the intervention . The pilot resembles one cluster in a stepped wedge cluster randomized study, and will thus allow us to ascertain whether the intervention can be delivered during a three-month period, or if longer time is required to avoid carry-over effects . In the event that more time is necessary to deliver the intervention, it will be difficult, if not impossible, to accurately determine the optimal duration of a cluster. This will likewise complicate the stepped wedge design. One way to compensate for incomplete knowledge on the optimal timeframe for the intervention may be to include a “wash out” period after every cluster allowing for any delay or lag in implementation before the next cluster is commenced . The length of the “wash out” period can be estimated from the results of the pilot study.
We have randomly sampled 200 patients from each GP in order to have a source population that is representative of the target population. We have chosen to target people born between 1957 and 1986 to assess the risk of lifestyle-related disease and health-risk behavior at an age interval where changes in lifestyle will provide significant health effects and be cost-effective. To this end, we have chosen to assess variation in the proportion of patients at increased risk of lifestyle-related disease between baseline and the 12-week follow up as our primary health-related outcome. Further, given the fact that complex interventions, such as the one described here, usually have concurrent endpoints , we also collect data on a variety of other variables – both questionnaire- and register-based – related to both lifestyle and disease. We have yet to determine which of these endpoints to include in the full-scale randomized study.
We have planned the intervention in collaboration with the stakeholders, patients, and service providers in order to run a pilot study that is both acceptable and relevant for all user groups. We use quantitative as well as qualitative research methods to assess the acceptability, demand, implementation, and practicality of the pilot, from the viewpoint of both users and service-providers. In addition to evaluating the intervention, we assess the organizational challenges of planning and implementing IT-supported pilot studies . At the same time we test different methods of data collection, including electronic collection of data from the digital support system and participant observations at the GP clinics. We also test various types of questionnaires, including ones that involve simple items with binary outcomes as well as others in more complex discrete choice format. The pilot will hence enable us to assess whether the intervention can be executed, and whether the organizational approach taken, fit the purpose. We will further be able to make an informed decision about how we can collect data during the full-scale study in the most efficient and cost-effective way that is also acceptable to both users and service-providers.
From pilot to full-scale randomized study
Another issue raised by Levati et al. and Eldridge et al. concerns pinpointing the appropriate time to move from piloting to full-scale RCT. That is, should we proceed with the project, and if so, how? [1, 49]. Proceeding from pilot to a full-scale randomized study is probably the most under-researched part of the implementation of complex interventions. Bugge et al. suggest a three step process to establish the best possible foundation on which to make a decision to advance a full-scale randomized study . First, any problems should be categorized into three distinct types: Issues that are likely to complicate the full-scale study, issues that are likely to complicate both trial and real-world situations, and issues that are likely to complicate real-world situations only. Next, potential solutions should be identified for the expected issues, ideally with lay participation. Finally, the best of these solutions should be selected to determine the best way to proceed. With this strategy in mind, we will do a thorough assessment of the problems encountered in the pilot before advancing the full-scale study. We will thus identify solutions in collaboration with the service providers (GPs and municipal health professionals) who participated in the pilot study, as well as with those who took part in the design of the intervention. We will also seek patient-feedback on the technical and communicative properties of the digital support system before defining its final specifications. The final assessment is presented to the steering committee that will take the decision on the way forward.
Anatomical Therapeutic Chemical Classification
Body mass index
Chronic Obstructive Pulmonary Disease
Chronic Obstructive Pulmonary Disease Population Screener
Cardio vascular disease
Electronic Data Interchange messages
Electronic patient record
International classification of diseases
International classification of primary care
Randomized controlled trial
Type 2 diabetes mellitus
Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al. Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework. PLoS ONE. 2016;11(3). Available from: http://0-www.ncbi.nlm.nih.gov.brum.beds.ac.uk/pmc/articles/PMC4792418/. [cited 2016 Nov 10].
WHO. Global Status on Noncommunicable diseases. Geneva: WHO; 2010.
Juel K, Sørensen J, Brønnum-Hansen H. Supplement: risk factors and public health in Denmark. Scand J Public Health. 2008;36(1 suppl):1–227.
WHO TRS 916. Diet, Nutrition, and the Prevention of Chronic Diseases. 2003.
Glümer C, Hilding-Nørkjær H, Jensen H, Jørgensen T, Andreasen A, Ladelund S. Sundhedsprofil for region og kommuner 2008. Region Hovedstaden: Glostrup; 2008.
Shaw JE, Sicree RA, Zimmet PZ. Global estimates of the prevalence of diabetes for 2010 and 2030. Diabetes Res Clin Pract. 2010;87(1):4–14.
Yusuf S, Reddy S, Ounpuu S, Anand S. Global burden of cardiovascular diseases: part I: general considerations, the epidemiologic transition, risk factors, and impact of urbanization. Circulation. 2001;104(22):2746–53.
NCD Risk Factor Collaboration (NCD-RisC). Trends in adult body-mass index in 200 countries from 1975 to 2014: a pooled analysis of 1698 population-based measurement studies with 19·2 million participants. Lancet 2016;387(10026):1377–1396.
Beaglehole R, Bonita R, Horton R, Adams C, Alleyne G, Asaria P, et al. Priority actions for the non-communicable disease crisis. Lancet. 2011;377(9775):1438–47.
The Role of General Practitioners in Preventing disease and promoting health in the Nordic countries [Internet]. Nordic Federation of General Practice; 2013. Available from: http://www.nfgp.org/files/8/policypaper_preventing_2.pdf. [cited 2016 Nov 6]
Si S, Moss JR, Sullivan TR, Newton SS, Stocks NP. Effectiveness of general practice-based health checks: a systematic review and meta-analysis. Br J Gen Pract. 2014;64(618):e47–53.
den Engelsen C, Koekkoek PS, Godefrooij MB, Spigt MG, Rutten GE. Screening for increased cardiometabolic risk in primary care: a systematic review. Br J Gen Pract. 2014;64(627):e616–26.
Jørgensen T, Jacobsen RK, Toft U, Aadahl M, Glümer C, Pisinger C. Effect of screening and lifestyle counselling on incidence of ischaemic heart disease in general population: Inter99 randomised trial. BMJ. 2014;348:g3617.
Krogsbøll LT, Jørgensen KJ, Grønhøj Larsen C, Gøtzsche PC. General health checks in adults for reducing morbidity and mortality from disease: Cochrane systematic review and meta-analysis. BMJ. 2012;345:e7191.
Dyakova M, Shantikumar S, Colquitt JL, Drew CM, Sime M, MacIver J, et al. Systematic versus opportunistic risk assessment for the primary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2016;1:CD010411.
Badenbroek IF, Stol DM, Nielen MM, Hollander M, Kraaijenhagen RA, de Wit GA, et al. Design of the INTEGRATE study: effectiveness and cost-effectiveness of a cardiometabolic risk assessment and treatment program integrated in primary care. BMC Fam Pract. 2014;15:90.
Marshall T, Caley M, Hemming K, Gill P, Gale N, Jolly K. Mixed methods evaluation of targeted case finding for cardiovascular disease prevention using a stepped wedged cluster RCT. BMC Public Health. 2012;12:908.
Andersen JH, Thorsen T, Kousgaard MB. Samarbejde mellem kommuner og almen praksis om henvisning til kommunale sundhedstilbud for patienter med kroniske sygdomme [Internet]. København: Forskningsenheden for almen praksis; 2014. Available from: http://patientuddannelse.info/media/95449/samarbejde_mellem_almen_praksis_og_kommuner.pdf. [cited 2016 Oct 20]
Helbech hansen B. Omfanget af henvisninger fra alment praktiserende læger til kommunale sundheds- og forebyggelsestilbud [Internet]. København: Kommunernes Landsforening; 2015. Available from: http://www.kl.dk/ImageVaultFiles/id_74921/cf_202/Henvisninger_fra_almen_praktiserende_l-ger_til_kom.PDF. [cited 2016 Oct 20]
Porterfield DS, Hinnant LW, Kane H, Horne J, McAleer K, Roussel A. Linkages between clinical practices and community organizations for prevention: a literature review and environmental scan. Am J Public Health. 2012 Jun;102(Suppl 3):S375–82.
Krist AH, Shenson D, Woolf SH, Bradley C, Liaw WR, Rothemich SF, et al. Clinical and community delivery Systems for Preventive Care. Am J Prev Med. 2013 Oct 1;45(4):508–16.
Bruun Larsen L, Soendergaard J, Halling A, Thilsing T, Thomsen JL. A novel approach to population-based risk stratification, comprising individualized lifestyle intervention in Danish general practice to prevent chronic diseases: Results from a feasibility study. Health Informatics J. 2017;23(4):249–59. https://doi-org.proxy1-bib.sdu.dk/10.1177/146045821664514.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337. Available from: http://0-www.ncbi.nlm.nih.gov.brum.beds.ac.uk/pmc/articles/PMC2769032/. [cited 2014 Jan 16].
Pedersen KM, Andersen JS, Søndergaard J. General practice and primary health Care in Denmark. J Am Board Fam Med. 2012;25(Suppl 1):S34–8.
Pedersen KM, Søndergaard J. Det samarbejdende hospital: Almen praksis og kommuner. In: Fremtidens Hospital. København: Munksgaard; 2014. p. 115–26.
Whitlock E. Evaluating primary care behavioral counseling interventions an evidence-based approach. Am J Prev Med. 2002 May;22(4):267–84.
Den motiverende samtale [Internet]. Dansk selskab for almen medicin; 1999 . Available from: http://www.dsam.dk/files/9/den_motiverende_samtale_1999.pdf. [cited 2014 Nov 16].
Christensen JO, Sandbaek A, Lauritzen T, Borch-Johnsen K. Population-based stepwise screening for unrecognised type 2 diabetes is ineffective in general practice despite reliable algorithms. Diabetologia. 2004;47(9):1566–73.
Martinez FJ, Raczek AE, Seifer FD, Conoscenti CS, Curtice TG, D’Eletto T, et al. Development and initial validation of a self-scored COPD population screener questionnaire (COPD-PS). COPD. 2008;5(2):85–95.
Svenska Socialstyrelsen. Sjukdomsförebyggande metoder. Vetenskabeligt underlag för nationella riktlinjer. Svenska Socialstyrelsen; 2011.
Schneider F, van Osch L, de Vries H. Identifying factors for optimal development of health-related websites: a Delphi study among experts and potential future users. J Med Internet Res. 2012;14(1):e18.
Krist AH, Woolf SH. A vision for patient-centered health information systems. JAMA. 2011;305(3):300–1.
Krist AH, Beasley JW, Crosson JC, Kibbe DC, Klinkman MS, Lehmann CU, et al. Electronic health record functionality needed to better support primary care. J Am Med Inform Assoc. 2014;21(5):764–71.
Murray J, Craigs CL, Hill KM, Honey S, House A. A systematic review of patient reported factors associated with uptake and completion of cardiovascular lifestyle behaviour change. BMC Cardiovasc Disord. 2012;12:120.
Murray J, Honey S, Hill K, Craigs C, House A. Individual influences on lifestyle change to reduce vascular risk: a qualitative literature review. Br J Gen Pract J R Coll Gen Pract. 2012;62(599):e403–10.
Murray J, Fenton G, Honey S, Bara AC, Hill KM, House A. A qualitative synthesis of factors influencing maintenance of lifestyle behaviour change in individuals with high cardiovascular risk. BMC Cardiovasc Disord. 2013;13:48.
Olsen LR, Jensen DV, Noerholm V, Martiny K, Bech P. The internal and external validity of the major depression inventory in measuring severity of depressive states. Psychol Med. 2003;33(2):351–6.
Topp CW, Østergaard SD, Søndergaard S, Bech P. The WHO-5 well-being index: a systematic review of the literature. Psychother Psychosom. 2015;84(3):167–76.
Van der Meer V, Nielen MM, Drenthen AJ, Van Vliet M, Assendelft WJ, Schellevis FG. Cardiometabolic prevention consultation in the Netherlands: screening uptake and detection of cardiometabolic risk factors and diseases - a pilot study. BMC Fam Pract. 2013;14:29.
Thygesen LC, Daasnes C, Thaulow I, Brønnum-Hansen H. Introduction to Danish (nationwide) registers on health and social issues: structure, access, legislation, and archiving. Scand J Public Health. 2011;39(7 suppl):12–6.
What are the equivalence scales [Internet]. OECD Project on Income Distribution and Poverty. Available from: http://www.oecd.org/els/soc/OECD-Note-EquivalenceScales.pdf. [cited 2016 Mar 23].
Schmidt M, Schmidt SAJ, Sandegaard JL, Ehrenstein V, Pedersen L, Sørensen HT. The Danish National Patient Registry: a review of content, data quality, and research potential. Clin Epidemiol. 2015;7:449–90.
Pottegård A, Schmidt SAJ, Wallach-Kildemoes H, Sørensen HT, Hallas J, Schmidt M. Data resource profile: the Danish National Prescription Registry. Int J Epidemiol. 2017;46(3):798–798f. https://doi.org/10.1093/ije/dyw213.
Bender AM, Kawachi I, Jørgensen T, Pisinger C. Neighborhood deprivation is strongly associated with participation in a population-based health check. PLoS One. 2015;10(6):e0129819.
Levati S, Campbell P, Frost R, Dougall N, Wells M, Donaldson C, et al. Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used. Pilot Feasibility Stud. 2016;2:17.
Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we design feasibility studies. Am J Prev Med. 2009;36(5):452–7.
Hargreaves JR, Copas AJ, Beard E, Osrin D, Lewis JJ, Davey C, et al. Five questions to consider before conducting a stepped wedge trial. Trials. 2015;16:350.
Copas AJ, Lewis JJ, Thompson JA, Davey C, Baio G, Hargreaves JR. Designing a stepped wedge trial: three main designs, carry-over effects and randomisation approaches. Trials. 2015;16:352.
Hertzum M, Bansler JP, Havn EC, Simonsen J. Pilot implementation: learning from field tests in IS development. Commun Assoc Inf Syst. 2012;30. Article 20. Available at: http://aisel.aisnet.org/cais/vol30/iss1/20.
Bugge C, Williams B, Hagen S, Logan J, Glazener C, Pringle S, et al. A process for decision-making after pilot and feasibility trials (ADePT): development following a feasibility study of a complex intervention for pelvic organ prolapse. Trials. 2013;14:353.
Ingham SL, Moody A, Abhishek A, Doherty SA, Zhang W, Doherty M. Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study. BMC Med Res Methodol. 2010;10:57.
Thanks to all the patients, GPs and municipal health professionals who provided valuable input to the development of the intervention. Also thanks to the steering committee members whose contribution to the realisation of the study was significant.
The project has received funding from the Region of Southern Denmark for secretarial support, participatory processes, digital support system and remuneration of the participating GPs; The joint Quality and educational committee (KEU) of the Region of Southern Denmark and the The Organization of general practitioners in Denmark for funding of research work-packages; And The Ministry of Health for testing and evaluation of the digital support system. The funders of the project have no role in the analysis, or interpretation of the data, writing of research papers, or the decision to submit a paper for publication.
Availability of data and materials
The data that support the findings of this study will be available from Statistics Denmark but restrictions apply to the availability of these data, which will be used under license for the current study, and so are not publicly available. Data will however be available from the authors upon reasonable request and with permission of Statistics Denmark.
Ethics approval and consent to participate
The study adheres to the SPIRIT guidelines and has been approved by the Danish Data Protection Agency (J.nr 2015–57-0008) and registered at Clinical Trial Gov (Unique Protocol ID: TOFpilot2016). According to Danish regulations (Act on Research Ethics Review of Health Research Projects (section 14,2)) this study does not need approval from a health research ethics committee as no research on human tissue or other biological material is performed. The study complies with the Helsinki declaration with informed consent to study participation and to disclosure of data from the GPs EPR obtained from all participants before enrolment. Participants were asked to read the information and electronically sign the consent form that was supplemented with short videos of the principal investigator and a GP describing the purpose of the study and the intervention. Before linking project data and national registers from Statistics Denmark participants will be pseudomized. Data management and data analysis of quantitative data will be performed on secure servers at Statistics Denmark.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Detailed project flow showing the recruitment, intervention and evaluation phases. Detailed project flow from recruitment to intervention and evaluation. It shows how participants will be recruited, how they will be stratified using algorithms and what intervention elements the participant will receive. Furthermore, it shows when quantitative data will be collected for evaluative purposes. (TIF 1491 kb)
About this article
Cite this article
Larsen, L.B., Sonderlund, A.L., Sondergaard, J. et al. Targeted prevention in primary care aimed at lifestyle-related diseases: a study protocol for a non-randomised pilot study. BMC Fam Pract 19, 124 (2018) doi:10.1186/s12875-018-0820-8
- Targeted health checks
- Primary care
- Intersectoral collaboration