This article has Open Peer Review reports available.
Diffusion of an e-learning programme among Danish General Practitioners: A nation-wide prospective survey
© Waldorff et al; licensee BioMed Central Ltd. 2008
Received: 01 October 2007
Accepted: 25 April 2008
Published: 25 April 2008
We were unable to identify studies that have considered the diffusion of an e-learning programme among a large population of general practitioners. The aim of this study was to investigate the uptake of an e-learning programme introduced to General Practitioners as part of a nation-wide disseminated dementia guideline.
A prospective study among all 3632 Danish GPs. The GPs were followed from the launching of the e-learning programme in November 2006 and 6 months forward. Main outcome measures: Use of the e-learning programme. A logistic regression model (GEE) was used to identify predictors for use of the e-learning programme.
In the study period, a total of 192 different GPs (5.3%) were identified as users, and 17% (32) had at least one re-logon. Among responders at first login most have learnt about the e-learning programme from written material (41%) or from the internet (44%). A total of 94% of the users described their ability of conducting a diagnostic evaluation as good or excellent. Most of the respondents used the e-learning programme due to general interest (90%). Predictors for using the e-learning programme were Males (OR = 1.4, 95% CI 1.1; 2.0) and members of Danish College of General Practice (OR = 2.2, 95% CI 1.5; 3.1), whereas age, experience and working place did not seem to be influential.
Only few Danish GPs used the e-learning programme in the first 6 months after the launching. Those using it were more often males and members of Danish College of General Practice. Based on this study we conclude, that an active implementation is needed, also when considering electronic formats of CME like e-learning.
ClinicalTrials.gov Identifier: NCT00392483.
Internet-based education offers the possibility for professional education and training of physicians and refers to the use of internet technologies to deliver a broad array of solutions that enhance knowledge and performance for the user . In 2001, only 2.7% of physicians in the United States used the Internet for Continuous Medical Education (CME) . However, this figure has recently increased to an estimated 31% and is expected to increase in the coming years .
The literature in medical education indicates that internet-based programmes are as effective in increasing participant knowledge as traditional formats [4–6]. In the non-medical literature it has been demonstrated that e-learning can result in significant cost-savings, sometimes as much as 50%, compared with traditional instructor-led learning . Studies in both medical and non-medical literature have consistently demonstrated a high learner satisfaction with e-learning and the satisfaction rates increase with e-learning compared to traditional learning, along with perceived ease of use and access, navigation, interactivity, and user-friendly interface design .
Clinical guidelines, in the form of systematically developed statements to assist physician-patient decisions on appropriate health care for specific circumstances are produced in many countries . However, the dissemination of guidelines alone rarely brings about improvements in clinical practice  and even an implementation of guidelines may not change clinical practice [10, 11]. We were unable to identify studies that have considered the diffusion of an e-learning programme among general practitioners. Diffusion of Innovations, theorized that innovations would spread through society in an s-curve, as early adopters select the technology first, followed by the majority, until a technology or innovation is common. Due to the assumption that the use of e-learning programmes, as a source to CME, will increase in the future we found it of interest to study the diffusion of an e-learning programme.
The aim of this study was to investigate the uptake of an e-learning programme introduced to General Practitioners as part of a nation wide disseminated dementia guideline.
The study was conducted as nation-wide prospective survey in Denmark among all Danish GPs from November 3rd 2006–May 3rd 2007.
Characteristics of Danish GPs (N = 3.632)
Average Age (SD)
Proportion of females
Members of the Danish College of General Practice
Years since graduation (SD)
Municipalities with more than 50.000 inhabitants
Municipalities with cities from 20.000–50.000 inhabitants
Municipalities up to 20.000 inhabitants
The guideline and the e-learning programme
The Dementia Guideline was developed by the Danish College of General Practitioners (DSAM) and mailed to all Danish General Practitioners (GPs) in October 2006 . The dissemination strategy was chosen by DSAM and the ELP producer jointly. The e-learning programme (ELP) was mentioned in the guideline in a separate section and was launched in the beginning of November 2006. The ELP followed the recommendation of the Guideline and consisted of five sections: Suspicion of dementia, identification, diagnostics, evaluation and follow-up. The ELP was based on interactive parts: using slides with audio, video-cases and self-study parts. The estimated time to complete the ELP was 90 minutes and the producers did not incorporate an evaluation of performance. All GPs had free access to the ELP from the homepages of DSAM as well as DMA by a unique username and password. At the launching the ELP was promoted at the homepages of the DMA as well as DSAM, the ELP was mentioned in the weekly journal of DMA (Ugeskrift for Læger) as well as the journal of DSAM (Practicus). Furthermore, DSAM sent one email to all members with a stated email address. The Guideline and the ELP was financially supported by the Danish Ministry of Health.
Data was collected at the logon by Internet based pop up questionnaires; log files, as well as from databases at the DMA. The data was provided with a constructed identification code. Thus, data on the individual GP identity was kept anonymous for the authors.
Internet based pop up questionnaires
Statements from GPs using the e-learning programme for the first time (N = 125)
Item 1. Where have you heard about the e-learning programme?*
On the internet
Recommended by peer
Item 2. How would you describe your ability to perform diagnostic evaluation of dementia? (n = 124)
Item 3. Have you read the latest version of the Dementia guideline? # (n = 122)
Item 4. Why did you use the e-learning program this time? # (n = 124)
Problem with a specific diagnostic evaluation
Item 5. Have you Internet access in your clinical office? (n = 124)
Item 6. How often do you use the Internet when you are working? (n = 120)
less than every week
Item 7. How many persons are around you now when you are using this e-learning programme? (n = 124)
One beside me
Two beside me
Statements from GPs at subsequent log-on(s) at the e-learning programme (n = 60)*
Item 1. How would you describe the ability to navigate in the e-learning programme? (n = 60)
Item 2. Did you find the answer you were trying to find? (n = 59)
I don't know
Item 3. Would you recommend this e-learning programme to colleagues? (n = 58)
I don't know
These files were retrieved from a central database by the software provider (Cursum). Each click by a mouse is filed in a log file, which makes it possible to examine the use and time spent on the e-learning programme. When no mouse click was detected for 20 minutes the programme was terminated and no time was calculated. Log files were obtained as plain text.
Data from Danish Medical Association
Information's regarding: Sex, age, year of graduation from university, working address, type of practice and membership of the Danish College of General Practitioners and logons at the e-learning programme were retrieved from the DMA database.
We used chi-square and t-tests to compare differences between users and non-users. In order to identify predictors for using the e-learning programme the probabilities and corresponding 95% confidence intervals were estimated based on logistic regression analysis using with the GEE methods. Pearson's chi-square was used to evaluate Goodness of Fit for the model. A deviance approximately equal to its degrees of freedom has been suggested as a possible indication of a good model fit.
The following variables were included in the model as predictors: age, gender, membership of the Danish College of General Practitioners and municipality size. Age was dichotomized at 55 years and experience was dichotomised at 15 years. All statistical analyses were performed using SAS, version 9.1, proc Gee (SAS Institute Inc, Cary, NC).
The Scientific Ethical Committee for Copenhagen and Frederiksberg Municipalities evaluated the project. The Danish Data Protection Agency and the Danish College of General Practitioners Study Committee approved the project. The project was registered in ClinicalTrials.gov Identifier: NCT00392483.
Predictors for GPs using the e-learning programme in a 6 month period (N = 3632)
Odds Ratio (95% CI)
Age under 55
Members of Danish College of General Practice
Municipalities with more than 20.000 inhabitants
Graduation at University
To our knowledge, this is the first study to examine the diffusion of an e-learning programme (ELP) in General Practice. Only few GPs used the ELP in the study period. The GPs using the ELP were in general sitting alone and did not have a specific diagnostic problem. Male GPs and Members of Danish College of General Practitioners may be more inclined to use the ELP. It was possible to identify a total of 5.3% of Danish GPs that had at least one log on session within a period of 6 months from launching of the ELP. This figure was lower, than we had expected. One reason may be that the mailed letter did not evoke the GPs attention. Another reason may be that the ELP did not appeal to the GPs or a lack of perceived need for CME in dementia. An active implementation strategy could have included emails with direct link to the ELP or small group CME activities. Some GPs may prefer written material or courses as a tool for learning. The low figure may also be due to the new technology that ELP represent. Trying a new technology may be considered as a barrier .
Among the responses from those GPs using the ELP more than once there was a clear indication that they actually found it easy to use, found what they were looking for and would recommend it to colleagues. The fact, that the participants completing the questionnaires in general had a high self-rated competency in diagnostic evaluation of dementia, and were using the programme due to general interest, indicate that the GPs with at least one log on session were specially motivated physicians that may not belong to the target group of this CME activity. Furthermore, members of DSAM were more inclined to log on, which may be explained by the email sent to members by the DSAM. According to the diffusion of innovation we assume that the participant are early adaptors and thus, may not be considered as a representative group of Danish GPs. The finding that the ELP users are more often members of the College of General Practitioners supports this. We can therefore expect that the responses regarding performance (Table 2) may score higher than average Danish GPs.
However, some GPs may have used other ways to gain information than this ELP and that self-reports may overestimate actual performance. We would like to stress, that there are different means of learning and they may change over time, and e-learning is only one of the means. Furthermore, this was the first ELP aimed directly at GPs, and integrated in the dissemination of a guideline, thus ELP has not been established as a possible CME activity in the mind of most GPs. We have not identified other studies reporting the number of persons using an ELP. Most of the participants were sitting alone when using the ELP, even though we think there is a great learning possibility in ELP for groups.
Dementia is a common condition in the elderly, with an estimated prevalence of 7.5% those above 65 years of age . However, previous surveys have indicated that a substantial fraction of patients with cognitive symptoms are not diagnosed by GPs , that diagnostic evaluation in general practice is difficult [11, 15] and that several barriers for diagnostic evaluation in patients and their caregivers as well as among GPs exists . Improvement in the handling of dementia in general practice faces the same barriers as other implementations initiatives: lack of perceived requirement for change; costs; poorly designed implementation; inadequate technology. However, a precondition for improvements is that the GP knows about dementia and how to diagnose it. This ELP aimed at providing the GP with such knowledge and perhaps is 5% a realistic aim for such a mass strategy and reflect the proportion of GPs who are interested in the clinical area and also find the ELP as a learning method fits their learning profile. Previous studies have only considered targeted strongly motivated groups of professionals [16–22] or internet traffic at a web site .
Different barriers may be present in different settings at different times. If the implementation methods are tailored to overcome the obstacles, then change may be more likely to take place. In order to identify the obstacles in this present setting an initial survey could have been initiated before the launching of the ELP. This could possibly have improved the implementation strategy and the subsequent number of users.
In accordance with other studies, we used log-files from the ELP software provider as an outcome measure . This methodology ensures that our data are complete and correct and that the proportion of participants can thus be considered to be accurate. Thus, we believe that this result could be generalised in a Danish setting. Danish general practices were computerized at an early stage and Danish GPs are probably at least as prone to use information technology tools such as ELP as GPs elsewhere.
However, this outcome measure does not evaluate the actual learning progress of the individual physician using the ELP. In our study, we had the advantage of having the possibility to identify users by some basic characteristics due to the possibility of identifying the participants by a unique log-on code and a subsequent merging of the log files with the DMA member database. To secure anonymity for the GPs we received data with a newly constructed participation code, which did not allow us to identify individual GPs. Thus, we do not have any ethical concerns regarding this study. However, we could have increased knowledge about non-users by mailing a questionnaire to a random sample of non-users. We did not consider this, because of the constructed participant code, which did not allow us to identify the individual GP.
This study demonstrated that only few GPs used an e-learning programme for dementia developed for and by GPs. This was the first ELP introduced to Danish GPs and the user rate may increase in the future, when the GPs become familiar with this technology. The dissemination and promotion of the ELP was planned and implemented independently of this study. However, this study underscores the need to identifying barriers and plan implementation strategies accordingly.
The Danish Ministry of Health financially supported this study. We would like to thank Jens Engberg, Jørgen Peter Ærthøj, Jesper Lundh, Ole Dinesen and Lars Rytter for their help when planning the study.
- M R: E-Learning: Strategies for Delivering Knowledge in the Digital Age. 2001, New York, McGraw-HillGoogle Scholar
- Brown TT, Proctor SE, Sinkowitz-Cochran RL, Smith TL, Jarvis WR: Physician preferences for continuing medical education with a focus on the topic of antimicrobial resistance: Society for Healthcare Epidemiology of America. Infect Control Hosp Epidemiol. 2001, 22: 656-660. 10.1086/501841.View ArticlePubMedGoogle Scholar
- A R, JA. MD: Evaluating technology-enhanced continuing medical education. Med Educ Online. 2006, 11: 1-8.Google Scholar
- Cobb SC: Internet continuing education for health care professionals: an integrative review. J Contin Educ Health Prof. 2004, 24: 171-180. 10.1002/chp.1340240308.View ArticlePubMedGoogle Scholar
- Ruiz JG, Mintzer MJ, Leipzig RM: The impact of E-learning in medical education. Acad Med. 2006, 81: 207-212. 10.1097/00001888-200603000-00002.View ArticlePubMedGoogle Scholar
- Wutoh R, Boren SA, Balas EA: eLearning: a review of Internet-based continuing medical education. J Contin Educ Health Prof. 2004, 24: 20-30. 10.1002/chp.1340240105.View ArticlePubMedGoogle Scholar
- A G, P F: Computer-based instruction. Training & Retraining: A handbook for business, Industry, Goverment and the Military. Edited by: S T and J F. 2002, New York, Macmillian Reference, 410-442.Google Scholar
- Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I, Long A, Sheldon T: Developing and implementing clinical practice guidelines. Qual Health Care. 1995, 4: 55-64.View ArticlePubMedPubMed CentralGoogle Scholar
- Wensing M, van der WT, Grol R: Implementing guidelines and innovations in general practice: which interventions are effective?. Br J Gen Pract. 1998, 48: 991-997.PubMedPubMed CentralGoogle Scholar
- Bro F, Waldorff FB: Guidelines--let's take a break and then move forward together!. Scand J Prim Health Care. 2004, 22: 2-5. 10.1080/02813430310004975.View ArticlePubMedGoogle Scholar
- Waldorff FB, Almind G, Makela M, Moller S, Waldemar G: Implementation of a clinical dementia guideline. A controlled study on the effect of a multifaceted strategy. Scand J Prim Health Care. 2003, 21: 142-147. 10.1080/02813430310005136.View ArticlePubMedGoogle Scholar
- Danish College of General Practitioners. 2006, [http://www.dsam.dk]
- Waldorff FB, Rishoj S, Waldemar G: Identification and diagnostic evaluation of possible dementia in general practice. A prospective study. Scand J Prim Health Care. 2005, 23: 221-226. 10.1080/02813430510031324.View ArticlePubMedGoogle Scholar
- Lobo A, Launer LJ, Fratiglioni L, Andersen K, Di Carlo A, Breteler MM, Copeland JR, Dartigues JF, Jagger C, Martinez-Lage J, Soininen H, Hofman A: Prevalence of dementia and major subtypes in Europe: A collaborative study of population-based cohorts. Neurologic Diseases in the Elderly Research Group. Neurology. 2000, 54: S4-S9.View ArticlePubMedGoogle Scholar
- Renshaw J, Scurfield P, Cloke L, Orrell M: General practitioners' views on the early diagnosis of dementia. Br J Gen Pract. 2001, 51: 37-38.PubMedPubMed CentralGoogle Scholar
- Schilling K, Wiecha J, Polineni D, Khalil S: An interactive web-based curriculum on evidence-based medicine: design and effectiveness. Fam Med. 2006, 38: 126-132.PubMedGoogle Scholar
- Wehrs VH, Pfafflin M, May TW: E-learning courses in epilepsy--concept, evaluation, and experience with the e-learning course "genetics of epilepsies". Epilepsia. 2007, 48: 872-879. 10.1111/j.1528-1167.2007.01029.x.View ArticlePubMedGoogle Scholar
- Vandeweerd JM, Davies JC, Pinchbeck GL, Cotton JC: Teaching veterinary radiography by e-learning versus structured tutorial: a randomized, single-blinded controlled trial. J Vet Med Educ. 2007, 34: 160-167. 10.3138/jvme.34.2.160.View ArticlePubMedGoogle Scholar
- Whitfield L: Back to the new school. Health Serv J. 2007, 117: Suppl-Google Scholar
- Lewis PA, Price S: Distance education and the integration of E-learning in a graduate program. J Contin Educ Nurs. 2007, 38: 139-143.View ArticlePubMedGoogle Scholar
- Filippucci E, Meenagh G, Ciapetti A, Iagnocco A, Taggart A, Grassi W: E-learning in ultrasonography: a web-based approach. Ann Rheum Dis. 2007, 66: 962-965. 10.1136/ard.2006.064568.View ArticlePubMedPubMed CentralGoogle Scholar
- Ridgway PF, Sheikh A, Sweeney KJ, Evoy D, McDermott E, Felle P, Hill AD, O'Higgins NJ: Surgical e-learning: validation of multimedia web-based lectures. Med Educ. 2007, 41: 168-172. 10.1111/j.1365-2929.2006.02669.x.View ArticlePubMedGoogle Scholar
- Sparacia G, Cannizzaro F, D'Alessandro DM, D'Alessandro MP, Caruso G, Lagalla R: Initial experiences in radiology e-learning. Radiographics. 2007, 27: 573-581. 10.1148/rg.272065077.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2296/9/24/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.