- Research article
- Open Access
- Open Peer Review
Estimating the workload associated with symptoms-based ovarian cancer screening in primary care: an audit of electronic medical records
BMC Family Practice volume 15, Article number: 200 (2014)
Ovarian cancer is the most lethal gynaecological malignancy in the United Kingdom (UK). Studies have found that many women with ovarian cancer have symptoms for several months before diagnosis. Using a symptoms-based tool to diagnose ovarian cancer (OC) earlier is appealing, but may increase general practitioner (GP) workload because the symptoms are typically vague and non-specific. This study aimed to provide estimates of the GP workload associated with offering symptoms-based ovarian cancer screening.
A cross-sectional analysis of electronic records from four general practices in England, UK. We downloaded anonymous data on women aged 45–74 who consulted over one week to estimate the proportion who would be offered ‘screening’ according to the UK National Institute for Health and Care Excellence (NICE) guidelines and a symptoms index (Index 2) over one year. We used previous consultations (censoring women with no prior symptom at the date of their last recorded consultation) to estimate the proportion of women presenting with a new (not recorded in previous 12 months) NICE symptom each year.
Data were obtained from 19,558 women. The proportion presenting over one week varied between practices (5%-14%), however, the proportion with an OC symptom was similar (17% overall). Over one year, an estimated 51.8% (95% CI 44.0%-59.7%) would present with an OC symptom, 26.6% (95% CI 19.3%-35.1%) with a NICE symptom and 20.3% (95% CI 13.7%-28.5%) with an Index 2 symptom. Each year, an estimated 11.9% (95% CI 5.0%-18.3%) of women would present with a new NICE symptom.
One in two women aged 45–74 present to primary care at least once a year with an OC symptom, 11.9% with a new NICE symptom. This would be comparable to 2 to 8 yearly screening (depending on what symptoms triggered testing).
Ovarian cancer is the most lethal gynaecological malignancy in the UK causing around 4,200 deaths per year . The majority of women are diagnosed with advanced stage disease and the lack of an effective screening mechanism means that diagnosis relies on symptomatic presentation. Numerous retrospective studies - have shown that women have symptoms for many months before ovarian cancer diagnosis. This has led to interest in using symptoms to prompt investigations which could hopefully facilitate earlier stage diagnosis. This would be a form of targeted ‘screening’ in which women presenting to primary care with symptoms suggestive of ovarian cancer would be offered a blood test (e.g. CA125 or any future biomarker) and/or pelvic ultrasound. The challenge is that ovarian cancer is rare, and the symptoms are relatively common with non-malignant conditions in postmenopausal women (in whom >80% of ovarian cancers occur).
In the UK, NICE (National Institute for Health and Clinical Excellence) guidelines for ovarian cancer recommend CA125 testing for persistent symptoms of abdominal distension, feeling full quickly/loss of appetite, pelvic/abdominal pain and urinary frequency or urgency . Urgent investigation for ovarian cancer is only recommended for women with suspected ascites or a palpable mass. In 2012, primary care physicians (GPs) in England were given increased access to non-obstetric ultrasound with the express purpose of aiding ovarian cancer diagnosis . However, there are few data on the prevalence of ovarian cancer-like symptoms in women presenting to primary care or in the general population. Also, because of the growing demands on primary care, activities that could increase GP workload need careful assessment.
Electronic patient records (EPR) enable large amounts of data to be obtained with a simple download. The aim of this study was to use electronic medical records to provide an unbiased estimate of the GP workload associated with offering symptoms-based ovarian cancer screening.
We identified potential GP surgeries in London, Newbury, Wokingham and Bracknell via research contacts and collaborators. Of those willing to participate we only included those with a list size of at least 5500, that had been using EMIS (Egton Medical Information Systems one of the main software suppliers to UK general practices) LV (Limited Version) for at least one year, had at least one female GP (in case women are less likely to report gynaecological symptoms to a male GP), and no unusual demographic composition. The threshold for list size was based on the average of 5891 patients for England set by the 2004 General Medical Services contract .
Only anonymised data were used in the study, therefore ethics approval was not necessary. We used EMIS to download data on permanently registered women aged 45–74 years who presented over one week. Women whose records showed that they had a history of ovarian cancer or were actively receiving treatment for a malignancy (except for hormonal treatment only) were excluded.
Downloads took place between November 2007 and May 2008. We developed a search strategy in EMIS LV which downloaded data on women aged 45–74 who consulted over one week. Data included the woman’s age, medical history and details of the most recent previous consultation entries up to a maximum of 10. The week examined preceded the date of download by one day to allow time for after-hours and home visits to be entered.
We also collected the following details from each practice:
List size (including breakdown of age and sex)
Total number of women aged 45–74 in the practice
Number of GPs
Full-time or part-time work status of each GP
Total number of women registered with the practice
Consultation data in EMIS include entries that are not actual consultations such as incoming letters, administrative notes and laboratory test results. For each consultation entry we determined who was seen/encountered (from the name of the person who made the entry; eg a doctor or receptionist’s name), the consultation location (from the consultation type field; eg “GP surgery”, “path lab”). Consultation entries were then limited to those that were with a GP or a nurse and in-person (GP surgery or home visits) or over the telephone.
The same researcher (AWL) extracted symptoms from the consultation free text and clinical codes. Extracted symptoms were then coded as relevant or not relevant to ovarian cancer according to a pre-defined list of symptoms most commonly reported by women with ovarian cancer -. Symptoms included pelvic or abdominal pain or discomfort; abdominal bloating; increased abdominal size/abdominal distension; abdominal lump; indigestion; constipation; diarrhoea; nausea or vomiting; other gastrointestinal symptoms (eg wind, change in bowel habit); loss of appetite; weight loss, fatigue; urinary frequency or urgency; postmenopausal bleeding; and vaginal discharge. Vaginal discharge is not usually considered to be a typical ovarian cancer symptom, but was included because we found it to be independently associated with ovarian cancer in a case–control study . A systematic coding frame (compiled with the input of two gynaecologists: Professor Usha Menon and Dr Aarti Sharma) was used to ensure symptoms were classified consistently.
Details of co-morbidities (type and date diagnosed/recorded) were obtained from the women’s medical history summary data.
We estimated the proportion of women who would be offered targeted ‘screening’ in GP primary care over one week under two different scenarios. The first used NICE guidelines which recommend CA125 testing in women who have any one of persistent abdominal distension, feeling full (early satiety) and/or loss of appetite, pelvic or abdominal pain or increased urinary urgency and/or frequency, on a persistent or frequent basis particularly more than 12 times per month . We applied these criteria to our data except for symptom frequency as this information was not available in the GP notes. The second used a symptoms index (Index 2) that we developed in a previous study . Women are considered positive on Index 2 if they have any one of pelvic abdominal pain or discomfort; loss of appetite; increase in abdominal size; able to feel a lump in the abdomen; or vaginal discharge. We also considered women who had two or more Index 2 symptoms given that the positive predictive value of individual symptoms is low .
Targeted ovarian cancer ‘screening’ is unlikely to be triggered by longstanding symptoms (unless there is worsening or change). Therefore, we also estimated the proportion of women who presented with a NICE guideline symptom that was new in the previous 12 months. The time period covered by downloading the last 10 consultation entries varied between women (median 6.0 months inter-quartile range 2.8-11.5). To use all available data for each woman we used the Kaplan-Meier method to estimate the proportion of women with a NICE guideline symptom in the reference week who had presented previously with that symptom as a function of time. From this we estimated the proportion who had at least one NICE guideline symptom for which they had not presented in the previous year (ie ‘new’). We multiplied this by the proportion of registered women aged 45–74 who presented with a NICE symptom to calculate the proportion (p) who would present during the week with a NICE guideline symptom that was new in the last year. The Delta method was used to calculate the variance to obtain confidence intervals for our estimate of NICE guideline symptoms new in the last year (taking into account the Kaplan-Meier estimate).
We calculated the proportion of women aged 45–74 who presented during the reference week with symptoms with 95% confidence intervals (for proportions) for women with:
Any ovarian cancer symptom
Any NICE guideline symptom
Any Index 2 symptom
Any ‘new’ NICE guideline symptom
At least two Index 2 symptoms
We approximate the proportion of all women aged 45–74 that would be offered testing over one year according to different symptom categories using the equation:
where p is the proportion of women to be offered testing in a single week. Confidence intervals (95%) were calculated using the same equation and were based on the binomial distribution.
A total of seven practices were approached of which five agreed to participate. Of these, one was excluded because the list size was too small (below 5500).
The combined list size was 38,921, of whom 5737 were women aged 45–74. Table 1 shows GP practice details and the number of women aged 45–74 who consulted during the reference week for each practice and overall. Although the proportion of registered females in the target age range at each practice was broadly comparable between practices (11%-17%), the proportion that consulted during the week varied considerably (e.g. almost 3 times as many women presented at Chrisp Street (14%) than at Boundary House and Woosehill practice (both 5%)). Of the women who consulted during the week the proportion who reported any symptom was similar across practices. However, again there was almost a 3-fold difference between practices in the proportion of all women aged 45–74 who presented with an ovarian cancer symptom during the week (0.8% (Woosehill) cf. 2.2% (Chrisp Street).
Table 2 shows the estimated proportion of women who presented at each practice that would be offered testing in one week based on different criteria. According to the basic testing scenario of any ovarian cancer symptom, 16.8% of women aged 45–74 who present over one week would be ‘screened’ (equivalent to 1.4% of all women in the age group each week). It is much less common to have two or more Index 2 symptoms: 0.8% of women who present over one week had at least two Index 2 symptoms.
Our estimates for the proportion of women aged 45–74 presenting over one year are shown in Table 3. According to the survival analysis 45.0% of women with a NICE guideline symptom in the reference week would not have had that same symptom within the previous 12 months (i.e. for 45.0% of those with a NICE symptom, at least one NICE symptom was new). Extrapolation yielded 11.9% (95% CI 5.0%, 18.3%) of all women aged 45–74 would present with a new NICE guideline symptom over one year. However, it should be noted that the estimates obtained from individual practices varied considerably.
According to our estimates, about a quarter of women aged 45–74 presenting to GP primary care would be offered symptoms-based screening for a NICE guideline symptom each year, however, this reduced to about a fifth when only ‘new’ symptoms were considered.
Despite having diverse locations, the four GP practices studied showed comparable proportions of women aged 45–74 who presented during the reference week. By contrast, the proportion of women in the target age range who presented with at least one ovarian cancer symptom relative to list size differed widely across surgeries.
Strengths and limitations
A key strength of the study is that we collected data from a mixture of urban and non-urban practices to obtain a representative sample. In addition, having the last 10 consultations entries before the date of download provided information on symptom development. We used several testing scenarios to estimate the proportion of women who would be offered symptoms-based ovarian cancer screening, including an assessment of whether symptoms were new in the last year (testing is unlikely to be offered for longstanding symptoms). We used an age range that is most likely to be chosen for symptoms-based ovarian cancer screening; ovarian cancer incidence is much higher in postmenopausal women aged ≥45 and screening is not usually offered to those aged over 74. Finally, data were collected before initiatives to raise symptom awareness and encourage early presentation were commonplace (e.g. National Awareness and Early Diagnosis Initiative - NAEDI).
The main limitations are that the study was small and only records from women consulting during a single week were examined. This period is too short to take seasonal variations in consultations (e.g. flu season) into account. Additionally, we only studied four GP practices and these were seen to be heterogeneous. Another drawback is our inability to accurately assess other factors which would inform the decision to offer screening to women, such as symptom frequency, severity and persistence. In particular this could have led to overestimates of the proportion that would be offered symptoms-based screening.
Comparison with existing literature
Estimates from a recent UK study  were smaller than ours. The authors used logistic regression to derive three different weighted ovarian cancer scores were derived using GP medical record data from 212 women with ovarian cancer and 1060 age-matched controls. Seven symptoms were included in each of the scores: bloating, urinary frequency, rectal bleeding, postmenopausal bleeding, loss of appetite, abdominal pain and abdominal distension. The main score had a specificity of 91.3% which is equivalent to 8.7% of women without ovarian cancer testing positive on the score over one year.
A prospective study randomised GP practices to being able to refer (or not refer) women aged ≥45 with any one of a list of 19 symptoms potentially related to ovarian cancer for immediate CA125 testing and transvaginal ultrasound . Compliance was poor and only 39 out of 79 practices made referrals during the study period. Referral patterns were also extremely variable between GPs. Over the recruitment period that spanned almost 2½ years, only 317 women were referred.
Implications for research/practice
Based on our findings, symptoms-based screening would result in roughly the same amount of screening as two yearly population screening for any ovarian cancer symptom, four yearly population screening for any NICE guideline symptom and eight yearly population screening for any ‘new’ NICE guideline symptom. One drawback of symptoms-based screening is that it is necessary to wait for symptoms to develop and for women to present. Lower socioeconomic status is associated with delayed presentation for some cancers , therefore, symptoms-based screening could lead to an increase in the social inequalities that already exist in ovarian cancer .
Nevertheless, current referral criteria for rapid access gynaecological-oncology clinics (relevant to ovarian cancer) only include two symptoms: suspicious pelvic mass and postmenopausal bleeding (if not on hormone replacement therapy). Symptoms-based screening could be a useful tool when other typical ovarian cancer symptoms are present but the index of suspicion is not sufficient to prompt referral or more expensive investigations. This could be particularly appealing given that the effectiveness of population-based ovarian cancer screening remains unclear. UKCTOCS (United Kingdom Collaborative Trial of Ovarian Cancer Screening) is the largest randomised trial of ovarian screening to date. Around 200,000 women from the general population were randomised to either screening with transvaginal ultrasound (TVS) or multimodal screening with CA125 and TVS or no screening. Data from the prevalent screening round found that sensitivity for primary invasive epithelial ovarian/tubal cancer was 89.5% and specificity was 99.8% in the multimodal arm . Although these data are encouraging, the final picture will need to be balanced against unnecessary surgeries, complications and most importantly, needs to be able to demonstrate a mortality benefit. Mortality data are due in 2015 and are expected to provide major insights into ovarian screening.
Although our estimates for women who would require symptoms-based testing are relatively large, the extrapolations over one year are somewhat crude. Furthermore, any testing threshold for symptoms-based screening is likely to include a criterion for symptom persistence which was unaccounted for in this analysis. The NICE guidelines  and the symptom index produced by Goff et al.  stipulate that symptoms should occur more than 12 times per month Applying similar criteria should further reduce the number of women who require testing, as would the use of a score or similar. In this study, only 3.6% (95% CI 1.0%-8.9%) of women aged 45–74 would have had testing in one year if the requirement was for two or more Index 2 symptoms. Additionally, testing would not be offered to women who have already been recently tested (say the last 6–12 months) which would also reduce testing numbers.
Over one year, between 11.9%-51.8% of women aged 45–74 who present to primary care would be offered symptoms-based ovarian screening depending on the guidelines adopted. Although there are other issues to consider, these data are encouraging since the numbers are considerably less than those required for annual (or even biennial) population screening and in reality, stricter criteria would be applied which would further reduce these figures.
Egton Medical Information Systems
National Institute for Health and Clinical Excellence
United Kingdom Collaborative Trial of Ovarian Cancer
Office for National Statistics: Cancer Incidence and Mortality in the United Kingdom, 2008–10. 2012. Available from: [http://www.ons.gov.uk/ons/rel/cancer-unit/cancer-incidence-and-mortality/2008-2010/index.html] (accessed 29/07/2014).,
Chan YM, Ng TY, Lee PW, Ngan HY, Wong LC: Symptoms, coping strategies, and timing of presentations in patients with newly diagnosed ovarian cancer. Gynecol Oncol. 2003, 90 (3): 651-656. 10.1016/S0090-8258(03)00394-9.
Eltabbakh GH, Yadav PR, Morgan A: Clinical picture of women with early stage ovarian cancer. Gynecol Oncol. 1999, 75 (3): 476-479. 10.1006/gyno.1999.5621.
Goff BA, Mandel L, Muntz HG, Melancon CH: Ovarian carcinoma diagnosis. Cancer. 2000, 89 (10): 2068-2075. 10.1002/1097-0142(20001115)89:10<2068::AID-CNCR6>3.0.CO;2-Z.
Goff BA, Mandel LS, Melancon CH, Muntz HG: Frequency of symptoms of ovarian cancer in women presenting to primary care clinics. JAMA. 2004, 291 (22): 2705-2712. 10.1001/jama.291.22.2705.
Olson SH, Mignone L, Nakraseive C, Caputo TA, Barakat RR, Harlap S: Symptoms of ovarian cancer. Obstet Gynecol. 2001, 98 (2): 212-217. 10.1016/S0029-7844(01)01457-0.
Smith EM, Anderson B: The effects of symptoms and delay in seeking diagnosis on stage of disease at diagnosis among women with cancers of the ovary. Cancer. 1985, 56 (11): 2727-2732. 10.1002/1097-0142(19851201)56:11<2727::AID-CNCR2820561138>3.0.CO;2-8.
Vine MF, Calingaert B, Berchuck A, Schildkraut JM: Characterization of prediagnostic symptoms among primary epithelial ovarian cancer cases and controls. Gynecol Oncol. 2003, 90 (1): 75-82. 10.1016/S0090-8258(03)00175-6.
Vine MF, Ness RB, Calingaert B, Schildkraut JM, Berchuck A: Types and duration of symptoms prior to diagnosis of invasive or borderline ovarian tumor. Gynecol Oncol. 2001, 83 (3): 466-471. 10.1006/gyno.2001.6411.
Yawn BP, Barrette BA, Wollan PC: Ovarian cancer: the neglected diagnosis. Mayo Clin Proc. 2004, 79 (10): 1277-1282. 10.4065/79.10.1277.
Friedman GD, Skilling JS, Udaltsova NV, Smith LH: Early symptoms of ovarian cancer: a case–control study without recall bias. Fam Pract. 2005, 22 (5): 548-553. 10.1093/fampra/cmi044.
Lim AWW, Mesher D, Gentry-Maharaj A, Balogun N, Jacobs I, Menon U, Sasieni P: Predictive value of symptoms for ovarian cancer: comparison of symptoms reported by questionnaire, interview, and general practitioner notes. J Natl Cancer Inst. 2012, 104 (2): 114-124. 10.1093/jnci/djr486.
Smith LH, Morris CR, Yasmeen S, Parikh-Patel A, Cress RD, Romano PS: Ovarian cancer: Can we make the clinical diagnosis earlier?. Cancer. 2005, 104 (7): 1398-1407. 10.1002/cncr.21310.
National Institute for Health and Clinical Excellence: Ovarian cancer: the recognition and initial management of ovarian cancer. Clinical guidelines CG122. Edited by NICE, vol. CG122; 2011. Available from: [http://www.nice.org.uk/guidance/cg122] (accessed 29/07/2014).,
Department of Health: Direct access to diagnostic tests for cancer: best practice referral pathways for general practitioners. 2012: 36. Available from: [http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_133510] (accessed 06/03/2013).,
Royal College of General Practitioners: General Practice in the UK: A Basic Overview. RCGP Information Sheet No 4. 2005, vol. 4: ᅟ-
Hamilton W, Peters TJ, Bankhead C, Sharp D: Risk of ovarian cancer in women with symptoms in primary care: population based case–control study. BMJ. 2009, 339: b2998-10.1136/bmj.b2998.
Grewal K, Hamilton W, Sharp D: Ovarian cancer prediction: development of a scoring system for primary care. BJOG. 2013, 120 (8): 1016-1019. 10.1111/1471-0528.12200.
Rufford BD, Jacobs I, Menon U: Feasibility of screening for ovarian cancer using symptoms as selection criteria. BJOG. 2007, 114 (1): 59-64. 10.1111/j.1471-0528.2006.01153.x.
Macleod U, Mitchell ED, Burgess C, Macdonald S, Ramirez AJ: Risk factors for delayed presentation and referral of symptomatic cancer: evidence for common cancers. Br J Cancer. 2009, 101 (Suppl 2): S92-S101. 10.1038/sj.bjc.6605398.
Maringe C, Walters S, Butler J, Coleman MP, Hacker N, Hanna L, Mosgaard BJ, Nordin A, Rosen B, Engholm G, Gjerstorff ML, Hatcher J, Johannesen TB, McGahan CE, Meechan D, Middleton R, Tracey E, Turner D, Richards MA, Rachet B: Stage at diagnosis and ovarian cancer survival: evidence from the International Cancer Benchmarking Partnership. Gynecol Oncol. 2012, 127 (1): 75-82. 10.1016/j.ygyno.2012.06.033.
Menon U, Gentry-Maharaj A, Hallett R, Ryan A, Burnell M, Sharma A, Lewis S, Davies S, Philpott S, Lopes A, Godfrey K, Oram D, Herod J, Williamson K, Seif MW, Scott I, Mould T, Woolas R, Murdoch J, Dobbs S, Amso NN, Leeson S, Cruickshank D, McGuire A, Campbell S, Fallowfield L, Singh N, Dawnay A, Skates SJ, Parmar M, et al: Sensitivity and specificity of multimodal and ultrasound screening for ovarian cancer, and stage distribution of detected cancers: results of the prevalence screen of the UK Collaborative Trial of Ovarian Cancer Screening (UKCTOCS). Lancet Oncol. 2009, 10 (4): 327-340. 10.1016/S1470-2045(09)70026-9.
Goff BA, Mandel LS, Drescher CW, Urban N, Gough S, Schurman KM, Patras J, Mahony BS, Andersen MR: Development of an ovarian cancer symptom index: possibilities for earlier detection. Cancer. 2007, 109 (2): 221-227. 10.1002/cncr.22371.
This study was funded by Cancer Research UK (C8162/A6138 to PS and AWL. and C8162/A10406 to PS and DM).
We are grateful to Northcroft Practice, Chrisp Street Practice, Woosehill Practice and Boundary House Practice for allowing us access to their data. We thank Gladys Foudjour and Keith Prescott from the Clinical Effectiveness Group at Queen Mary University of London for helping to develop the EMIS search strategy and Richard Ostler from the Centre for Cancer Prevention, at Queen Mary University of London for developing the programme to anonymise the GP record data. We thank the late Prof. Joan Austoker and Dr Clare Bankhead for helping to identify the GP practices, University Research Lecturer (Department of Primary Health Care Sciences, University of Oxford, Oxford, UK).
We thank Prof. Usha Menon and Dr Aarti Sharma from the Gynaecological Cancer Research Centre, Women’s Cancer, Institute for Women’s Health, University College London) for devising the ovarian cancer symptom coding framework.
The authors declare that they have no competing interests.
All authors participated in the editing of this manuscript and approved the final version for publication. AWL and PS jointly planned and designed the study and interpreted the data. AWL collected and analysed the study data, wrote the first draft of the manuscript and contributed to the revising of the manuscript. DM and PS led the data analysis.
About this article
Cite this article
Lim, A.W., Mesher, D. & Sasieni, P. Estimating the workload associated with symptoms-based ovarian cancer screening in primary care: an audit of electronic medical records. BMC Fam Pract 15, 200 (2014) doi:10.1186/s12875-014-0200-y
- Ovarian cancer
- General practice
- Early diagnosis