- Research article
- Open Access
Effectiveness, benefit harm and cost effectiveness of colorectal cancer screening in Austria
BMC Gastroenterology volume 19, Article number: 209 (2019)
Clear evidence on the benefit-harm balance and cost effectiveness of population-based screening for colorectal cancer (CRC) is missing. We aim to systematically evaluate the long-term effectiveness, harms and cost effectiveness of different organized CRC screening strategies in Austria.
A decision-analytic cohort simulation model for colorectal adenoma and cancer with a lifelong time horizon was developed, calibrated to the Austrian epidemiological setting and validated against observed data. We compared four strategies: 1) No Screening, 2) FIT: annual immunochemical fecal occult blood test age 40–75 years, 3) gFOBT: annual guaiac-based fecal occult blood test age 40–75 years, and 4) COL: 10-yearly colonoscopy age 50–70 years. Predicted outcomes included: benefits expressed as life-years gained [LYG], CRC-related deaths avoided and CRC cases avoided; harms as additional complications due to colonoscopy (physical harm) and positive test results (psychological harm); and lifetime costs. Tradeoffs were expressed as incremental harm-benefit ratios (IHBR, incremental positive test results per LYG) and incremental cost-effectiveness ratios [ICER]. The perspective of the Austrian public health care system was adopted. Comprehensive sensitivity analyses were performed to assess uncertainty.
The most effective strategies were FIT and COL. gFOBT was less effective and more costly than FIT. Moving from COL to FIT results in an incremental unintended psychological harm of 16 additional positive test results to gain one life-year. COL was cost saving compared to No Screening. Moving from COL to FIT has an ICER of 15,000 EUR per LYG.
Organized CRC-screening with annual FIT or 10-yearly colonoscopy is most effective. The choice between these two options depends on the individual preferences and benefit-harm tradeoffs of screening candidates.
Colorectal carcinoma (CRC) is the third most common carcinoma and has one of the highest mortality rates worldwide. Most of CRC cases originate from a benign neoplasm (adenoma) [1, 2]. Early detection and removal of these precancerous lesions leads to a significant reduction in CRC incidence and mortality .
The chance of early detection increases with CRC screening. Currently, two categories of screening technologies are used: 1) tests for detecting blood, exfoliated DNA or specific enzymes in stool samples and 2) structural exams, including sigmoidoscopy (FSIG), colonoscopy, double-contrast barium enema (DCBE), and computed tomographic colonography (CTC). Although invasive, the structural exams have the advantage that suspicious lesions (adenomatous polyps) can be detected and removed (polypectomy) during the test . However, there are also potential side effects associated with colonoscopy including colonic perforation and major bleeding . Independent of the applied technology, false positive test results and overdiagnosis (i.e., cancers detected at screening that would not have become clinically manifest during one’s lifetime) can lead to discomfort, overtreatment and associated physical and psychological harm. The consequences of diagnostic and therapeutic procedures can also generate stress and anxiety in patients [4, 6, 7].
The Advisory Committee on Cancer Prevention in the European Union recommends that persons 50–74 years old should be screened with guaiac-fecal occult blood test (gFOBT) every 1–2 years. In case of a positive test, colonoscopy should follow . A systematic review on international screening programs showed that for organized screening programs either fecal immunochemical test (FIT) or gFOBT are being used for the initial test due to the higher acceptance of these test technologies .
Austria is among those countries in the European Union (EU) with a opportunistic screening program that recommends colonoscopy at intervals of 10 years and annual or biennial gFOBT as an alternative screening strategy [10, 11]. Currently, no organized screening program for colorectal cancer exists in Austria.
As there are currently no head-to-head trials demonstrating that any of the screening strategies is more effective than the others , modeling studies have been used worldwide to compare the long-term effectiveness and cost effectiveness of these strategies [13,14,15,16]. Cost-effectiveness studies show that CRC screening is cost effective and even cost saving compared to No Screening, however study results differ on which strategy is cost effective [17,18,19,20]. Recently, the US Preventive Services Task Force (USPSTF) used three independently created and well-established models (MISCAN, CRC-SPIN, SimCRC) to evaluate benefits, burden (colonoscopies), and harms (colonoscopy complications) of CRC screening strategies [14, 21]. The Task Force estimated that “assuming 100% adherence, the strategies of colonoscopy every 10 years, annual FIT, sigmoidoscopy every 10 years with annual FIT, and CTC every 5 years performed from ages 50 through 75 years provided similar life-years gained (LYG) and a comparable balance of benefit and screening burden” .
This study commissioned by the Main Association of Austrian Social Security Institutions aims to systematically evaluate the long-term benefits, harms, costs, benefit-harm and cost-effectiveness relations of different organized CRC screening strategies compared to no screening for average-risk women and men aged 40–75 years in Austria.
A decision-analytic Markov state-transition cohort model  was developed. The simulation starts with a hypothetical healthy cohort of the general population with average CRC risk. Starting at the age of 20 years, individuals are at age-specific risk for developing one or more adenomas. The evaluation of the screening strategies and calculation of model outcomes start at the age when the decision about the screening program is made (age 40) and are performed lifelong.
Model design and assumptions
A state-transition Markov model was chosen because it reflects the course of disease of colorectal cancer, with a natural history and disease progression that follows several well-defined histologic and clinical “health states” (Markov states) with transition and event probabilities . The decision-analytic model was programmed and validated using the decision-analytic software package TreeAge Pro 2017 (TreeAge Software Inc., Williamstown, MA, USA).
Within the evaluation of the screening program, repeated screening events are required and time to event is important (e.g., disease progression). As the number of health states is manageable, the model was designed to be analyzed as a cohort simulation .
The model structure including natural history and the impact of screening and surveillance is displayed in Fig. 1. The natural history, that is, occurrence and growth of adenoma and progression to cancer, is modeled starting with healthy individuals at average risk of CRC that enter the model and may develop adenomas. Adenomas may progress to advanced adenoma. Advanced adenomas are defined as “adenoma with villous histology or high-grade dysplasia or ≥ 10mm in size” . Advanced adenomas may further progress and become malignant. Preclinical (i.e., undiagnosed) cancers may progress from stage I to stage IV according to the Union for International Cancer Control (UICC) classification. Cancer at any stage may be diagnosed by symptoms or screening. Adenomas are assumed to be detectable only by screening.
Individuals diagnosed with cancer are assumed to be treated according to the Austrian clinical guidelines  reflected in the Austrian claims data of the Main Association of Austrian Social Security Institutions. According to the structural assumption of the model, individuals technically remain in the health state determined after the cancer diagnosis for their remaining lifetime until they die from CRC or other causes. In those“health states (diagnosed cancer states), stage-specific follow-up treatment and survival, which also accounts for further disease progression, are considered.
Evaluated screening strategies may alter the risk of cancer progression and survival probability due to the removal of adenomas before they become malignant or due to early detection (with potential removal) of cancer. Adverse effects from colonoscopy (confirmatory or screening) leading to hospitalization or death are also considered. At any point in time, individuals may die from other causes.
The following model assumptions were made:  the model simulates an average number of lesions, meaning that the progression of single adenomas was not simulated ; adenomas cannot regress, because regression of adenoma is rare and evidence from literature is limited  ; age-specific risk for adenoma, and other risk factors such as gender and anatomical adenoma location as well as age-specific adenoma progression were not explicitly modeled ; incidental detection of asymptomatic disease was not considered, adenomas can only be detected by screening ; symptomatic patients would receive confirmatory colonoscopy and therefore face the risk of adverse events. For confirmatory colonoscopies in symptomatic patients, false negative results were assumed to be negligible for our evaluation.
Screening population and strategies
The implemented screening strategies include follow-up screening algorithms (surveillance) based on the Austrian guidelines  and recommendations of the European Society of Gastrointestinal Endoscopy (ESGE)  and were confirmed by the Austrian expert panel. Four screening strategies are considered: 1) No Screening, 2) annual immunochemical fecal occult blood test (FIT) at age 40–75 years, 3) annual guaiac-based fecal occult blood test (gFOBT) at age 40–75 years, and 4) ten-yearly colonoscopy at age 50–70 years. Other index tests were not considers by the experts for several reasons including limited relevance in the Austrian setting (sigmoidoscopy), additional radiation and missing recommendation for routine use (CT colonography) or limited evidence on test accuracy (DNA stool tests).
In the screening strategies with annual FIT and gFOBT, the patients with a positive blood test result undergo diagnostic colonoscopy.
In all strategies, patients with detected CRC are treated according to Austrian treatment guidelines. They continue with follow-up examinations and do not enter the regular screening program again. Identified non-adenomas and advanced adenomas are removed by polypectomy and individuals continue screening according to the assumptions described below.
In the screening strategies with annual fecal occult blood tests, patients with detected non-advanced adenomas continue screening with colonoscopy every 10 years. The detection of advanced adenomas leads to 3-yearly surveillance with colonoscopy.
Similarly, in the colonoscopy screening program individuals continue with the 10-year colonoscopy screening interval, if non-advanced adenomas are detected and patients with detected advanced adenomas, are referred to 3-yearly surveillance.
Patients undergoing 3-yearly surveillance continue surveillance in 3-years intervals only if an advanced adenoma was found in the following surveillance examination. If non-advanced or no adenomas are found, these individuals are referred to 5-yearly surveillance with colonoscopy. They will continue the 5-yearly surveillance as long as no advanced adenomas are detected. A detection of advanced adenomas will lead to 3-yearly surveillance.
In all strategies, surveillance examinations until the age of 75 are considered.
Natural history data and model calibration
Natural history parameters for the progression of the disease were estimated in three steps. First, epidemiological data (cancer incidence, cancer stage distribution) were determined from Statistics Austria  and published literature serving as starting parameter sets and calibration targets. Second, the model was calibrated in a hierarchical fashion using optimization algorithms (Nelder Mead and Basinn-Hoping) and third, a final parameter adjustment was performed to meet the calibration-target distribution for all cancer stages. Further details on model calibration and the natural history parameter values are reported in the Additional file 1.
Colorectal cancer survival and mortality from other causes
The age-specific mortality rates from other causes were based on Austrian statistical life tables for the year 2016 from Statistics Austria . Mortality rates for age groups over 100 years were extrapolated applying an exponential distribution. CRC-specific mortality (post-diagnosis) was derived from Statistics Austria (2010–2014), extrapolated and adjusted for screenning detection and symptom detection . Hazard ratios between these two modes of detection for different cancer stages were derived from Brenner et al.  (see Additional file 1: Table S7 and S8).
Screening test accuracy
For FIT, sensitivity for advanced adenoma (36.7%), CRC (87.2%) and specificity for both adenoma and CRC (92.8%) was obtained from a meta-analysis (22 studies pooled, 174,469 patients, brand: OC-Sensor) . Differences in the results for the specificity of advanced adenoma (93.4%; 95% CI: 90.2–95.6%) and CRC (92.8%; 95% CI: 90.6–94.5%) were not significant, therefore the specificity for CRC was selected as overall specificity of the test. The sensitivity of FIT for non-advanced adenomas (7.6%) was obtained from a large clinical trial (9989 patients, brands: OC FIT-CHEK, Polymedco) .
For gFOBT, sensitivity for CRC (72.2%) and specificity (90.0%) was obtained from a meta-analysis (6 studies pooled, 7564 patients, brands: Hemoccult, Hemoccult II, Hemoccult Sensa) . Reported sensitivity for CRC for the proximal (62.6%) and distal colon (75.4%) was pooled according to the distribution of anatomical location (proximal 25%, distal 75%) . Sensitivity for adenomas (9.5%) and advanced adenomas (23.9%) were determined from a modeling study from the USPSTF (brand: Hemoccult Sensa) . Sensitivity for adenomas was reported in the USPSTF-study only by adenoma size (1-5 mm 7.5%; 6-9 mm 12.4%; > 10 mm 23.9%) therefore, a pooled sensitivity for adenomas 1–9 mm (1-5 mm 60.3%, 6-9 mm 39.7% ) was calculated and for advanced adenomas the sensitivity for adenomas > 10 mm was considered.
For colonoscopy, a meta-analysis was conducted due to missing pooled data. As a result, sensitivities of colonoscopy for non-advanced adenomas was 69.0% and for advanced adenomas 86.7% per patient . The sensitivity of colonoscopy for CRC (94.7%) was obtained from a published meta-analysis including trials where computed tomographic colonoscopy was compared to optical colonoscopy (49 studies; 11,151 patients) . The specificity of colonoscopy for adenomas and for CRC was assumed to be 100% according to the Austrian expert panel.
Furthermore, it was assumed that the test accuracy of confirmatory colonoscopy after a positive fecal blood test result is independent of the first fecal blood test result. Potential changes of the sensitivity and specificity in a long series of consecutive fecal occult blood tests due to specific characteristics of lesions were not considered due to a lack of information. Information on test accuracy parameter values is summarized in the Additional file 1: Table S2.
Direct medical costs were derived from the perspective of the Austrian public-health care system. Both medical outpatient- and inpatient-care costs were based on original data from the Main Association of Austrian Social Security Institutions (HVB) and include costs of tests, staging, medication follow-up, screening, treatments of complications and average cost for end-of-life treatment of colorectal cancer and rectal cancer . All costs were inflated to the index year 2017 by using the Consumer Price Index (CPI) for Austria from the OECD . Table 1 presents the aggregated costs taking into account the relative frequency distribution of cancer location, cancer stage and medication options (reported in the Additional file 1) . The cancer locations are classified using the 10th revision of the International Statistical Classification of Diseases and Related Health Problems (ICD-10) and include malignant neoplasms of colon (ICD-10 C18), of rectosigmoid junction (ICD-10 C19) and of rectum (ICD-10 C20) . Further information and cost data are provided in the Additional file 1: Table S3, S4 and S5.
Model analyses and outcomes
The Markov model has a cycle length of 1 year, simulating individuals until death. Half-cycle correction is used at start and termination of the model.
Predicted outcomes are: benefits expressed as life-years gained [LYG], CRC-related deaths avoided and CRC cases avoided; harms expressed as additional complications due to colonoscopy (physical harm) and positive test results (psychological harm); and lifetime costs. Related differences (increments) of these outcomes when compared to the next non-dominated strategy. Benefits and harms are displayed in an population fact box . Tradeoffs were expressed as incremental harm-benefit ratios and incremental cost-effectiveness ratios.
The clinical tradeoffs between benefits and harms for a screening strategy that provides more benefits but also lead to additional harms in comparison to an alternative strategy are expressed as so called incremental harm-benefit ratio (IHBR). The IHBR is calculated by dividing the difference in harms (incremental harm, e.g. additional positive test results, adverse events) by the difference in the chosen measure of benefit (incremental benefit, e.g., additional life-years gained, cancer cases avoided). The IHBR provides information of additional harms individuals will be exposed to gain one unit of benefits in a screening strategy compared to a less beneficial/effective strategy. The primary IHBR of our analysis was defined as additional psychological harm due to positive test results for one additional life-year gained when using one strategy compared to another. Similarly, the secondary IHBR was defined as the psychological harm due to additional positive test results per CRC-related death avoided or per CRC avoided.
Economic outcomes include lifetime costs and discounted incremental cost-effectiveness ratios (ICER) expressed in additional costs (in EUR) per life-year gained (LYG). The ICER is calculated by dividing the discounted incremental costs between two alternatives by the discounted incremental health effects between these two alternatives. An annual discount rate of 3% was applied for the cost-effectiveness analysis. Strategies are considered dominated if they provide less health benefit at higher costs when compared to any other strategy. Therefore, dominated strategies should not be considered by decision makers and no ICER is calculated. Furthermore, extended dominance is applied to eliminate strategies, for which costs and benefits are dominated by a mix of two other alternatives. A dominant strategy provides better health effects at lower cost compared to other strategies [42, 43].
For the base-case analysis, we chose a sustained strategy comparison, that is, full adherence to screening strategies including follow-up and surveillance tests was assumed to provide a strict comparison of the intended strategies without dilution by non-adherence.
We performed one-way and two-way deterministic sensitivity analyses as well as deterministic scenario analyses on crucial input parameters and assumptions to evaluate the robustness of the results and to identify future research priorities. In the one-way sensitivity analyses, we varied the sensitivity for fecal occult blood tests from 0 to 100% to account for declining sensitivity of consecutive tests because it is likely that sensitivities of repeated tests in the same individual are dependent conditional on disease, and therefore, may be substantially lower in individuals with prior false negative test results. Increasing costs of new therapies were considered by increasing the inpatient-care costs of patients in tumor stage UICC IV by up to 50%. The cost of colonoscopy and polypectomy was increased by up to 100%. The discount rate was varied within the range of 0 to 10%.
In the two-way sensitivity analyses, the sensitivity parameters for fecal occult blood tests and colonoscopy were reduced by up to 50% and increased by up to 10% simultaneously. In a scenario analysis, the cost for screening colonoscopy and polypectomy was assumed to be EUR 352 and EUR 98, respectively. In a second scenario analysis, the participation rates were assumed to be 20.0% for colonoscopy and 38.9% for FIT according to Austrian experiences and 31.1% for gFOBT assuming a 20% lower acceptance rate of gFOBT compared to FIT [44, 45]. Furthermore, the participation rates were assumed to be 28.0% for colonoscopy, 31.1% for gFOBT and 38.9% for FIT. In a two-way sensitivity analysis, the participation rates of colonoscopy and fecal occult blood tests were simultaneously varied from 10 to 100%. Finally, the CRC related mortality rates were assumed to be independent of the mode of detection (by screening or symptoms). Relative cancer stage- specific survival probabilities reported by Statistics Austria 2010–2014 including a mix of screen- and symptom-detected patients were applied for all patients diagnosed with cancer (see Additional file 1: Table S9).
The model was validated internally and externally on several levels: (1) face validity (i.e., by clinical experts, modeling experts, and patient representatives), (2) internal validation (e.g., debugging, consistency and plausibility checks), (3) external validation with epidemiological data from Statistics Austria  (cumulative cancer mortality at age 75) and data from the literature.
The calibrated natural history model predicts a cumulative CRC-related mortality of 1.74% at the age of 75. Statistics Austria reports a cumulative mortality of 1.97% for the years 1995–1999 . The relative difference of − 4.28% is reasonable according to the Austrian expert panel.
Base-case analysis screening-related benefits and harms
In comparison to No Screening, screening a cohort of 1000 40-year-old individuals is expected to gain 394 LYG with 10-yearly with colonoscopy from age 50 to 70, 480 LYG with annual gFOBT from age 40 to 75, and 491 LYG with annual FIT from age 40 to 75. These and the following results represent total results for the screening strategies including index testing, further diagnostics, surveillance, treatment and follow up interventions. Colonoscopy yielded 30 averted CRC-related deaths, and both FIT and gFOBT yielded 35 averted CRC-related deaths per 1000 screened individuals. In terms of CRC incidence, colonoscopy averted 61, gFOBT 66 and FIT 69 CRC cases per 1000 screened individuals, respectively.
In comparison to no Screening the screening strategies lead to unintended psychological and physical harms. The colonoscopy screening strategy leads to 679 expected positive test results per 1000 individuals. In comparison to colonoscopy, gFOBT results in around four times as many positive test results (n = 2797), and FIT to more than three times as many positive test results (n = 2206). In all strategies, the additional complications due to colonoscopy leading to hospitalization were very low, at 1–2 expected cases per 1000 screenees. The comparative effectiveness (i.e., benefit outcomes) and unintended harms are summarized in the Additional file 1: Table S10.
The benefits and harms of the non-dominated screening strategies FIT and colonoscopy are displayed in an population fact box (see Table 2) and in an individual fact box (see Table 3) in order to guide decisions of payers, physicians and screening candidates. It must be mentioned that the results in the fact boxes are a consequence of both different screening intervals and different screening tests.
In particular, the individual fact box translates population numbers into expected values per one individual, that is, one screening candidate. For example, the individual fact box presented in Table 3 shows that moving from 10-yearly colonoscopy to annual FIT is associated with an average gain of 5 life-weeks at the cost of 1.5 additional positive test results.
In order to gain one life-year with annual FIT compared to 10-yearly colonoscopy, there is an expected incremental unintended psychological harm of additional 16 positive test results (derived from Table 2).
In order to avoid one CRC-related death with annual FIT compared to 10-yearly colonoscopy, there is a psychological harm of more than 300 additional positive test results.
In order to avoid one CRC-case with annual FIT compared to 10-yearly colonoscopy, there is an incremental expected psychological harm of additional 200 positive test results.
Details of the incremental cost-effectiveness analysis are shown in Table 4 and Fig. 2. Based on our base-case analysis with a screening adherence of 100% in all screening strategies, the strategy No Screening (discounted costs: EUR 1138) and the gFOBT strategy (discounted costs: EUR 1398, LYG in comparison to No Screening 0.15 years) are dominated, and are therefore no efficient choices for decision makers. In 40-year old individuals, colonoscopy leads to an average of 0.12 discounted life-years gained (i.e., 44 life-days gained) when compared to No Screening and to average discounted lifetime costs of EUR 754. In contrast, the FIT strategy leads to an average of 0.16 discounted life-years gained (i.e., 58 life-days gained) when compared to No Screening and to average lifetime costs of EUR 1352. The corresponding ICER of switching from colonoscopy to FIT is EUR 14960/LYG.
If, based on the benefit-harm analysis or based on personal preferences regarding screening burden, the first choice between annual stool blood tests and 10-yearly colonoscopy is the colonoscopy, then the colonoscopy program is considered the best screening option as well as cost saving compared to all other strategies.
If, however, based on the benefit-harm analysis, the first choice between the compared strategies is annual FIT, then the cost-effectiveness depends on the payer’s willingness-to-pay. In this case with a payer’s willingness-to-pay threshold above EUR 15000 per life-year gained, the annual FIT strategy is considered the best as well as a cost-effective screening option.
An overview of the results of the one-way sensitivity analyses comparing colonoscopy and FIT are provided in Table 5. Model-predicted base-case cost-effectiveness results were particularly sensitive to sensitivities of fecal occult blood stool tests and colonoscopy, discount rate as well as participation rates. FIT would be more effective and less costly than all other strategies assuming a participation rate of 28% for Colonoscopy, 38.9% for FIT and 31.1% for gFOBT. An increase in costs of inpatient care of patients in cancer stage UICC IV and the application of CRC-specific mortalities unadjusted for the mode of cancer detection (detected by screening or symptoms) showed only minor effects on the ICER.
The analysis of reduced sensitivity of repeated fecal occult blood test (i.e., dependence of sensitivity conditional on disease) indicate that an overall 70% reduction would lead to a similar life expectancy for the FIT and the colonoscopy strategy. Such a reduction would imply that colonoscopy becomes a dominant strategy. An overall reduction of 60% sensitivity leads to similar life expectancy of gFOBT and colonoscopy. Additional graphical results for the one-way sensitivity analysis on test sensitivity and the results of the two-ways sensitivity analyses on test accuracies as well as participation rates are presented in the Additional file 1.
Based on our results, colorectal cancer screening with an annual FIT is more effective than all other investigated screening strategies when considering long-term outcomes such as life expectancy, risk of colorectal cancer, and mortality due to colorectal cancer. The annual gFOBT strategy is less effective and was dominated in the economic evaluation. The 10-yearly colonoscopy screening strategy is less effective compared with annual FIT in terms of remaining life expectancy, risk of colorectal cancer, and mortality due to colorectal cancer, but it is also less costly. Moving from colonoscopy to FIT has a discounted incremental cost-effectiveness ratio of EUR 14960/LYG. The benefit-harm analysis, however, shows that in order to gain one life-year with annual FIT compared to 10-yearly colonoscopy, there is an expected incremental unintended psychological harm of additional 16 positive test results. In order to avoid one CRC-related death with annual FIT compared to 10-yearly colonoscopy, there are more than 300 additional positive tests.
Our findings are consistent with the results of other published modeling studies showing that No Screening is clearly dominated [14, 15, 17]. However, in the literature, there is no clear evidence about what is an optimal or cost-effective screening test or strategy . Results differ because of applications in different health care settings, main model assumptions including age of initiation and termination of screening, screening intervals, surveillance, sensitivities of tests (depending on brand, cut-off values and source of information), evaluation period, and country-specific epidemiology as well as country-specific cost structures. As a consequence, a wide variety of screening strategies are being offered worldwide.
The USPTF reported colonoscopy every 10 years and annual FIT to be recommendable strategies in terms of effectiveness . With colonoscopy, slightly more LY could be gained compared to FIT. In our analysis, FIT provides more LY in comparison with colonoscopy. In the USPTF study, no high sensitivity gFOBT strategy was recommanded . To our knowledge, there is no study comparing exactly the same screening scenarios including surveillance follow up based on Austrian guidelines. In the systematic review of Lansdorp-Vogelaar et al., discounted LYG of annual gFOBT in comparison to No Screening ranges between 0.019 and 0.16 and for colonoscopy between 0.019 and 0.18 (studies published year 2000 onwards) . The results of our base-case analysis are within these ranges (gFOBT discounted LYG 0.15, colonoscopy discounted LYG 0.12). In this review, approximately half of the studies found FIT to be dominant and the other half found FIT to be dominated by gFOBT Hemoccult Sensa based on US cost estimates . For a willingness-to-pay of $ 20,000/LYG 10-yearly colonoscopy was predominantly the optimal option. As another example, Zauber evaluated screening strategies in the US initiated at the age of 50 until the age of 80 following the cohort for a maximum age of 100. Reported LYG for a cohort of 1000 individuals are 238 with FIT, 240 with gFOBT (Hemoccult Sensa) and 243 with colonoscopy. Differences in the absolute values in comparison to our study (colonoscopy LYG 394, gFOBT LYG 480, FIT LYG 491) may be caused by different ages of initiation and termination, assumptions about test sensitivities and surveillance . The EUnetHTA report of gFOBT and FIT concluded that FIT should be the preferred choice of those two fecal occult blood test due to several characteristics including higher sensitivity and higher participation rate .
A specific strength of our study is that based on the natural history of the disease, we transparently described and systematically evaluated the effect of the sensitivity of different screening tests including surveillance, capturing stage shift and incorporating survival probabilities depending on the mode of detection (screening, symptoms) over a lifelong time horizon. Settings and uncertain variables were assessed systematically in sensitivity analyses to examine the robustness of the model’s predicted results and to identify further research priorities. This is a typical example of a situation where decision-analytic modeling offers a transparent and systematic decision aid and complements the results from randomized clinical trials. Results were presented in systematic fact boxes (Tables 2 and 3) to support communication of multiple benefits and harm outcomes from the public health and individual perspective.
As all decision analyses, our study has several limitations. First, we did not consider shorter screening intervals for colonoscopy or biennial intervals for fecal occult blood tests. The improved clinical benefits of annual fecal occult blood tests in comparison to 10-yearly colonoscopy can be partly explained by the fact that the 10-year sensitivity (Sensitivity10y = 1-(1-Sensitivity1year)^10) for FIT and gFOBT is higher than the sensitivity of colonoscopy in advanced adenomas and cancer. In adenomas, the 10-year sensitivity for FIT and gFOBT is only slightly lower than the sensitivity of colonoscopy, which is performed only once every 10 years (see Additional file 1: Table S11). Therefore, shorter screening intervals for colonoscopy should also be investigated.
Second, we assumed that the test accuracies of consecutive annual fecal blood tests are independent conditional on disease. If there is a biological reason why the test failed to detect lesions that do not change over time, this assumption does not hold (e.g., lesions in the right-sided colon are usually non-polypoid or flat, which is assumed to be associated with less bleeding) . This means that undetected lesions associated with less bleeding may in practice decrease overall sensitivity for fecal occult blood tests of certain persons over time. Our results may therefore overestimate the effectiveness of repeated fecal occult blood tests and underestimate costs, because missed adenomas may progress to cancer and may therefore, also lead to further treatment cost. A simplified first sensitivity analysis showed that a reduced sensitivity of FIT by an overall factor of 0.3 would lead to similar remaining life expectancy for FIT and colonoscopy. For a more precise analysis, a microsimulation that allows for modeling separate lesions with the respective location and further characteristics would be required. For a confirmatory colonoscopy, it is more likely that the sensitivity is closer to the sensitivity of a colonoscopy in a patient without a pretest since the sensitivity is less dependent on the prevalence of the disease. In practice, however, a physician examining a patient with a positive stool test may adapt clinical practice, spending more time and, therefore, increasing the chance to detect lesions. With respect to the applied parameter values, test sensitivity and specificity data for primary screening tests were based upon meta-analysis results including data from randomized clinical trials. However, sensitivity and specificity in real-world settings may also be reduced due to clinical practice, which differs from a strictly defined setting of a clinical trial and may depend on physicians’ experiences and learning curves with new technologies etc.
The reported accuracies of fecal occult blood tests are usually calculated assuming standard colonoscopy to be the “gold standard”. Standard colonoscopy, however, is not a perfect test. For an improved approximation of the sensitivities of fecal blood tests, the relative sensitivities provided by published studies should be adjusted by the sensitivities of colonoscopy. These adjusted sensitivities should be applied in future scenario analyses.
Reported sensitivities of gFOBT and FIT vary considerably. Sensitivities of gFOBT for advanced adenomas are reported in a recent systematic review ranging from 31.4–41.3% (median 30.8%) and for CRC ranging from 37.1–79.4% (median 62.9%) . An EUnetHTA report for Austria provides a range of 13–63% for the sensitivity of gFOBT . A meta-analysis on Hemoccult (an outdated test) only reported a sensitivity of 14% for advanced adenomas and sensitivity for CRC of 47.4% . Our assumptions for the sensitivity of advanced adenomas of 23.9% were based on a recent modeling study  and sensitivity for CRC (72.2%) was based on a recent meta-analysis . Sensitivities of FIT for advanced adenomas are reported in a recent systematic review ranging from 6 to 44% (median 28%) and for CRC ranging from 25 to 100% (median 88%) . A German study on “immoCARE-C” reported sensitivities depending on cut-off values (37% for polyps > 1 cm cut-off 50, CRC not reported for cut-off 50 and lower) . A recent clinical trial on 9989 patients reported a sensitivity of FIT for advanced adenomas of 23.8 and 73.8% for CRC . Our assumptions on FIT sensitivity (advanced adenoma 36.7%, CRC 87.2%) are based on a recent meta-analysis, for “OC sensor” .
Third, the setting of perfect adherence to screening in the base-case analysis including follow-up and surveillance tests provides the maximum achievable benefit for each strategy from the patient perspective (if compliant). Implemented screening programs often face the problem to achieve such benefits and adherence may also be dependent on the test itself, comorbidities, or respective mass campaigns [44, 45, 50, 51]. This is important for a population perspective and public health considerations. Adherence rates were, therefore, adjusted in the sensitivity analysis focusing on adherence to the primary screening test. As a result, assuming a participation rate of 28% for colonoscopy, 39% for FIT and 31% for gFOBT, FIT would become dominant, that is more effective and less costly than all other strategies. More complex adherence patterns that include adherence for confirmatory colonoscopy, for positive fecal occult blood tests or surveillance could be investigated further.
Fourth, we used reimbursement costs for the inpatient care of CRC cases derived from Austrian health insurances. These claims data contain still some level of uncertainty and, in addition, actual costs, for example in hospitals, may be higher. Therefore, our results are rather conservative. The ranking and dominance of strategies should be independent of this fact. In future, treatment costs may not describe the real costs, because promising immunotherapies that enter clinical practice may increase costs substantially. The sensitivity analysis on increased costs for patients in stage UICC IV, however, did not show much impact on the results since No Screening and gFOBT remained dominated and the ICER comparing colonoscopy and FIT decreased slightly in favor of FIT.
Fifth, to define epidemiological calibration target values for the distribution of cancer stages in the Austrian population, patients with reported unknown cancer stages were distributed among all cancer stages assuming random causes and death certificate only cases (DCO) were assumed to be more severe and, therefore, distributed among UICC III and UICC IV stages.
Sixth, we did not incorporate health-related quality-of-life data, which could be additionally implemented into the model in a future analysis. As such, long-term effectiveness was based on life expectancy instead of quality-adjusted life expectancy. Since screening results in a relatively small average gain in life expectancy, changes in quality-of-life due to psychological distress associated with the communication of screening results (e.g., of the fecal blood stool tests) or adverse events of confirmatory tests may affect the estimated incremental cost-effectiveness ratios.
Seventh, our decision model did not consider heterogeneity of the population with respect to sex or location of lesions. Only an average number of lesions were modeled and age-specific progression of adenomas was not considered.
Eighth, only index tests relevant in the Austrian setting were considered.
In conclusion, based on our decision analysis and simplifying assumptions, an organized screening program with annual FIT or 10-yearly colonoscopy assuming full adherence rate is most effective. The choice between these two options may depend on the individual preferences and benefit harm-tradeoffs of screening candidates. If the first choice is 10-yearly colonoscopy, this option is cost saving and if the first choice is annual FIT, this option can be considered cost effective. The results of these analyses, including the fact boxes provided, can be used to guide decisions of payers, physicians, clinical guideline developers, and screening candidates.
Availability of data and materials
All data and material are available in published, mentioned and referenced studies.
Further datasets on not aggregated data analyzed during the current study are available from the corresponding author on reasonable request.
Consumer price index
Colorectal Cancer Simulated Population model for Incidence and Natural history
Double-contrast barium enema
Death certificate only
Documentation and Information System for Analysis in the Healthcare Sector (Dokumentations- und Informationssystem für Analysen im Gesundheitswesen)
Diagnosis Related Groups
European Society of Gastrointestinal Endoscopy
European Network for Health Technology Assessment
Immunochemical fecal occult blood test
Guaiac-based fecal occult blood test
Health technology assessment
Main Association of Austrian Social Security Institutions
- ICD 10 C18:
Malignant neoplasm of colon
- ICD 10 C19:
Malignant neoplasm of rectosigmoid junction
- ICD 10 C20:
Malignant neoplasm of rectum
International Classification of Diseases
Incremental cost-effectiveness ratio
Incremental harm-benefit ratios
International Society for Pharmacoeconomics and Outcomes Research
M2 pyruvate kinase
Microsimulation Screening Analysis
Magnetic resonance tomography
The Organization for Economic Cooperation and Development
Surveillance, Epidemiology, and End Results (SEER) program
Simulation Model of Colorectal Cancer
Society for Medical Decision Making
Union for International Cancer Control
University for Health Sciences, Medical Informatics and Technology
United States Preventive Services Task Force
World Health Organization (WHO). International Classification of Diseases, 10th Revision (ICD-10). Geneva: WHO; 1992.
Tanaka T. Colorectal carcinogenesis: review of human and experimental animal studies. J Carcinogen. 2009;8:5.
Zauber AG, Winawer SJ, O'Brien MJ, Lansdorp-Vogelaar I, van Ballegooijen M, Hankey BF, et al. Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. N Engl J Med. 2012;366(8):687–96.
Brenner H, Altenhofen L, Stock C, Hoffmeister M. Prevention, early detection, and overdiagnosis of colorectal cancer within 10 years of screening colonoscopy in Germany. Clin Gastroenterol Hepatol. 2015;13(4):717–23.
Lin JS, Piper MA, Perdue LA, Rutter CM, Webber EM, O'Connor E, et al. Screening for colorectal cancer: updated evidence report and systematic review for the US preventive services task force. Jama. 2016;315(23):2576–94.
Garcia M. Addressing overuse and overdiagnosis in colorectal cancer screening for average-risk individuals. Colorectal Cancer. 2015;4(1):27–35.
Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG). Einladungsschreiben und Entscheidungshilfen zum Darmkrebs-Screening. Available from https://www.iqwig.de/download/P15-01_Abschlussbericht_Einladungsschreiben-und-Entscheidungshilfe-zum-Darmkrebs-Screening.pdf [Accessed on 27 Dec 2017].
Labianca R, Nordlinger B, Beretta GD, Brouquet A, Cervantes A. Primary colon cancer: ESMO clinical practice guidelines for diagnosis, adjuvant treatment and follow-up. Ann Oncol. 2010;21(Suppl 5):v70–7.
Fröschl B, Antony K, Ivansits S. Übersicht nationaler Kolonkrebs-Screening-Programme. Available from https://www.researchgate.net/publication/316683925_Ubersicht_nationaler_Kolonkrebs-Screening-Programme [Accessed on December 27, 2017]. 2017.
Main Association of Austrian Security Institutions (Hauptverband der österreichischen Sozialversicherungsträger-HBV). Vorsorgeuntersuchung NEU. 2016. Available from https://www.sozialversicherung.at/cdscontent/load?contentid=10008.605059&version=1452782802 [Accessed on 28 Dec 2017].
Austrian Society of Gastroenterology and Hepatology ÖGfGuH-Ö. LEITLINIE Qualitätsgesicherte Vorsorgekoloskopie. 2010. Available from http://www.oeggh.at/zertifikat/pdf/2010/Leitlinie%2029%2009%202010_Version%201.5.pdf [Accessed on 28 Dec 2017].
Bibbins-Domingo K, Grossman DC, Curry SJ, Davidson KW, Epling JW Jr, Garcia FAR, et al. Screening for colorectal cancer: US preventive services task force recommendation statement. Jama. 2016;315(23):2564–75.
Jeong KE, Cairns JA. Review of economic evidence in the prevention and early detection of colorectal cancer. Health Econ Rev. 2013;3:20.
Knudsen AB, Zauber AG, Rutter CM, Naber SK, Doria-Rose VP, Pabiniak C, et al. Estimation of benefits, burden, and harms of colorectal Cancer screening strategies: modeling study for the US preventive services task force. Jama. 2016;315(23):2595–609.
Patera N, Schumacher I. Kolonkrebsscreening. Teil 2: Gesundheitsökonomische Evaluationen und Aspekte der Kostenentwicklung (2. überarbeitete Auflage). 2012. Available from: http://eprints.hta.lbg.ac.at/982/1/HTA-Projektbericht_Nr.41b_Update_2012.pdf. [Accessed on 21 Nov 2016]
Jonas M. Volkswirtschaftlicher Nutzen eines Österreichischen Darmkrebsvorsorgeprogrammes//economic effects of the Austrian colorectal Cancer screening. J Gastroenterol Hepatol Erkrank. 2017;15(1):14–8.
Lansdorp-Vogelaar I, Knudsen AB, Brenner H. Cost-effectiveness of colorectal cancer screening. Epidemiol Rev. 2011;33:88–100.
Patel SS, Kilgore ML. Cost effectiveness of colorectal cancer screening strategies. Cancer Control. 2015;22(2):248–58.
Pignone M, Saha S, Hoerger T, Mandelblatt J. Cost-effectiveness analyses of colorectal cancer screening: a systematic review for the U.S. preventive services task force. Ann Intern Med. 2002;137(2):96–104.
Main Association of Austrian Security Institutions (Hauptverband der österreichischen Sozialversicherungsträger-HBV). CRC Screening mit M2-PK Stuhltest im Vergleich zu gFOBT und FIT. 2016. Available from http://www.hauptverband.at/cdscontent/load?contentid=10008.623215&version=1442491208 [Accessed on 28 Dec 2017].
Cancer Intervention and Surveillance Modeling Network (CISNET). Colorectal cancer models overview. Available online from: https://resources.cisnet.cancer.gov/registry/site-summary/colorectal/ [Accessed on 28 Dec 2017].
Siebert U. When should decision-analytic modeling be used in the economic evaluation of health care? Eur J Health Econ. 2003;4(3):143–50.
Siebert U, Alagoz O, Bayoumi AM, Jahn B, Owens DK, Cohen DJ, et al. State-transition modeling: a report of the ISPOR-SMDM modeling good research practices task force--3. Value Health. 2012;15(6):812–20.
Caro JJ, Briggs AH, Siebert U, Kuntz KM. Modeling good research practices--overview: a report of the ISPOR-SMDM modeling good research practices task force--1. Value Health. 2012;15(6):796–803.
Drummond MF, Schwartz JS, Jonsson B, Luce BR, Neumann PJ, Siebert U, et al. Key principles for the improved conduct of health technology assessments for resource allocation decisions. Int J Technol Assess Health Care. 2008;24(3):244–58 discussion 362-8.
EUnetHTA. Methods for health economic evaluations – A guideline based on current practices in Europe. 2016. Available online from: http://www.eunethta.eu/sites/default/files/sites/5026.fedimbo.belgium.be/files/Methods%20for%20health%20economic%20evaluations%20A%20guideline%20based%20on%20current%20practices%20in%20Europe_Guideline_Final%20May%202015.pdf [Accessed on 28 Dec 2017].
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS) statement. BMJ (Clinical research ed). 2013;346:f1049.
Hassan C, Quintero E, Dumonceau JM, Regula J, Brandao C, Chaussade S, et al. Post-polypectomy colonoscopy surveillance: European Society of Gastrointestinal Endoscopy (ESGE) guideline. Endoscopy. 2013;45(10):842–51.
Statistics Austria. Personal communication. 2017.
Statistics Austria. Sterbetafeln. Jährliche Sterbetafeln 1947 bis 2016 für Österreich. Available from: https://www.statistik.at/web_de/statistiken/menschen_und_gesellschaft/bevoelkerung/sterbetafeln/index.html [Accessed on 27 Dec 2017].
Brenner H, Jansen L, Ulrich A, Chang-Claude J, Hoffmeister M. Survival of patients with symptom- and screening-detected colorectal cancer. Oncotarget. 2016;7(28):44695–704.
Launois R, Le Moine JG, Uzzan B, Fiestas Navarrete LI, Benamouzig R. Systematic review and bivariate/HSROC random-effect meta-analysis of immunochemical and guaiac-based fecal occult blood tests for colorectal cancer screening. Eur J Gastroenterol Hepatol. 2014;26(9):978–89.
Imperiale TF, Ransohoff DF, Itzkowitz SH. Multitarget stool DNA testing for colorectal-cancer screening. N Engl J Med. 2014;371(2):187–8.
Hirai HW, Tsoi KK, Chan JY, Wong SH, Ching JY, Wong MC, et al. Systematic review with meta-analysis: faecal occult blood tests show lower colorectal cancer detection rates in the proximal colon in colonoscopy-verified diagnostic studies. Aliment Pharmacol Ther. 2016;43(7):755–64.
Austrian Colonoscopy Registry. Personal communication. 2017.
Zauber AG, Lansdorp-Vogelaar I, Knudsen AB, Wilschut J, van Ballegooijen M, Kuntz KM. Evaluating test strategies for colorectal cancer screening: a decision analysis for the U.S. Preventive Services Task Force. Ann Intern Med. 2008;149(9):659–69. Epub 2008 Oct 6.
Bundo M, Jahn B, Arvandi M, Sroczynski G, Siebert U. Adenoma miss rate of conventional colonoscopy: a systematic review and meta-analysis [poster presentation]. Graz: EbM-Kongress 2018; 2018.
Pickhardt PJ, Hassan C, Halligan S, Marmo R. Colorectal cancer: CT colonography and colonoscopy for detection--systematic review and meta-analysis. Radiology. 2011;259(2):393–405.
Main Association of Austrian Security Institutions (Hauptverband der österreichischen Sozialversicherungsträger-HBV). Original data on medical costs. Personal communication. 2017.
OECD.stat. Consumer Prices. 2017.Available from https://stats.oecd.org/index.aspx?queryid=221 [Accessed on 20 Nov 2017].
McDowell M, Rebitschek FG, Gigerenzer G, Wegwarth O. A simple tool for communicating the benefits and harms of health interventions: a guide for creating a fact box. MDM Policy Pract. 2016;1(1):2381468316665365.
Hunink MM, Weinstein MC, Wittenberg E, Drummond MF, Pliskin JS, Wong JB, et al. Decision making in health and medicine: integrating evidence and values: Cambridge University Press; 2014.
Neumann PJ, Sanders GD, Russell LB, Siegel JE, Ganiats TG. Cost-effectiveness in health and medicine. Cambridge: Oxford University Press; 2016.
Vart G, Banzi R, Minozzi S. Comparing participation rates between immunochemical and guaiac faecal occult blood tests: a systematic review and meta-analysis. Prev Med. 2012;55(2):87–92.
Hassan C, Giorgi Rossi P, Camilloni L, Rex DK, Jimenez-Cendales B, Ferroni E, et al. Meta-analysis: adherence to colorectal cancer screening and the detection rate for advanced neoplasia, according to the type of screening test. Aliment Pharmacol Ther. 2012;36(10):929–40.
Ran T, Cheng CY, Misselwitz B, Brenner H, Ubels J, Schlander M. Cost-Effectiveness of Colorectal Cancer Screening Strategies-A Systematic Review. Clin Gastroenterol Hepatol. 2019;17(10):1969–81.e15. https://0-doi-org.brum.beds.ac.uk/10.1016/j.cgh.2019.01.014. Epub 2019 Jan 16.
Zauber AG. Cost-effectiveness of colonoscopy. Gastrointest Endosc Clin N Am. 2010;20(4):751–70.
Renner A, Bobek J, Ingrid R, Endel G, Wilbacher I, Marsteuer B. Kolonkrebs-Screening mittels Stuhlbluttests. 2014. Available from: https://www.researchgate.net/profile/Ingrid_Rosian-Schikuta/publication/298763364_Kolonkrebs-Screening_mittels_Stuhlbluttests_Nationaler_Bericht_basierend_auf_dem_EUnetHTA_Core_BerichtNational_Report_on_colorectal_cancer_Screening_tests_adapted_from_EUnetHTA-Core-Report/links/56eac5a008aec6b5001633ce/Kolonkrebs-Screening-mittels-Stuhlbluttests-Nationaler-Bericht-basierend-auf-dem-EUnetHTA-Core-Bericht-National-Report-on-colorectal-cancer-Screening-tests-adapted-from-EUnetHTA-Core-Report.pdf [Accessed on 27 Dec 2017].
Brenner G, Faure H, Heuer S, Reinholz J. Detection of colorectal findings for cancer prevention by immunochemical stool test with different sensitivity levels. Z Gastroenterol. 2012;50(10):1083–8.
Bretthauer M, Kaminski MF, Loberg M, Zauber AG, Regula J, Kuipers EJ, et al. Population-based colonoscopy screening for colorectal cancer: a randomized clinical trial. JAMA Intern Med. 2016;176(7):894–902.
Guiriguet C, Pera G, Castells A, Toran P, Grau J, Rivero I, et al. Impact of comorbid conditions on participation in an organised colorectal cancer screening programme: a cross-sectional study. BMC Cancer. 2017;17(1):524.
We thank our advisory board of physicians for their excellent clinical expertise and for providing clinical data: Univ. Prof. Dr. Christoph Profanter, Medical University of Innsbruck; Prim. Univ. Prof. Dr. Rainer Schöfl, Pancreas and Liver Center, Elisabethinen Linz; Prim. Univ.-Doz. Dr. Michael Gschwantler, Wilhelminenspital, Vienna; Univ.-Prof. Dr. Herbert Tilg, Medical University of Innsbruck; Dr. Friedrich Anton Weiser, Medical Center East, Vienna; Prim. Univ. Prof. Dr. Ludwig Kramer, Hietzing Hospital, Vienna; and OA Dr. Karin Haider, Austrian Cancer Aid. We thank the following experts from different fields for their knowledge and expertise as well as for contributing original Austrian epidemiological, economic, and health care practice data: Doris Kiefhaber, Austrian Cancer Aid, Veronika Plank, Federal Ministry of Health and Women; Mag. Katja Antony, Austrian Federal Institute for the Health System and Fonds; Mag. Sarah Ivansits, MSc, Austrian Federal Institute for the Health System and Fonds and Mag. Barbara Fröschl, Austrian Federal Institute for the Health System and Fonds. We thank our international experts for their valuable expertise on the screening modeling and model conceptualization: Ass.-Prof. Amy Knudsen, Harvard Medical School, Boston, MA, USA and Prof. Deborah Schrag, Dana-Farber Cancer Institute, Boston, MA, USA. We thank the team members of the Main Association of Austrian Social Security Institutions for their support during the project: Nikoletta Malbaski, MA; Stephanie Stürzenbecher, MA; Timea Helter, MSc. Additionally, we thank the following team members of the Department of Public Health, Health Services Research and Health Technology Assessment at UMIT - University for Health Sciences, Medical Informatics and Technology, Hall i.T.: Dr. Annette Conrads-Frank for supporting model implementation, Dr. Marjan Arvandi, MSc, for supporting the meta-analysis and Artemisa Gogollari, MD, for developing graphical illustrations.
Writing assistance: We thank Dr. Lyndon James (Harvard T.H. Chan School of Public Health) for proofreading and language editing.
The study was funded by the Main Association of Austrian Social Security Institutions. In addition, this work has been financially supported through Erasmus Mundus Western Balkans (ERAWEB), a project funded by the European Commission. The two funding agreements ensured the authors’ independence in designing the study, analyzing and interpreting the data, writing, and publishing the report.
Ethics approval and consent to participate
The study was approved and registered at the Research Committee for Scientific Ethical Questions at UMIT - University for Health Sciences, Medical Computer Science and Technology, Hall i.T., Austria (Registration 2397). The study is purely based on secondary data sources. No patient-level data were obtained. An informed consent from patients was not applicable.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Jahn, B., Sroczynski, G., Bundo, M. et al. Effectiveness, benefit harm and cost effectiveness of colorectal cancer screening in Austria. BMC Gastroenterol 19, 209 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12876-019-1121-y
- Colorectal cancer
- State-transition cohort model, Markov model