Methodological approaches to population based research of screening procedures in the presence of selection bias and exposure measurement error: colonoscopy and colorectal cancer outcomes in Ontario

Abstract Background The study describes the methodological challenges encountered in an observational study estimating the effectiveness of colonoscopy in reducing colorectal cancer (CRC) incidence and mortality. Methods Using Ontario provincial administrative data, we conducted a population-based retrospective cohort study to assess CRC incidence and mortality in a group of average-risk subjects aged 50–74 years who underwent colonoscopy between 1996–2000. We created two study cohorts; unselected and restricted. The unselected cohort consists of subjects aged 50–74 years who were eligible for CRC screening and who had the same primary care physician (PCP) during the period 1996–2000 with at least two years of follow-up. PCPs are general practioners/family physicians who are the main source of health care for Ontarians. The restricted cohort was a nested sample of unselected cohort who were alive and free of CRC as on January 1, 2001 and whose PCPs had at least 10 screen-eligible patients with a colonoscopy referral rate of more than 3%. We compared the outcomes in the two study cohorts; unselected vs. restricted. We then estimated the absolute risk reduction associated with colonoscopy in preventing CRC incidence and mortality in the restricted cohort, using traditional regression analysis, propensity score analysis and instrumental variable analysis. Results The unselected cohort (N = 1,341,612) showed that colonoscopy was associated with an increase in CRC incidence (1.61% vs. 4.61%) and mortality (0.36% vs. 1.16%), whereas the restricted cohort (N = 1,089,998) showed that colonoscopy was associated with a reduction in CRC incidence (1.36% vs. 0.84%) and mortality (0.23% vs. 0.15%). For CRC incidence, the absolute risk reduction (ARR) associated with colonoscopy use was 0.52% in an unadjusted model, 0.53% in a multivariate logistic regression model, 0.54% in a propensity score-weighted outcome model, 0.56% in propensity score-matched model, and 0.60% using instrumental variable analysis. For CRC mortality, the ARR was 0.08% in the unadjusted model, multivariate logistic regression model and for a propensity score- weighted outcome model, 0.10% using propensity score matched model and 0.17% using the IVA model. Conclusions Colonoscopy use reduced the risk of CRC incidence and mortality in the restricted cohort. The study highlights the importance of appropriate selection of study subjects and use of analytic methods for the evaluation of screening methods using observational data