Commonalities and differences in HTA outcomes: a comparative analysis of five countries and implications for coverage decisions

Objective: To identify diverging HTA recommendations across five countries, understand the rationale for decision-making in specific therapeutic categories, and suggest ways forward to minimize these inter-country differences. Methods: A comparative analysis of HTA recommendations for 287 drug-indication pairs appraised by five countries (England, Scotland, Sweden, Canada, and Australia) between 2007 and 2009, including an in-depth analysis of two case studies. Agreement levels were measured using kappa scores. Associations were explored through correspondence analysis. Results: Significant inter-country variability in the HTA recommendations exists: 46% of the drug-indication pairs studied received diverging recommendations across countries. The level of agreement between agencies was poor to moderate. Associations between HTA recommendations issued by each HTA body per therapy area (cancer, orphan, CNS) differed from the general pattern observed across the complete sample. Expectations from HTA bodies in terms of relative effectiveness differ depending on the drug and disease's characteristics, although agency-specific guidelines are homogeneous for all treatments. Policy implications: Distinguishing and accounting for the specifics underpinning individual conditions and their characteristics in HTA processes may constitute a way forward to improved HTA methods, while increasing transparency in the expectations that HTA bodies have in terms of relative effectiveness of the drug depending on these characteristics