Effect of change in the CG CAHPS survey instrument recall period on patient experience scores on healthcare utilization

Standardized patient experience survey instruments play an important role in informing healthcare quality and process improvement. However, any changes in standardized instruments can impact the interpretation, trending, and analysis of patient reported data. This study investigates how the change in Clinician and Group Consumer Assessment of Healthcare Providers and Systems (CG CAHPS) survey recall period, from 12- to 6-months, can impact the accuracy and quality of patient experience data. This study used primary survey data on patient experience collected in 2016. Analyses included tests of proportion and t-tests for a comparison of: 1) experience ratings, and 2) administrative data to corroborate how accurately respondents report the number of visits received within the recall period. The findings indicated that respondents, on average, underestimated their usage of care based on a 12-month recall period, apart from those who reported just one visit. A shorter 6-month recall period resulted in higher accuracy in reporting the number of actual visits that occurred. Furthermore, experiential measures showed consistently higher scores across measures for Provider Communications, Staff Communications, Timely Access to Care, and Care Coordination for a 6-month recall period compared to a 12-month period. This study showed that it would be difficult to compare CG CAHPS Version 2.0 to Version 3.0 due to recall differences in experiential measures. Given that shorter recall periods tend to be associated with higher CG CAHPS ratings, healthcare stakeholders should consider bias introduced by changes of recall periods in survey instruments. Experience Framework This article is associated with the Policy & Measurement lens of The Beryl Institute Experience Framework. (http://bit.ly/ExperienceFramework) Access other PXJ articles related to this lens. Access other resources related to this lens.