Where is the theory? Evaluating the theoretical frameworks described in decision support technologies

Objective To identify and describe the extent to which theory or theoretical frameworks informed the development and evaluation of decision support technologies (DSTs). Methods The analysis was based on the decision technologies used in studies included in the Cochrane systematic review of patient decision aids for people facing health screening or treatment decisions. The assumption was made that DSTs evaluated by randomized controlled trials, and therefore included in the updated Cochrane review have been the most rigorously developed. Results Of the 50 DSTs evaluated only 17 (34%) were based on a theoretical framework. Amongst these, 11 decision-making theories were described but the extent to which theory informed the development, field-testing and evaluation of these interventions was highly variable between DSTs. The majority of the 17 DSTs that relied on a theory was not explicit about how theory had guided their design and evaluation. Many had superficial descriptions of the theory or theories involved. Furthermore, based on the analysis of those 17 DSTs, none had reported field-testing prior to evaluation