Most Influential Qualities in Creating Satisfaction Among the Users of Health Information Systems: A Study in Seven EU Countries

Background: Several models suggest how the qualities of a product or service influence user satisfaction. Models, such as the Customer Satisfaction Index (CSI), Technology Acceptance Model (TAM), and Delone and McLean Information Systems Success (D&M IS), demonstrate those relations and have been used in the context of health information systems. Objective: We want to investigate which qualities foster greater satisfaction among patient and professional users. In addition, we are interested in knowing to what extent improvement in those qualities can explain user satisfaction and if this makes user satisfaction a proxy indicator of those qualities. Methods: The Unified eValuation using ONtology (UVON) method was utilised to construct an ontology of the required qualities for seven e-health applications being developed in the FI-STAR project, a European Union (EU) project in e-health. The e-health applications were deployed across seven EU countries. The ontology included and unified the required qualities of those systems together with the aspects suggested by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. Two similar questionnaires, for 87 patient users and 31 health professional users, were elicited from the ontology. In the questionnaires, user was asked if the system has improved the specified qualities and if the user was satisfied with the system. The results were analysed using Kendall correlation coefficients matrices, incorporating the quality and satisfaction aspects. For the next step, two Partial Least Squares Structural Equation Modelling (PLS-SEM) path models were developed using the quality and satisfaction measure variables and the latent construct variables that were suggested by the UVON method. Results: Most of the quality aspects grouped by the UVON method are highly correlated. Strong correlations in each group suggest that the grouped qualities can be measures which reflect a latent quality construct. The PLS-SEM path analysis for the patients reveals that the effectiveness, safety, and efficiency of treatment provided by the system are the most influential qualities in achieving and predicting user satisfaction. For the professional users, effectiveness and affordability are the most influential. The parameters of the PLS-SEM that are calculated allow for the measurement of a user satisfaction index similar to CSI for similar health information systems. Conclusions: For both patients and professionals, the effectiveness of systems highly contributes to their satisfaction. Patients care about improvements in safety and efficiency, while professionals care about improvements in the affordability of treatments with health information systems. User satisfaction is reflected more in the users' evaluation of system output and fulfilment of expectations, but slightly less in how far the system is from ideal. Investigating satisfaction scores can be a simple, fast way to infer if the system has improved the abovementioned qualities in treatment and care.Open access