Assessing the quality of COVID-19 vaccine videos on video-sharing platforms

Background: Video-sharing platforms are a common source for health information such as Coronavirus Disease 2019 (COVID-19) vaccines. It is important that they provide good quality, evidence-based information. However, to date, the quality of information surrounding COVID-19 vaccines on video-sharing platforms has not been established. Objective: This study developed an assessment tool to evaluate the quality of Coronavirus Disease 2019 (COVID-19) vaccine videos on YouTube, Facebook Watch and TikTok. Methods: Assessment of quality was based on understandability, actionability, accuracy, comprehensiveness and reliability. Videos were searched using the keywords “COVID-19 vaccine”, “Coronavirus vaccine” and “SARS-CoV-2 vaccine”. Seventy-two videos were evaluated. Descriptive statistics, Kruskal-Wallis and Wilcoxon-rank sum tests were used for analysis. Results: YouTube had the highest median composite score compared to TikTok (36.8% versus 27.5%, p = 0.001). YouTube also had the highest median reliability score (37.5%), but those of Facebook Watch (35.0%) and TikTok (35.0%) were only marginally lower. Median accuracy scores of all platforms were 100%, but their median comprehensiveness scores were low (YouTube 12.5%; Facebook Watch 6.3%; TikTok 6.3%, p = 0.004). Median actionability scores (0%) were the lowest for all platforms. TikTok had the highest median understandability score compared to YouTube and Facebook Watch (96.9% versus 80.0 each, p < 0.001). Conclusion: The overall quality of videos on all video-sharing platforms were low. All platforms provided accurate COVID-19 vaccine information, but TikTok videos were the most understandable. Most videos did not provide full details about COVID-19 vaccines, thus viewers would need to watch several videos before making a better-informed decision