External quality assessment of SARS-CoV-2-sequencing: An ESGMD-SSM pilot trial across 15 European laboratories

OBJECTIVE: This first pilot on external quality assessment (EQA) of SARS-CoV-2 whole genome sequencing, initiated by the ESCMID Study Group for Genomic and Molecular Diagnostics (ESGMD) and Swiss Society for Microbiology (SSM), aims to build a framework between laboratories in order to improve pathogen surveillance sequencing. METHODS: Ten samples with varying viral loads were sent out to 15 clinical laboratories who had free choice of sequencing methods and bioinformatic analyses. The key aspects on which the individual centres were compared on were identification of 1) SNPs and indels, 2) Pango lineages, and 3) clusters between samples. RESULTS: The participating laboratories used a wide array of methods and analysis pipelines. Most were able to generate whole genomes for all samples. Genomes were sequenced to varying depth (up to 100-fold difference across centres). There was a very good consensus regarding the majority of reporting criteria, but there were a few discrepancies in lineage and cluster assignment. Additionally, there were inconsistencies in variant calling. The main reasons for discrepancies were missing data, bioinformatic choices, and interpretation of data. CONCLUSIONS: The pilot EQA was an overall success. It was able to show the high quality of participating labs and provide valuable feedback in cases where problems occurred, thereby improving the sequencing setup of laboratories. A larger follow-up EQA should, however, improve on defining the variables and format of the report. Additionally, contamination and/or minority variants should be a further aspect of assessment