Overview of the CLEF–2021 CheckThat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News
- Nakov P.
- Da San Martino G.
- Elsayed T.
- Barron-Cedeno A.
- Miguez R.
- Shaar S.
- Alam F.
- Haouari F.
- Hasanain M.
- Mansour W.
- Hamdan B.
- Ali Z. S.
- Babulkov N.
- Nikolov A.
- Shahi G. K.
- Struss J. M.
- Mandl T.
- Kutlu M.
- Kartal Y. S.
DOIAbstract
We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classificat...
Add to ORKG