Skip to main content
profile image
Selected Works of Preslav Nakov
Article
Overview of the CLEF–2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
  • Preslav Nakov, Mohamed bin Zayed University of Artificial Intelligence
  • Alberto Barrón-Cedeño, Università di Bologna, Forlì, Italy
  • Giovanni da San Martino, University of Padova, Padova, Italy
  • Firoj Alam, Qatar Computing Research Institute, HBKU, Ar-Rayyan, Qatar
  • Julia Maria Struß, University of Applied Sciences Potsdam, Potsdam, Germany
  • Thomas Mandl, University of Hildesheim, Hildesheim, Germany
  • Rubén Míguez, Newtral Media Audiovisual, Madrid, Spain
  • Tommaso Caselli, University of Groningen, Groningen, Netherlands
  • Mucahid Kutlu, TOBB University of Economics and Technology, Ankara, Turkey
  • Wajdi Zaghouani, Hamad Bin Khalifa University, Ar-Rayyan, Qatar
  • Chengkai Li, University of Texas at Arlington, Arlington, United States
  • Shaden Shaar, Cornell University, Ithaca, United States
  • Gautam Kishore Shahi, University of Duisburg-Essen, Duisburg, Germany
  • Hamdy Mubarak, Qatar Computing Research Institute, HBKU, Ar-Rayyan, Qatar
  • Alex Nikolov, CheckStep, London, United Kingdom
  • Nikolay Babulkov, Sofia University, Sofia, Bulgaria
  • Yavuz Selim Kartal, GESIS-Leibniz Institute for the Social Sciences, Mannheim, Germany
  • Michael Wiegand, University of Klagenfurt, Klagenfurt, Austria
  • Melanie Siegel, Darmstadt University of Applied Sciences, Darmstadt, Germany
  • Juliane Köhler, University of Applied Sciences Potsdam, Potsdam, Germany
Link
Document Type
Conference Proceeding
Abstract

We describe the fifth edition of the CheckThat! lab, part of the 2022 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality in multiple languages: Arabic, Bulgarian, Dutch, English, German, Spanish, and Turkish. Task 1 asks to identify relevant claims in tweets in terms of check-worthiness, verifiability, harmfullness, and attention-worthiness. Task 2 asks to detect previously fact-checked claims that could be relevant to fact-check a new claim. It targets both tweets and political debates/speeches. Task 3 asks to predict the veracity of the main claim in a news article. CheckThat! was the most popular lab at CLEF-2022 in terms of team registrations: 137 teams. More than one-third (37%) of them actually participated: 18, 7, and 26 teams submitted 210, 37, and 126 official runs for tasks 1, 2, and 3, respectively. © 2022, The Author(s), under exclusive license to Springer Nature Switzerland AG.

DOI
10.1007/978-3-031-13643-6_29
Publication Date
8-25-2022
Keywords
  • Check-Worthiness,
  • COVID-19,
  • Disinformation,
  • Fact-Checking,
  • Fake News,
  • Misinformation,
  • Verified Claim Retrieval
Disciplines
Comments

IR Deposit conditions: non-described

Citation Information
P. Nakov et al, "Overview of the CLEF–2022 CheckThat! Lab on Fighting the COVID-19 Infodemic and Fake News Detection", in Experimental IR Meets Multilinguality, Multimodality, and Interaction (CLEF 2022), Lecture Notes in Computer Science, vol 13390, pp 495-520, Aug 2022, doi:10.1007/978-3-031-13643-6_29