Skip to main content
Article
The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
  • Alberto Barrón-Cedeño, Alma Mater Studiorum Università di Bologna
  • Firoj Alam, Qatar Computing Research Institute
  • Tommaso Caselli, Rijksuniversiteit Groningen
  • Giovanni Da San Martino, Università degli Studi di Padova
  • Tamer Elsayed, Qatar University
  • Andrea Galassi, Alma Mater Studiorum Università di Bologna
  • Fatima Haouari, Qatar University
  • Federico Ruggeri, Alma Mater Studiorum Università di Bologna
  • Julia Maria Struß, Fachhochschule Potsdam
  • Rabindra Nath Nandi, BJIT Limited
  • Gullal S. Cheema, Technische Informationsbibliothek (TIB)
  • Dilshod Azizov, Mohamed Bin Zayed University of Artificial Intelligence
  • Preslav Nakov, Mohamed Bin Zayed University of Artificial Intelligence
Document Type
Conference Proceeding
Abstract

The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and—for the first time—it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim.

DOI
10.1007/978-3-031-28241-6_59
Publication Date
3-16-2023
Keywords
  • Authority finding,
  • Check-worthiness,
  • Disinformation,
  • Fact-checking,
  • Factuality,
  • Political bias,
  • Subjectivity
Disciplines
Comments

IR conditions: non-described

Citation Information
A. Barrón-Cedeño et al., "The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority," Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13982 LNCS, pp. 506 - 517, Mar 2023. doi: 10.1007/978-3-031-28241-6_59