Skip to main content
profile image
Selected Works of Preslav Nakov
Article
Overview of the CLEF-2023 CheckThat! Lab Task 3 on Political Bias of News Articles and News Media
CEUR Workshop Proceedings
  • Giovanni Da San Martino, Università degli Studi di Padova
  • Firoj Alam, Qatar Computing Research Institute
  • Maram Hasanain, Università degli Studi di Padova
  • Rabindra Nath Nandi, Hishab Singapore Pte. Ltd
  • Dilshod Azizov, Mohamed Bin Zayed University of Artificial Intelligence
  • Preslav Nakov, Mohamed Bin Zayed University of Artificial Intelligence
  • Tamer Elsayed, Qatar University
  • Dilshod Azizov, Qatar University
  • Tommaso Caselli, University of Groningen
  • Gullal S. Cheema, Leibniz University of Hannover
  • Fatima Haouari, Qatar University
  • Maram Hasanain, Qatar Computing Research Institute
  • Mucahid Kutlu, TOBB University of Economics and Technology
  • Chengkai Li, University of Texas at Arlington
  • Federico Ruggeri, Università di Bologna
  • Julia Maria Struß, University of Applied Sciences Potsdam
  • Wajdi Zaghouani, Hamad bin Khalifa University
Link
Document Type
Conference Proceeding
Abstract

We provide an overview of task 3 of the CheckThat!lab from the Cross-Language Evaluation Forum (CLEF) 2023, which focuses on predicting the political leaning of English-language news articles and news media outlets. We describe the data collection, the task setup, the evaluation outcomes, and the approaches used by the participating teams. A total of six teams submitted runs for the two subtasks. The top-performing system in Subtask 3A achieved a Mean Absolute Error (MAE) of 0.473, while the best system in Subtask 3B yielded a MAE of 0.549. We make all datasets and evaluation scripts available to the public, aiming to boost further research on this problem.

DOI
10.1007/978-3-031-42448-9_20
Publication Date
9-11-2023
Keywords
  • news articles,
  • news media,
  • Political bias
Disciplines
Comments

IR conditions: non-described

Additional Links

DOI link: https://doi.org/10.1007/978-3-031-42448-9_20

Citation Information
Barrón-Cedeño, A. et al, "Overview of the CLEF–2023 CheckThat! Lab on Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority of News Articles and Their Source," In Proceedings of the 14th Intl. Conf. of the Cross-Language Evaluation Forum for European Languages (CLEF 2023), Lecture Notes in Computer Science, vol 14163, Sept 2023. doi:10.1007/978-3-031-42448-9_20