Overview of the CLEF-2023 CheckThat! Lab Task 3 on Political Bias of News Articles and News Media
Document Type
Conference Proceeding
Publication Title
CEUR Workshop Proceedings
Abstract
We provide an overview of task 3 of the CheckThat!lab from the Cross-Language Evaluation Forum (CLEF) 2023, which focuses on predicting the political leaning of English-language news articles and news media outlets. We describe the data collection, the task setup, the evaluation outcomes, and the approaches used by the participating teams. A total of six teams submitted runs for the two subtasks. The top-performing system in Subtask 3A achieved a Mean Absolute Error (MAE) of 0.473, while the best system in Subtask 3B yielded a MAE of 0.549. We make all datasets and evaluation scripts available to the public, aiming to boost further research on this problem.
First Page
250
Last Page
259
DOI
10.1007/978-3-031-42448-9_20
Publication Date
9-11-2023
Keywords
news articles, news media, Political bias
Recommended Citation
Barrón-Cedeño, A. et al, "Overview of the CLEF–2023 CheckThat! Lab on Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority of News Articles and Their Source," In Proceedings of the 14th Intl. Conf. of the Cross-Language Evaluation Forum for European Languages (CLEF 2023), Lecture Notes in Computer Science, vol 14163, Sept 2023. doi:10.1007/978-3-031-42448-9_20
Comments
IR conditions: non-described