The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority
Document Type
Conference Proceeding
Publication Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Abstract
The five editions of the CheckThat! lab so far have focused on the main tasks of the information verification pipeline: check-worthiness, evidence retrieval and pairing, and verification. The 2023 edition of the lab zooms into some of the problems and—for the first time—it offers five tasks in seven languages (Arabic, Dutch, English, German, Italian, Spanish, and Turkish): Task 1 asks to determine whether an item, text or a text plus an image, is check-worthy; Task 2 requires to assess whether a text snippet is subjective or not; Task 3 looks for estimating the political bias of a document or a news outlet; Task 4 requires to determine the level of factuality of a document or a news outlet; and Task 5 is about identifying authorities that should be trusted to verify a contended claim.
First Page
506
Last Page
517
DOI
10.1007/978-3-031-28241-6_59
Publication Date
1-1-2023
Keywords
Authority finding, Check-worthiness, Disinformation, Fact-checking, Factuality, Political bias, Subjectivity
Recommended Citation
A. Barrón-Cedeño and F. Alam and T. Caselli and G. Da San Martino and T. Elsayed and A. Galassi and F. Haouari and F. Ruggeri and J. Struß and R. Nandi and G. Cheema and D. Azizov and P. Nakov, "The CLEF-2023 CheckThat! Lab: Checkworthiness, Subjectivity, Political Bias, Factuality, and Authority," Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 13982 LNCS, pp. 506 - 517, Jan 2023.
The definitive version is available at https://doi.org/10.1007/978-3-031-28241-6_59