DOMLIN at SemEval-2019 Task 8: Automated Fact Checking exploiting Ratings in Community Question Answering Forums

Dominik Stammbach, Stalin Varanasi, Günter Neumann

In: The InternationalWorkshop on Semantic Evaluation - Proceedings of the Thirteenth Workshop. International Workshop on Semantic Evaluation (SemEval-2019) located at Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies June 6-7 Minneapolis United States Pages 1145-1150 ISBN 978-1-950737-06-2 NAACL 6/2019.


In the following, we describe our system developed for the Semeval2019 Task 8. We finetuned a BERT checkpoint on the qatar living forum dump and used this checkpoint to train a number of models. Our hand-in for subtask A consists of a fine-tuned classifier from this BERT checkpoint. For subtask B, we first have a classifier deciding whether a comment is factual or non-factual. If it is factual, we retrieve intra-forum evidence and using this evidence, have a classifier deciding the comment’s veracity. We trained this classifier on ratings which we crawled from


76_Paper.pdf (pdf, 161 KB )

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz