Publication Details

BUT-FIT at SemEval-2019 Task 7: Determining the Rumour Stance with Pre-Trained Deep Bidirectional Transformers

FAJČÍK Martin, BURGET Lukáš and SMRŽ Pavel. BUT-FIT at SemEval-2019 Task 7: Determining the Rumour Stance with Pre-Trained Deep Bidirectional Transformers. In: Proceedings of the 13th International Workshop on Semantic Evaluation. Minneapolis, Minnesota: Association for Computational Linguistics, 2019, pp. 1097-1104. ISBN 978-1-950737-06-2. Available from: https://aclweb.org/anthology/papers/S/S19/S19-2192/
Czech title
BUT-FIT na SemEval-2019 Task 7: Určování postojů k fámám s použitím predtrénovaných hlubokých transformer sítí
Type
conference paper
Language
english
Authors
Fajčík Martin, Ing., Ph.D. (DCGM FIT BUT)
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT)
Smrž Pavel, doc. RNDr., Ph.D. (DCGM FIT BUT)
URL
Keywords

rumour stance, hidden rumour stance, BERT, transformer, classification, stance classification, twitter post classification, reddit post classification, thread post classification, semeval, rumoureval

Abstract

This paper describes our system submitted to SemEval 2019 Task 7: RumourEval 2019: Determining Rumour Veracity and Support for Rumours, Subtask A (Gorrell et al., 2019). The challenge focused on classifying whether posts from Twitter and Reddit support, deny, query, or comment a hidden rumour, truthfulness of which is the topic of an underlying discussion thread. We formulate the problem as a stance classification, determining the rumour stance of a post with respect to the previous thread post and the source thread post. The recent BERT architecture was employed to build an end-to-end system which has reached the F1 score of 61.67 % on the provided test data. Without any hand-crafted feature, the system finished at the 2nd place in the competition, only 0.2 % behind the winner.

Published
2019
Pages
1097-1104
Proceedings
Proceedings of the 13th International Workshop on Semantic Evaluation
Conference
2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, US
ISBN
978-1-950737-06-2
Publisher
Association for Computational Linguistics
Place
Minneapolis, Minnesota, US
EID Scopus
2-s2.0-85095494215
BibTeX 
@INPROCEEDINGS{FITPUB12015,
   author = "Martin Faj\v{c}\'{i}k and Luk\'{a}\v{s} Burget and Pavel Smr\v{z}",
   title = "BUT-FIT at SemEval-2019 Task 7: Determining the Rumour Stance with Pre-Trained Deep Bidirectional Transformers",
   pages = "1097--1104",
   booktitle = "Proceedings of the 13th International Workshop on Semantic Evaluation",
   year = 2019,
   location = "Minneapolis, Minnesota, US",
   publisher = "Association for Computational Linguistics",
   ISBN = "978-1-950737-06-2",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/12015"
}
Back to top