DistilBERT and RoBERTa Models for Identification of Fake News
Date Issued
2023-05-22
Author(s)
Kitanovski, A.
Toshevska, M.
Mirceva, G.
DOI
10.23919/mipro57284.2023.10159740
Abstract
The proliferation of fake news has become a significant issue in today’s society, affecting the public’s perception of current events and causing harm to individuals and organizations. Therefore, the need for automated systems that can identify and flag fake news is critical. This paper presents a study on the effectiveness of DistilBERT and RoBERTa, two state-of-the-art language models, for detecting fake news. In this study, we trained both models on a dataset of labelled news articles and evaluated them on two different datasets, comparing their performance in terms of accuracy, precision, recall and F1-score. The results of our experiments show that both models perform well in detecting fake news, with RoBERTa model achieving slightly better results in overall. Our study highlights the ability of these models to effectively identify fake news and help combat misinformation.
File(s)![Thumbnail Image]()
Loading...
Name
MIPRO2023_Mirceva_fake_news.pdf
Size
303.45 KB
Format
Adobe PDF
Checksum
(MD5):d8d5a8ca4cac467d6affcc18a7fbedfc