AraBERT
Related Papers
An Empirical Study of Pre-trained Transformers for Arabic Information Extraction
AbstractMultilingual pre-trained Transformers, such as mBERT (Devlin et al., 2019) and XLM-RoBERTa (Conneau et al., 2020a), have been shown to enable effective cross-lingual zero-shot transfer. However, their performance on Arabic …...
LISAC FSDM-USMBA Team at SemEval-2020 Task 12: Overcoming AraBERT’s pretrain-finetune discrepancy for Arabic offensive language identification
AbstractAraBERT is an Arabic version of the state-of-the-art Bidirectional Encoder Representations from Transformers (BERT) model. The latter has achieved good performance in a variety of Natural Language Processing (NLP) tasks. …...
akaBERT at SemEval-2022 Task 6: An Ensemble Transformer-based Model for Arabic Sarcasm Detection
AbstractDue to the widespread usage of social media sites and the enormous number of users who utilize irony implicit words in most of their tweets and posts, it has become …...
Siamese AraBERT-LSTM Model based Approach for Arabic Paraphrase Detection
Paraphrase detection allows identifying the degree of likelihood between source and suspect sentences. It is a critical machine learning problem in computational linguistics. This is due to the expression variability …...