Архитектура BERT
Related Papers
Modeling Intra and Inter-modality Incongruity for Multi-Modal Sarcasm Detection
AbstractSarcasm is a pervasive phenomenon in today’s social media platforms such as Twitter and Reddit. These platforms allow users to create multi-modal messages, including texts, images, and videos. Existing multi-modal …...
Frustratingly Easy Performance Improvements for Low-resource Setups: A Tale on BERT and Segment Embeddings
AbstractAs input representation for each sub-word, the original BERT architecture proposes the sum of the sub-word embedding, position embedding and a segment embedding. Sub-word and position embeddings are well-known and …...
Noisy Self-Training with Data Augmentations for Offensive and Hate Speech Detection Tasks
AbstractOnline social media is rife with offensive and hateful comments, prompting the need for their automatic detection given the sheer amount of posts created every second. Creating high-quality human-labelled datasets …...
Performance Analysis of Arabic Pre-trained Models on Named Entity Recognition Task
AbstractNamed Entity Recognition (NER) is a crucial task within natural language processing (NLP) that entails the identification and classification of entities, such as person, organization and location. This study delves …...