Прямой нейронный сеть
Related Papers
Unraveling Antonym’s Word Vectors through a Siamese-like Network
AbstractDiscriminating antonyms and synonyms is an important NLP task that has the difficulty that both, antonyms and synonyms, contains similar distributional information. Consequently, pairs of antonyms and synonyms may have …...
EBERT: Efficient BERT Inference with Dynamic Structured Pruning
Pruning has been demonstrated as an effective way of reducing computational complexity for deep networks, especially CNNs for computer vision tasks. In this paper, we investigate the opportunity to accelerate …...
Mask Attention Networks: Rethinking and Strengthen Transformer
AbstractTransformer is an attention-based neural network, which consists of two sublayers, namely, Self-Attention Network (SAN) and Feed-Forward Network (FFN). Existing research explores to enhance the two sublayers separately to improve …...
Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space
AbstractTransformer-based language models (LMs) are at the core of modern NLP, but their internal prediction construction process is opaque and largely not understood. In this work, we make a substantial …...
FIT BUT at SemEval-2023 Task 12: Sentiment Without Borders - Multilingual Domain Adaptation for Low-Resource Sentiment Classification
AbstractThis paper presents our proposed method for SemEval-2023 Task 12, which focuses on sentiment analysis for low-resource African languages. Our method utilizes a language-centric domain adaptation approach which is based …...