Большие предварительно обученные модели
Related Papers
RethinkCWS: Is Chinese Word Segmentation a Solved Task?
AbstractThe performance of the Chinese Word Segmentation (CWS) systems has gradually reached a plateau with the rapid development of deep neural networks, especially the successful use of large pre-trained models. …...
DYPLOC: Dynamic Planning of Content Using Mixed Language Models for Text Generation
AbstractWe study the task of long-form opinion text generation, which faces at least two distinct challenges. First, existing neural generation models fall short of coherence, thus requiring efficient content planning. …...
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalizability
AbstractFine-tuning large pre-trained models with task-specific data has achieved great success in NLP. However, it has been demonstrated that the majority of information within the self-attention networks is redundant and …...
Improve Query Focused Abstractive Summarization by Incorporating Answer Relevance
ive Summarization by Incorporating Answer Relevance Dan Su∗, Tiezheng Yu∗, Pascale Fung Center for Artificial Intelligence Research (CAiRE) Department of Electronic and Computer Engineering The Hong Kong University of Science …...
Performance Analysis of Arabic Pre-trained Models on Named Entity Recognition Task
AbstractNamed Entity Recognition (NER) is a crucial task within natural language processing (NLP) that entails the identification and classification of entities, such as person, organization and location. This study delves …...