Адаптерное слияние
Related Papers
AdapterFusion: Non-Destructive Task Composition for Transfer Learning
AbstractSequential fine-tuning and multi-task learning are methods aiming to incorporate knowledge from multiple tasks; however, they suffer from catastrophic forgetting and difficulties in dataset balancing. To address these shortcomings, we …...
AdapterShare: Task Correlation Modeling with Adapter Differentiation
AbstractThanks to the development of pre-trained language models, multitask learning (MTL) methods achieve a great success in natural language understanding area. However, current MTL methods pay more attention to task …...
Samsung Research Philippines - Datasaur AI’s Submission for the WMT22 Large Scale Multilingual Translation Task
AbstractThis paper describes the submission of the joint Samsung Research Philippines - Datasaur AI team for the WMT22 Large Scale Multilingual African Translation shared task. We approach the contest as …...
Bridging Argument Quality and Deliberative Quality Annotations with Adapters
AbstractAssessing the quality of an argument is a complex, highly subjective task, influenced by heterogeneous factors (e.g., prior beliefs of the annotators, topic, domain, and application), and crucial for its …...
HHU at SemEval-2023 Task 3: An Adapter-based Approach for News Genre Classification
AbstractThis paper describes our approach for Subtask 1 of Task 3 at SemEval-2023. In this subtask, task participants were asked to classify multilingual news articles for one of three classes: …...
Parameter-efficient Modularised Bias Mitigation via AdapterFusion
AbstractLarge pre-trained language models contain societal biases and carry along these biases to downstream tasks. Current in-processing bias mitigation approaches (like adversarial training) impose debiasing by updating a model’s parameters, …...