Downstream Task
Related Papers
Word Embedding Binarization with Semantic Information Preservation
AbstractWith growing applications of Machine Learning in daily lives Natural Language Processing (NLP) has emerged as a heavily researched area. Finding its applications in tasks ranging from simple Q/A chatbots …...
On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation
AbstractAdapter-based tuning has recently arisen as an alternative to fine-tuning. It works by adding light-weight adapter modules to a pretrained language model (PrLM) and only updating the parameters of adapter …...
Unsupervised Conversation Disentanglement through Co-Training
AbstractConversation disentanglement aims to separate intermingled messages into detached sessions, which is a fundamental task in understanding multi-party conversations. Existing work on conversation disentanglement relies heavily upon human-annotated datasets, which …...
An Empirical Study on the Transferability of Transformer Modules in Parameter-efficient Fine-tuning
AbstractParameter-efficient fine-tuning has garnered lots of attention in recent studies. On this subject, we investigate the capability of different transformer modules in transferring knowledge from a pre-trained model to a …...
BECEL: Benchmark for Consistency Evaluation of Language Models
AbstractBehavioural consistency is a critical condition for a language model (LM) to become trustworthy like humans. Despite its importance, however, there is little consensus on the definition of LM consistency, …...
IgboBERT Models: Building and Training Transformer Models for the Igbo Language
AbstractThis work presents a standard Igbo named entity recognition (IgboNER) dataset as well as the results from training and fine-tuning state-of-the-art transformer IgboNER models. We discuss the process of our …...
OpenKorPOS: Democratizing Korean Tokenization with Voting-Based Open Corpus Annotation
AbstractKorean is a language with complex morphology that uses spaces at larger-than-word boundaries, unlike other East-Asian languages. While morpheme-based text generation can provide significant semantic advantages compared to commonly used …...