Оптимальный транспорт
Related Papers
Geometry-aware domain adaptation for unsupervised alignment of word embeddings
AbstractWe propose a novel manifold based geometric approach for learning unsupervised alignment of word embeddings between the source and the target languages. Our approach formulates the alignment learning problem as …...
Improving Text Generation with Student-Forcing Optimal Transport
AbstractNeural language models are often trained with maximum likelihood estimation (MLE), where the next word is generated conditioned on the ground-truth word tokens. During testing, however, the model is instead …...
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport
AbstractSelecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal …...
Semantic Matching for Sequence-to-Sequence Learning
AbstractIn sequence-to-sequence models, classical optimal transport (OT) can be applied to semantically match generated sentences with target sentences. However, in non-parallel settings, target sentences are usually unavailable. To tackle this …...
Topic-relevant Response Generation using Optimal Transport for an Open-domain Dialog System
AbstractConventional neural generative models tend to generate safe and generic responses which have little connection with previous utterances semantically and would disengage users in a dialog system. To generate relevant …...
Unleash GPT-2 Power for Event Detection
AbstractEvent Detection (ED) aims to recognize mentions of events (i.e., event triggers) and their types in text. Recently, several ED datasets in various domains have been proposed. However, the major …...
Cross-Lingual Event Detection via Optimized Adversarial Training
AbstractIn this work, we focus on Cross-Lingual Event Detection where a model is trained on data from a source language but its performance is evaluated on data from a second, …...
Document-Level Event Argument Extraction via Optimal Transport
AbstractEvent Argument Extraction (EAE) is one of the sub-tasks of event extraction, aiming to recognize the role of each entity mention toward a specific event trigger. Despite the success of …...
Keyphrase Generation via Soft and Hard Semantic Corrections
AbstractKeyphrase generation aims to generate a set of condensed phrases given a source document. Although maximum likelihood estimation (MLE) based keyphrase generation methods have shown impressive performance, they suffer from …...
Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similarity
AbstractWe present a new scientific document similarity model based on matching fine-grained aspects of texts. To train our model, we exploit a naturally-occurring source of supervision: sentences in the full-text …...
On the Complementarity between Pre-Training and Random-Initialization for Resource-Rich Machine Translation
AbstractPre-Training (PT) of text representations has been successfully applied to low-resource Neural Machine Translation (NMT). However, it usually fails to achieve notable gains (some- times, even worse) on resource-rich NMT …...
Quantized Wasserstein Procrustes Alignment of Word Embedding Spaces
AbstractMotivated by the widespread interest in the cross-lingual transfer of NLP models from high resource to low resource languages, research on Cross-lingual word embeddings (CLWEs) has gained much popularity over …...
Text Style Transfer via Optimal Transport
AbstractText style transfer (TST) is a well-known task whose goal is to convert the style of the text (e.g., from formal to informal) while preserving its content. Recently, it has …...
Transferring Knowledge via Neighborhood-Aware Optimal Transport for Low-Resource Hate Speech Detection
AbstractThe concerning rise of hateful content on online platforms has increased the attention towards automatic hate speech detection, commonly formulated as a supervised classification task. State-of-the-art deep learning-based approaches usually …...
Word-Label Alignment for Event Detection: A New Perspective via Optimal Transport
AbstractEvent Detection (ED) aims to identify mentions/triggers of real world events in text. In the literature, this task is modeled as a sequence-labeling or word-prediction problem. In this work, we …...
Guide the Many-to-One Assignment: Open Information Extraction via IoU-aware Optimal Transport
AbstractOpen Information Extraction (OIE) seeks to extract structured information from raw text without the limitations of close ontology. Recently, the detection-based OIE methods have received great attention from the community …...
MANNER: A Variational Memory-Augmented Model for Cross Domain Few-Shot Named Entity Recognition
AbstractThis paper focuses on the task of cross domain few-shot named entity recognition (NER), which aims to adapt the knowledge learned from source domain to recognize named entities in target …...
Optimal Transport for Unsupervised Hallucination Detection in Neural Machine Translation
AbstractNeural machine translation (NMT) has become the de-facto standard in real-world machine translation applications. However, NMT models can unpredictably produce severely pathological translations, known as hallucinations, that seriously undermine user …...
Speech Translation with Foundation Models and Optimal Transport: UPC at IWSLT23
AbstractThis paper describes the submission of the UPC Machine Translation group to the IWSLT 2023 Offline Speech Translation task. Our Speech Translation systems utilize foundation models for speech (wav2vec 2.0) …...
Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models?
AbstractRecent advancements in Large Language Models (LLMs) have drawn increasing attention since the learned embeddings pretrained on large-scale datasets have shown powerful ability in various downstream applications. However, whether the …...
Unbalanced Optimal Transport for Unbalanced Word Alignment
AbstractMonolingual word alignment is crucial to model semantic interactions between sentences. In particular, null alignment, a phenomenon in which words have no corresponding counterparts, is pervasive and critical in handling …...