Латентные представления
Related Papers
Generating Sentences from a Continuous Space
The standard recurrent neural network language model (rnnlm) generates sen- tences one word at a time and does not work from an explicit global sentence rep- resentation. In this work, …...
Acquiring language from speech by learning to remember and predict
AbstractClassical accounts of child language learning invoke memory limits as a pressure to discover sparse, language-like representations of speech, while more recent proposals stress the importance of prediction for language …...
Learning an Unreferenced Metric for Online Dialogue Evaluation
AbstractEvaluating the quality of a dialogue interaction between two agents is a difficult task, especially in open-domain chit-chat style dialogue. There have been recent efforts to develop automatic dialogue evaluation …...
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
AbstractAdvances in language modeling architectures and the availability of large text corpora have driven progress in automatic text generation. While this results in models capable of generating coherent texts, it …...
Non-Autoregressive Neural Machine Translation with Consistency Regularization Optimized Variational Framework
AbstractVariational Autoencoder (VAE) is an effective framework to model the interdependency for non-autoregressive neural machine translation (NAT). One of the prominent VAE-based NAT frameworks, LaNMT, achieves great improvements to vanilla …...
PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation
AbstractDespite recent progress of pre-trained language models on generating fluent text, existing methods still suffer from incoherence problems in long-form text generation tasks that require proper content control and planning …...
Pretraining on Interactions for Learning Grounded Affordance Representations
AbstractLexical semantics and cognitive science point to affordances (i.e. the actions that objects support) as critical for understanding and representing nouns and verbs. However, study of these semantic features has …...
Learning the Effects of Physical Actions in a Multi-modal Environment
AbstractLarge Language Models (LLMs) handle physical commonsense information inadequately. As a result of being trained in a disembodied setting, LLMs often fail to predict an action’s outcome in a given …...
Long Document Summarization with Top-down and Bottom-up Inference
AbstractText summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens …...