Шығару
Related Papers
A Parsing Architecture Based on Distributed Memory Machines
The paper begins by defining a class of distributed memory machines which have useful properties as retrieval and filtering devices. These memory mechanisms store large numbers of associations on a …...
Improving Probabilistic Latent Semantic Analysis with Principal Component Analysis
Probabilistic Latent Semantic Analysis (PLSA) models have been shown to pro- vide a better model for capturing poly- semy and synonymy than Latent Seman- tic Analysis (LSA). However, the param- …...
Qme! : A Speech-based Question-Answering system on Mobile Devices
Mobile devices are becoming the dominant mode of information access despite being cumbersome to input text using small key- boards and browsing web pages on small screens. We present Qme!, …...
Abu-MaTran: automatic building of machine translation
Current Translation Memory (TM) sys- tems work at the surface level and lack se- mantic knowledge while matching. This paper presents an approach to incorpo- rating semantic knowledge in the …...
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
AbstractSentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various …...
Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP
AbstractRetrieval is a core component for open-domain NLP tasks. In open-domain tasks, multiple entities can share a name, making disambiguation an inherent yet under-explored problem. We propose an evaluation benchmark …...
Characterizing Verbatim Short-Term Memory in Neural Language Models
AbstractWhen a language model is trained to predict natural language sequences, its prediction at each moment depends on a representation of prior context. What kind of information about the prior …...
Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions
AbstractPrompting-based large language models (LLMs) are surprisingly powerful at generating natural language reasoning steps or Chains-of-Thoughts (CoT) for multi-step question answering (QA). They struggle, however, when the necessary knowledge is …...
John Boy Walton at SemEval-2023 Task 5: An Ensemble Approach to Spoiler Classification and Retrieval for Clickbait Spoiling
AbstractClickbait spoiling is a task of generating or retrieving a fairly short text with a purpose to satisfy curiosity of a content consumer without their addressing to the document linked …...
On the Generalization Ability of Retrieval-Enhanced Transformers
AbstractRecent work on the Retrieval-Enhanced Transformer (RETRO) model has shown impressive results: off-loading memory from trainable weights to a retrieval database can significantly improve language modeling and match the performance …...
Patton: Language Model Pretraining on Text-Rich Networks
AbstractA real-world text corpus sometimes comprises not only text documents, but also semantic links between them (e.g., academic papers in a bibliographic network are linked by citations and co-authorships).Text documents …...