Встраивание
Related Papers
A Comparative Study on Regularization Strategies for Embedding-based Neural Networks
This paper aims to compare different reg- ularization strategies to address a com- mon phenomenon, severe overfitting, in embedding-based neural networks for NLP. We chose two widely studied neu- ral …...
Learning Embeddings to lexicalise RDF Properties
A difficult task when generating text from knowledge bases (KB) consists in finding appropriate lexicalisations for KB sym- bols. We present an approach for lexicalis- ing knowledge base relations and …...
Continuous Representation of Location for Geolocation and Lexical Dialectology using Mixture Density Networks
AbstractWe propose a method for embedding two-dimensional locations in a continuous vector space using a neural network-based model incorporating mixtures of Gaussian distributions, presenting two model variants for text-based geolocation …...
Low-Rank RNN Adaptation for Context-Aware Language Modeling
AbstractA context-aware language model uses location, user and/or domain metadata (context) to adapt its predictions. In neural language models, context information is typically represented as an embedding and it is …...
State Gradients for RNN Memory Analysis
AbstractWe present a framework for analyzing what the state in RNNs remembers from its input embeddings. We compute the gradients of the states with respect to the input embeddings and …...
Tempo-Lexical Context Driven Word Embedding for Cross-Session Search Task Extraction
AbstractTask extraction is the process of identifying search intents over a set of queries potentially spanning multiple search sessions. Most existing research on task extraction has focused on identifying tasks …...
Strong and Simple Baselines for Multimodal Utterance Embeddings
AbstractHuman language is a rich multimodal signal consisting of spoken words, facial expressions, body gestures, and vocal intonations. Learning representations for these spoken utterances is a complex research problem due …...
A Biologically Plausible Parser
AbstractWe describe a parser of English effectuated by biologically plausible neurons and synapses, and implemented through the Assembly Calculus, a recently proposed computational framework for cognitive function. We demonstrate that …...
A Deep Metric Learning Approach to Account Linking
AbstractWe consider the task of linking social media accounts that belong to the same author in an automated fashion on the basis of the content and meta-data of the corresponding …...
A Systematic Investigation of KB-Text Embedding Alignment at Scale
AbstractKnowledge bases (KBs) and text often contain complementary knowledge: KBs store structured knowledge that can support long range reasoning, while text stores more comprehensive and timely knowledge in an unstructured …...
EDIN: An End-to-end Benchmark and Pipeline for Unknown Entity Discovery and Indexing
AbstractExisting work on Entity Linking mostly assumes that the reference knowledge base is complete, and therefore all mentions can be linked. In practice this is hardly ever the case, as …...
Direct Fact Retrieval from Knowledge Graphs without Entity Linking
AbstractThere has been a surge of interest in utilizing Knowledge Graphs (KGs) for various natural language processing/understanding tasks. The conventional mechanism to retrieve facts in KGs usually involves three steps: …...