Языковые модели на основе нейронных сетей
Related Papers
Learning Sense-specific Word Embeddings By Exploiting Bilingual Resources
Recent work has shown success in learning word embeddings with neural network language models (NNLM). However, the majority of previous NNLMs represent each word with a single embedding, which fails …...
Higher-order Lexical Semantic Models for Non-factoid Answer Reranking
AbstractLexical semantic models provide robust performance for question answering, but, in general, can only capitalize on direct evidence seen during training. For example, monolingual alignment models acquire term alignment probabilities …...
Strategies for Training Large Vocabulary Neural Language Models
Training neural network language mod- els over large vocabularies is computa- tionally costly compared to count-based models such as Kneser-Ney. We present a systematic comparison of neural strate- gies to …...
Neural language models as psycholinguistic subjects: Representations of syntactic state
AbstractWe investigate the extent to which the behavior of neural network language models reflects incremental representations of syntactic state. To do so, we employ experimental methodologies which were originally developed …...
Stolen Probability: A Structural Weakness of Neural Language Models
AbstractNeural Network Language Models (NNLMs) generate probability distributions by applying a softmax function to a distance metric formed by taking the dot product of a prediction vector with all word …...