Word Similarity Benchmarks

Distributional models are derived from co- occurrences in a corpus, where only a small proportion of all possible plausible co- occurrences will be observed. This results in a very sparse …...

AbstractResearchers have recently demonstrated that tying the neural weights between the input look-up table and the output classification layer can improve training and lower perplexity on sequence learning tasks such …...

AbstractWe reduce the model size of pre-trained word embeddings by a factor of 200 while preserving its quality. Previous studies in this direction created a smaller word embedding model by …...