Weight Norm
method
ID: weightnorm
Related Papers
Improving Neural Language Models with Weight Norm Initialization and Regularization
AbstractEmbedding and projection matrices are commonly used in neural language models (NLM) as well as in other sequence processing networks that operate on large vocabularies. We examine such matrices in …...