Softmax Layer
method
ID: softmaxlayer
Related Papers
Global Normalization of Convolutional Neural Networks for Joint Entity and Relation Classification
AbstractWe introduce globally normalized convolutional neural networks for joint entity classification and relation extraction. In particular, we propose a way to utilize a linear-chain conditional random field output layer for …...
MulCode: A Multiplicative Multi-way Model for Compressing Neural Language Model
AbstractIt is challenging to deploy deep neural nets on memory-constrained devices due to the explosion of numbers of parameters. Especially, the input embedding layer and Softmax layer usually dominate the …...
Self-Knowledge Distillation in Natural Language Processing
AbstractSince deep learning became a key player in natural language processing (NLP), many deep learning models have been showing remarkable performances in a variety of NLP tasks. Such high performance …...