Objective Functions
Related Papers
Investigating Loss Functions and Optimization Methods for Discriminative Learning of Label Sequences
Discriminative models have been of inter- est in the NLP community in recent years. Previous research has shown that they are advantageous over generative mod- els. In this paper, we …...
Asynchronous Parallel Learning for Neural Networks and Structured Models with Dense Features
AbstractExisting asynchronous parallel learning methods are only for the sparse feature models, and they face new challenges for the dense feature models like neural networks (e.g., LSTM, RNN). The problem …...
Semi-supervised Multi-task Learning for Multi-label Fine-grained Sexism Classification
AbstractSexism, a form of oppression based on one’s sex, manifests itself in numerous ways and causes enormous suffering. In view of the growing number of experiences of sexism reported online, …...
Mitigating the Diminishing Effect of Elastic Weight Consolidation
AbstractElastic weight consolidation (EWC, Kirkpatrick et al. 2017) is a promising approach to addressing catastrophic forgetting in sequential training. We find that the effect of EWC can diminish when fine-tuning …...