Шығындарды қысқарту
method
ID: losstruncation
Related Papers
Improved Natural Language Generation via Loss Truncation
AbstractNeural language models are usually trained to match the distributional properties of large-scale corpora by minimizing the log loss. While straightforward to optimize, this approach forces the model to reproduce …...