Жасырын күйлер
material
ID: hiddenstates
Related Papers
Neural Machine Translation with Word Predictions
AbstractIn the encoder-decoder architecture for neural machine translation (NMT), the hidden states of the recurrent structures in the encoder and decoder carry the crucial information about the sentence. These vectors …...
Interpreting Word-Level Hidden State Behaviour of Character-Level LSTM Language Models
AbstractWhile Long Short-Term Memory networks (LSTMs) and other forms of recurrent neural network have been successfully applied to language modeling on a character level, the hidden state dynamics of these …...
How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT’s Attention
AbstractRecent research on the multi-head attention mechanism, especially that in pre-trained models such as BERT, has shown us heuristics and clues in analyzing various aspects of the mechanism. As most …...