Globally Normalized Attention

Filtering target-irrelevant information through hierarchically refining hidden states has been demonstrated to be effective for obtaining in- formative representations. However, previous work simply relies on locally normalized at- tention without …...