ReLU
otherentity
ID: relu
Related Papers
DA-Transformer: Distance-aware Transformer
AbstractTransformer has achieved great success in the NLP field by composing various advanced models like BERT and GPT. However, Transformer and its existing variants may not be optimal in capturing …...