Extended Transformer Construction

Back to List
method ID: extendedtransformerconstruction

Related Papers

ETC: Encoding Long and Structured Inputs in Transformers

Authors: nan

Publication: TIPSTER (2020)

DOI: nan

AbstractTransformer models have advanced the state of the art in many Natural Language Processing (NLP) tasks. In this paper, we present a new Transformer architecture, “Extended Transformer Construction” (ETC), that …...

31271