TransformerNetworks
Related Papers
Contrastive Self-Supervised Learning for Commonsense Reasoning
AbstractWe propose a self-supervised method to solve Pronoun Disambiguation and Winograd Schema Challenge problems. Our approach exploits the characteristic structure of training corpora related to so-called “trigger” words, which are …...
On the Influence of Coreference Resolution on Word Embeddings in Lexical-semantic Evaluation Tasks
AbstractCoreference resolution (CR) aims to find all spans of a text that refer to the same entity. The F1-Scores on these task have been greatly improved by new developed End2End-approaches …...
Is Encoder-Decoder Redundant for Neural Machine Translation?
AbstractEncoder-decoder architecture is widely adopted for sequence-to-sequence modeling tasks. For machine translation, despite the evolution from long short-term memory networks to Transformer networks, plus the introduction and development of attention …...
Neural Machine Translation for Mathematical Formulae
AbstractWe tackle the problem of neural machine translation of mathematical formulae between ambiguous presentation languages and unambiguous content languages. Compared to neural machine translation on natural language, mathematical formulae have …...