Convolution

AbstractRecurrent Neural Network (RNN) is one of the most popular architectures used in Natural Language Processsing (NLP) tasks because its recurrent structure is very suitable to process variable-length text. RNN …...

AbstractProblems involving code-mixed language are often plagued by a lack of resources and an absence of materials to perform sophisticated transfer learning with. In this paper we describe our submission …...

Modern pre-trained language models are mostly built upon backbones stacking self- attention and feed-forward layers in an in- terleaved order. In this paper, beyond this stereotyped layer pattern, we aim …...