Transformer Based Language Model
material
ID: transformerbasedlanguagemodel
Related Papers
BottleSum: Unsupervised and Self-supervised Sentence Summarization using the Information Bottleneck Principle
AbstractThe principle of the Information Bottleneck (Tishby et al., 1999) produces a summary of information X optimized to predict some other relevant information Y. In this paper, we propose a …...
Watching a Language Model Learning Chess
AbstractWe analyse how a transformer-based language model learns the rules of chess from text data of recorded games. We show how it is possible to investigate how the model capacity …...
Learning Semantic Textual Similarity via Topic-informed Discrete Latent Variables
AbstractRecently, discrete latent variable models have received a surge of interest in both Natural Language Processing (NLP) and Computer Vision (CV), attributed to their comparable performance to the continuous counterparts …...