What Context Features Can Transformer Language Models Use?

8813

Knowledge Triples

Source Entity	Relationship	Target Entity
Context Conditioning Method	enhances	Usable Information Metric
Transformer Language Models Method	measuredBy	Perplexity Metric
Transformer Language Models Method	trainedOn	English Wikipedia Material
Transformer Language Models Method	uses	Context Conditioning Method
Usable Information Metric	includes	Lexical Information OtherEntity
Usable Information Metric	includes	Structural Information Material