Bidirectional Language Model Pre Training
method
ID: bidirectionallanguagemodelpretraining
Related Papers
R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling
AbstractHuman language understanding operates at multiple levels of granularity (e.g., words, phrases, and sentences) with increasing levels of abstraction that can be hierarchically combined. However, existing deep models with stacked …...