Extremely Small BERT Models from Mixed-Vocabulary Training

42578

Knowledge Triples

Source Entity	Relationship	Target Entity
Distillation Method Method	creates	Task Agnostic Model Material
Task Agnostic Model Material	evaluatedIn	Dialogue task Task
Task Agnostic Model Material	evaluatedIn	Language Understanding Benchmarks Task