ALBERT Base
method
ID: albertbase
Related Papers
Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings
AbstractThe current state-of-the-art task-oriented semantic parsing models use BERT or RoBERTa as pretrained encoders; these models have huge memory footprints. This poses a challenge to their deployment for voice assistants …...