Fixed Token Embedding
method
ID: fixedtokenembedding
Related Papers
Construction of Japanese BERT with Fixed Token Embeddings
In this study, we propose a method to construct Japanese BERT using fixed Token Embedding to reduce BERT model construction time. This method constructs word embeddings in advance using word2vec …...