Japanese BERT

For evaluation of pre-trained models like bidi- rectional encoder representations from trans- formers (BERT), task-based approaches are frequently adopted and there is a possibility that meta parameters for fine-tuning influence …...

AbstractThis paper contributes to studying relationships between Japanese topography and places featured in early modern landscape prints, so-called ukiyo-e or ‘pictures of the floating world’. The printed inscriptions on these …...

In this study, we propose a method to construct Japanese BERT using fixed Token Embedding to reduce BERT model construction time. This method constructs word embeddings in advance using word2vec …...