Книжный корпус
material
ID: bookcorpus
Related Papers
An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-training
AbstractPre-training large language models has become a standard in the natural language processing community. Such models are pre-trained on generic data (e.g. BookCorpus and English Wikipedia) and often fine-tuned on …...
Similarity or deeper understanding? Analyzing the TED-Q dataset of evoked questions
AbstractWe take a close look at a recent dataset of TED-talks annotated with the questions they implicitly evoke, TED-Q (Westera et al., 2020). We test to what extent the relation …...