Intrinsic Tasks
Related Papers
Investigating Different Syntactic Context Types and Context Representations for Learning Word Embeddings
AbstractThe number of word embedding models is growing every year. Most of them are based on the co-occurrence information of words and their contexts. However, it is still an open …...
Incorporating Syntactic and Semantic Information in Word Embeddings using Graph Convolutional Networks
AbstractWord embeddings have been widely adopted across several NLP applications. Most existing word embedding methods utilize sequential context of a word to learn its embedding. While there have been some …...
Using Context-to-Vector with Graph Retrofitting to Improve Word Embeddings
AbstractAlthough contextualized embeddings generated from large-scale pre-trained models perform well in many tasks, traditional static embeddings (e.g., Skip-gram, Word2Vec) still play an important role in low-resource and lightweight settings due …...
Pre-Training to Learn in Context
AbstractIn-context learning, where pre-trained language models learn to perform tasks from task examples and instructions in their contexts, has attracted much attention in the NLP community. However, the ability of …...