Word Sense Distinction

It. is common in NLP that the categories into which text is classified do not have fully objective def- initions. Examples of such categories are lexical distinctions such as part-of-speech …...

AbstractIn this work, we demonstrate that the contextualized word vectors derived from pretrained masked language model-based encoders share a common, perhaps undesirable pattern across layers. Namely, we find cases of …...