Long Tail Tokens
otherentity
ID: longtailtokens
Related Papers
Understanding In-Context Learning via Supportive Pretraining Data
AbstractIn-context learning (ICL) improves language models’ performance on a variety of NLP tasks by simply demonstrating a handful of examples at inference time. It is not well understood why ICL …...