Шығындардың таралуы
metric
ID: lossdistribution
Related Papers
Learn with Noisy Data via Unsupervised Loss Correction for Weakly Supervised Reading Comprehension
AbstractWeakly supervised machine reading comprehension (MRC) task is practical and promising for its easily available and massive training data, but inevitablely introduces noise. Existing related methods usually incorporate extra submodels …...
ETHICIST: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confidence Estimation
AbstractLarge pre-trained language models achieve impressive results across many tasks. However, recent works point out that pre-trained language models may memorize a considerable fraction of their training data, leading to …...