Ішкі бағалау
task
ID: intrinsicevaluations
Related Papers
Fully Unsupervised Crosslingual Semantic Textual Similarity Metric Based on BERT for Identifying Parallel Data
AbstractWe present a fully unsupervised crosslingual semantic textual similarity (STS) metric, based on contextual embeddings extracted from BERT – Bidirectional Encoder Representations from Transformers (Devlin et al., 2019). The goal …...
When Do Pre-Training Biases Propagate to Downstream Tasks? A Case Study in Text Summarization
AbstractLarge language models (LLMs) are subject to sociocultural and other biases previously identified using intrinsic evaluations. However, when and how these intrinsic biases in pre-trained LM representations propagate to downstream, …...