Causal Language Modeling
method
ID: causallanguagemodeling
Related Papers
A Closer Look at Parameter Contributions When Training Neural Language and Translation Models
AbstractWe analyze the learning dynamics of neural language and translation models using Loss Change Allocation (LCA), an indicator that enables a fine-grained analysis of parameter updates when optimizing for the …...
Cross-lingual Similarity of Multilingual Representations Revisited
AbstractRelated works used indexes like CKA and variants of CCA to measure the similarity of cross-lingual representations in multilingual language models. In this paper, we argue that assumptions of CKA/CCA …...