Эффективность вычислений
metric
ID: computeefficiency
Related Papers
Efficient Large Scale Language Modeling with Mixtures of Experts
AbstractMixture of Experts layers (MoEs) enable efficient scaling of language models through conditional computation. This paper presents a detailed empirical study of how autoregressive MoE language models scale in comparison …...
FedPerC: Federated Learning for Language Generation with Personal and Context Preference Embeddings
AbstractFederated learning is a training paradigm that learns from multiple distributed users without aggregating data on a centralized server, promising the ability to deploy machine-learning to a diverse population of …...