Жақындасу
Related Papers
The Acquisition of Word Order by a Computational Learning System
The purpose of this work is to investigate the process of grammatical acquisition from data. We are using a computational learning sys- tern that is composed of a Universal Grammar …...
Finding Domain Terms using Wikipedia
AbstractIn this paper we present a new approach for obtaining the terminology of a given domain using the category and page structures of the Wikipedia in a language independent way. …...
A Study on Bootstrapping Bilingual Vector Spaces from Non-Parallel Data (and Nothing Else)
We present a new language pair agnostic ap- proach to inducing bilingual vector spaces from non-parallel data without any other re- source in a bootstrapping fashion. The pa- per systematically …...
Aligned Weight Regularizers for Pruning Pretrained Neural Networks
AbstractPruning aims to reduce the number of parameters while maintaining performance close to the original network. This work proposes a novel self-distillation based pruning strategy, whereby the representational similarity between …...
Arabic Dialect Identification with a Few Labeled Examples Using Generative Adversarial Networks
AbstractGiven the challenges and complexities introduced while dealing with Dialect Arabic (DA) variations, Transformer based models, e.g., BERT, outperformed other models in dealing with the DA identification task. However, to …...
CAME: Confidence-guided Adaptive Memory Efficient Optimization
AbstractAdaptive gradient methods, such as Adam and LAMB, have demonstrated excellent performance in the training of large language models. Nevertheless, the need for adaptivity requires maintaining second-moment estimates of the …...