heldout perplexity

We introduce polyglot language models, re- current neural network models trained to pre- dict symbol sequences in many different lan- guages using shared representations of sym- bols and conditioning on …...

AbstractDirichlet Multinomial Regression (DMR) and other supervised topic models can incorporate arbitrary document-level features to inform topic priors. However, their ability to model corpora are limited by the representation and …...