Language Modeling Tasks

We describe a corpus-based induction algo- rithm for probabilistic context-free gram- mars. The algorithm employs a greedy heuristic search within a Bayesian frame- work, and a post-pass using the Inside- …...

AbstractNeural architectures are prominent in the construction of language models (LMs). However, word-level prediction is typically agnostic of subword-level information (characters and character sequences) and operates over a closed vocabulary, …...

AbstractVariational autoencoders (VAEs) are widely used for latent variable modeling of text. We focus on variations that learn expressive prior distributions over the latent variable. We find that existing training …...