Contrastive Predictive Coding
method
ID: contrastivepredictivecoding
Related Papers
ETC: Encoding Long and Structured Inputs in Transformers
AbstractTransformer models have advanced the state of the art in many Natural Language Processing (NLP) tasks. In this paper, we present a new Transformer architecture, “Extended Transformer Construction” (ETC), that …...
Do self-supervised speech models develop human-like perception biases?
AbstractSelf-supervised models for speech processing form representational spaces without using any external labels. Increasingly, they appear to be a feasible way of at least partially eliminating costly manual annotations, a …...