Text Only Training
method
ID: textonlytraining
Related Papers
The World of an Octopus: How Reporting Bias Influences a Language Model’s Perception of Color
AbstractRecent work has raised concerns about the inherent limitations of text-only pretraining. In this paper, we first demonstrate that reporting bias, the tendency of people to not state the obvious, …...