Erratum: Measuring and Improving Consistency in Pretrained Language Models

Erratum: Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar1,2 Nora Kassner3 Shauli Ravfogel1,2 Abhilasha Ravichander4 Eduard Hovy4 Hinrich Sch¨utze3 Yoav Goldberg1,2 1Computer Science Department, Bar Ilan University, Israel 2Allen Institute for Artificial Intelligence, United States 3Center for Information and Language Processing (CIS), LMU Munich, Germany 4Language Technologies Institute, Carnegie Mellon University, United States {yanaiela,shauli.ravfogel,yoav.goldberg}@gmail.com kassner@cis.lmu.de {aravicha,hovy}@cs.cmu.edu Abstract During production of this paper, an error was introduced to the formula on the bottom of the right column of page 1020. In the last two terms of the formula, the n and m subscripts were swapped. The correct formula is: Lc = k � n=1 k � m=n+1 DKL(Qri n ∥Qri m)+DKL(Qri m∥Qri n ) The paper has been updated. 1407 Transactions of the Association for Computational Linguistics, vol. 9, p. 1407, 2021. https://doi.org/10.1162/tacl x 00455 Action Editor: George Foster. Submission batch: 3/2021; Revision batch: 4/2021; Published 2021. c⃝ 2021 Association for Computational Linguistics. Distributed under a CC-BY 4.0 license.