ExtrinsicBiasEvaluation
metric
ID: extrinsicbiasevaluation
Related Papers
Debiasing Isn’t Enough! – on the Effectiveness of Debiasing MLMs and Their Social Biases in Downstream Tasks
AbstractWe study the relationship between task-agnostic intrinsic and task-specific extrinsic social bias evaluation measures for MLMs, and find that there exists only a weak correlation between these two types of …...