Behavioural Consistency
metric
ID: behaviouralconsistency
Related Papers
BECEL: Benchmark for Consistency Evaluation of Language Models
AbstractBehavioural consistency is a critical condition for a language model (LM) to become trustworthy like humans. Despite its importance, however, there is little consensus on the definition of LM consistency, …...