Человеческие оценщики
otherentity
ID: humanevaluators
Related Papers
Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort
AbstractIn Machine Translation, assessing the quality of a large amount of automatic translations can be challenging. Automatic metrics are not reliable when it comes to high performing systems. In addition, …...
The statistical advantage of automatic NLG metrics at the system level
AbstractEstimating the expected output quality of generation systems is central to NLG. This paper qualifies the notion that automatic metrics are not as good as humans in estimating system-level quality. …...