Метрика
Related Papers
Evaluation of multimodal components within CHIL: The evaluation packages and results
AbstractThis article describes the first CHIL evaluation campaign in which 12 technologies were evaluated. The major outcomes of the first evaluation campaign are the so-called Evaluation Packages. An evaluation package …...
Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Construction
AbstractWhile the fast-paced inception of novel tasks and new datasets helps foster active research in a community towards interesting directions, keeping track of the abundance of research activity in different …...
SLURP: A Spoken Language Understanding Resource Package
AbstractSpoken Language Understanding infers semantic meaning directly from audio data, and thus promises to reduce error propagation and misunderstandings in end-user applications. However, publicly available SLU resources are limited. In …...
Emotion Stimulus Detection in German News Headlines
Emotion stimulus extraction is a fine-grained subtask of emotion analysis that focuses on identifying the description of the cause behind an emotion expression from a text passage (e.g., in the …...
End-to-End Construction of NLP Knowledge Graph
This paper studies the end-to-end construction of an NLP Knowledge Graph (KG) from scien- tific papers. We focus on extracting four types of relations: evaluatedOn between tasks and datasets, evaluatedBy …...