Наборы для оценки

While the concept of similarity is well grounded in psychology, text similarity is less well-defined. Thus, we analyze text similarity with respect to its definition and the datasets used for …...

The role of search queries, as available within query sessions or in isolation from one an- other, in examined in the context of ranking the class labels (e.g., brazilian cities, …...

A weakly-supervised method is applied to anonymized queries to extract lexical interpre- tations of compound noun phrases (e.g., “for- tune 500 companies”). The interpretations explain the subsuming role (“listed in”) …...

Distributed word representations are widely used in many NLP tasks, and there are lots of benchmarks to evaluate word embeddings in English. However there are barely evaluation sets with large …...

AbstractConsistency is a long standing issue faced by dialogue models. In this paper, we frame the consistency of dialogue agents as natural language inference (NLI) and create a new natural …...

AbstractRecent efforts to create challenge benchmarks that test the abilities of natural language understanding models have largely depended on human annotations. In this work, we introduce the “Break, Perturb, Build” …...