Test Suite Accuracy
metric
ID: testsuiteaccuracy
Related Papers
Semantic Evaluation for Text-to-SQL with Distilled Test Suites
AbstractWe propose test suite accuracy to approximate semantic accuracy for Text-to-SQL models. Our method distills a small test suite of databases that achieves high code coverage for the gold query …...