Benchmark Transparency: Measuring the Impact of Data on Evaluation

Keyphrases

• Data Distribution 100%
• Model Performance 33%
• Evaluation Framework 33%
• Stratified Sampling 33%
• Point Distribution 33%
• Quantifying Impact 33%
• Different Datasets 33%
• Ranking Model 33%
• Relative Rank 33%
• Explicit Control 33%
• Automated Framework 33%
• Similarity Vectors 33%
• Dataset Similarity 33%
• NLP Model 33%

Mathematics

• Data Distribution 100%
• Data Point 33%
• Performance Model 33%
• Exploratory 33%
• Stratified Sampling 33%

Computer Science

• Data Distribution 100%
• Performance Model 33%
• Discriminability 33%
• Distribution Point 33%