Kavli Affiliate: Jie Shan | First 5 Authors: Shuyin Ouyang, Shuyin Ouyang, , , | Summary: We introduce DSCodeBench, a new benchmark designed to evaluate large language models (LLMs) on complicated and realistic data science code generation tasks. DSCodeBench consists of 1,000 carefully constructed problems sourced from realistic problems from GitHub across ten widely used […]
Continue.. DSCodeBench: A Realistic Benchmark for Data Science Code Generation