Kavli Affiliate: Zhuo Li | First 5 Authors: Yihong Dong, Jiazheng Ding, Xue Jiang, Ge Li, Zhuo Li | Summary: A proper code evaluation metric (CEM) profoundly impacts the evolution of code generation, which is an important research field in NLP and software engineering. Prevailing match-based CEMs (e.g., BLEU, Accuracy, and CodeBLEU) suffer from two […]
Continue.. CodeScore: Evaluating Code Generation by Learning Code Execution