Kavli Affiliate: Xiang Zhang | First 5 Authors: Tianchun Wang, Tianchun Wang, , , | Summary: Large language model (LLM) scaling inference is key to unlocking greater performance, and leveraging diversity has proven an effective way to enhance it. Motivated by the observed relationship between solution accuracy and meaningful response diversity, we systematically study the […]
Continue.. On the Effect of Sampling Diversity in Scaling LLM Inference