Kavli Affiliate: Max Tegmark | First 5 Authors: Jinyeop Song, Ziming Liu, Max Tegmark, Jeff Gore, | Summary: Neural scaling laws characterize how model performance improves as the model size scales up. Inspired by empirical observations, we introduce a resource model of neural scaling. A task is usually composite hence can be decomposed into many […]
Continue.. A Resource Model For Neural Scaling Law