Kavli Affiliate: Max Tegmark | First 5 Authors: Ziming Liu, Max Tegmark, , , | Summary: Neural scaling laws (NSL) refer to the phenomenon where model performance improves with scale. Sharma & Kaplan analyzed NSL using approximation theory and predict that MSE losses decay as $N^{-alpha}$, $alpha=4/d$, where $N$ is the number of model parameters, […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Ziming Liu, Max Tegmark, , , | Summary: Neural scaling laws (NSL) refer to the phenomenon where model performance improves with scale. Sharma & Kaplan analyzed NSL using approximation theory and predict that MSE losses decay as $N^{-alpha}$, $alpha=4/d$, where $N$ is the number of model parameters, […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Wes Gurnee, Max Tegmark, , , | Summary: The capabilities of large language models (LLMs) have sparked debate over whether such systems just learn an enormous collection of superficial statistics or a coherent model of the data generating process — a world model. We find evidence for […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Wes Gurnee, Max Tegmark, , , | Summary: The capabilities of large language models (LLMs) have sparked debate over whether such systems just learn an enormous collection of superficial statistics or a coherent model of the data generation process — a world model. We find preliminary evidence […]
Kavli Affiliate: Max Tegmark | First 5 Authors: Wes Gurnee, Max Tegmark, , , | Summary: The capabilities of large language models (LLMs) have sparked debate over whether such systems just learn an enormous collection of superficial statistics or a set of more coherent and grounded representations that reflect the real world. We find evidence […]
Kavli Affiliate: Laura Schaefer | First 5 Authors: Maggie A. Thompson, Myriam Telus, Graham Harper Edwards, Laura Schaefer, Jasmeet Dhaliwal | Summary: Outgassing is a central process during the formation and evolution of terrestrial planets and their atmospheres both within and beyond the solar system. Although terrestrial planets’ early atmospheres likely form via outgassing during […]
Kavli Affiliate: Simeon Hellerman | First 5 Authors: Matthew Dodelson, Simeon Hellerman, Masataka Watanabe, Masahito Yamazaki, | Summary: It is shown that integrability is an accidental property of generic two-dimensional $O(2)$-symmetric asymptotically-free theories in the regime where the charge density is much larger than the dynamical scale. We show this by constructing an infinite tower […]
Kavli Affiliate: Simeon Hellerman | First 5 Authors: Matthew Dodelson, Simeon Hellerman, Masataka Watanabe, Masahito Yamazaki, | Summary: It is shown that integrability is an accidental property of generic two-dimensional $O(2)$-symmetric asymptotically-free theories in the regime where the charge density is much larger than the dynamical scale. We show this by constructing an infinite tower […]
Kavli Affiliate: Simeon Hellerman | First 5 Authors: Matthew Dodelson, Simeon Hellerman, Masataka Watanabe, Masahito Yamazaki, | Summary: It is shown that integrability is an accidental property of generic two-dimensional $O(2)$-symmetric asymptotically-free theories in the regime where the charge density is much larger than the dynamical scale. We show this by constructing an infinite tower […]