Kavli Affiliate: Max Tegmark | First 5 Authors: David D. Baek, Yuxiao Li, Max Tegmark, , | Summary: Motivated by interpretability and reliability, we investigate how neural networks represent knowledge during graph learning, We find hints of universality, where equivalent representations are learned across a range of model sizes (from $10^2$ to $10^9$ parameters) and […]
Continue.. Generalization from Starvation: Hints of Universality in LLM Knowledge Graph Learning