Kavli Affiliate: Max Tegmark | First 5 Authors: Ziqian Zhong, Ziming Liu, Max Tegmark, Jacob Andreas, | Summary: Do neural networks, trained on well-understood algorithmic tasks, reliably rediscover known algorithms for solving those tasks? Several recent studies, on tasks ranging from group arithmetic to in-context linear regression, have suggested that the answer is yes. Using […]
Continue.. The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks