Kavli Affiliate: Max Tegmark | First 5 Authors: Subhash Kantamneni, Max Tegmark, , , | Summary: Mathematical reasoning is an increasingly important indicator of large language model (LLM) capabilities, yet we lack understanding of how LLMs process even simple mathematical tasks. To address this, we reverse engineer how three mid-sized LLMs compute addition. We first […]
Continue.. Language Models Use Trigonometry to Do Addition